00000400:00080000:1.0F:1780340501.667747:0:80392:0:(debug.c:457:libcfs_run_debug_log_upcall()) Invoked LNET debug log upcall /usr/lib/lustre/lnet_debug_log_upcall /tmp/lustre-log.1780340501.79997 00010000:02000000:3.0F:1780340501.669385:0:79997:0:(ldlm_lib.c:1853:target_finish_recovery()) lustre-MDT0000: Recovery over after 3:03, of 2 clients 1 recovered and 1 was evicted. 00000004:00000080:3.0:1780340501.711089:0:79997:0:(mdd_device.c:2374:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff992742be3e10 00100000:10000000:3.0:1780340501.711105:0:79997:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0:1780340501.722291:0:79985:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x90:0x0] 00000100:00100000:1.0:1780340501.722360:0:79985:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471573b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:79985:1866818960979712:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1780340501.722426:0:79985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340501.722453:0:79985:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04775bb9c0 going to sleep for 20 seconds 00000004:00080000:0.0F:1780340501.722546:0:79983:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x282:0x0] 00000100:00100000:0.0:1780340501.722576:0:79983:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:79983:1866818960979840:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1780340501.722604:0:79983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340501.722632:0:79983:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04529f4240 going to sleep for 20 seconds 00000100:00100000:0.0:1780340501.722651:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960979712 00000100:00100000:0.0:1780340501.722658:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960979712 00000100:00100000:0.0:1780340501.722707:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960979840 00000100:00100000:0.0:1780340501.722710:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960979840 00000100:00100000:0.0:1780340501.722732:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5847 00000100:00100000:0.0:1780340501.722740:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:79985:x1866818960979712:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:0.0:1780340501.722747:0:25495:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:0.0:1780340501.722805:0:25495:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 673 -> diff = -529 00002000:02000040:0.0:1780340501.722810:0:25495:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:145 to 0x2c0000401:673) 00000100:00080000:3.0:1780340501.723956:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340501.723961:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340501.723989:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5848 00000100:00100000:3.0:1780340501.724004:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:79983:x1866818960979840:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:3.0:1780340501.724011:0:25488:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:3.0:1780340501.724033:0:25488:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 673 -> diff = -31 00002000:02000040:3.0:1780340501.724038:0:25488:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:643 to 0x280000401:673) 00002000:00010000:0.0:1780340501.739725:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.739741:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037d1ee22/0xa24651432772f2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.739782:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.739784:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.745355:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037d1ee22/0xa24651432772f2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745386:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037d1ee22/0xa24651432772f2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745397:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037d1ee22/0xa24651432772f2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745406:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037d1ee22/0xa24651432772f2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745443:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340501.745560:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.745565:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0907af1/0xa24651432772f33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745576:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.745578:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.745582:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0907af1/0xa24651432772f33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745591:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0907af1/0xa24651432772f33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745599:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0907af1/0xa24651432772f33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745606:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0907af1/0xa24651432772f33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745630:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1780340501.745667:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.745672:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e79de54/0xa24651432772f3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745680:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.745682:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.745691:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e79de54/0xa24651432772f3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745701:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e79de54/0xa24651432772f3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745709:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e79de54/0xa24651432772f3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745716:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e79de54/0xa24651432772f3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745732:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1780340501.745743:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1780340501.745747:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037d1ee22/0xa24651432772f2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745754:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.745776:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037d1ee22/0xa24651432772f2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745785:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037d1ee22/0xa24651432772f2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745811:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037d1ee22/0xa24651432772f2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.745815:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780340501.745820:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0907af1/0xa24651432772f33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.745828:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.745830:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037d1ee22/0xa24651432772f2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.745841:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0907af1/0xa24651432772f33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745847:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340501.745848:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0907af1/0xa24651432772f33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745850:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e79de54/0xa24651432772f3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745857:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340501.745859:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0907af1/0xa24651432772f33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745860:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e79de54/0xa24651432772f3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.745866:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0907af1/0xa24651432772f33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745868:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e79de54/0xa24651432772f3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745877:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e79de54/0xa24651432772f3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.745878:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340501.745880:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340501.745882:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.745883:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e79de54/0xa24651432772f3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.745893:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.745894:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.745896:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340501.746070:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.746076:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e40ce22/0xa24651432772f41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746089:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.746090:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.746093:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e40ce22/0xa24651432772f41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746102:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e40ce22/0xa24651432772f41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746110:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e40ce22/0xa24651432772f41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746117:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e40ce22/0xa24651432772f41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746133:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340501.746141:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340501.746145:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e40ce22/0xa24651432772f41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746151:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.746154:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e40ce22/0xa24651432772f41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746161:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e40ce22/0xa24651432772f41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746182:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e40ce22/0xa24651432772f41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746189:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e40ce22/0xa24651432772f41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746201:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.746203:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.746306:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340501.746360:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.746366:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000538e7f63/0xa24651432772f48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746375:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.746376:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.746379:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000538e7f63/0xa24651432772f48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746389:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000538e7f63/0xa24651432772f48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746396:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000538e7f63/0xa24651432772f48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746403:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000538e7f63/0xa24651432772f48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746427:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340501.746461:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.746467:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008281118c/0xa24651432772f4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746475:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.746477:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.746479:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008281118c/0xa24651432772f4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746489:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008281118c/0xa24651432772f4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746497:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008281118c/0xa24651432772f4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746504:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008281118c/0xa24651432772f4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746517:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1780340501.746524:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780340501.746527:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000538e7f63/0xa24651432772f48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746535:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.746538:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000538e7f63/0xa24651432772f48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746551:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000538e7f63/0xa24651432772f48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746562:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000538e7f63/0xa24651432772f48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746570:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000538e7f63/0xa24651432772f48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746584:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340501.746588:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008281118c/0xa24651432772f4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746594:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.746597:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008281118c/0xa24651432772f4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746604:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008281118c/0xa24651432772f4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746612:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008281118c/0xa24651432772f4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746619:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008281118c/0xa24651432772f4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746641:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.746643:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.746645:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340501.746681:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.746686:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000865bfea/0xa24651432772f56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746694:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.746695:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.746698:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000865bfea/0xa24651432772f56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746706:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000865bfea/0xa24651432772f56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746715:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000865bfea/0xa24651432772f56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746722:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000865bfea/0xa24651432772f56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746734:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340501.746739:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340501.746742:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000865bfea/0xa24651432772f56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.746777:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.746781:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000865bfea/0xa24651432772f56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747373:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000865bfea/0xa24651432772f56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747390:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000865bfea/0xa24651432772f56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747398:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000865bfea/0xa24651432772f56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747416:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.747418:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.747420:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340501.747480:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.747485:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa24651432772f5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747494:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.747496:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.747499:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa24651432772f5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747509:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa24651432772f5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747523:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa24651432772f5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747531:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa24651432772f5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747545:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340501.747552:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340501.747556:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa24651432772f5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747564:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.747567:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa24651432772f5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747576:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa24651432772f5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747587:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa24651432772f5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747594:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa24651432772f5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747607:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.747614:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.747615:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340501.747655:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x299:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.747660:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432772f64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747668:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.747669:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.747672:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432772f64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747680:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432772f64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747688:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432772f64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747696:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432772f64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747708:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340501.747714:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340501.747717:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432772f64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747724:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32ac00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.747726:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432772f64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747744:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432772f64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747754:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432772f64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.747782:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432772f64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0F:1780340501.748106:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.748119:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340501.749298:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x298:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.749305:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa24651432772f6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749318:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.749320:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.749323:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa24651432772f6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749346:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa24651432772f6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749355:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa24651432772f6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749363:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa24651432772f6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749380:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340501.749451:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x297:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.749456:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432772f72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749464:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.749465:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.749468:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432772f72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749492:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432772f72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749501:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432772f72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749507:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432772f72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749522:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1780340501.749561:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x296:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.749566:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432772f79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749573:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.749575:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.749577:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432772f79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749586:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432772f79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749594:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432772f79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749601:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432772f79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749621:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1780340501.749631:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1780340501.749635:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa24651432772f6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749643:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.749646:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa24651432772f6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749655:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa24651432772f6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749668:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa24651432772f6b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749676:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa24651432772f6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749694:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340501.749697:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432772f72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749703:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.749706:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432772f72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749725:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432772f72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749735:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432772f72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749743:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432772f72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749755:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340501.749774:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432772f79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749781:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.749784:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432772f79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749791:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432772f79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749801:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432772f79 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749807:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432772f79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.749843:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.749845:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.749847:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.749878:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.749880:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.749882:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340501.749888:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x295:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.749888:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.749892:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.749893:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432772f80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.750057:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.750060:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.750063:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432772f80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.750072:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432772f80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.750079:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432772f80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.750085:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432772f80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.752110:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340501.752739:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340501.752746:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432772f80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.752771:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.752789:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432772f80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.752799:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432772f80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.752819:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432772f80 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.752826:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432772f80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.752861:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.752863:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.752865:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340501.753004:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x294:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.753011:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432772f87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753022:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.753024:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.753028:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432772f87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753039:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432772f87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753060:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432772f87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753068:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432772f87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753088:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340501.753136:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x293:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.753141:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432772f8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753149:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.753150:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.753153:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432772f8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753161:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432772f8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753169:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432772f8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753175:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432772f8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753192:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1780340501.753272:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780340501.753278:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432772f87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753286:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.753289:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432772f87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753297:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432772f87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753307:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432772f87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753315:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432772f87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753342:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340501.753346:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432772f8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753353:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.753356:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432772f8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753364:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432772f8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753385:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432772f8e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753392:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432772f8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753405:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.753407:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.753409:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340501.753449:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x292:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.753455:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432772f95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753462:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.753464:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.753466:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432772f95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753475:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432772f95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753482:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432772f95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753490:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432772f95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753513:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340501.753521:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340501.753526:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432772f95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753532:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32be00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.753535:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432772f95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753543:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432772f95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753553:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432772f95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753561:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432772f95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753574:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.753575:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.753577:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340501.753613:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x291:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.753618:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432772f9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753627:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.753633:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.753636:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432772f9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753645:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432772f9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753653:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432772f9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753660:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432772f9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753672:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340501.753679:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340501.753683:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432772f9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753690:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.753693:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432772f9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753700:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432772f9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753710:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432772f9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753728:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432772f9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.753741:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.753743:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.753745:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.754300:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340501.756361:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x290:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.756372:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432772fa3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756386:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.756388:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.756393:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432772fa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756405:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432772fa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756414:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432772fa3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756422:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432772fa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756448:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340501.756518:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.756534:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432772faa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756542:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.756544:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.756546:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432772faa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756555:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432772faa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756561:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432772faa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.756565:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340501.756568:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432772faa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.756571:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432772fa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.756578:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32aa00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.756582:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340501.756583:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432772fa3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756590:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340501.756591:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432772fa3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756594:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432772faa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756600:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32ae00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.756602:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432772faa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.756606:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432772fa3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756609:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432772faa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.756620:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432772fa3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756628:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432772faa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756634:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432772faa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.756643:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.756645:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.756647:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.756650:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.756652:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.756653:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340501.756696:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.756701:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432772fb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756709:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.756710:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.756713:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432772fb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756721:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432772fb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756729:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432772fb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756736:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432772fb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.756775:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340501.757060:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340501.757065:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432772fb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.757072:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.757075:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432772fb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.757082:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432772fb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.757092:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432772fb1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.757098:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432772fb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.757111:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.757113:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.757114:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340501.757320:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.757335:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432772fb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757344:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.757345:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.757348:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432772fb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757356:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432772fb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757362:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432772fb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757369:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432772fb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757389:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340501.757427:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.757432:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432772fbf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757439:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.757440:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.757448:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432772fbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757457:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432772fbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757465:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432772fbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757471:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432772fbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757482:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1780340501.757517:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.757521:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432772fc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757527:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.757529:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.757531:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432772fc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757538:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432772fc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757545:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432772fc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757560:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432772fc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757570:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1780340501.757608:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.757613:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432772fcd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757620:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.757622:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.757624:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432772fcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757632:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432772fcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757639:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432772fcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757644:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432772fcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757658:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1780340501.757665:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1780340501.757669:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432772fb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757687:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.757690:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432772fb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757697:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432772fb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757707:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432772fb8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757714:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432772fb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757729:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1780340501.757732:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432772fbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757738:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.757741:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432772fbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757747:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432772fbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.757756:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432772fbf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760006:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432772fbf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760057:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780340501.760062:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432772fc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760070:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.760074:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432772fc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760084:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432772fc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760105:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432772fc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760110:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432772fc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760122:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340501.760125:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432772fcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760131:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.760150:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432772fcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760158:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432772fcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760168:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432772fcd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760175:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432772fcd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760191:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.760192:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.760195:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340501.760482:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x289:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.760488:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432772fd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760499:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.760501:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.760506:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432772fd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760516:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432772fd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760525:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432772fd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760539:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432772fd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760557:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340501.760594:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x288:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.760598:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432772fdb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760605:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.760607:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.760610:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432772fdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760618:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432772fdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760625:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432772fdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760631:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432772fdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760647:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1780340501.760654:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780340501.760658:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432772fd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760686:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32ba00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.760689:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432772fd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760697:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432772fd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760707:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432772fd4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760714:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432772fd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760728:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340501.760731:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432772fdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760737:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.760739:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432772fdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760746:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432772fdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760754:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432772fdb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.760780:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432772fdb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.760865:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.760872:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.760876:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.760881:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.762905:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.762995:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.762998:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340501.763113:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x287:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.763121:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432772fe2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.763134:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.763136:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.763141:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432772fe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.763153:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432772fe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.763162:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432772fe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.763170:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432772fe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.763196:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340501.763250:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340501.763256:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432772fe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.763265:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.763269:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432772fe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.763278:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432772fe2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.763294:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432772fe2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.763300:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432772fe2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.763317:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.763319:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.763320:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340501.765089:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.765101:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f384f2f9/0xa24651432772fe9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.765393:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.766111:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.766117:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f384f2f9/0xa24651432772fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766142:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f384f2f9/0xa24651432772fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766152:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f384f2f9/0xa24651432772fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766159:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f384f2f9/0xa24651432772fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766182:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340501.766300:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.766305:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046b7e531/0xa24651432772ff0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766313:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.766314:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.766317:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046b7e531/0xa24651432772ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766337:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046b7e531/0xa24651432772ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766360:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046b7e531/0xa24651432772ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766367:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046b7e531/0xa24651432772ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766384:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1780340501.766441:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.766447:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432772ff7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766454:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.766455:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.766458:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432772ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766467:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432772ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766474:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432772ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766482:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432772ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766499:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1780340501.766517:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1780340501.766523:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f384f2f9/0xa24651432772fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766530:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.766534:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f384f2f9/0xa24651432772fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766543:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f384f2f9/0xa24651432772fe9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766558:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f384f2f9/0xa24651432772fe9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766565:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f384f2f9/0xa24651432772fe9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766585:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340501.766588:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046b7e531/0xa24651432772ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766594:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.766597:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046b7e531/0xa24651432772ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766604:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046b7e531/0xa24651432772ff0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766625:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046b7e531/0xa24651432772ff0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766632:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046b7e531/0xa24651432772ff0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766644:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340501.766647:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432772ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766652:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.766655:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432772ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766662:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432772ff7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766671:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432772ff7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766677:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432772ff7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766687:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.766689:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.766696:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340501.766743:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.766748:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432772ffe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766755:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.766757:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.766777:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432772ffe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766784:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432772ffe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766791:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432772ffe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766798:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432772ffe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.766818:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340501.767070:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.767076:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432773005 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767085:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.767086:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.767089:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432773005 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767109:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432773005 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767117:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432773005 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767124:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432773005 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767297:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340501.767309:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432772ffe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767317:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.767320:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432772ffe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767338:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432772ffe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767351:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432772ffe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767355:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340501.767358:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432772ffe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767363:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340501.767367:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432773005 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767373:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.767374:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.767375:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.767376:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432773005 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767377:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.767384:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432773005 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340501.767432:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x286:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.767438:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa2465143277300c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767446:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.767447:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.767450:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa2465143277300c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767453:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432773005 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767461:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432773005 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767471:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa2465143277300c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767479:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.767479:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa2465143277300c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767481:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.767483:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.767486:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa2465143277300c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767504:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340501.767508:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340501.767511:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa2465143277300c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767518:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32bc00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.767521:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa2465143277300c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767528:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa2465143277300c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767538:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa2465143277300c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340501.767539:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x285:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.767544:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773013 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767546:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa2465143277300c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767551:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.767553:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.767555:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773013 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767563:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773013 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767565:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.767566:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.767568:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.767571:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773013 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767578:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773013 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340501.767595:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.767596:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340501.767599:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa2465143277301a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767602:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340501.767605:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773013 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767613:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.767616:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.767616:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773013 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767617:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.767621:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa2465143277301a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767624:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773013 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767630:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa2465143277301a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767634:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773013 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767637:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa2465143277301a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767641:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773013 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767645:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa2465143277301a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767655:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340501.767656:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340501.767659:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa2465143277301a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767661:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.767665:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.767667:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa2465143277301a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767684:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa2465143277301a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767694:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa2465143277301a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340501.767695:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.767700:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432773021 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767702:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa2465143277301a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767707:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.767708:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.767710:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432773021 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767715:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.767716:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.767718:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.767719:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432773021 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340501.767754:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x284:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.767773:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773028 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767781:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432773021 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767781:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.767782:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.767785:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767789:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432773021 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767801:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340501.767807:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767808:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340501.767811:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432773021 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767815:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773028 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767818:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.767821:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432773021 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767829:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432773021 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767832:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773028 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767838:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432773021 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767845:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432773021 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767845:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340501.767851:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340501.767853:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773028 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767859:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.767860:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.767862:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773028 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.767866:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.767868:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.767870:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773028 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767880:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773028 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767887:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773028 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767900:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.767902:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.767903:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340501.767905:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.767909:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa2465143277302f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340501.767939:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x283:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.767950:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432773036 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767958:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.767959:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.767962:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432773036 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767971:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432773036 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767980:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432773036 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767986:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432773036 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.767996:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340501.768003:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340501.768005:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432773036 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.768011:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.768013:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432773036 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.768020:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432773036 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.768040:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432773036 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.768048:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432773036 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.768064:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.768066:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.768068:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340501.768107:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x282:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.768111:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa2465143277303d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.768119:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.768120:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340501.768123:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa2465143277303d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.768132:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa2465143277303d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.768140:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa2465143277303d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.768147:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa2465143277303d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.768173:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340501.768276:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.768278:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.768281:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa2465143277302f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768290:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa2465143277302f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768298:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa2465143277302f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768306:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa2465143277302f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768317:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340501.768321:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa2465143277303d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768338:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.768341:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa2465143277303d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768360:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa2465143277303d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768371:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa2465143277303d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768379:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa2465143277303d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768411:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.768413:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.768415:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.768426:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340501.768432:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340501.768436:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa2465143277302f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768444:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ebe00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.768447:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa2465143277302f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768455:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa2465143277302f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768465:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa2465143277302f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768478:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa2465143277302f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768493:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.768495:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.768497:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340501.768534:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x299:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.768539:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432773044 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768546:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.768548:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.768551:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432773044 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768560:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432773044 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768569:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432773044 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768576:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432773044 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768593:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340501.768596:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340501.768601:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432773044 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.768607:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340501.768611:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432773044 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.768618:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432773044 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340501.768624:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x298:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340501.768628:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432773044 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768633:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa2465143277304b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.768636:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432773044 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768640:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.768642:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.768645:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa2465143277304b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340501.768649:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.768650:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340501.768652:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.768653:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa2465143277304b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768660:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa2465143277304b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768667:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa2465143277304b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768680:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340501.768686:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340501.768689:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa2465143277304b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768696:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eae00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.768699:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa2465143277304b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768707:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa2465143277304b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768729:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa2465143277304b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768737:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa2465143277304b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768750:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.768752:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.768754:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340501.768807:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x297:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.768813:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432773052 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768820:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.768822:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.768825:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432773052 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768848:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432773052 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768857:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432773052 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768864:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432773052 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768887:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340501.768894:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340501.768898:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432773052 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.768905:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.768908:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432773052 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.769244:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.769469:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432773052 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.769482:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432773052 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.769490:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432773052 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.769505:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.769507:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.769509:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340501.769553:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x296:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.769559:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432773059 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.769567:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.769573:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.769577:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432773059 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.769587:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432773059 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.769596:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432773059 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.769603:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432773059 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.769626:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340501.769660:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x295:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.769665:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432773060 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.769671:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.769673:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.769675:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432773060 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.769683:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432773060 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.769691:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432773060 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.769709:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432773060 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.769722:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780340501.769730:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340501.769734:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432773059 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.769742:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.769745:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432773059 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.769753:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432773059 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.769790:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432773059 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.769798:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432773059 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.769813:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340501.769815:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432773060 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.769961:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.770186:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.770281:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432773060 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770292:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432773060 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770304:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432773060 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770312:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432773060 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770337:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.770339:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.770341:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340501.770388:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x294:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.770392:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432773067 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770466:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.770467:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.770470:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432773067 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770479:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432773067 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770493:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432773067 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770499:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432773067 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770518:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340501.770554:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x293:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.770559:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa2465143277306e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770566:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.770567:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.770569:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa2465143277306e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770578:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa2465143277306e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770584:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa2465143277306e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770590:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa2465143277306e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770603:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780340501.770616:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340501.770621:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432773067 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770628:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eac00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.770631:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432773067 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770638:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432773067 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770648:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432773067 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770655:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432773067 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770669:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340501.770672:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa2465143277306e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770679:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eaa00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.770681:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa2465143277306e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770687:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa2465143277306e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770708:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa2465143277306e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770715:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa2465143277306e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770728:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.770729:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.770731:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340501.770799:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x292:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.770804:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432773075 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770811:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.770812:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.770815:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432773075 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770822:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432773075 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.770829:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432773075 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.772516:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340501.773176:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.773943:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432773075 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.773983:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340501.774096:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x291:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.774104:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa2465143277307c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774116:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.774118:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.774124:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa2465143277307c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774149:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa2465143277307c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774157:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa2465143277307c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774163:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa2465143277307c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774182:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780340501.774291:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340501.774297:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432773075 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774306:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ebc00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340501.774309:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432773075 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774318:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432773075 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774343:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432773075 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774351:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432773075 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774386:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340501.774389:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa2465143277307c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774396:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eba00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340501.774399:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa2465143277307c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774406:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa2465143277307c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774416:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa2465143277307c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774422:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa2465143277307c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774434:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340501.774436:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340501.774438:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340501.774440:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x290:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.774445:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432773083 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774452:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.774453:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.774462:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432773083 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774472:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432773083 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774480:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432773083 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774487:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432773083 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774508:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340501.774562:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.774567:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa2465143277308a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774574:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.774575:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.774578:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa2465143277308a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774585:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa2465143277308a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774593:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa2465143277308a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774609:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa2465143277308a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774620:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780340501.774648:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340501.774653:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432773083 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340501.774659:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340501.774661:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.774663:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432773091 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774669:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432773083 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774671:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.774672:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.774675:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432773091 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774677:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432773083 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774684:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432773091 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774687:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432773083 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774692:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432773091 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774694:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432773083 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774700:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432773091 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774708:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340501.774711:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa2465143277308a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774711:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340501.774718:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340501.774720:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa2465143277308a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774727:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa2465143277308a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774737:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa2465143277308a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340501.774740:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340501.774744:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa2465143277308a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774745:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432773098 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774778:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340501.774779:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340501.774779:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340501.774782:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432773091 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774783:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432773098 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774792:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432773098 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774799:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432773098 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774806:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432773098 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774818:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340501.774861:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340501.774865:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432773091 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340501.774868:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340501.774873:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432773091 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774873:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa2465143277309f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774880:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.774882:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340501.774883:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432773091 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774885:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa2465143277309f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774891:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432773091 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.774893:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa2465143277309f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774905:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340501.774919:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432773098 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774925:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340501.774928:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432773098 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774946:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432773098 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774956:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432773098 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774963:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432773098 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.774976:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340501.774978:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340501.774980:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340501.774986:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340501.774990:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340501.775183:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340501.775198:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.776067:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa2465143277309f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776074:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa2465143277309f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776096:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340501.776118:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340501.776124:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa2465143277309f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.776132:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340501.776136:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa2465143277309f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.776144:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa2465143277309f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.776158:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa2465143277309f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.776172:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa2465143277309f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340501.776194:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340501.776196:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340501.776198:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340501.776359:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.776365:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5ee531c/0xa246514327730a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776374:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.776375:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.776379:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5ee531c/0xa246514327730a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776388:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5ee531c/0xa246514327730a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776406:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5ee531c/0xa246514327730a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776414:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5ee531c/0xa246514327730a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776432:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340501.776471:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.776476:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa246514327730ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776484:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.776486:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.776488:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa246514327730ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776497:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa246514327730ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776504:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa246514327730ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776512:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa246514327730ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776526:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1780340501.776555:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x289:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.776559:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa246514327730b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776566:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.776568:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.776571:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa246514327730b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776579:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa246514327730b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776592:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa246514327730b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776600:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa246514327730b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776610:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1780340501.776642:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x288:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.776647:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa246514327730bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776654:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.776656:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.776659:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa246514327730bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776668:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa246514327730bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776675:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa246514327730bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776683:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa246514327730bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776693:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1780340501.776751:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x287:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.776756:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa246514327730c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776782:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.776783:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.776786:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa246514327730c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776795:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa246514327730c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776802:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa246514327730c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776810:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa246514327730c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776822:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1780340501.776871:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x286:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.776876:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa246514327730c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776883:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.776885:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.776888:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa246514327730c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.776897:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa246514327730c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1780340501.777027:0:25495:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:144 00000100:00100000:0.0:1780340501.777116:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471572300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:79985:x1866818960979712:12345-0@lo:5:osp-pre-1-0.0 Request processed in 54373us (54686us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340501.777126:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5847 00000100:00100000:0.0:1780340501.777184:0:79985:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471573b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:79985:1866818960979712:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1780340501.777200:0:79985:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2a1:0x0] from OST, last_created [0x2c0000401:0x2a1:0x0]last_used is [0x2c0000401:0x90:0x0] 00010000:00010000:1.0:1780340501.777296:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1780340501.777302:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5ee531c/0xa246514327730a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777312:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340501.777315:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5ee531c/0xa246514327730a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777322:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5ee531c/0xa246514327730a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777352:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5ee531c/0xa246514327730a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777358:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5ee531c/0xa246514327730a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777373:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1780340501.777377:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa246514327730ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777382:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340501.777384:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa246514327730ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777412:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa246514327730ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777422:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa246514327730ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777427:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa246514327730ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777439:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1780340501.777442:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa246514327730b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777448:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340501.777450:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa246514327730b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777457:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa246514327730b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777464:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa246514327730b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777470:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa246514327730b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777491:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780340501.777494:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa246514327730bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777499:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340501.777501:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa246514327730bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777508:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa246514327730bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777516:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa246514327730bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777522:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa246514327730bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777530:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340501.777533:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa246514327730c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777539:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340501.777541:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa246514327730c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777556:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa246514327730c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777565:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa246514327730c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777571:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa246514327730c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.777581:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340501.777583:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340501.777584:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340501.777591:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340501.777595:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.778500:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa246514327730c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.778508:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa246514327730c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.778529:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340501.778609:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x285:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.778614:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000802885fc/0xa246514327730d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.778623:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.778625:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.778629:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000802885fc/0xa246514327730d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.778639:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000802885fc/0xa246514327730d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.778646:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000802885fc/0xa246514327730d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.778652:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000802885fc/0xa246514327730d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.778665:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1780340501.778713:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x284:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340501.778718:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa246514327730d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.778726:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.778727:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340501.778730:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa246514327730d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.778739:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa246514327730d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.778747:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa246514327730d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.778754:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa246514327730d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.778795:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1780340501.778805:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1780340501.778810:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa246514327730c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.778818:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340501.778822:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa246514327730c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340501.778945:0:79985:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:79985:1866818960980096:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1780340501.778999:0:79985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340501.779027:0:79985:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04509becc0 going to sleep for 20 seconds 00000100:00100000:0.0:1780340501.779047:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960979968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340501.779074:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340501.779111:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960980096 00000100:00100000:0.0:1780340501.779118:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960980096 00000100:00100000:0.0:1780340501.779159:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5849 00000100:00100000:0.0:1780340501.779168:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:79985:x1866818960980096:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:0.0:1780340501.779174:0:25489:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:1.0:1780340501.779240:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780340501.779247:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000802885fc/0xa246514327730d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779255:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340501.779258:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000802885fc/0xa246514327730d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779266:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000802885fc/0xa246514327730d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1780340501.779275:0:25489:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 674 00010000:00010000:1.0:1780340501.779279:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000802885fc/0xa246514327730d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779292:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000802885fc/0xa246514327730d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779310:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340501.779313:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa246514327730d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779320:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340501.779323:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa246514327730d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779341:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa246514327730d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779351:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa246514327730d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779358:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa246514327730d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779369:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340501.779370:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340501.779372:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340501.779378:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340501.779412:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960979968 00000100:00100000:1.0:1780340501.779420:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960979968 00000100:00100000:1.0:1780340501.779453:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1852 00000100:00100000:1.0:1780340501.779460:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818960979968:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:1.0:1780340501.779464:0:10290:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1780340501.779474:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 216384 pending 896 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340501.779516:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818960979968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340501.779523:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1852 00000100:00100000:1.0:1780340501.779577:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960979968:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1780340501.779622:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340501.779627:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780340501.779720:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x283:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340501.779725:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa246514327730de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779734:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340501.779735:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340501.779739:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa246514327730de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779748:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa246514327730de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779756:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa246514327730de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779827:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa246514327730de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779863:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780340501.779872:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340501.779876:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa246514327730de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779882:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340501.779885:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa246514327730de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779891:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa246514327730de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779916:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa246514327730de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779923:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa246514327730de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340501.779938:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340501.779939:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340501.779941:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1780340501.779970:0:25488:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:642 00000100:00100000:1.0:1780340501.780014:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:79983:x1866818960979840:12345-0@lo:5:osp-pre-0-0.0 Request processed in 56016us (57408us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340501.780021:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5848 00000100:00100000:1.0:1780340501.780066:0:79983:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:79983:1866818960979840:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1780340501.780077:0:79983:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x2a1:0x0] from OST, last_created [0x280000401:0x2a1:0x0]last_used is [0x280000401:0x282:0x0] 00000100:00100000:1.0:1780340501.780117:0:79983:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471573b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:79983:1866818960980352:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1780340501.780157:0:79983:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340501.780174:0:79983:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04775bbf00 going to sleep for 20 seconds 00000100:00100000:1.0:1780340501.780184:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340501.780192:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960980224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340501.780214:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340501.780237:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960980224 00000100:00100000:1.0:1780340501.780241:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960980224 00000100:00100000:1.0:1780340501.780264:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1853 00000100:00100000:1.0:1780340501.780271:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960980224:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:1.0:1780340501.780276:0:8403:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1780340501.780290:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8654144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340501.780318:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960980224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340501.780335:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1853 00000100:00100000:1.0:1780340501.780363:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960980224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340501.780404:0:25497:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960980352 00000100:00100000:1.0:1780340501.780407:0:25497:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960980352 00000100:00100000:1.0:1780340501.780428:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5850 00000100:00100000:1.0:1780340501.780434:0:25497:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:79983:x1866818960980352:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:1.0:1780340501.780439:0:25497:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:1.0:1780340501.780457:0:25497:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 674 00000100:00100000:0.0:1780340501.781120:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:79985:x1866818960980096:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1952us (2120us total) trans 4294969448 rc 0/0 00000100:00100000:0.0:1780340501.781127:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5849 00000100:00100000:0.0:1780340501.781166:0:79985:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:79985:1866818960980096:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1780340501.781175:0:79985:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2a1:0x0]-[0x2c0000401:0x2c1:0x0] 00010000:00010000:2.0:1780340501.782503:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa246514327730c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.782548:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa246514327730c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.782556:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa246514327730c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340501.782583:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.782585:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340501.782587:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340501.784561:0:25497:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349957480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:79983:x1866818960980352:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4119us (4396us total) trans 4294969447 rc 0/0 00000100:00100000:0.0:1780340501.784576:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5850 00000100:00100000:0.0:1780340501.788047:0:79983:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471573b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:79983:1866818960980352:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1780340501.788067:0:79983:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2a1:0x0]-[0x280000401:0x2c1:0x0] 00010000:00010000:1.0:1780340502.346029:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1780340502.410266:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340502.410285:0:49688:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1780340502.410434:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818960980736:0@lo:400:kworker.0 00000100:00100000:2.0:1780340502.410504:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340502.410542:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960981248:0@lo:400:kworker.0 00000100:00100000:2.0:1780340502.410566:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340502.410582:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960981760:0@lo:400:kworker.0 00000100:00100000:2.0:1780340502.410600:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340502.410624:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1780340502.410630:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818960980864:0@lo:400:kworker.0 00000100:00100000:2.0:1780340502.410650:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340502.410668:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818960981376:0@lo:400:kworker.0 00000100:00100000:2.0:1780340502.410689:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340502.410706:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818960981888:0@lo:400:kworker.0 00000100:00100000:2.0:1780340502.410725:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340502.410800:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960980736 00000100:00100000:2.0:1780340502.410807:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960980736 00000100:00100000:2.0:1780340502.411101:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960980864 00000100:00100000:2.0:1780340502.411122:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960980864 00000100:00100000:2.0:1780340502.411142:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960981376 00000100:00100000:2.0:1780340502.411144:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960981376 00000100:00100000:2.0:1780340502.411155:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960981888 00000100:00100000:2.0:1780340502.411157:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960981888 00000100:00100000:2.0:1780340502.411170:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:2.0:1780340502.411177:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0458810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818960980736:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1780340502.411184:0:63710:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1780340502.411233:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0458810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818960980736:12345-0@lo:400:kworker.0 Request processed in 55us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340502.411241:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:2.0:1780340502.411258:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:2.0:1780340502.411264:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0458811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818960980864:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1780340502.411268:0:63710:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1780340502.411293:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0458811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818960980864:12345-0@lo:400:kworker.0 Request processed in 30us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340502.411299:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:2.0:1780340502.411311:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:2.0:1780340502.411317:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0458812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818960981376:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1780340502.411332:0:63710:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1780340502.411359:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0458812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818960981376:12345-0@lo:400:kworker.0 Request processed in 42us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340502.411364:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:2.0:1780340502.411377:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:2.0:1780340502.411384:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0458810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818960981888:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1780340502.411388:0:63710:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1780340502.411411:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0458810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818960981888:12345-0@lo:400:kworker.0 Request processed in 28us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340502.411423:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00100000:2.0:1780340502.411471:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818960980864:0@lo:400:kworker.0 00000100:00100000:2.0:1780340502.411482:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818960981376:0@lo:400:kworker.0 00000100:00100000:2.0:1780340502.411490:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818960981888:0@lo:400:kworker.0 00000100:00100000:2.0:1780340502.411498:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818960980736:0@lo:400:kworker.0 00000100:00100000:1.0:1780340502.411660:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818960980608:0@lo:400:kworker.0 00000100:00100000:1.0:1780340502.411695:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340502.411718:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960981120:0@lo:400:kworker.0 00000100:00100000:1.0:1780340502.411754:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340502.411795:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818960981632:0@lo:400:kworker.0 00000100:00100000:1.0:1780340502.411817:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340502.411835:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1780340502.411841:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818960980480:0@lo:400:kworker.0 00000100:00100000:1.0:1780340502.411865:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340502.411890:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818960980992:0@lo:400:kworker.0 00000100:00100000:1.0:1780340502.411910:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340502.411925:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818960981504:0@lo:400:kworker.0 00000100:00100000:1.0:1780340502.411946:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340502.411971:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960981248 00000100:00100000:1.0:1780340502.411975:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960981248 00000100:00100000:1.0:1780340502.412001:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960981760 00000100:00100000:1.0:1780340502.412004:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960981760 00000100:00100000:1.0:1780340502.412020:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960981120 00000100:00100000:1.0:1780340502.412022:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960981120 00000100:00100000:1.0:1780340502.412038:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960981632 00000100:00100000:1.0:1780340502.412041:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960981632 00000100:00100000:1.0:1780340502.412054:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2281 00000100:00100000:1.0:1780340502.412060:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0458810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960981248:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1780340502.412064:0:25491:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1780340502.412099:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0458810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960981248:12345-0@lo:400:kworker.0 Request processed in 39us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340502.412104:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2281 00000100:00100000:1.0:1780340502.412116:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2282 00000100:00100000:1.0:1780340502.412129:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0458812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818960981760:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1780340502.412133:0:25491:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1780340502.412160:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0458812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818960981760:12345-0@lo:400:kworker.0 Request processed in 31us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340502.412166:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2282 00000100:00100000:1.0:1780340502.412176:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2283 00000100:00100000:1.0:1780340502.412182:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818960981120:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1780340502.412185:0:25491:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1780340502.412211:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818960981120:12345-0@lo:400:kworker.0 Request processed in 30us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340502.412216:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2283 00000100:00100000:1.0:1780340502.412224:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2284 00000100:00100000:1.0:1780340502.412230:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818960981632:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1780340502.412233:0:25491:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1780340502.412256:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818960981632:12345-0@lo:400:kworker.0 Request processed in 27us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340502.412262:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2284 00000100:00100000:1.0:1780340502.412290:0:79969:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960980480 00000100:00100000:1.0:1780340502.412294:0:79969:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960980480 00000100:00100000:1.0:1780340502.412316:0:79969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1780340502.412335:0:79969:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818960980480:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1780340502.412339:0:79969:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1780340502.412366:0:79969:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818960980480:12345-0@lo:400:kworker.0 Request processed in 45us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340502.412372:0:79969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1780340502.412399:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960981504 00000100:00100000:1.0:1780340502.412402:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960981504 00000100:00100000:1.0:1780340502.412431:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3670 00000100:00100000:1.0:1780340502.412437:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818960981504:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1780340502.412441:0:26074:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1780340502.412474:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818960981504:12345-0@lo:400:kworker.0 Request processed in 38us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340502.412480:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3670 00000100:00100000:1.0:1780340502.412507:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960980608 00000100:00100000:1.0:1780340502.412511:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960980608 00000100:00100000:1.0:1780340502.412534:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960980992 00000100:00100000:1.0:1780340502.412537:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960980992 00000100:00100000:1.0:1780340502.412555:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:1.0:1780340502.412561:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818960980608:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1780340502.412565:0:63711:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1780340502.412592:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818960980608:12345-0@lo:400:kworker.0 Request processed in 32us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340502.412598:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:1.0:1780340502.412608:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:1.0:1780340502.412613:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818960980992:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1780340502.412617:0:63711:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1780340502.412640:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818960980992:12345-0@lo:400:kworker.0 Request processed in 27us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340502.412645:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:1.0:1780340502.412680:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818960980480:0@lo:400:kworker.0 00000100:00100000:1.0:1780340502.412689:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818960980992:0@lo:400:kworker.0 00000100:00100000:1.0:1780340502.412698:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818960981504:0@lo:400:kworker.0 00000100:00100000:1.0:1780340502.412706:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818960980608:0@lo:400:kworker.0 00000100:00100000:1.0:1780340502.412724:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960981120:0@lo:400:kworker.0 00000100:00100000:2.0:1780340502.413121:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960981248:0@lo:400:kworker.0 00000100:00100000:2.0:1780340502.413132:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960981760:0@lo:400:kworker.0 00000100:00080000:3.0:1780340502.413273:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340502.413277:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340502.413279:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780340502.413281:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340502.413358:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818960981632:0@lo:400:kworker.0 00010000:00080000:3.0:1780340502.473905:0:8410:0:(ldlm_lib.c:3119:target_queue_recovery_request()) @@@ queue final req req@ffff8c0458811500 x1866818960978432/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1780340511 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340502.474012:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0458811500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818960978432:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 1062765us (1063111us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340502.474022:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3664 00000100:00080000:2.0:1780340502.474178:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1780340502.474186:0:3658:0:(client.c:3224:ptlrpc_resend_req()) @@@ going to resend req@ffff8c0458813b80 x1866818960978432/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340531 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340502.474195:0:3658:0:(client.c:3233:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8c0458813b80 x1866818960978432/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340531 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340502.474202:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1780340502.474217:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1780340502.474222:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0458813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818960978432:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1780340502.481458:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960982016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340502.481544:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340502.481931:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960982016 00000100:00100000:2.0:1780340502.481940:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960982016 00000100:00100000:2.0:1780340502.481999:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3671 00000100:00100000:2.0:1780340502.482009:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818960982016:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1780340502.482017:0:22660:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1780340502.482053:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445240832 avail 1299001344 00000100:00100000:2.0:1780340502.482111:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818960982016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340502.482131:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3671 00000100:00100000:0.0:1780340502.484248:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960982016:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1780340503.369992:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340504.394696:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340504.458694:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340504.458717:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0458813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960982144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780340504.458817:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340504.458909:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960982144 00000100:00100000:2.0:1780340504.458917:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960982144 00000100:00100000:2.0:1780340504.458965:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3672 00000100:00100000:2.0:1780340504.458974:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960982144:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:2.0:1780340504.458980:0:8411:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1780340504.459013:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:2.0:1780340504.459067:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960982144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340504.459075:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3672 00000100:00100000:3.0:1780340504.459211:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0458813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960982144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780340504.970358:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960982272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340504.970426:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340504.970518:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960982272 00000100:00100000:1.0:1780340504.970533:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960982272 00000100:00100000:1.0:1780340504.970582:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1854 00000100:00100000:1.0:1780340504.970590:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960982272:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:1.0:1780340504.970596:0:10290:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1780340504.970622:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340504.970662:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960982272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340504.970668:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1854 00000100:00080000:3.0:1780340504.971618:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340504.971667:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960982272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340504.972669:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0458810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818960982400:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340504.972733:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340504.972990:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960982400 00000100:00100000:1.0:1780340504.972996:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960982400 00000100:00100000:1.0:1780340504.973051:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1855 00000100:00100000:1.0:1780340504.973059:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818960982400:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:1.0:1780340504.973066:0:8404:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1780340504.973088:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340504.973130:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818960982400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340504.973137:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1855 00000100:00080000:0.0:1780340504.974281:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340504.974340:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0458810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818960982400:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1780340505.418332:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340506.451440:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340506.451668:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818960982528:0@lo:400:kworker.0 00000100:00100000:3.0:1780340506.451757:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340506.452000:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818960982912:0@lo:400:kworker.0 00000100:00100000:1.0:1780340506.452042:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340506.452071:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818960983424:0@lo:400:kworker.0 00000100:00100000:1.0:1780340506.452102:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340506.452118:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818960983936:0@lo:400:kworker.0 00000100:00100000:1.0:1780340506.452135:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340506.452157:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1780340506.452163:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818960982784:0@lo:400:kworker.0 00000100:00100000:1.0:1780340506.452184:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340506.452201:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818960983296:0@lo:400:kworker.0 00000100:00100000:1.0:1780340506.452219:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340506.452234:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818960983808:0@lo:400:kworker.0 00000100:00100000:1.0:1780340506.452252:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340506.452280:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960982912 00000100:00100000:1.0:1780340506.452287:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960982912 00000100:00100000:1.0:1780340506.452343:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960982784 00000100:00100000:1.0:1780340506.452347:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960982784 00000100:00100000:1.0:1780340506.452367:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:1.0:1780340506.452376:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818960982912:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1780340506.452383:0:63711:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1780340506.452428:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818960982912:12345-0@lo:400:kworker.0 Request processed in 53us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340506.452436:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:1.0:1780340506.452451:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1780340506.452457:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818960982784:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1780340506.452460:0:63711:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1780340506.452483:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818960982784:12345-0@lo:400:kworker.0 Request processed in 27us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340506.452488:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1780340506.452518:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960983424 00000100:00100000:1.0:1780340506.452521:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960983424 00000100:00100000:1.0:1780340506.452543:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960983936 00000100:00100000:1.0:1780340506.452545:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960983936 00000100:00100000:1.0:1780340506.452561:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960983296 00000100:00100000:1.0:1780340506.452563:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960983296 00000100:00100000:1.0:1780340506.452578:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960983808 00000100:00100000:1.0:1780340506.452581:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960983808 00000100:00100000:1.0:1780340506.452600:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2285 00000100:00100000:1.0:1780340506.452607:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818960983424:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1780340506.452611:0:8401:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1780340506.452728:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818960983040:0@lo:400:kworker.0 00000100:00100000:3.0:1780340506.452753:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340506.452796:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818960983552:0@lo:400:kworker.0 00000100:00100000:3.0:1780340506.452818:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340506.452833:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b4b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818960984064:0@lo:400:kworker.0 00000100:00100000:3.0:1780340506.452853:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340506.452870:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1780340506.452876:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818960982656:0@lo:400:kworker.0 00000100:00100000:3.0:1780340506.452895:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340506.452907:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960983168:0@lo:400:kworker.0 00000100:00100000:3.0:1780340506.452927:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340506.452942:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960983680:0@lo:400:kworker.0 00000100:00100000:3.0:1780340506.452962:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340506.452990:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2286 00000100:00100000:3.0:1780340506.452998:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818960983936:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1780340506.453001:0:8400:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1780340506.453030:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818960983936:12345-0@lo:400:kworker.0 Request processed in 34us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340506.453036:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2286 00000100:00100000:3.0:1780340506.453049:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2287 00000100:00100000:3.0:1780340506.453055:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818960983296:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1780340506.453059:0:8400:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1780340506.453083:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818960983296:12345-0@lo:400:kworker.0 Request processed in 28us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340506.453100:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2287 00000100:00100000:3.0:1780340506.453112:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2288 00000100:00100000:3.0:1780340506.453117:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818960983808:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1780340506.453121:0:8400:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1780340506.453147:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818960983808:12345-0@lo:400:kworker.0 Request processed in 30us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340506.453153:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2288 00000100:00100000:3.0:1780340506.453170:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960983040 00000100:00100000:3.0:1780340506.453174:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960983040 00000100:00100000:3.0:1780340506.453193:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960983552 00000100:00100000:3.0:1780340506.453196:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960983552 00000100:00100000:3.0:1780340506.453205:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960984064 00000100:00100000:3.0:1780340506.453208:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960984064 00000100:00100000:3.0:1780340506.453217:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960982656 00000100:00100000:3.0:1780340506.453219:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960982656 00000100:00100000:3.0:1780340506.453231:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1780340506.453238:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818960983040:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1780340506.453241:0:64454:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1780340506.453277:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818960983040:12345-0@lo:400:kworker.0 Request processed in 40us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340506.453283:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1780340506.453308:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:3.0:1780340506.453314:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04445b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818960983552:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1780340506.453317:0:64454:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1780340506.453339:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04445b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818960983552:12345-0@lo:400:kworker.0 Request processed in 26us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340506.453344:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:3.0:1780340506.453361:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:3.0:1780340506.453366:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04445b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818960984064:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1780340506.453369:0:64454:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1780340506.453391:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04445b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818960984064:12345-0@lo:400:kworker.0 Request processed in 25us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340506.453396:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:3.0:1780340506.453405:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1780340506.453411:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04445b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818960982656:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1780340506.453414:0:64454:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1780340506.453432:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04445b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818960982656:12345-0@lo:400:kworker.0 Request processed in 22us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340506.453438:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1780340506.453456:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960983168 00000100:00100000:3.0:1780340506.453459:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960983168 00000100:00100000:3.0:1780340506.453476:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960983680 00000100:00100000:3.0:1780340506.453479:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960983680 00000100:00100000:3.0:1780340506.453495:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3673 00000100:00100000:3.0:1780340506.453500:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04445b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818960983168:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1780340506.453503:0:26074:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1780340506.453533:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04445b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818960983168:12345-0@lo:400:kworker.0 Request processed in 34us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340506.453538:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3673 00000100:00100000:3.0:1780340506.453547:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3674 00000100:00100000:3.0:1780340506.453552:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960983680:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1780340506.453555:0:26074:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1780340506.453575:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960983680:12345-0@lo:400:kworker.0 Request processed in 23us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340506.453589:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3674 00000100:00100000:0.0:1780340506.453599:0:79974:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960982528 00000100:00100000:0.0:1780340506.453605:0:79974:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960982528 00000100:00100000:3.0:1780340506.453632:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818960982656:0@lo:400:kworker.0 00000100:00100000:0.0:1780340506.453644:0:79974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1780340506.453652:0:79974:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818960982528:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1780340506.453657:0:79974:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1780340506.453692:0:79974:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818960982528:12345-0@lo:400:kworker.0 Request processed in 41us (1935us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340506.453699:0:79974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1780340506.453789:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340506.453794:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340506.453797:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340506.453800:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780340506.453833:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818960982784:0@lo:400:kworker.0 00000100:00100000:2.0:1780340506.453845:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818960983296:0@lo:400:kworker.0 00000100:00100000:2.0:1780340506.453857:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818960983808:0@lo:400:kworker.0 00000100:00100000:2.0:1780340506.453866:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818960982912:0@lo:400:kworker.0 00000100:00100000:2.0:1780340506.453874:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818960983424:0@lo:400:kworker.0 00000100:00100000:2.0:1780340506.453882:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818960983936:0@lo:400:kworker.0 00000100:00100000:3.0:1780340506.454547:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960983168:0@lo:400:kworker.0 00000100:00100000:3.0:1780340506.454559:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960983680:0@lo:400:kworker.0 00000100:00100000:3.0:1780340506.454569:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a127480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818960983040:0@lo:400:kworker.0 00000100:00100000:3.0:1780340506.454577:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818960983552:0@lo:400:kworker.0 00000100:00100000:3.0:1780340506.454587:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b4b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818960984064:0@lo:400:kworker.0 00000100:00100000:3.0:1780340506.454596:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818960982528:0@lo:400:kworker.0 00000100:00100000:1.0:1780340506.454945:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818960983424:12345-0@lo:400:kworker.0 Request processed in 2337us (2839us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340506.454956:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2285 00000100:00100000:3.0:1780340506.676390:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340506.676438:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340506.676478:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340506.676595:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340506.676694:0:79971:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940368256 00000100:00100000:2.0:1780340506.676706:0:79971:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940368256 00000100:00100000:2.0:1780340506.676754:0:79971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 151 00000100:00100000:0.0:1780340506.676793:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940368640 00000100:00100000:2.0:1780340506.676794:0:79971:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445832c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940368256:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340506.676800:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940368640 00000020:02000000:2.0:1780340506.676804:0:79971:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1780340506.676843:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2289 00000100:00100000:0.0:1780340506.676849:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940368640:12345-192.168.203.16@tcp:400:kworker.0 00000020:02000000:0.0:1780340506.676853:0:25492:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1780340506.676893:0:79971:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445832c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940368256:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 102us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340506.676896:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940368640:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 46us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340506.676903:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2289 00000100:00100000:2.0:1780340506.676914:0:79971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 151 00000100:00080000:0.0:1780340506.676922:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340506.676936:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940368512 00000100:00100000:0.0:1780340506.676940:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940368512 00000100:00100000:0.0:1780340506.676964:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940368384 00000100:00100000:0.0:1780340506.676966:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940368384 00000100:00100000:0.0:1780340506.676979:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 994 00000100:00100000:0.0:1780340506.676985:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940368512:12345-192.168.203.16@tcp:400:kworker.0 00000020:02000000:0.0:1780340506.676988:0:64454:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1780340506.677007:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940368512:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340506.677012:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 994 00000100:00100000:0.0:1780340506.677019:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1008 00000100:00100000:0.0:1780340506.677023:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03493d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1866818940368384:12345-192.168.203.16@tcp:38:kworker.0 00000020:02000000:0.0:1780340506.677025:0:64454:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:0.0:1780340506.677046:0:64454:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp t90194313217 exp 0000000000000000 cur 3286 last 0 00000020:00000080:0.0:1780340506.677097:0:64454:0:(genops.c:1406:class_connect()) connect: client e06e5cf1-1986-4ba7-9630-fad7efb74eca, cookie 0xa246514327730e5 00000004:00100000:0.0:1780340506.677122:0:64454:0:(mdt_handler.c:7301:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1780340506.677218:0:64454:0:(import.c:65:import_set_state_nolock()) ffff8c03490be800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340506.677269:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03493d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940368384:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 243us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340506.677276:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1008 00000100:00080000:0.0:1780340506.677301:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340506.703130:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340506.703481:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940368768 00000100:00100000:0.0:1780340506.703612:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940368768 00000100:00100000:0.0:1780340506.703729:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1009 00000100:00100000:0.0:1780340506.703749:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:63424:x1866818940368768:12345-192.168.203.16@tcp:41:lfs.0 00000020:02000000:0.0:1780340506.703800:0:70100:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1780340506.703844:0:70100:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:0.0:1780340506.703940:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:63424:x1866818940368768:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 193us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340506.703948:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1009 00000100:00100000:2.0:1780340506.718335:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340506.718795:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940368896 00000100:00100000:1.0:1780340506.718807:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940368896 00000100:00100000:1.0:1780340506.718871:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1856 00000100:00100000:1.0:1780340506.718882:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0458811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:63424:x1866818940368896:12345-192.168.203.16@tcp:13:lfs.0 00000020:02000000:1.0:1780340506.718889:0:10290:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1780340506.718920:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340506.718992:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0458811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:63424:x1866818940368896:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 113us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340506.718999:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1856 00000100:00100000:3.0:1780340506.726811:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340506.727224:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940369024 00000100:00100000:1.0:1780340506.727236:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940369024 00000100:00100000:1.0:1780340506.727303:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5851 00000100:00100000:1.0:1780340506.727313:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2406:x1866818940369024:12345-192.168.203.16@tcp:8:lfs.0 00000020:02000000:1.0:1780340506.727321:0:25491:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:1.0:1780340506.727365:0:25491:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0001: connection from e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp t0 exp 0000000000000000 cur 3286 last 0 00000020:00000080:1.0:1780340506.727409:0:25491:0:(genops.c:1406:class_connect()) connect: client e06e5cf1-1986-4ba7-9630-fad7efb74eca, cookie 0xa246514327730ec 00002000:00100000:1.0:1780340506.727420:0:25491:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e06e5cf1-1986-4ba7-9630-fad7efb74eca/ffff8c0349150000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211351c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1780340506.727437:0:25491:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1780340506.727497:0:25491:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1780340506.727538:0:25491:0:(import.c:65:import_set_state_nolock()) ffff8c0346fd3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780340506.727799:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940369024:12345-192.168.203.16@tcp:8:lfs.0 Request processed in 295us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340506.727812:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5851 00000100:00100000:3.0:1780340506.736735:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340506.736962:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940369152 00000100:00100000:1.0:1780340506.736974:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940369152 00000100:00100000:1.0:1780340506.737027:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1857 00000100:00100000:1.0:1780340506.737038:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:63424:x1866818940369152:12345-192.168.203.16@tcp:13:lfs.0 00000020:02000000:1.0:1780340506.737045:0:8404:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1780340506.737082:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340506.737180:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:63424:x1866818940369152:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 143us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340506.737188:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1857 00000100:00100000:3.0:1780340507.018869:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340507.018894:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960984192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340507.018963:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340507.022614:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960984192 00000100:00100000:1.0:1780340507.022627:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960984192 00000100:00100000:1.0:1780340507.022686:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1858 00000100:00100000:1.0:1780340507.022697:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818960984192:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:1.0:1780340507.022704:0:10290:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1780340507.022727:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340507.022833:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818960984192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (3868us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340507.022840:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1858 00000100:00100000:1.0:1780340507.022910:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960984192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340507.023161:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960984320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340507.023201:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340507.025732:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960984320 00000100:00100000:0.0:1780340507.025747:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960984320 00000100:00100000:0.0:1780340507.025881:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1859 00000100:00100000:0.0:1780340507.025892:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818960984320:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:0.0:1780340507.025898:0:8404:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1780340507.025920:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340507.026004:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818960984320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (2802us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340507.026012:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1859 00000100:00100000:3.0:1780340507.026242:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960984320:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1780340507.466367:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340507.530084:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818960984448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340507.530151:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340507.530786:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960984448 00000100:00100000:3.0:1780340507.530797:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960984448 00000100:00100000:3.0:1780340507.530854:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3675 00000100:00100000:3.0:1780340507.530864:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0458812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818960984448:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:3.0:1780340507.530883:0:26074:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:3.0:1780340507.530915:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:3.0:1780340507.530979:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0458812300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818960984448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340507.530986:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3675 00000100:00100000:2.0:1780340507.531116:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818960984448:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1780340508.047932:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969447 is committed 00000001:00100000:0.0:1780340508.048456:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000001:00080000:0.0:1780340508.048465:0:9462:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969448 is committed 00000001:00100000:3.0:1780340508.048559:0:79964:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00010000:00010000:1.0:1780340508.499355:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340508.898855:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340508.899039:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940369280 00000100:00100000:0.0:1780340508.899049:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940369280 00000100:00100000:0.0:1780340508.899118:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1010 00000100:00100000:0.0:1780340508.899129:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0458810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:63529:x1866818940369280:12345-192.168.203.16@tcp:101:lfs.0 00000020:02000000:0.0:1780340508.899148:0:64454:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:0.0:1780340508.899163:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340508.899197:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa246514327730f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced21e6 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780340508.906373:0:64454:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 7002us 00010000:00010000:0.0:1780340508.981265:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa246514327730fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340508.981297:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa246514327730fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340508.981311:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa246514327730fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340508.981369:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780340508.981374:0:64454:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1780340508.981436:0:64454:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa246514327730fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340508.981666:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa246514327730f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21e6 expref: 7 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340508.981687:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa246514327730fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21e6 expref: 6 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340508.981696:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045a897d00) 00010000:00010000:0.0:1780340508.981699:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780340508.981703:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440031400, rc 0) 00000100:00100000:0.0:1780340508.981791:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0458810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:63529:x1866818940369280:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 82664us (82951us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340508.981801:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1010 00000100:00100000:0.0:1780340508.996717:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340508.996935:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940369408 00000100:00100000:3.0:1780340508.996947:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940369408 00000100:00100000:3.0:1780340508.996996:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1011 00000100:00100000:3.0:1780340508.997008:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:63529:x1866818940369408:12345-192.168.203.16@tcp:41:lfs.0 00000020:02000000:3.0:1780340508.997016:0:63711:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:3.0:1780340508.997050:0:63711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:3.0:1780340508.997117:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:63529:x1866818940369408:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 112us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340508.997125:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1011 00000100:00100000:0.0:1780340509.005717:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340509.005809:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940369536 00000100:00100000:1.0:1780340509.005818:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940369536 00000100:00100000:1.0:1780340509.005876:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1012 00000100:00100000:1.0:1780340509.005887:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:63529:x1866818940369536:12345-192.168.203.16@tcp:41:lfs.0 00000020:02000000:1.0:1780340509.005896:0:70100:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1780340509.005944:0:70100:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:1.0:1780340509.006008:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:63529:x1866818940369536:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 125us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340509.006016:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1012 00000100:00080000:0.0:1780340509.008026:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340509.014672:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340509.015032:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940369664 00000100:00100000:1.0:1780340509.015042:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940369664 00000100:00100000:1.0:1780340509.015101:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1860 00000100:00100000:1.0:1780340509.015111:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:63529:x1866818940369664:12345-192.168.203.16@tcp:13:lfs.0 00000020:02000000:1.0:1780340509.015119:0:10290:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1780340509.015154:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340509.015217:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:63529:x1866818940369664:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 108us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340509.015225:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1860 00000100:00080000:0.0:1780340509.015477:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340509.024326:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340509.025121:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940369792 00000100:00100000:2.0:1780340509.025137:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940369792 00000100:00100000:2.0:1780340509.025232:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1861 00000100:00100000:2.0:1780340509.025244:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:63529:x1866818940369792:12345-192.168.203.16@tcp:13:lfs.0 00000020:02000000:2.0:1780340509.025254:0:8403:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:2.0:1780340509.025307:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340509.025413:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:63529:x1866818940369792:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 170us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340509.025422:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1861 00000100:00100000:3.0:1780340509.049092:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340509.049266:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940369920 00000100:00100000:0.0:1780340509.049289:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940369920 00000100:00100000:0.0:1780340509.049357:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1013 00000100:00100000:0.0:1780340509.049368:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:63039:x1866818940369920:12345-192.168.203.16@tcp:101:multiop.0 00000020:02000000:0.0:1780340509.049378:0:64454:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:0.0:1780340509.049408:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340509.049433:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031000/0xa24651432773101 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced21ed expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.049517:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432773108 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.049535:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432773108 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.049549:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432773108 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.049564:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa2465143277310f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.049571:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa2465143277310f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.049578:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa2465143277310f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.049814:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432773116 lrc: 3/1,0 mode: --/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.049843:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432773116 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.049850:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432773116 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340509.049889:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a041:0x1:0x0]: returning size 0 00000004:00200000:0.0:1780340509.049895:0:64454:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1780340509.049938:0:64454:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432773116 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.049952:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432773116 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.049962:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432773108 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.049970:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432773108 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.049977:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432773108 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.049983:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432773108 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.049989:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440030e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340509.049993:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432773108 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.050001:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432773108 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.050025:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045a897d00) 00010000:00010000:0.0:1780340509.050028:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340509.050034:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432773108 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.050041:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432773108 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.050054:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa2465143277310f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.050060:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa2465143277310f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.050066:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa2465143277310f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.050071:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440030800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340509.050074:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa2465143277310f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.050079:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa2465143277310f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.050086:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff8c045a897400) 00010000:00010000:0.0:1780340509.050088:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340509.050090:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa2465143277310f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.050095:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa2465143277310f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.050136:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031000/0xa24651432773101 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21ed expref: 8 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.050161:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432773116 lrc: 3/0,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21ed expref: 7 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340509.050170:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff8c045a897b00) 00010000:00010000:0.0:1780340509.050172:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780340509.050175:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440030200, rc 0) 00000100:00100000:0.0:1780340509.050248:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:63039:x1866818940369920:12345-192.168.203.16@tcp:101:multiop.0 Request processed in 881us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340509.050256:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1013 00010000:00010000:1.0:1780340509.530644:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340509.595480:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340509.595503:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818960984576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340509.595617:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340509.595668:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960984576 00000100:00100000:0.0:1780340509.595677:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960984576 00000100:00100000:0.0:1780340509.595722:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3676 00000100:00100000:0.0:1780340509.595732:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a82b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818960984576:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:0.0:1780340509.595738:0:22660:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1780340509.595797:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:0.0:1780340509.595842:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a82b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818960984576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340509.595849:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3676 00000100:00100000:0.0:1780340509.595891:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818960984576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340510.092144:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960984704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340510.092226:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340510.092290:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960984832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340510.092331:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340510.092376:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960984704 00000100:00100000:0.0:1780340510.092384:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960984704 00000100:00100000:0.0:1780340510.092437:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960984832 00000100:00100000:0.0:1780340510.092440:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960984832 00000100:00100000:0.0:1780340510.092470:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1862 00000100:00100000:0.0:1780340510.092479:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b48e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818960984704:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:0.0:1780340510.092486:0:10290:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1780340510.092504:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340510.092551:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b48e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818960984704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340510.092559:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1862 00000100:00100000:0.0:1780340510.092827:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1863 00000100:00100000:0.0:1780340510.092837:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048584c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960984832:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:0.0:1780340510.094935:0:10290:0:(tgt_handler.c:763:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1780340510.094959:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340510.095035:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048584c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960984832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2197us (2711us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340510.095043:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1863 00000100:00080000:0.0:1780340510.095082:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340510.095088:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340510.095133:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960984832:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340510.095180:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960984704:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1780340510.538908:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340511.562276:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340511.627103:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340511.627139:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048584f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818960985088:0@lo:400:kworker.0 00000100:00100000:0.0:1780340511.627391:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340511.627516:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048584c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818960985216:0@lo:400:kworker.0 00000100:00100000:0.0:1780340511.627541:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340511.627557:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960985728:0@lo:400:kworker.0 00000100:00100000:0.0:1780340511.627580:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340511.627596:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04445b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818960986240:0@lo:400:kworker.0 00000100:00100000:0.0:1780340511.627615:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340511.627630:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1780340511.627635:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960985600:0@lo:400:kworker.0 00000100:00100000:0.0:1780340511.627655:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340511.627670:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818960986112:0@lo:400:kworker.0 00000100:00100000:0.0:1780340511.627688:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340511.627714:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960985600 00000100:00100000:0.0:1780340511.627721:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960985600 00000100:00100000:0.0:1780340511.627802:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960986112 00000100:00100000:0.0:1780340511.627805:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960986112 00000100:00100000:0.0:1780340511.627827:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3677 00000100:00100000:0.0:1780340511.627834:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818960985600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340511.627883:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818960985600:12345-0@lo:400:kworker.0 Request processed in 49us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340511.627890:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3677 00000100:00100000:0.0:1780340511.627906:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3678 00000100:00100000:0.0:1780340511.627913:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818960986112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340511.627940:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818960986112:12345-0@lo:400:kworker.0 Request processed in 28us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340511.627956:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3678 00000100:00100000:0.0:1780340511.627997:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960985600:0@lo:400:kworker.0 00000100:00100000:0.0:1780340511.628008:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818960986112:0@lo:400:kworker.0 00000100:00100000:3.0:1780340511.628094:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960985088 00000100:00100000:3.0:1780340511.628098:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960985088 00000100:00100000:3.0:1780340511.628136:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960985216 00000100:00100000:3.0:1780340511.628139:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960985216 00000100:00100000:3.0:1780340511.628158:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:3.0:1780340511.628165:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048584d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818960985088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340511.628217:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048584d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818960985088:12345-0@lo:400:kworker.0 Request processed in 52us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340511.628222:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:3.0:1780340511.628237:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:3.0:1780340511.628259:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818960985216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340511.628290:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818960985216:12345-0@lo:400:kworker.0 Request processed in 41us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340511.628296:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:1.0:1780340511.628804:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048584ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818960985344:0@lo:400:kworker.0 00000100:00100000:1.0:1780340511.628837:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340511.628861:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960985856:0@lo:400:kworker.0 00000100:00100000:1.0:1780340511.628881:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340511.628895:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04445b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960986368:0@lo:400:kworker.0 00000100:00100000:1.0:1780340511.628922:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340511.628940:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1780340511.628947:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048584df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818960984960:0@lo:400:kworker.0 00000100:00100000:1.0:1780340511.628971:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340511.628996:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048584dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818960985472:0@lo:400:kworker.0 00000100:00100000:1.0:1780340511.629015:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340511.629029:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818960985984:0@lo:400:kworker.0 00000100:00100000:1.0:1780340511.629048:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340511.629306:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960985344 00000100:00100000:3.0:1780340511.629311:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960985344 00000100:00100000:3.0:1780340511.629332:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960985472 00000100:00100000:3.0:1780340511.629334:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960985472 00000100:00100000:3.0:1780340511.629343:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960985984 00000100:00100000:3.0:1780340511.629345:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960985984 00000100:00100000:3.0:1780340511.629356:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:3.0:1780340511.629362:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818960985344:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1780340511.629421:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340511.629426:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780340511.629439:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:0.0:1780340511.629447:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818960985472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340511.629548:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:2.0:1780340511.629558:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818960985984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340511.632085:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818960985344:12345-0@lo:400:kworker.0 Request processed in 2473us (2998us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340511.632098:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:3.0:1780340511.632244:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960985728 00000100:00100000:3.0:1780340511.632261:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960985728 00000100:00100000:3.0:1780340511.632304:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960986240 00000100:00100000:3.0:1780340511.632308:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960986240 00000100:00100000:3.0:1780340511.632335:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960985856 00000100:00100000:3.0:1780340511.632338:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960985856 00000100:00100000:3.0:1780340511.632352:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960986368 00000100:00100000:3.0:1780340511.632475:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960986368 00000100:00100000:3.0:1780340511.632565:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2290 00000100:00100000:3.0:1780340511.632573:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818960985728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340511.632622:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818960985728:12345-0@lo:400:kworker.0 Request processed in 51us (5041us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340511.632628:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2290 00000100:00100000:3.0:1780340511.632639:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2291 00000100:00100000:3.0:1780340511.632657:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818960986240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340511.632684:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818960986240:12345-0@lo:400:kworker.0 Request processed in 28us (5068us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340511.632689:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2291 00000100:00100000:3.0:1780340511.632699:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2292 00000100:00100000:3.0:1780340511.632704:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960985856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340511.632726:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960985856:12345-0@lo:400:kworker.0 Request processed in 23us (3845us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340511.632732:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2292 00000100:00100000:3.0:1780340511.632740:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2293 00000100:00100000:3.0:1780340511.632746:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960986368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340511.633031:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960986368:12345-0@lo:400:kworker.0 Request processed in 284us (4106us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340511.633037:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2293 00000100:00100000:3.0:1780340511.633094:0:79970:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960984960 00000100:00100000:3.0:1780340511.633099:0:79970:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960984960 00000100:00100000:3.0:1780340511.633123:0:79970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1780340511.633129:0:79970:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445831850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818960984960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340511.633597:0:79970:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445831850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818960984960:12345-0@lo:400:kworker.0 Request processed in 469us (4625us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340511.633604:0:79970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:3.0:1780340511.633650:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340511.633655:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340511.633691:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048584c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818960985216:0@lo:400:kworker.0 00000100:00100000:3.0:1780340511.633704:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960985728:0@lo:400:kworker.0 00000100:00100000:3.0:1780340511.633728:0:3662:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969447 gen 2 00000100:00100000:3.0:1780340511.633744:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04445b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818960986240:0@lo:400:kworker.0 00000100:00100000:3.0:1780340511.633756:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048584f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818960985088:0@lo:400:kworker.0 00000100:00100000:0.0:1780340511.640470:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818960985472:12345-0@lo:400:kworker.0 Request processed in 11016us (11444us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340511.640474:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04445b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818960986496:0@lo:400:kworker.0 00000100:00100000:0.0:1780340511.640483:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:1.0:1780340511.640776:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340511.640826:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048584ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818960985344:0@lo:400:kworker.0 00000100:00100000:1.0:1780340511.640839:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960985856:0@lo:400:kworker.0 00000100:00100000:1.0:1780340511.640847:0:3659:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 2 00000100:00100000:1.0:1780340511.640862:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04445b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960986368:0@lo:400:kworker.0 00000100:00100000:3.0:1780340511.641671:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960986496 00000100:00100000:3.0:1780340511.641679:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960986496 00000100:00100000:3.0:1780340511.641737:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1780340511.641746:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818960986496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340511.641823:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818960986496:12345-0@lo:400:kworker.0 Request processed in 78us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340511.641831:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:1.0:1780340511.641994:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048584df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818960984960:0@lo:400:kworker.0 00000100:00100000:1.0:1780340511.642007:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048584dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818960985472:0@lo:400:kworker.0 00000100:00100000:1.0:1780340511.642017:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04445b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818960986496:0@lo:400:kworker.0 00000100:00100000:2.0:1780340511.642021:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818960985984:12345-0@lo:400:kworker.0 Request processed in 12466us (12971us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340511.642028:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1780340511.642033:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818960985984:0@lo:400:kworker.0 00000100:00100000:0.0:1780340511.787079:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340511.787135:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340511.787163:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340511.787208:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340511.787237:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340511.787275:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940370304 00000100:00100000:0.0:1780340511.787286:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940370304 00000100:00100000:0.0:1780340511.787443:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940370176 00000100:00100000:0.0:1780340511.787447:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940370176 00000100:00100000:0.0:1780340511.787469:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1001 00000100:00100000:3.0:1780340511.787479:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1002 00000100:00100000:0.0:1780340511.787479:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940370304:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340511.787487:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2410:x1866818940370176:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340511.787571:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940370560 00000100:00100000:1.0:1780340511.787587:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940370560 00000100:00100000:2.0:1780340511.787788:0:79975:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940370048 00000100:00100000:2.0:1780340511.787793:0:79975:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940370048 00000100:00100000:2.0:1780340511.787823:0:79975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 153 00000100:00100000:2.0:1780340511.787838:0:79975:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445830850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2410:x1866818940370048:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340511.787921:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2410:x1866818940370176:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 433us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340511.787929:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1002 00000100:00100000:1.0:1780340511.788082:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940370432 00000100:00100000:1.0:1780340511.788086:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940370432 00000100:00100000:1.0:1780340511.788121:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2294 00000100:00100000:1.0:1780340511.788128:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2410:x1866818940370560:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340511.790855:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2295 00000100:00100000:0.0:1780340511.790876:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940370432:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340511.790938:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940370432:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 72us (3700us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340511.790959:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2295 00000100:00100000:0.0:1780340511.791037:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940370304:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 3558us (3900us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340511.791045:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1001 00000100:00100000:2.0:1780340511.791158:0:79975:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445830850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2410:x1866818940370048:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 3319us (4085us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340511.791166:0:79975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 153 00000100:00080000:0.0:1780340511.791839:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340511.791846:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340511.802426:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2410:x1866818940370560:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 14286us (15249us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340511.802441:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2294 00000100:00100000:3.0:1780340512.138087:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0458813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960986624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340512.138156:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340512.138413:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960986624 00000100:00100000:2.0:1780340512.138422:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960986624 00000100:00100000:2.0:1780340512.138473:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1864 00000100:00100000:2.0:1780340512.138482:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a204a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960986624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780340512.138509:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340512.138555:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a204a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960986624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340512.138563:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1864 00000100:00100000:2.0:1780340512.138603:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0458813b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960986624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340512.138843:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a206680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818960986752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340512.138879:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340512.138940:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960986752 00000100:00100000:3.0:1780340512.138944:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960986752 00000100:00100000:3.0:1780340512.138974:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1865 00000100:00100000:3.0:1780340512.138980:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818960986752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340512.138996:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340512.139027:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818960986752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340512.139048:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1865 00000100:00100000:3.0:1780340512.139084:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a206680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818960986752:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1780340512.595946:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340512.661985:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340512.662008:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a206680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818960986880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340512.662085:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340512.662412:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960986880 00000100:00100000:3.0:1780340512.662420:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960986880 00000100:00100000:3.0:1780340512.662472:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3679 00000100:00100000:3.0:1780340512.662483:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0458813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818960986880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340512.662518:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:3.0:1780340512.662576:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0458813b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818960986880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340512.662583:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3679 00000100:00100000:2.0:1780340512.662699:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a206680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818960986880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340513.210232:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340513.210329:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940370816 00000100:00100000:1.0:1780340513.210339:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940370816 00000100:00100000:1.0:1780340513.210411:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1014 00000100:00100000:1.0:1780340513.210421:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0458810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:63647:x1866818940370816:12345-192.168.203.16@tcp:36:rm.0 00010000:00010000:1.0:1780340513.210473:0:63712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1780340513.210518:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432773116 lrc: 0/0,0 mode: --/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21ed expref: 7 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.210539:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff8c045a897b00) 00010000:00010000:1.0:1780340513.210556:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa246514327730fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21e6 expref: 6 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.210566:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045a897d00) 00010000:00010000:1.0:1780340513.210571:0:63712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780340513.210597:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762800/0xa2465143277311d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.210628:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762800/0xa2465143277311d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.210638:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762800/0xa2465143277311d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.210666:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762200/0xa24651432773124 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.210673:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762200/0xa24651432773124 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.210679:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762200/0xa24651432773124 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.210754:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762e00/0xa2465143277312b lrc: 3/0,1 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.210788:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762e00/0xa2465143277312b lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.210796:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762e00/0xa2465143277312b lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1780340513.211065:0:63712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x58:0x0].2, 64 off8320 00000004:00080000:1.0:1780340513.211075:0:63712:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3293200314895ns, next at 3294200312958ns, rc = 0 00010000:00010000:1.0:1780340513.211127:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763200/0xa24651432773132 lrc: 3/0,1 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211137:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763200/0xa24651432773132 lrc: 3/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211156:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763200/0xa24651432773132 lrc: 3/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211164:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763200/0xa24651432773132 lrc: 4/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211171:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763200/0xa24651432773132 lrc: 4/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211177:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763200/0xa24651432773132 lrc: 3/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211195:0:63712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780340513.211225:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762e00/0xa2465143277312b lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211232:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762e00/0xa2465143277312b lrc: 2/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211238:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762e00/0xa2465143277312b lrc: 3/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211255:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340513.211259:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762e00/0xa2465143277312b lrc: 3/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211266:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762e00/0xa2465143277312b lrc: 4/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211275:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff8c04506cfe00) 00010000:00010000:1.0:1780340513.211278:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1780340513.211289:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762e00/0xa2465143277312b lrc: 2/0,0 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211295:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762e00/0xa2465143277312b lrc: 0/0,0 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211311:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762800/0xa2465143277311d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211318:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762800/0xa2465143277311d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211324:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762800/0xa2465143277311d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211330:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762800/0xa2465143277311d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211336:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340513.211339:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762800/0xa2465143277311d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211344:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762800/0xa2465143277311d lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211351:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:1.0:1780340513.211354:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340513.211356:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762800/0xa2465143277311d lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211362:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762800/0xa2465143277311d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340513.211373:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006d2bacb8 reply state 00000000bc265220 transno 94489280513 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762200/0xa24651432773124 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211389:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762200/0xa24651432773124 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211396:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff8c04506cfc00) 00010000:00010000:1.0:1780340513.211398:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340513.211401:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780340513.211469:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0458810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:63647:x1866818940370816:12345-192.168.203.16@tcp:36:rm.0 Request processed in 1048us (1245us total) trans 94489280513 rc 0/0 00000100:00100000:1.0:1780340513.211477:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1014 00010000:00010000:1.0:1780340513.211507:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340513.211512:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763200/0xa24651432773132 lrc: 2/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211519:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476763200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340513.211522:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763200/0xa24651432773132 lrc: 2/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211528:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763200/0xa24651432773132 lrc: 3/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211537:0:41205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff8c04506cfe00) 00010000:00010000:1.0:1780340513.211539:0:41205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1780340513.211542:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763200/0xa24651432773132 lrc: 1/0,0 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211548:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763200/0xa24651432773132 lrc: 0/0,0 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340513.211560:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340513.211562:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340513.211569:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780340513.211798:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1780340513.623119:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340514.634264:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340514.698341:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818960987008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340514.698445:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340514.698991:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960987008 00000100:00100000:0.0:1780340514.698999:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960987008 00000100:00100000:0.0:1780340514.699093:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3680 00000100:00100000:0.0:1780340514.699103:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0458811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818960987008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780340514.699136:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:0.0:1780340514.699192:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0458811c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818960987008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340514.699200:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3680 00000100:00100000:2.0:1780340514.699279:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818960987008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780340515.217269:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960987136:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340515.217338:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340515.217420:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340515.217428:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960987264:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340515.217449:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340515.217589:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960987136 00000100:00100000:2.0:1780340515.217598:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960987136 00000100:00100000:2.0:1780340515.217669:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960987264 00000100:00100000:2.0:1780340515.217672:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960987264 00000100:00100000:2.0:1780340515.217695:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866 00000100:00100000:2.0:1780340515.217704:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a205f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818960987136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340515.217731:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340515.217805:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a205f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818960987136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340515.217812:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866 00000100:00100000:2.0:1780340515.217826:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1867 00000100:00100000:2.0:1780340515.217832:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a206680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818960987264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340515.217845:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340515.217867:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a206680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818960987264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340515.217872:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1867 00000100:00100000:2.0:1780340515.217911:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960987264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340515.217923:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960987136:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1780340515.218231:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340515.218236:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1780340515.657978:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340516.684049:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340516.750076:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04445b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818960987520:0@lo:400:kworker.0 00000100:00100000:3.0:1780340516.750153:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340516.750182:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048584ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818960988032:0@lo:400:kworker.0 00000100:00100000:3.0:1780340516.750234:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340516.750251:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818960988544:0@lo:400:kworker.0 00000100:00100000:3.0:1780340516.752364:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340516.752544:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1780340516.752557:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04445b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818960987392:0@lo:400:kworker.0 00000100:00100000:3.0:1780340516.752631:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340516.752662:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048584df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818960987904:0@lo:400:kworker.0 00000100:00100000:3.0:1780340516.752688:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340516.752709:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818960988416:0@lo:400:kworker.0 00000100:00100000:3.0:1780340516.752747:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340516.752782:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1866818960988928:0@lo:400:kworker.0 00000100:00100000:3.0:1780340516.752815:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340516.752849:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04445b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818960987648:0@lo:400:kworker.0 00000100:00100000:3.0:1780340516.752871:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340516.752888:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048584f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960988160:0@lo:400:kworker.0 00000100:00100000:3.0:1780340516.752909:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340516.752923:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960988672:0@lo:400:kworker.0 00000100:00100000:3.0:1780340516.752943:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340516.752961:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1780340516.752967:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048584dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818960987776:0@lo:400:kworker.0 00000100:00100000:3.0:1780340516.752985:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340516.752995:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048584c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960988288:0@lo:400:kworker.0 00000100:00100000:3.0:1780340516.753011:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340516.753026:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960988800:0@lo:400:kworker.0 00000100:00100000:3.0:1780340516.753044:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340516.753076:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960987520 00000100:00100000:3.0:1780340516.753084:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960987520 00000100:00100000:0.0:1780340516.756597:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960987904 00000100:00100000:0.0:1780340516.756610:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960987904 00000100:00100000:1.0:1780340516.756617:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960988160 00000100:00100000:1.0:1780340516.756620:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960988160 00000100:00100000:1.0:1780340516.756653:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960988672 00000100:00100000:1.0:1780340516.756657:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960988672 00000100:00100000:1.0:1780340516.756682:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960988288 00000100:00100000:1.0:1780340516.756686:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960988288 00000100:00100000:2.0:1780340516.756690:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960988800 00000100:00100000:2.0:1780340516.756696:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960988800 00000100:00100000:1.0:1780340516.756727:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2296 00000100:00100000:0.0:1780340516.756732:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960988416 00000100:00100000:0.0:1780340516.756736:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960988416 00000100:00100000:1.0:1780340516.756738:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818960988160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340516.756753:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2297 00000100:00100000:0.0:1780340516.756754:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960988928 00000100:00100000:0.0:1780340516.756776:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960988928 00000100:00100000:0.0:1780340516.756802:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960987648 00000100:00100000:0.0:1780340516.756804:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960987648 00000100:00100000:0.0:1780340516.756816:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960987776 00000100:00100000:0.0:1780340516.756819:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960987776 00000100:00100000:0.0:1780340516.756834:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:1.0:1780340516.756841:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818960988160:12345-0@lo:400:kworker.0 Request processed in 106us (3929us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340516.756841:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818960987904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340516.756848:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2296 00000100:00100000:2.0:1780340516.756868:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960988672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340516.756873:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2298 00000100:00100000:0.0:1780340516.756880:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818960987904:12345-0@lo:400:kworker.0 Request processed in 40us (4190us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340516.756882:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818960988288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340516.756896:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:0.0:1780340516.756911:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:1.0:1780340516.756916:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818960988288:12345-0@lo:400:kworker.0 Request processed in 37us (3905us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340516.756919:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818960988416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340516.756922:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2298 00000100:00100000:1.0:1780340516.756937:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2299 00000100:00100000:3.0:1780340516.756939:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960988032 00000100:00100000:1.0:1780340516.756944:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960988800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340516.756948:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960988672:12345-0@lo:400:kworker.0 Request processed in 186us (4001us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340516.756953:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960988032 00000100:00100000:0.0:1780340516.756955:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818960988416:12345-0@lo:400:kworker.0 Request processed in 36us (4206us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340516.756963:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2297 00000100:00100000:0.0:1780340516.756966:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:1.0:1780340516.756979:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a827b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960988800:12345-0@lo:400:kworker.0 Request processed in 37us (3934us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340516.756985:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2299 00000100:00100000:0.0:1780340516.756987:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:0.0:1780340516.756995:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1866818960988928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340516.756996:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960988544 00000100:00100000:3.0:1780340516.757001:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960988544 00000100:00100000:0.0:1780340516.757030:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1866818960988928:12345-0@lo:400:kworker.0 Request processed in 36us (4212us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340516.757033:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3681 00000100:00100000:0.0:1780340516.757041:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:3.0:1780340516.757045:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349861180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818960988032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340516.757059:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:0.0:1780340516.757067:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818960987648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340516.757095:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349861180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818960988032:12345-0@lo:400:kworker.0 Request processed in 52us (6859us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340516.757103:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3681 00000100:00100000:0.0:1780340516.757112:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818960987648:12345-0@lo:400:kworker.0 Request processed in 45us (4238us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340516.757119:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:3.0:1780340516.757126:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3682 00000100:00100000:3.0:1780340516.757135:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818960988544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340516.757140:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:0.0:1780340516.757150:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818960987776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340516.757173:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818960988544:12345-0@lo:400:kworker.0 Request processed in 41us (4815us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340516.757181:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3682 00000100:00100000:0.0:1780340516.757193:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818960987776:12345-0@lo:400:kworker.0 Request processed in 44us (4205us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340516.757199:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:0.0:1780340516.757226:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:3.0:1780340516.757231:0:79969:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960987392 00000100:00100000:0.0:1780340516.757235:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1866818960987520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340516.757236:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048584df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818960987904:0@lo:400:kworker.0 00000100:00100000:3.0:1780340516.757237:0:79969:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960987392 00000100:00100000:1.0:1780340516.757252:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818960988416:0@lo:400:kworker.0 00000100:00100000:1.0:1780340516.757265:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1866818960988928:0@lo:400:kworker.0 00000100:00100000:0.0:1780340516.757267:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1866818960987520:12345-0@lo:400:kworker.0 Request processed in 36us (7114us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340516.757274:0:79969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1780340516.757284:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:3.0:1780340516.757288:0:79969:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445833850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818960987392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340516.757291:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04445b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818960987520:0@lo:400:kworker.0 00000100:00100000:1.0:1780340516.757304:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048584ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818960988032:0@lo:400:kworker.0 00000100:00100000:1.0:1780340516.757314:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818960988544:0@lo:400:kworker.0 00000100:00100000:3.0:1780340516.757504:0:79969:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445833850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818960987392:12345-0@lo:400:kworker.0 Request processed in 218us (4871us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340516.757511:0:79969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1780340516.757558:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340516.757563:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340516.757571:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340516.757573:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780340516.757605:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048584dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818960987776:0@lo:400:kworker.0 00000100:00100000:2.0:1780340516.757620:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048584c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960988288:0@lo:400:kworker.0 00000100:00100000:2.0:1780340516.757631:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960988800:0@lo:400:kworker.0 00000100:00100000:2.0:1780340516.757641:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04445b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818960987648:0@lo:400:kworker.0 00000100:00100000:2.0:1780340516.757650:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048584f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960988160:0@lo:400:kworker.0 00000100:00100000:2.0:1780340516.757658:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960988672:0@lo:400:kworker.0 00000100:00100000:1.0:1780340516.758633:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04445b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818960987392:0@lo:400:kworker.0 00000100:00100000:0.0:1780340516.906234:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340516.906321:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340516.906352:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340516.906390:0:79974:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940370944 00000100:00100000:3.0:1780340516.906400:0:79974:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940370944 00000100:00100000:3.0:1780340516.906470:0:79974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 155 00000100:00100000:3.0:1780340516.906481:0:79974:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445831450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2409:x1866818940370944:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340516.906564:0:79974:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445831450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2409:x1866818940370944:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 85us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340516.906571:0:79974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 155 00000100:00100000:1.0:1780340516.910478:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940371072 00000100:00100000:1.0:1780340516.910491:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940371072 00000100:00100000:0.0:1780340516.910516:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340516.911088:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340516.911119:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940371456 00000100:00100000:0.0:1780340516.911123:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940371456 00000100:00100000:0.0:1780340516.911160:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940371328 00000100:00100000:0.0:1780340516.911163:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940371328 00000100:00100000:0.0:1780340516.911188:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2300 00000100:00100000:0.0:1780340516.911219:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940371456:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340516.911246:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2301 00000100:00100000:3.0:1780340516.911254:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940371328:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340516.911325:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940371456:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 129us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340516.911332:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2300 00000100:00100000:3.0:1780340516.911656:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940371328:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 402us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340516.911664:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2301 00000100:00080000:0.0:1780340516.912840:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340516.912846:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340516.912848:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340516.913314:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940371200 00000100:00100000:1.0:1780340516.913324:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940371200 00000100:00100000:0.0:1780340516.913346:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1009 00000100:00100000:0.0:1780340516.913361:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2410:x1866818940371072:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340516.913442:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2410:x1866818940371072:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 88us (7216us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340516.913449:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1009 00000100:00100000:1.0:1780340516.914276:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1010 00000100:00100000:1.0:1780340516.914284:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940371200:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340516.914318:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940371200:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 35us (7965us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340516.914325:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1010 00000100:00080000:1.0:1780340516.914371:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340517.259082:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818960989056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340517.259161:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1780340517.261637:0:79983:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3297250875325ns, next at 3298250872995ns, rc = 0 00000100:00100000:3.0:1780340517.261720:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960989184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340517.261804:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340517.261973:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960989056 00000100:00100000:0.0:1780340517.261980:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960989056 00000100:00100000:0.0:1780340517.262044:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960989184 00000100:00100000:0.0:1780340517.262047:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960989184 00000100:00100000:0.0:1780340517.262110:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1868 00000100:00100000:0.0:1780340517.262120:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818960989056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780340517.262150:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340517.262202:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818960989056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (3040us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340517.262220:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1868 00000100:00100000:0.0:1780340517.262237:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1869 00000100:00100000:0.0:1780340517.262244:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960989184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340517.262261:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340517.262293:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960989184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340517.262299:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1869 00000100:00100000:3.0:1780340517.270980:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960989184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340517.271061:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818960989056:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1780340517.707604:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340517.770116:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960989312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340517.770184:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340517.770284:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960989312 00000100:00100000:3.0:1780340517.770292:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960989312 00000100:00100000:3.0:1780340517.770342:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3683 00000100:00100000:3.0:1780340517.770352:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818960989312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340517.770384:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:3.0:1780340517.770459:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818960989312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340517.770466:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3683 00000100:00100000:2.0:1780340517.770725:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a826300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960989312:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1780340518.731334:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1780340518.808100:0:79964:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1780340518.808151:0:79964:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280513 is committed 00000004:00080000:3.0:1780340518.808157:0:79964:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1780340518.808193:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762200/0xa24651432773124 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340518.808216:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762200/0xa24651432773124 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340518.808244:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762200/0xa24651432773124 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340518.808258:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340518.808262:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762200/0xa24651432773124 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340518.808269:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762200/0xa24651432773124 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340518.808290:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff8c04506cfc00) 00010000:00010000:3.0:1780340518.808293:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340518.808299:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762200/0xa24651432773124 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340518.808304:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762200/0xa24651432773124 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340518.809425:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960989440:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1780340518.809496:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340518.811096:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960989440 00000100:00100000:2.0:1780340518.811108:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960989440 00000100:00100000:2.0:1780340518.811186:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5852 00000100:00080000:3.0:1780340518.811193:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340518.811197:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960989440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1780340518.811235:0:25494:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:642 count 1 00010000:00010000:2.0:1780340518.811269:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432773139 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340518.811477:0:25494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e567eece/0xa24651432772cd9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21c3 expref: 5 pid: 25488 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340518.811487:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340518.811489:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340518.811493:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432773139 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340518.811537:0:25494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e567eece/0xa24651432772cd9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21c3 expref: 5 pid: 25488 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340518.811550:0:25494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e567eece/0xa24651432772cd9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21c3 expref: 5 pid: 25488 timeout: 3398 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340518.811564:0:25494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25494:1866818960989568:192.168.203.16@tcp:104: 00000100:00100000:2.0:1780340518.811648:0:25494:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348210a80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340518.818050:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340518.818050:0:25494:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:25494:1866818960989568:192.168.203.16@tcp:104: 00010000:00010000:1.0:1780340518.818085:0:25494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432773139 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340518.818144:0:7443:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940371584 00000100:00100000:1.0:1780340518.818151:0:7443:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940371584 00010000:00010000:1.0:1780340518.818192:0:7443:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e567eece/0xa24651432772cd9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21c3 expref: 6 pid: 25488 timeout: 3398 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340518.818237:0:7443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2536 00000100:00100000:1.0:1780340518.818247:0:7443:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940371584:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780340518.818263:0:7443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340518.818269:0:7443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e567eece/0xa24651432772cd9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21c3 expref: 6 pid: 25488 timeout: 3398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340518.818281:0:7443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e567eece/0xa24651432772cd9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21c3 expref: 6 pid: 25488 timeout: 3398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340518.818306:0:7443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e567eece/0xa24651432772cd9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21c3 expref: 6 pid: 25488 timeout: 3398 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340518.818327:0:7443:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340518.818329:0:7443:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340518.818334:0:7443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432773139 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340518.818344:0:7443:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432773139 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340518.818380:0:7443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340518.818429:0:7443:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2410:x1866818940371584:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 183us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340518.818437:0:7443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2536 00010000:00010000:1.0:1780340518.818547:0:25494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432773139 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340518.818556:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432773139 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340518.818565:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432773139 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340518.818572:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432773139 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340518.818588:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1780340518.818807:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818960989440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7612us (9310us total) trans 4294969448 rc 0/0 00000100:00100000:1.0:1780340518.818815:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5852 00010000:00010000:1.0:1780340518.818836:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340518.818841:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432773139 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340518.818850:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340518.818860:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432773139 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340518.818870:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432773139 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340518.818884:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432773139 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340518.818892:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432773139 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340518.818929:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340518.818931:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340518.818933:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1780340518.818963:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c04587a7800/2, rc 0, transno 4294969448 00000100:00100000:1.0:1780340518.818969:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960989440:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1780340518.819792:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1780340519.754930:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340519.818507:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340519.818536:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960989696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340519.818616:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340519.819020:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960989696 00000100:00100000:2.0:1780340519.819028:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960989696 00000100:00100000:2.0:1780340519.819091:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3684 00000100:00100000:2.0:1780340519.819100:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04445b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960989696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340519.819138:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:2.0:1780340519.819203:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04445b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960989696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340519.819210:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3684 00000100:00100000:1.0:1780340519.819296:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960989696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340520.330660:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340520.330687:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960989824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340520.330817:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340520.330879:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960989824 00000100:00100000:1.0:1780340520.330887:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960989824 00000100:00100000:1.0:1780340520.330949:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870 00000100:00100000:1.0:1780340520.330986:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04445b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818960989824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780340520.331016:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340520.331061:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04445b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818960989824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340520.331080:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870 00000100:00080000:1.0:1780340520.331100:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340520.331134:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960989824:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340520.334104:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340520.334127:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960989952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340520.334203:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340520.334347:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960989952 00000100:00100000:2.0:1780340520.334355:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960989952 00000100:00100000:2.0:1780340520.334420:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871 00000100:00100000:2.0:1780340520.334429:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818960989952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340520.334457:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340520.334516:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818960989952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340520.334538:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871 00000100:00080000:3.0:1780340520.335154:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340520.335204:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960989952:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1780340520.783067:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340521.804644:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340521.865954:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818960990080:0@lo:400:kworker.0 00000100:00100000:1.0:1780340521.866046:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340521.866157:0:79975:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960990080 00000100:00100000:2.0:1780340521.866167:0:79975:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960990080 00000100:00100000:2.0:1780340521.866246:0:79975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1780340521.866256:0:79975:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445832850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818960990080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340521.870718:0:79975:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445832850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818960990080:12345-0@lo:400:kworker.0 Request processed in 4447us (4656us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340521.870737:0:79975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1780340521.876272:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818960990208:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.876365:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340521.876407:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818960990720:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.876436:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340521.876454:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a07ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818960991232:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.876498:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340521.876530:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1780340521.876537:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818960990592:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.876561:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340521.876579:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818960991104:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.876599:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340521.876615:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1866818960991616:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.876636:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340521.876667:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818960990336:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.877169:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340521.877329:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960990848:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.877360:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340521.877388:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960991360:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.877409:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340521.877434:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1780340521.877441:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818960990464:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.877465:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340521.877569:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818960990080:0@lo:400:kworker.0 00000100:00100000:2.0:1780340521.879836:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960990848 00000100:00100000:2.0:1780340521.879852:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960990848 00000100:00100000:2.0:1780340521.879913:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960991360 00000100:00100000:2.0:1780340521.879917:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960991360 00000100:00100000:2.0:1780340521.879954:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2302 00000100:00100000:2.0:1780340521.879964:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818960990848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340521.880079:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818960990848:12345-0@lo:400:kworker.0 Request processed in 116us (2717us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340521.880087:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2302 00000100:00100000:2.0:1780340521.880104:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2303 00000100:00100000:2.0:1780340521.880110:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818960991360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340521.880144:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818960991360:12345-0@lo:400:kworker.0 Request processed in 31us (2729us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340521.880151:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2303 00000100:00080000:2.0:1780340521.880172:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340521.880847:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960990976:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.880904:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340521.880928:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a82bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960991488:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.880949:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340521.880978:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960990976 00000100:00100000:3.0:1780340521.880984:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960990976 00000100:00100000:3.0:1780340521.881017:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960991488 00000100:00100000:3.0:1780340521.881020:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960991488 00000100:00100000:3.0:1780340521.881044:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2304 00000100:00100000:3.0:1780340521.881052:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818960990976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340521.881184:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2305 00000100:00100000:2.0:1780340521.881195:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960991488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340521.881249:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960991488:12345-0@lo:400:kworker.0 Request processed in 50us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340521.881264:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2305 00000100:00080000:2.0:1780340521.881293:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340521.881354:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818960990976:12345-0@lo:400:kworker.0 Request processed in 302us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340521.881360:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2304 00000100:00100000:0.0:1780340521.881569:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960990208 00000100:00100000:0.0:1780340521.881575:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960990208 00000100:00100000:0.0:1780340521.881618:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960990592 00000100:00100000:0.0:1780340521.881622:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960990592 00000100:00100000:0.0:1780340521.881638:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960991104 00000100:00100000:0.0:1780340521.881641:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960991104 00000100:00100000:0.0:1780340521.881655:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960991616 00000100:00100000:0.0:1780340521.881658:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960991616 00000100:00100000:0.0:1780340521.881670:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960990336 00000100:00100000:0.0:1780340521.881672:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960990336 00000100:00100000:0.0:1780340521.881695:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960990464 00000100:00100000:0.0:1780340521.881697:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960990464 00000100:00100000:0.0:1780340521.881711:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1780340521.881718:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1866818960990208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340521.881797:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1866818960990208:12345-0@lo:400:kworker.0 Request processed in 79us (5433us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340521.881804:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1780340521.881821:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:0.0:1780340521.881828:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818960990592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340521.881856:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818960990592:12345-0@lo:400:kworker.0 Request processed in 29us (5294us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340521.881862:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:0.0:1780340521.881872:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:0.0:1780340521.881878:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818960991104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340521.881905:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818960991104:12345-0@lo:400:kworker.0 Request processed in 28us (5305us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340521.881911:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:0.0:1780340521.881928:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:0.0:1780340521.881933:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1866818960991616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340521.881957:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1866818960991616:12345-0@lo:400:kworker.0 Request processed in 25us (5321us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340521.881963:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:0.0:1780340521.881973:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:0.0:1780340521.881979:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818960990336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340521.882005:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818960990336:12345-0@lo:400:kworker.0 Request processed in 27us (4838us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340521.882011:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:0.0:1780340521.882021:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1780340521.882026:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818960990464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340521.882083:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818960990464:12345-0@lo:400:kworker.0 Request processed in 52us (4612us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340521.882089:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1780340521.882140:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b4b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818960990592:0@lo:400:kworker.0 00000100:00100000:0.0:1780340521.882154:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818960991104:0@lo:400:kworker.0 00000100:00100000:0.0:1780340521.882164:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a82b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1866818960991616:0@lo:400:kworker.0 00000100:00100000:0.0:1780340521.882186:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818960990208:0@lo:400:kworker.0 00000100:00080000:2.0:1780340521.882602:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340521.882607:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780340521.885453:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a82bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960991488:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.885487:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818960990336:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.885501:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960990848:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.885517:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960991360:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.885559:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818960990464:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.885572:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960990976:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.885882:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960990720 00000100:00100000:3.0:1780340521.885892:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960990720 00000100:00100000:3.0:1780340521.885953:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960991232 00000100:00100000:3.0:1780340521.885956:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960991232 00000100:00100000:3.0:1780340521.885981:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3685 00000100:00100000:3.0:1780340521.885991:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818960990720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.886198:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818960990720:12345-0@lo:400:kworker.0 Request processed in 208us (9760us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340521.886207:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3685 00000100:00100000:3.0:1780340521.886230:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3686 00000100:00100000:3.0:1780340521.886236:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818960991232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.886267:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818960991232:12345-0@lo:400:kworker.0 Request processed in 32us (9769us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340521.886273:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3686 00000100:00100000:3.0:1780340521.886318:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818960990720:0@lo:400:kworker.0 00000100:00100000:3.0:1780340521.886329:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a07ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818960991232:0@lo:400:kworker.0 00000001:02000400:0.0:1780340521.907953:0:80694:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130a: DoM file create (setstripe) replay ========================================================== 15:02:00 (1780340520) 00000100:00100000:3.0:1780340522.031185:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340522.031235:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340522.031363:0:79969:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940371712 00000100:00100000:2.0:1780340522.031394:0:79969:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940371712 00000100:00100000:2.0:1780340522.031472:0:79969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 157 00000100:00100000:2.0:1780340522.031485:0:79969:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445831050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2409:x1866818940371712:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340522.031581:0:79969:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445831050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2409:x1866818940371712:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 92us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340522.031590:0:79969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 157 00000100:00100000:2.0:1780340522.033474:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340522.033517:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340522.033652:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940372224 00000100:00100000:3.0:1780340522.033666:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940372224 00000100:00100000:3.0:1780340522.033852:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2306 00000100:00100000:3.0:1780340522.033864:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940372224:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340522.033951:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940372224:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 89us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340522.033959:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2306 00000100:00080000:3.0:1780340522.036276:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340522.044500:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340522.044540:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940372096 00000100:00100000:2.0:1780340522.044553:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940372096 00000100:00100000:2.0:1780340522.044631:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2307 00000100:00100000:2.0:1780340522.044643:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940372096:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340522.044756:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940372096:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 115us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340522.044788:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2307 00000100:00080000:2.0:1780340522.044816:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340522.050121:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940371968 00000100:00100000:1.0:1780340522.050143:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940371968 00000100:00100000:1.0:1780340522.050256:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940371840 00000100:00100000:1.0:1780340522.050261:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940371840 00000100:00100000:1.0:1780340522.050297:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1017 00000100:00100000:1.0:1780340522.050310:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940371968:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340522.050544:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940371968:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 236us (19307us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340522.050554:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1017 00000100:00100000:1.0:1780340522.050576:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1018 00000100:00100000:1.0:1780340522.050584:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940371840:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340522.050609:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940371840:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 27us (17092us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340522.050615:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1018 00000100:00080000:3.0:1780340522.051858:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780340522.051868:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340522.379795:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340522.379830:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04445b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960991744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340522.379928:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340522.379980:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960991744 00000100:00100000:1.0:1780340522.379989:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960991744 00000100:00100000:1.0:1780340522.380047:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1872 00000100:00100000:1.0:1780340522.380069:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960991744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780340522.380110:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340522.380161:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960991744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340522.380169:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1872 00000100:00100000:1.0:1780340522.380240:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04445b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960991744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340522.380923:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960991872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340522.380972:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340522.381046:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960991872 00000100:00100000:2.0:1780340522.381063:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960991872 00000100:00100000:2.0:1780340522.381109:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1873 00000100:00100000:2.0:1780340522.381119:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818960991872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780340522.381158:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340522.381211:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818960991872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340522.381218:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1873 00000100:00100000:3.0:1780340522.381348:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960991872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1780340522.836503:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340522.890086:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960992000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340522.890215:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340522.891876:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960992000 00000100:00100000:2.0:1780340522.891892:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960992000 00000100:00100000:2.0:1780340522.891963:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3687 00000100:00100000:2.0:1780340522.891973:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818960992000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780340522.892021:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:2.0:1780340522.892126:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818960992000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 153us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340522.892135:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3687 00000100:00100000:0.0:1780340522.895557:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960992000:0@lo:41:osp-pre-0-1.0 00000001:00080000:3.0:1780340523.264261:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969448 is committed 00000100:00100000:0.0:1780340523.369795:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340523.371628:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940372352 00000100:00100000:1.0:1780340523.371639:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940372352 00000100:00100000:1.0:1780340523.371703:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1015 00000100:00100000:1.0:1780340523.371715:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:64235:x1866818940372352:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1780340523.371733:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340523.371754:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763800/0xa24651432773140 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced21f4 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340523.374149:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762a00/0xa24651432773147 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340523.374174:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762a00/0xa24651432773147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340523.374196:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762a00/0xa24651432773147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340523.374238:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1780340523.374242:0:63711:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:1.0:1780340523.374328:0:63711:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762a00/0xa24651432773147 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340523.374358:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763800/0xa24651432773140 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21f4 expref: 7 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340523.374373:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762a00/0xa24651432773147 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21f4 expref: 6 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340523.374382:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04506cf700) 00010000:00010000:1.0:1780340523.374385:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1780340523.374388:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0476762a00, rc 0) 00000100:00100000:1.0:1780340523.374450:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64235:x1866818940372352:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 2738us (4692us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340523.374458:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1015 00000100:00100000:1.0:1780340523.395273:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340523.395469:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940372480 00000100:00100000:0.0:1780340523.395478:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940372480 00000100:00100000:0.0:1780340523.395529:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1016 00000100:00100000:0.0:1780340523.395538:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64235:x1866818940372480:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:0.0:1780340523.395573:0:63710:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:0.0:1780340523.395636:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64235:x1866818940372480:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 99us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340523.395644:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1016 00000100:00100000:0.0:1780340523.409980:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340523.410039:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940372608 00000100:00100000:3.0:1780340523.410048:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940372608 00000100:00100000:3.0:1780340523.410097:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1017 00000100:00100000:3.0:1780340523.410107:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64235:x1866818940372608:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:3.0:1780340523.410141:0:63712:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:3.0:1780340523.410209:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64235:x1866818940372608:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 103us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340523.410217:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1017 00000100:00100000:2.0:1780340523.422651:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340523.422915:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940372736 00000100:00100000:1.0:1780340523.422924:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940372736 00000100:00100000:1.0:1780340523.422968:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1874 00000100:00100000:1.0:1780340523.422976:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:64235:x1866818940372736:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:1.0:1780340523.423000:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340523.423433:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a127480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:64235:x1866818940372736:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 456us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340523.423451:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1874 00000100:00100000:1.0:1780340523.433587:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340523.433651:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940372864 00000100:00100000:2.0:1780340523.433679:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940372864 00000100:00100000:2.0:1780340523.433736:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1875 00000100:00100000:2.0:1780340523.433747:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04445b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:64235:x1866818940372864:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:2.0:1780340523.433795:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340523.433858:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04445b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:64235:x1866818940372864:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 113us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340523.433866:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1875 00000100:00100000:3.0:1780340523.499662:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340523.500268:0:63720:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940372992 00000100:00100000:3.0:1780340523.500280:0:63720:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940372992 00000100:00100000:3.0:1780340523.500340:0:63720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:3.0:1780340523.500349:0:63720:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64242:x1866818940372992:12345-192.168.203.16@tcp:700:mcreate.0 00000100:00100000:3.0:1780340523.500444:0:63720:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64242:x1866818940372992:12345-192.168.203.16@tcp:700:mcreate.0 Request processed in 96us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340523.500453:0:63720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:3.0:1780340523.502741:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340523.502792:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940373248 00000100:00100000:3.0:1780340523.502801:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940373248 00000100:00100000:3.0:1780340523.502846:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1018 00000100:00100000:3.0:1780340523.502855:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64242:x1866818940373248:12345-192.168.203.16@tcp:36:mcreate.0 00010000:00010000:3.0:1780340523.502907:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340523.502931:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762a00/0xa24651432773147 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21f4 expref: 6 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.502965:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04506cf700) 00010000:00010000:3.0:1780340523.502976:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340523.503033:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277314e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.503146:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277314e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.503158:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277314e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.503181:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773155 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.503189:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773155 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.503195:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773155 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.503627:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277314e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.503636:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277314e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.503642:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277314e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.503648:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277314e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.503664:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340523.504772:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277314e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.504788:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277314e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.504802:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c046b231700) 00010000:00010000:3.0:1780340523.504806:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340523.504810:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277314e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.504816:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277314e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340523.504836:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000093772ef6 reply state 000000006472060a transno 94489280514 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773155 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.504847:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773155 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.504854:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c046b231100) 00010000:00010000:3.0:1780340523.504856:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340523.504859:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780340523.504960:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:64242:x1866818940373248:12345-192.168.203.16@tcp:36:mcreate.0 Request processed in 2103us (2222us total) trans 94489280514 rc 0/0 00000100:00100000:3.0:1780340523.504968:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1018 00000100:00100000:3.0:1780340523.526282:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340523.526424:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940373376 00000100:00100000:1.0:1780340523.526435:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940373376 00000100:00100000:1.0:1780340523.526493:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1019 00000100:00100000:1.0:1780340523.526503:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:64245:x1866818940373376:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:1.0:1780340523.526527:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340523.526549:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277315c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced21fb expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340523.526611:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773163 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340523.526625:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340523.526636:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340523.526691:0:70100:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1780340523.526695:0:70100:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:1.0:1780340523.526714:0:70100:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340523.526737:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277315c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21fb expref: 9 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340523.526752:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773163 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21fb expref: 8 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340523.526816:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04506cff00) 00010000:00010000:1.0:1780340523.526819:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1780340523.526823:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0476763c00, rc 0) 00000100:00100000:1.0:1780340523.526881:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:64245:x1866818940373376:12345-192.168.203.16@tcp:101:rm.0 Request processed in 379us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340523.526888:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1019 00000100:00100000:3.0:1780340523.530120:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340523.530176:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940373504 00000100:00100000:0.0:1780340523.530186:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940373504 00000100:00100000:0.0:1780340523.530234:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1020 00000100:00100000:0.0:1780340523.530245:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:64245:x1866818940373504:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:0.0:1780340523.530275:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340523.530291:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa2465143277316a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2202 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530342:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432773171 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530352:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432773171 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530359:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432773171 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530365:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773178 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530370:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773178 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530373:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773178 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530562:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa2465143277317f lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530568:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa2465143277317f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530572:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa2465143277317f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340523.530606:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x1:0x0]: returning size 0 00000004:00200000:0.0:1780340523.530615:0:64454:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1780340523.530639:0:64454:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa2465143277317f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530650:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa2465143277317f lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530657:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432773171 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530661:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432773171 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530665:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432773171 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530669:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432773171 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530673:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440030200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340523.530675:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432773171 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530680:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432773171 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530739:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04506cff00) 00010000:00010000:0.0:1780340523.530743:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340523.530747:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432773171 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530753:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432773171 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530836:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773178 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530842:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773178 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530848:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773178 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530854:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340523.530857:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773178 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530863:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773178 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530872:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c046b231100) 00010000:00010000:0.0:1780340523.530874:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340523.530878:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773178 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530883:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773178 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530903:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa2465143277316a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2202 expref: 10 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530911:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa2465143277317f lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2202 expref: 9 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340523.530923:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff8c045a897400) 00010000:00010000:0.0:1780340523.530924:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780340523.530926:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440031600, rc 0) 00000100:00100000:2.0:1780340523.531013:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:64245:x1866818940373504:12345-192.168.203.16@tcp:101:rm.0 Request processed in 769us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340523.531022:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1020 00000100:00100000:2.0:1780340523.534983:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340523.535083:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940373760 00000100:00100000:3.0:1780340523.535106:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940373760 00000100:00100000:3.0:1780340523.535214:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1021 00000100:00100000:3.0:1780340523.535224:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:64245:x1866818940373760:12345-192.168.203.16@tcp:36:rm.0 00010000:00010000:3.0:1780340523.535276:0:63710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1780340523.535305:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa2465143277317f lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2202 expref: 9 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535324:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff8c045a897400) 00010000:00010000:3.0:1780340523.535340:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773163 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21fb expref: 8 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535348:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04506cff00) 00010000:00010000:3.0:1780340523.535354:0:63710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340523.535374:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773186 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535386:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773186 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535395:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773186 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535406:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277318d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535413:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277318d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535419:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277318d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535503:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773194 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535511:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773194 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535518:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773194 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535715:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5e00/0xa2465143277319b lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535724:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5e00/0xa2465143277319b lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535732:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5e00/0xa2465143277319b lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535740:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5e00/0xa2465143277319b lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535746:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5e00/0xa2465143277319b lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535752:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5e00/0xa2465143277319b lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535890:0:63710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340523.535911:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773194 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535918:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773194 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535935:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773194 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535941:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340523.535944:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773194 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535952:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773194 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535961:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff8c046b231c00) 00010000:00010000:3.0:1780340523.535964:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1780340523.535967:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773194 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535973:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773194 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535992:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773186 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.535998:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773186 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.536003:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773186 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.536009:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773186 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.536013:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340523.536022:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773186 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.536029:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773186 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.536037:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c046b231700) 00010000:00010000:3.0:1780340523.536039:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340523.536042:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773186 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.536048:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773186 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340523.536063:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a9f19615 reply state 00000000a8782158 transno 94489280515 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277318d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.536073:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277318d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340523.536080:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c046b231100) 00010000:00010000:3.0:1780340523.536082:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340523.536085:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780340523.536155:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:64245:x1866818940373760:12345-192.168.203.16@tcp:36:rm.0 Request processed in 932us (1180us total) trans 94489280515 rc 0/0 00000100:00100000:3.0:1780340523.536172:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1021 00010000:00010000:2.0:1780340523.537825:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340523.537845:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5e00/0xa2465143277319b lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340523.537854:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340523.537858:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5e00/0xa2465143277319b lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340523.537867:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5e00/0xa2465143277319b lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340523.537881:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff8c046b231c00) 00010000:00010000:2.0:1780340523.537884:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1780340523.537887:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5e00/0xa2465143277319b lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340523.537893:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5e00/0xa2465143277319b lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340523.538041:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340523.538097:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340523.538100:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340523.859866:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340524.875165:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340524.938407:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340524.938427:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818960992128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340524.938493:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340524.938539:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960992128 00000100:00100000:2.0:1780340524.938547:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960992128 00000100:00100000:2.0:1780340524.938605:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3688 00000100:00100000:2.0:1780340524.938614:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818960992128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340524.938649:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:2.0:1780340524.938712:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a125f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818960992128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340524.938721:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3688 00000100:00100000:2.0:1780340524.938790:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818960992128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340525.451615:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340525.451636:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960992256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340525.451708:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340525.451839:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960992256 00000100:00100000:2.0:1780340525.451846:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960992256 00000100:00100000:2.0:1780340525.451912:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1876 00000100:00100000:2.0:1780340525.451921:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960992256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340525.451957:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340525.452000:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960992256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340525.452007:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1876 00000100:00100000:2.0:1780340525.452025:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780340525.452033:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960992384:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340525.452058:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1780340525.452079:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340525.452087:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960992384 00000100:00100000:2.0:1780340525.452091:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960992384 00000100:00100000:2.0:1780340525.452116:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1877 00000100:00100000:2.0:1780340525.452122:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818960992384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340525.452136:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340525.452178:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818960992384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340525.452183:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1877 00000100:00100000:2.0:1780340525.452221:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960992256:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1780340525.452242:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340525.452271:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960992384:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1780340525.898305:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340526.921954:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340526.986013:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818960992896:0@lo:400:kworker.0 00000100:00100000:2.0:1780340526.986079:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340526.986109:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960993408:0@lo:400:kworker.0 00000100:00100000:2.0:1780340526.986133:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340526.986162:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960993920:0@lo:400:kworker.0 00000100:00100000:2.0:1780340526.986182:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340526.986205:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1780340526.986211:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818960992512:0@lo:400:kworker.0 00000100:00100000:2.0:1780340526.986237:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340526.986262:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818960993024:0@lo:400:kworker.0 00000100:00100000:2.0:1780340526.986283:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340526.986299:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818960993536:0@lo:400:kworker.0 00000100:00100000:2.0:1780340526.986320:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340526.986337:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818960994048:0@lo:400:kworker.0 00000100:00100000:2.0:1780340526.986355:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340526.986380:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818960992640:0@lo:400:kworker.0 00000100:00100000:2.0:1780340526.986430:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340526.986451:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960993152:0@lo:400:kworker.0 00000100:00100000:2.0:1780340526.986475:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340526.986492:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960993664:0@lo:400:kworker.0 00000100:00100000:2.0:1780340526.986510:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340526.986529:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1780340526.986534:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818960992768:0@lo:400:kworker.0 00000100:00100000:2.0:1780340526.986576:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340526.986589:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960993280:0@lo:400:kworker.0 00000100:00100000:2.0:1780340526.986814:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340526.986835:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960993792:0@lo:400:kworker.0 00000100:00100000:2.0:1780340526.986857:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340526.986891:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960992896 00000100:00100000:2.0:1780340526.986898:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960992896 00000100:00100000:2.0:1780340526.986943:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960993024 00000100:00100000:2.0:1780340526.986946:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960993024 00000100:00100000:2.0:1780340526.986960:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960993536 00000100:00100000:2.0:1780340526.986962:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960993536 00000100:00100000:2.0:1780340526.986974:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960994048 00000100:00100000:2.0:1780340526.986977:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960994048 00000100:00100000:2.0:1780340526.986987:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960992640 00000100:00100000:2.0:1780340526.986989:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960992640 00000100:00100000:2.0:1780340526.987002:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960992768 00000100:00100000:2.0:1780340526.987005:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960992768 00000100:00100000:2.0:1780340526.987019:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1780340526.987028:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818960992896:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340526.987050:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047207d880 x1866818960992896/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:707/0 lens 224/224 e 0 to 0 dl 1780340537 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340526.987089:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818960992896:12345-0@lo:400:kworker.0 Request processed in 63us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340526.987096:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1780340526.987113:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1780340526.987120:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818960993024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340526.987157:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818960993024:12345-0@lo:400:kworker.0 Request processed in 38us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340526.987173:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1780340526.987186:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1780340526.987192:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818960993536:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340526.987202:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04467fe300 x1866818960993536/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:707/0 lens 224/224 e 0 to 0 dl 1780340537 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340526.987227:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818960993536:12345-0@lo:400:kworker.0 Request processed in 37us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340526.987233:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1780340526.987246:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:2.0:1780340526.987252:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818960994048:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340526.987262:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04467fe680 x1866818960994048/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:707/0 lens 224/224 e 0 to 0 dl 1780340537 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340526.987285:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818960994048:12345-0@lo:400:kworker.0 Request processed in 35us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340526.987290:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:2.0:1780340526.987302:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1780340526.987308:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818960992640:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340526.987317:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c034d875500 x1866818960992640/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:707/0 lens 224/224 e 0 to 0 dl 1780340537 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340526.987345:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818960992640:12345-0@lo:400:kworker.0 Request processed in 38us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340526.987351:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1780340526.987362:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1780340526.987368:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818960992768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340526.987415:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818960992768:12345-0@lo:400:kworker.0 Request processed in 47us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340526.987421:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1780340526.987439:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960993408 00000100:00100000:2.0:1780340526.987443:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960993408 00000100:00100000:2.0:1780340526.987465:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960993920 00000100:00100000:2.0:1780340526.987468:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960993920 00000100:00100000:2.0:1780340526.987485:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960993280 00000100:00100000:2.0:1780340526.987488:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960993280 00000100:00100000:2.0:1780340526.987500:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960993792 00000100:00100000:2.0:1780340526.987503:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960993792 00000100:00100000:2.0:1780340526.987519:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2308 00000100:00100000:2.0:1780340526.987525:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818960993408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340526.987551:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818960993408:12345-0@lo:400:kworker.0 Request processed in 26us (1416us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340526.987557:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2308 00000100:00100000:2.0:1780340526.987566:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2309 00000100:00100000:2.0:1780340526.987571:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960993920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340526.987593:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960993920:12345-0@lo:400:kworker.0 Request processed in 22us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340526.987599:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2309 00000100:00100000:3.0:1780340526.991952:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2310 00000100:00100000:3.0:1780340526.991971:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960993280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340526.992054:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960993280:12345-0@lo:400:kworker.0 Request processed in 92us (5239us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340526.992062:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2310 00000100:00100000:3.0:1780340526.992098:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2311 00000100:00100000:3.0:1780340526.992106:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960993792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340526.992136:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960993792:12345-0@lo:400:kworker.0 Request processed in 32us (5278us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340526.992153:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2311 00000100:00100000:3.0:1780340526.992174:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960993152 00000100:00100000:3.0:1780340526.992180:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960993152 00000100:00100000:3.0:1780340526.992219:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960993664 00000100:00100000:3.0:1780340526.992222:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960993664 00000100:00100000:3.0:1780340526.992240:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3689 00000100:00100000:3.0:1780340526.992245:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818960993152:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1780340526.992260:0:22660:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c034d877800 x1866818960993152/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:707/0 lens 224/224 e 0 to 0 dl 1780340537 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340526.992289:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818960993152:12345-0@lo:400:kworker.0 Request processed in 43us (5813us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340526.992295:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3689 00000100:00100000:3.0:1780340526.992308:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3690 00000100:00100000:3.0:1780340526.992314:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960993664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340526.992339:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960993664:12345-0@lo:400:kworker.0 Request processed in 25us (5827us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340526.992344:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3690 00000100:00100000:3.0:1780340526.992379:0:79971:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960992512 00000100:00100000:3.0:1780340526.992383:0:79971:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960992512 00000100:00100000:3.0:1780340526.992406:0:79971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1780340526.992411:0:79971:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445830c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818960992512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340526.992440:0:79971:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445830c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818960992512:12345-0@lo:400:kworker.0 Request processed in 29us (6202us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340526.992452:0:79971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1780340526.992527:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818960992768:0@lo:400:kworker.0 00000100:00100000:3.0:1780340526.992539:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960993280:0@lo:400:kworker.0 00000100:00100000:3.0:1780340526.992548:0:3659:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 2 00000004:00080000:3.0:1780340526.992553:0:3659:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c04587a7800, transno 4294969448 00000100:00100000:3.0:1780340526.992576:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960993792:0@lo:400:kworker.0 00000100:00100000:3.0:1780340526.992587:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818960992640:0@lo:400:kworker.0 00000100:00100000:3.0:1780340526.992596:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960993152:0@lo:400:kworker.0 00000100:00100000:3.0:1780340526.993518:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960993664:0@lo:400:kworker.0 00000100:00100000:3.0:1780340526.993582:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818960992512:0@lo:400:kworker.0 00000100:00100000:3.0:1780340526.993594:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818960993024:0@lo:400:kworker.0 00000100:00100000:3.0:1780340526.993613:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818960993536:0@lo:400:kworker.0 00000100:00100000:3.0:1780340526.993625:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818960994048:0@lo:400:kworker.0 00000100:00100000:3.0:1780340526.993634:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818960992896:0@lo:400:kworker.0 00000100:00100000:3.0:1780340526.993645:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960993408:0@lo:400:kworker.0 00000100:00100000:3.0:1780340526.993654:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960993920:0@lo:400:kworker.0 00000100:00080000:2.0:1780340526.994260:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340526.994266:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340526.994269:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340526.994272:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780340527.148739:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340527.149995:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940374016 00000100:00100000:1.0:1780340527.150008:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940374016 00000100:00100000:1.0:1780340527.151105:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1025 00000100:00100000:1.0:1780340527.151117:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:2408:x1866818940374016:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000080:1.0:1780340527.151159:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0348a68e00 x1866818940374016/t0(0) o400->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:708/0 lens 224/224 e 0 to 0 dl 1780340538 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340527.151220:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:2408:x1866818940374016:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 106us (2488us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340527.151227:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1025 00000100:00080000:3.0:1780340527.157245:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780340527.157318:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340527.160283:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340527.160310:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340527.160343:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340527.160372:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940374144 00000100:00100000:3.0:1780340527.160382:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940374144 00000100:00100000:3.0:1780340527.160441:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1026 00000100:00100000:3.0:1780340527.160451:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940374144:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340527.160520:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940374144:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 71us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340527.160527:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1026 00000100:00100000:3.0:1780340527.160552:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940374400 00000100:00100000:3.0:1780340527.160570:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940374400 00000100:00100000:3.0:1780340527.160609:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940374272 00000100:00100000:3.0:1780340527.160613:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940374272 00000100:00100000:3.0:1780340527.160636:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2312 00000100:00100000:3.0:1780340527.160642:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940374400:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340527.161413:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940374400:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 767us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340527.161422:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2312 00000100:00100000:3.0:1780340527.161442:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2313 00000100:00100000:3.0:1780340527.161450:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940374272:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340527.161475:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940374272:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 27us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340527.161482:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2313 00000100:00080000:3.0:1780340527.163377:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340527.163386:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340527.163394:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340527.165987:0:79970:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940373888 00000100:00100000:1.0:1780340527.166010:0:79970:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940373888 00000100:00100000:1.0:1780340527.166069:0:79970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 159 00000100:00100000:1.0:1780340527.166089:0:79970:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445832050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940373888:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340527.166172:0:79970:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445832050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940373888:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 95us (8858us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340527.166185:0:79970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 159 00000100:00100000:3.0:1780340527.503481:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960994176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340527.503987:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340527.504292:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818960994304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340527.504325:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340527.504407:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960994176 00000100:00100000:1.0:1780340527.504416:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960994176 00000100:00100000:1.0:1780340527.504466:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960994304 00000100:00100000:1.0:1780340527.504470:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960994304 00000100:00100000:1.0:1780340527.504495:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1878 00000100:00100000:1.0:1780340527.504504:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960994176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780340527.504536:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340527.504595:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960994176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340527.504602:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1878 00000100:00100000:1.0:1780340527.504617:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1879 00000100:00100000:1.0:1780340527.504623:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818960994304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780340527.504636:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340527.504794:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818960994304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340527.504810:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1879 00000100:00100000:3.0:1780340527.505019:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818960994304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340527.505054:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960994176:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1780340527.947521:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340528.020944:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960994432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340528.021015:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340528.021084:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960994432 00000100:00100000:1.0:1780340528.021091:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960994432 00000100:00100000:1.0:1780340528.021148:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3691 00000100:00100000:1.0:1780340528.021158:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818960994432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780340528.021199:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00010000:00000080:1.0:1780340528.021227:0:22660:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047b36ca80 x1866818960994432/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:709/0 lens 224/368 e 0 to 0 dl 1780340539 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340528.021367:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818960994432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 211us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340528.021375:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3691 00000100:00100000:2.0:1780340528.022205:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960994432:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1780340528.971004:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1780340529.698997:0:79964:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280515 is committed 00010000:00010000:0.0:1780340529.699086:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773155 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340529.699099:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773155 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340529.699106:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773155 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340529.699113:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340529.699125:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773155 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340529.699132:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773155 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340529.699150:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c046b231100) 00010000:00010000:0.0:1780340529.699153:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340529.699158:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773155 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340529.699164:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773155 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340529.699182:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277318d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340529.699193:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277318d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340529.699198:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277318d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340529.699202:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340529.699205:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277318d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340529.699210:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277318d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340529.699217:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c046b231100) 00010000:00010000:0.0:1780340529.699220:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340529.699223:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277318d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340529.699228:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277318d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340529.995484:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340530.060323:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780340530.060344:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960994560:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340530.060408:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340530.060735:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960994560 00000100:00100000:3.0:1780340530.060743:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960994560 00000100:00100000:3.0:1780340530.060803:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3692 00000100:00100000:3.0:1780340530.060812:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960994560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780340530.060844:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:3.0:1780340530.060891:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960994560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340530.060898:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3692 00000100:00100000:3.0:1780340530.060945:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960994560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340530.574595:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960994688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340530.574658:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340530.574719:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960994688 00000100:00100000:1.0:1780340530.574726:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960994688 00000100:00100000:1.0:1780340530.574793:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1880 00000100:00100000:1.0:1780340530.574802:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048584f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960994688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340530.574827:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340530.574870:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048584f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960994688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340530.574877:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1880 00000100:00080000:1.0:1780340530.574897:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340530.574932:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960994688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340530.575838:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340530.575849:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960994816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340530.575892:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340530.575926:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960994816 00000100:00100000:0.0:1780340530.575931:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960994816 00000100:00100000:0.0:1780340530.575973:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1881 00000100:00100000:0.0:1780340530.575981:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960994816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340530.576001:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340530.576048:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960994816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340530.576056:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1881 00000100:00080000:0.0:1780340530.576075:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340530.576101:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960994816:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1780340530.913950:0:81089:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00010000:00010000:0.0:1780340531.025573:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340531.075096:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340531.075168:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940374528 00000100:00100000:3.0:1780340531.075177:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940374528 00000100:00100000:3.0:1780340531.075239:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1022 00000100:00100000:3.0:1780340531.075249:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:64312:x1866818940374528:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1780340531.075276:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340531.075295:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa246514327731a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2209 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340531.075364:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa246514327731a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340531.075378:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa246514327731a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340531.075389:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa246514327731a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340531.075426:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1780340531.075429:0:63711:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1780340531.075446:0:63711:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa246514327731a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340531.075465:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa246514327731a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2209 expref: 7 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340531.075480:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa246514327731a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2209 expref: 6 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340531.075488:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0347c16a00) 00010000:00010000:3.0:1780340531.075491:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1780340531.075494:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4600, rc 0) 00010000:00000080:3.0:1780340531.075501:0:63711:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0446b65500 x1866818940374528/t0(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:712/0 lens 576/688 e 0 to 0 dl 1780340542 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340531.075551:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64312:x1866818940374528:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 304us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340531.075558:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1022 00000100:00080000:0.0:1780340531.076886:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780340531.082957:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340531.083017:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940374656 00000100:00100000:1.0:1780340531.083027:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940374656 00000100:00100000:1.0:1780340531.083083:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1023 00000100:00100000:1.0:1780340531.083094:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64312:x1866818940374656:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1780340531.083123:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340531.083143:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763a00/0xa246514327731b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2210 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083207:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762c00/0xa246514327731b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083229:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762c00/0xa246514327731b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083241:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762c00/0xa246514327731b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083268:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083275:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083280:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083321:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762c00/0xa246514327731b7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083328:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762c00/0xa246514327731b7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083334:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762c00/0xa246514327731b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083342:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762c00/0xa246514327731b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083348:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340531.083352:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762c00/0xa246514327731b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083359:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762c00/0xa246514327731b7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083377:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0347c16a00) 00010000:00010000:1.0:1780340531.083380:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340531.083385:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762c00/0xa246514327731b7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083392:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762c00/0xa246514327731b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083404:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083409:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083415:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083421:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340531.083424:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083430:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083437:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8c04506cfd00) 00010000:00010000:1.0:1780340531.083439:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340531.083441:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083447:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083488:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763a00/0xa246514327731b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2210 expref: 7 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083499:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0347c16a00) 00010000:00010000:1.0:1780340531.083501:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340531.083504:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763a00/0xa246514327731b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2210 expref: 7 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.083513:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0476763a00, rc 0) 00010000:00000080:1.0:1780340531.083521:0:63710:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047a82bb80 x1866818940374656/t0(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:712/0 lens 592/584 e 0 to 0 dl 1780340542 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340531.083582:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64312:x1866818940374656:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 490us (634us total) trans 0 rc 301/301 00000100:00100000:1.0:1780340531.083590:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1023 00000100:00100000:0.0:1780340531.103457:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340531.103513:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940374912 00000100:00100000:2.0:1780340531.103522:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940374912 00000100:00100000:2.0:1780340531.103572:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1024 00000100:00100000:2.0:1780340531.103581:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64312:x1866818940374912:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1780340531.103598:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340531.103601:0:64454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1780340531.103622:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa246514327731a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2209 expref: 6 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.103638:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0347c16a00) 00010000:00010000:2.0:1780340531.103648:0:64454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340531.103661:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7a00/0xa246514327731c5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2217 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.103774:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa246514327731cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.103786:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa246514327731cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.103794:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa246514327731cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.103805:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa246514327731d3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.103822:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa246514327731d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.103828:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa246514327731d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.104173:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa246514327731da lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.104183:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa246514327731da lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.104191:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa246514327731da lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340531.104199:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00010000:00010000:2.0:1780340531.104218:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa246514327731cc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.104225:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa246514327731cc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.104231:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa246514327731cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.104237:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa246514327731cc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.104242:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340531.104246:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa246514327731cc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.104272:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa246514327731cc lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.104280:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455e5c000) 00010000:00010000:2.0:1780340531.104283:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340531.104286:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa246514327731cc lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.104292:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa246514327731cc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340531.104302:0:64454:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000209b3792 reply state 00000000b8a6722b transno 94489280516 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa246514327731d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.104311:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa246514327731d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.104316:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8c0455e5c400) 00010000:00010000:2.0:1780340531.104319:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340531.104321:0:64454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1780340531.104341:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7a00/0xa246514327731c5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2217 expref: 8 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.104355:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa246514327731da lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2217 expref: 7 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340531.104362:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff8c0455e5c500) 00010000:00010000:2.0:1780340531.104364:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340531.104366:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7600, rc 0) 00010000:00000080:2.0:1780340531.104373:0:64454:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047a82b100 x1866818940374912/t94489280516(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:712/0 lens 536/608 e 0 to 0 dl 1780340542 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340531.104442:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:64312:x1866818940374912:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 862us (993us total) trans 94489280516 rc 0/0 00000100:00100000:2.0:1780340531.104449:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1024 00000100:00100000:0.0:1780340531.110230:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340531.110428:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940375168 00000100:00100000:1.0:1780340531.110437:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940375168 00000100:00100000:1.0:1780340531.110506:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1025 00000100:00100000:1.0:1780340531.110517:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:64312:x1866818940375168:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1780340531.110540:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340531.110560:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763a00/0xa246514327731e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced221e expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.110684:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731ef lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.110698:0:63712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa246514327731da lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2217 expref: 9 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.110720:0:63712:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731ef lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.110752:0:63712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa246514327731da lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2217 expref: 9 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.110806:0:63712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa246514327731da lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2217 expref: 9 pid: 64454 timeout: 3411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340531.110819:0:63712:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048584c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:63712:1866818960994944:192.168.203.16@tcp:104: 00000100:00100000:1.0:1780340531.110888:0:63712:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04754c2600 going to sleep for 11 seconds 00000100:00100000:1.0:1780340531.116930:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340531.116970:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940375296 00000100:00100000:1.0:1780340531.116979:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940375296 00010000:00010000:1.0:1780340531.117028:0:25498:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa246514327731da lrc: 5/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2217 expref: 10 pid: 64454 timeout: 3411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340531.117062:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2537 00000100:00100000:1.0:1780340531.117071:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048584dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2408:x1866818940375296:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780340531.117086:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340531.117092:0:25498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa246514327731da lrc: 5/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2217 expref: 10 pid: 64454 timeout: 3411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.117105:0:25498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa246514327731da lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2217 expref: 10 pid: 64454 timeout: 3411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.117159:0:25498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff8c0455e5c500) 00010000:00010000:1.0:1780340531.117164:0:25498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731ef lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.117173:0:25498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731ef lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.117182:0:25498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731ef lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340531.117200:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340531.117245:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048584dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2408:x1866818940375296:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 174us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340531.117253:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2537 00010000:00010000:3.0:1780340531.117379:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa246514327731da lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2217 expref: 10 pid: 64454 timeout: 3411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340531.117397:0:63712:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048584c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:63712:1866818960994944:192.168.203.16@tcp:104: 00010000:00010000:3.0:1780340531.117414:0:63712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731ef lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340531.117422:0:63712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731ef lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340531.117428:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731ef lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340531.117445:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00010000:00010000:3.0:1780340531.117621:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731ef lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340531.117792:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731ef lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340531.117799:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731ef lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340531.117805:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340531.117809:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731ef lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340531.117816:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731ef lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340531.117825:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff8c0455e5c500) 00010000:00010000:3.0:1780340531.117834:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780340531.117838:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731ef lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340531.117844:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762400/0xa246514327731ef lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340531.117893:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763a00/0xa246514327731e8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced221e expref: 9 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340531.117902:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04506cfd00) 00010000:00010000:3.0:1780340531.117904:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1780340531.117908:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763a00/0xa246514327731e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced221e expref: 9 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340531.117919:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0476763a00, rc 0) 00010000:00000080:3.0:1780340531.117926:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0349956a00 x1866818940375168/t94489280517(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:712/0 lens 712/824 e 0 to 0 dl 1780340542 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340531.117959:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:64312:x1866818940375168:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 7445us (7738us total) trans 94489280517 rc 301/301 00000100:00100000:3.0:1780340531.117965:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1025 00000100:00100000:0.0:1780340531.124479:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340531.124796:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940375552 00000100:00100000:2.0:1780340531.124808:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940375552 00000100:00100000:2.0:1780340531.124862:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 215 00000100:00100000:2.0:1780340531.124872:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:64312:x1866818940375552:12345-192.168.203.16@tcp:35:lfs.0 00010000:00000080:2.0:1780340531.125053:0:77826:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0349957800 x1866818940375552/t94489280518(0) o35->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:712/0 lens 392/456 e 0 to 0 dl 1780340542 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340531.125123:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:64312:x1866818940375552:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 252us (650us total) trans 94489280518 rc 0/0 00000100:00100000:2.0:1780340531.125130:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 215 00000100:00100000:0.0:1780340531.130630:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340531.130709:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940375808 00000100:00100000:3.0:1780340531.130720:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940375808 00000100:00100000:3.0:1780340531.130799:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 216 00000100:00100000:3.0:1780340531.130809:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:64312:x1866818940375808:12345-192.168.203.16@tcp:35:lfs.0 00010000:00000080:3.0:1780340531.130974:0:63713:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046b4b8000 x1866818940375808/t94489280519(0) o35->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:712/0 lens 392/456 e 0 to 0 dl 1780340542 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340531.131043:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:64312:x1866818940375808:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 236us (436us total) trans 94489280519 rc 0/0 00000100:00100000:3.0:1780340531.131061:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 216 00010000:00010000:3.0:1780340532.044385:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340532.106324:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818960995456:0@lo:400:kworker.0 00000100:00100000:0.0:1780340532.106492:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818960995328:0@lo:400:kworker.0 00000100:00100000:0.0:1780340532.106551:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340532.106594:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960995840:0@lo:400:kworker.0 00000100:00100000:0.0:1780340532.106621:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340532.106642:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960996352:0@lo:400:kworker.0 00000100:00100000:0.0:1780340532.106665:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340532.106713:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960995328 00000100:00100000:0.0:1780340532.106722:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960995328 00000100:00100000:0.0:1780340532.106827:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:0.0:1780340532.106840:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818960995328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340532.106899:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818960995328:12345-0@lo:400:kworker.0 Request processed in 63us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340532.106907:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00080000:0.0:1780340532.106939:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340532.106973:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818960995328:0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.107140:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818960995200:0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.107175:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340532.107201:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960995712:0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.107227:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340532.107246:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a07ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818960996224:0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.107267:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340532.107286:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1780340532.107291:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818960995072:0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.107318:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340532.107342:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818960995584:0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.107363:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340532.107393:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818960996096:0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.107425:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340532.107444:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818960996608:0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.107464:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340532.107491:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960995712 00000100:00100000:1.0:1780340532.107495:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960995712 00000100:00100000:1.0:1780340532.107525:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960996224 00000100:00100000:1.0:1780340532.107529:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960996224 00000100:00100000:1.0:1780340532.107550:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3693 00000100:00100000:1.0:1780340532.107556:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048584df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818960995712:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780340532.107577:0:22660:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c048584df80 x1866818960995712/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:713/0 lens 224/224 e 0 to 0 dl 1780340543 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340532.107611:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048584df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818960995712:12345-0@lo:400:kworker.0 Request processed in 55us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340532.107618:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3693 00000100:00100000:1.0:1780340532.107631:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3694 00000100:00100000:1.0:1780340532.107636:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048584c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818960996224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.107663:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048584c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818960996224:12345-0@lo:400:kworker.0 Request processed in 27us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340532.107669:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3694 00000100:00100000:1.0:1780340532.107699:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960995712:0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.107708:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a07ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818960996224:0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.107790:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960995200 00000100:00100000:1.0:1780340532.107794:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960995200 00000100:00100000:1.0:1780340532.107820:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960995584 00000100:00100000:1.0:1780340532.107823:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960995584 00000100:00100000:1.0:1780340532.107838:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960996096 00000100:00100000:1.0:1780340532.107848:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960996096 00000100:00100000:1.0:1780340532.107863:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960996608 00000100:00100000:1.0:1780340532.107866:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960996608 00000100:00100000:1.0:1780340532.107879:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:1.0:1780340532.107885:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048584ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818960995200:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780340532.107897:0:63710:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c048584ea00 x1866818960995200/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:713/0 lens 224/224 e 0 to 0 dl 1780340543 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340532.107933:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048584ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818960995200:12345-0@lo:400:kworker.0 Request processed in 48us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340532.107940:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:1.0:1780340532.107951:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1780340532.107957:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818960995584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.107982:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818960995584:12345-0@lo:400:kworker.0 Request processed in 26us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340532.107988:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1780340532.107998:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:1.0:1780340532.108004:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818960996096:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780340532.108013:0:63710:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046ba2fb80 x1866818960996096/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:713/0 lens 224/224 e 0 to 0 dl 1780340543 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340532.108035:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818960996096:12345-0@lo:400:kworker.0 Request processed in 32us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340532.108042:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:1.0:1780340532.108052:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:1.0:1780340532.108057:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818960996608:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780340532.108067:0:63710:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046ba2c380 x1866818960996608/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:713/0 lens 224/224 e 0 to 0 dl 1780340543 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340532.108116:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818960996608:12345-0@lo:400:kworker.0 Request processed in 59us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340532.108122:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:1.0:1780340532.108142:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960995840 00000100:00100000:1.0:1780340532.108146:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960995840 00000100:00100000:1.0:1780340532.108173:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960996352 00000100:00100000:1.0:1780340532.108176:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960996352 00000100:00100000:1.0:1780340532.108196:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2314 00000100:00100000:1.0:1780340532.108202:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960995840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.108233:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960995840:12345-0@lo:400:kworker.0 Request processed in 32us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340532.108238:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2314 00000100:00100000:1.0:1780340532.108249:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2315 00000100:00100000:1.0:1780340532.108255:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960996352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.108279:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960996352:12345-0@lo:400:kworker.0 Request processed in 25us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340532.108284:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2315 00000100:00100000:1.0:1780340532.108313:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a126a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818960995584:0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.108322:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818960996096:0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.108330:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818960996608:0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.108338:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818960995200:0@lo:400:kworker.0 00000100:00080000:0.0:1780340532.108671:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340532.108676:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340532.108678:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780340532.108707:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960995840:0@lo:400:kworker.0 00000100:00100000:0.0:1780340532.108718:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960996352:0@lo:400:kworker.0 00000100:00100000:2.0:1780340532.108863:0:79974:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960995072 00000100:00100000:2.0:1780340532.108869:0:79974:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960995072 00000100:00100000:2.0:1780340532.108914:0:79974:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1780340532.108921:0:79974:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818960995072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340532.108976:0:79974:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818960995072:12345-0@lo:400:kworker.0 Request processed in 56us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340532.108982:0:79974:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1780340532.109310:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818960995072:0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.109351:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340532.109483:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818960995968:0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.109517:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340532.109613:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960995456 00000100:00100000:3.0:1780340532.109617:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960995456 00000100:00100000:3.0:1780340532.109670:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1780340532.109678:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818960995456:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1780340532.109697:0:63710:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046ba2d880 x1866818960995456/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:713/0 lens 224/224 e 0 to 0 dl 1780340543 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340532.109734:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818960995456:12345-0@lo:400:kworker.0 Request processed in 58us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340532.109742:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00080000:3.0:1780340532.109799:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340532.112303:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818960996480:0@lo:400:kworker.0 00000100:00100000:1.0:1780340532.112390:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340532.121576:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818960995456:0@lo:400:kworker.0 00000100:00100000:2.0:1780340532.127147:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960995968 00000100:00100000:2.0:1780340532.127165:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960995968 00000100:00100000:3.0:1780340532.127169:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960996480 00000100:00100000:3.0:1780340532.127176:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960996480 00000100:00100000:2.0:1780340532.127338:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2316 00000100:00100000:2.0:1780340532.127351:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818960995968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340532.127491:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818960995968:12345-0@lo:400:kworker.0 Request processed in 143us (17972us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340532.127507:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2316 00000100:00100000:2.0:1780340532.127575:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a127b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818960995968:0@lo:400:kworker.0 00000100:00100000:3.0:1780340532.131947:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2317 00000100:00100000:3.0:1780340532.131964:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818960996480:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1780340532.132031:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340532.132399:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818960996480:12345-0@lo:400:kworker.0 Request processed in 440us (20019us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340532.132407:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2317 00000100:00100000:2.0:1780340532.132497:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818960996480:0@lo:400:kworker.0 00000100:00100000:0.0:1780340532.272641:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340532.272690:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340532.272725:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340532.272743:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340532.272919:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340532.272949:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940376192 00000100:00100000:0.0:1780340532.272961:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940376192 00000100:00100000:0.0:1780340532.273048:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940376064 00000100:00100000:0.0:1780340532.273052:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940376064 00000100:00100000:0.0:1780340532.273088:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1033 00000100:00100000:0.0:1780340532.273112:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940376192:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340532.273214:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940376192:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 115us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340532.273223:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1033 00000100:00100000:0.0:1780340532.273241:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1034 00000100:00100000:0.0:1780340532.273248:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2407:x1866818940376064:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000080:0.0:1780340532.273269:0:70100:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04529d5500 x1866818940376064/t0(0) o400->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:713/0 lens 224/224 e 0 to 0 dl 1780340543 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340532.273307:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2407:x1866818940376064:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 59us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340532.273314:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1034 00000100:00080000:0.0:1780340532.273333:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340532.274040:0:79975:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940375936 00000100:00100000:2.0:1780340532.274048:0:79975:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940375936 00000100:00100000:2.0:1780340532.274115:0:79975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 161 00000100:00100000:2.0:1780340532.274123:0:79975:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940375936:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340532.274179:0:79975:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0004:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940375936:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 56us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340532.274185:0:79975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 161 00000100:00100000:2.0:1780340532.274219:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940376448 00000100:00100000:2.0:1780340532.274223:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940376448 00000100:00100000:2.0:1780340532.274255:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940376320 00000100:00100000:2.0:1780340532.274257:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940376320 00000100:00100000:2.0:1780340532.274280:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2318 00000100:00100000:2.0:1780340532.274286:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940376448:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340532.274309:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940376448:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340532.274314:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2318 00000100:00100000:2.0:1780340532.274322:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2319 00000100:00100000:2.0:1780340532.274327:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940376320:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340532.274343:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940376320:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 17us (1425us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340532.274348:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2319 00000100:00080000:2.0:1780340532.274623:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340532.274628:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340532.622493:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340532.622533:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960996736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340532.622730:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340532.627465:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960996864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340532.627550:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340532.632319:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960996736 00000100:00100000:2.0:1780340532.632344:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960996736 00000100:00100000:2.0:1780340532.632435:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960996864 00000100:00100000:2.0:1780340532.632439:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960996864 00000100:00100000:2.0:1780340532.632474:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1882 00000100:00100000:2.0:1780340532.632487:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960996736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780340532.632533:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340532.632629:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1883 00000100:00100000:0.0:1780340532.632642:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960996864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340532.632663:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340532.632784:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a127b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818960996864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (5233us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340532.632793:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1883 00000100:00100000:0.0:1780340532.632861:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818960996864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340532.633041:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a126a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818960996736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 490us (10245us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340532.633050:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1882 00000100:00100000:0.0:1780340532.634132:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818960996736:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1780340533.069146:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340533.133562:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340533.133585:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960996992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340533.133652:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340533.133699:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960996992 00000100:00100000:0.0:1780340533.133707:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960996992 00000100:00100000:0.0:1780340533.133755:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3695 00000100:00100000:0.0:1780340533.133796:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818960996992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780340533.133829:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00010000:00000080:0.0:1780340533.133845:0:22660:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0479d8d500 x1866818960996992/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:714/0 lens 224/368 e 0 to 0 dl 1780340544 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340533.133888:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818960996992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340533.133905:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3695 00000100:00100000:0.0:1780340533.133954:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960996992:0@lo:41:osp-pre-0-1.0 00000020:01000004:2.0:1780340533.354592:0:81186:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1780340533.354645:0:81186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c046fb21800/0xa24651432772df8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432772dff expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.354660:0:81186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c046fb21800/0xa24651432772df8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432772dff expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.354668:0:81186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c046fb21800/0xa24651432772df8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432772dff expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.354674:0:81186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c046fb21800/0xa24651432772df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432772dff expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.354702:0:81186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1780340533.354707:0:81186:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1780340533.354730:0:81186:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1780340533.354734:0:81186:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1780340533.354753:0:81186:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1780340533.354795:0:81186:0:(import.c:65:import_set_state_nolock()) ffff8c0345f1b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1780340533.354856:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818960997120:0@lo:39:umount.0 00000100:00100000:3.0:1780340533.354922:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340533.355161:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960997120 00000100:00100000:0.0:1780340533.355168:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960997120 00010000:00010000:1.0:1780340533.355274:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340533.355281:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c046fb21800/0xa24651432772df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432772dff expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340533.355289:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c046fb21800 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340533.355292:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c046fb21800/0xa24651432772df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432772dff expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340533.355300:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c046fb21800/0xa24651432772df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432772dff expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340533.355307:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c046fb21800/0xa24651432772df8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432772dff expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340533.355313:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1780340533.355315:0:7442:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1780340533.355317:0:7442:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1780340533.355340:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c046fb21800/0xa24651432772df8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432772dff expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340533.355356:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1780340533.355356:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:0.0:1780340533.355365:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1866818960997120:12345-0@lo:39:umount.0 00010000:00010000:1.0:1780340533.355383:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c046fb21800/0xa24651432772df8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432772dff expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1780340533.355388:0:63712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772f17 00010000:00010000:1.0:1780340533.355389:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c046fb21800/0xa24651432772df8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432772dff expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1780340533.355395:0:63712:0:(import.c:65:import_set_state_nolock()) ffff8c045f0c3000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1780340533.355399:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340533.355401:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340533.355403:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000080:0.0:1780340533.355420:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c03484f1f80 x1866818960997120/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:714/0 lens 224/224 e 0 to 0 dl 1780340544 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340533.355458:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3658:x1866818960997120:12345-0@lo:39:umount.0 Request processed in 95us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340533.355465:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000020:00000080:0.0:1780340533.355473:0:63712:0:(genops.c:906:class_export_put()) final put ffff8c045f0c6800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1780340533.355496:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1780340533.355504:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045f0c6800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1780340533.355515:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340533.355524:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818960997248:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1780340533.355541:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c045f0c3000 for lustre-MDT0000 00000100:00100000:1.0:1780340533.355551:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340533.355578:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960997248 00000100:00100000:0.0:1780340533.355582:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960997248 00000100:00100000:0.0:1780340533.355617:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:0.0:1780340533.355623:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a124000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818960997248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780340533.355633:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340533.355646:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c046fb20000/0xa24651432772dff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432772df8 expref: 23 pid: 79971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340533.355657:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340533.355695:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a124000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3662:x1866818960997248:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340533.355701:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:1.0:1780340533.355748:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818960997248:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1780340533.356040:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0345f1b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1780340533.356056:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818960997120:0@lo:39:umount.0 00000100:00080000:2.0:1780340533.356108:0:81186:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1780340533.356111:0:81186:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1780340533.356115:0:81186:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1780340533.359142:0:81186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c046fb21a00/0xa24651432772d18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432772d1f expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.359159:0:81186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c046fb21a00/0xa24651432772d18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432772d1f expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.359167:0:81186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c046fb21a00/0xa24651432772d18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432772d1f expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.359173:0:81186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c046fb21a00/0xa24651432772d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432772d1f expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.359197:0:81186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340533.359204:0:81186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03485a1a00/0xa24651432772e1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432772e22 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.359210:0:81186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03485a1a00/0xa24651432772e1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432772e22 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.359216:0:81186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03485a1a00/0xa24651432772e1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432772e22 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.359222:0:81186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c03485a1a00/0xa24651432772e1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432772e22 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.359469:0:81186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780340533.359477:0:81186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c046fb21e00/0xa24651432772dea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432772df1 expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.359543:0:81186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c046fb21e00/0xa24651432772dea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432772df1 expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.359550:0:81186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c046fb21e00/0xa24651432772dea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432772df1 expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.359556:0:81186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c046fb21e00/0xa24651432772dea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432772df1 expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.359578:0:81186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1780340533.359589:0:81186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c046fb20800/0xa24651432772d03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432772d0a expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.359595:0:81186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c046fb20800/0xa24651432772d03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432772d0a expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.359601:0:81186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c046fb20800/0xa24651432772d03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432772d0a expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.359606:0:81186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c046fb20800/0xa24651432772d03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432772d0a expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.359618:0:81186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1780340533.359621:0:81186:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1780340533.359658:0:81186:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1780340533.359663:0:81186:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1780340533.359668:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:3.0:1780340533.359673:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:02000400:2.0:1780340533.359674:0:81186:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1780340533.359688:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c046fb21a00/0xa24651432772d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432772d1f expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.359697:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c046fb21a00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340533.359700:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c046fb21a00/0xa24651432772d18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432772d1f expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.359708:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c046fb21a00/0xa24651432772d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432772d1f expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340533.359715:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c046fb21a00/0xa24651432772d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432772d1f expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340533.359719:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1780340533.359722:0:23160:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1780340533.359724:0:23160:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1780340533.359754:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c046fb21a00/0xa24651432772d18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432772d1f expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.359802:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340533.359820:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c046fb21a00/0xa24651432772d18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432772d1f expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.359827:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c046fb21a00/0xa24651432772d18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432772d1f expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.359838:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780340533.359841:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c03485a1a00/0xa24651432772e1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432772e22 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.359846:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1a00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340533.359854:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c03485a1a00/0xa24651432772e1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432772e22 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.359861:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c03485a1a00/0xa24651432772e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432772e22 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340533.359866:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c03485a1a00/0xa24651432772e1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432772e22 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340533.359870:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1780340533.359872:0:23160:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1780340533.359874:0:23160:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1780340533.359888:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c03485a1a00/0xa24651432772e1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432772e22 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.359893:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340533.359907:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c03485a1a00/0xa24651432772e1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432772e22 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.359913:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c03485a1a00/0xa24651432772e1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432772e22 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.359922:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340533.359925:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c046fb21e00/0xa24651432772dea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432772df1 expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.359929:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c046fb21e00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340533.359932:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c046fb21e00/0xa24651432772dea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432772df1 expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.359938:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c046fb21e00/0xa24651432772dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432772df1 expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340533.360073:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c046fb21e00/0xa24651432772dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432772df1 expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340533.360080:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1780340533.360083:0:23160:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1780340533.360085:0:23160:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1780340533.360107:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c046fb21e00/0xa24651432772dea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432772df1 expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.360113:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340533.360119:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c046fb21e00/0xa24651432772dea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432772df1 expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.360126:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c046fb21e00/0xa24651432772dea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432772df1 expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.360134:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340533.360137:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c046fb20800/0xa24651432772d03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432772d0a expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.360143:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c046fb20800 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340533.360146:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c046fb20800/0xa24651432772d03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432772d0a expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.360152:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c046fb20800/0xa24651432772d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432772d0a expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340533.360158:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c046fb20800/0xa24651432772d03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432772d0a expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340533.360172:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1780340533.360174:0:23160:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1780340533.360175:0:23160:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1780340533.360185:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340533.360189:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c046fb20800/0xa24651432772d03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432772d0a expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.360194:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340533.360199:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c046fb20800/0xa24651432772d03 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432772d0a expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.360204:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c046fb20800/0xa24651432772d03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432772d0a expref: -99 pid: 79963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340533.360204:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818960997376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340533.360212:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340533.360213:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340533.360215:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340533.360223:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818960997760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780340533.360282:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1780340533.364281:0:81186:0:(mdt_handler.c:8186:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:2.0:1780340533.364510:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818960997504:0@lo:103:ldlm_bl.0 00000001:00080000:0.0:1780340533.364830:0:79964:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280519 is committed 00000100:00100000:1.0:1780340533.369414:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1780340533.369501:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1780340533.369588:0:81186:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1780340533.369598:0:81186:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c03490bc000 e06e5cf1-1986-4ba7-9630-fad7efb74eca 192.168.203.16@tcp 5 (0 0 0) 0 0 0 1: ffff8c0476f6f000 94489280519 stale:0 00000020:00080000:1.0:1780340533.369605:0:81186:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c04754ef800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780340533.369609:0:81186:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c0471e4e000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780340533.369613:0:81186:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c0450110000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780340533.369617:0:81186:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c046b9a9000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780340533.369622:0:81186:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff8c03482b0000) has exports, disconnecting them 00000020:00080000:1.0:1780340533.369638:0:81186:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.16@tcp (ffff8c03490bc000), last request at 1780340532 00000020:00000080:1.0:1780340533.369646:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327730e5 00000100:00080000:1.0:1780340533.369656:0:81186:0:(import.c:65:import_set_state_nolock()) ffff8c03490be800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1780340533.369660:0:7443:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960997376 00000100:00100000:0.0:1780340533.369669:0:7443:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960997376 00000020:00080000:1.0:1780340533.369677:0:81186:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.16@tcp (ffff8c03490bc000): rc 0 00000020:00080000:1.0:1780340533.369680:0:81186:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c04754ef800), last request at 1780340320 00000020:00000080:1.0:1780340533.369682:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772f10 00000100:00080000:1.0:1780340533.369685:0:81186:0:(import.c:65:import_set_state_nolock()) ffff8c04754ec800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1780340533.369698:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1780340533.369705:0:81186:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c04754ef800): rc 0 00000020:00000080:1.0:1780340533.369707:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c04754ef800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1780340533.369718:0:81186:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c0471e4e000), last request at 1780340532 00000020:00000080:1.0:1780340533.369721:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772f09 00000100:00080000:1.0:1780340533.369724:0:81186:0:(import.c:65:import_set_state_nolock()) ffff8c0471e48800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1780340533.369724:0:7443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:0.0:1780340533.369732:0:7443:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3662:x1866818960997376:12345-0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1780340533.369742:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04754ef800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:0.0:1780340533.369747:0:7443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340533.369797:0:7443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5200/0xa24651432772d1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432772d18 expref: 22 pid: 79969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1780340533.369803:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c04754ec800 for lustre-MDT0000 00000020:00080000:1.0:1780340533.369813:0:81186:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0471e4e000): rc 0 00010000:00010000:0.0:1780340533.369814:0:7443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:1.0:1780340533.369815:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c0471e4e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1780340533.369821:0:81186:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c0450110000), last request at 1780340532 00000020:00000080:1.0:1780340533.369824:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772f02 00000100:00080000:1.0:1780340533.369833:0:81186:0:(import.c:65:import_set_state_nolock()) ffff8c047a0a1800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1780340533.369845:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0471e4e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:0.0:1780340533.369859:0:7443:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a126d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:3662:x1866818960997376:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (450us total) trans 0 rc 0/0 00000020:00000080:1.0:1780340533.369865:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0471e48800 for lustre-MDT0000 00000100:00100000:0.0:1780340533.369866:0:7443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00010000:00010000:0.0:1780340533.369883:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1780340533.369886:0:81186:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0450110000): rc 0 00000020:00000080:1.0:1780340533.369887:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c0450110000/lustre-MDT0000-lwp-OST0000_UUID 00010000:00010000:0.0:1780340533.369887:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1780340533.369894:0:81186:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c046b9a9000), last request at 1780340314 00000020:00000080:0.0:1780340533.369894:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0450110000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1780340533.369897:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772d6c 00000100:00080000:1.0:1780340533.369903:0:81186:0:(import.c:65:import_set_state_nolock()) ffff8c0346bbc800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1780340533.369914:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1780340533.369916:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047a0a1800 for lustre-MDT0000 00000020:00080000:1.0:1780340533.369925:0:81186:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c046b9a9000): rc 0 00000020:00000080:1.0:1780340533.369927:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c046b9a9000/lustre-MDT0001-mdtlov_UUID 00000004:00000080:1.0:1780340533.369936:0:81186:0:(mdd_device.c:2374:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff99274169bae0 00000100:00100000:0.0:1780340533.369941:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818960997376:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1780340533.369955:0:81186:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1780340533.369958:0:81186:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378730 gen 3 00000020:00000080:0.0:1780340533.370077:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b9a9000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1780340533.370113:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0346bbc800 for lustre-MDT0000 00000100:00100000:3.0:1780340533.370795:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340533.370849:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818960997632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340533.370887:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1780340533.370919:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa246514327731d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.370929:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa246514327731d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.370936:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa246514327731d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.372355:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340533.372360:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa246514327731d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.372369:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa246514327731d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.372386:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8c0455e5c400) 00010000:00010000:3.0:1780340533.372389:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340533.372402:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa246514327731d3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.372408:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa246514327731d3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1780340533.372430:0:3645:0:(genops.c:906:class_export_put()) final put ffff8c03490bc000/e06e5cf1-1986-4ba7-9630-fad7efb74eca 00010000:00010000:3.0:1780340533.372464:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340533.372480:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960997760 00000100:00100000:3.0:1780340533.372488:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960997760 00000100:00100000:3.0:1780340533.372530:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960997632 00000100:00100000:3.0:1780340533.372533:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960997632 00000100:00100000:3.0:1780340533.372554:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1780340533.372561:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3661:x1866818960997760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340533.372572:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340533.372585:0:25498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03485a0a00/0xa24651432772d0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432772d03 expref: 22 pid: 79975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.372595:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340533.372731:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:3661:x1866818960997760:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340533.372750:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1780340533.372797:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:3.0:1780340533.372803:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04757d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3660:x1866818960997632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340533.372810:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340533.372819:0:25498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453122200/0xa24651432772df1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432772dea expref: 20 pid: 79975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.372826:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340533.372851:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04757d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:3660:x1866818960997632:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (1964us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340533.372856:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:3.0:1780340533.372926:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818960997760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340533.373061:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818960997632:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1780340533.373085:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c03490bc000/e06e5cf1-1986-4ba7-9630-fad7efb74eca for lustre-MDT0000 00000020:00000080:3.0:1780340533.373139:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c03490be800 for lustre-MDT0000 00000100:00080000:1.0:1780340533.373906:0:81186:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1780340533.373930:0:81186:0:(import.c:65:import_set_state_nolock()) ffff8c047651e000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1780340533.374338:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818960997888:0@lo:39:umount.0 00000100:00100000:3.0:1780340533.374398:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340533.374443:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960997888 00000100:00100000:3.0:1780340533.374449:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960997888 00000100:00100000:3.0:1780340533.374486:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3696 00000100:00100000:3.0:1780340533.374494:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818960997888:12345-0@lo:39:umount.0 00000020:00000080:3.0:1780340533.374519:0:8411:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772dab 00000100:00080000:3.0:1780340533.374526:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8c034a948000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780340533.374546:0:8411:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378730 00000100:00100000:2.0:1780340533.374854:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340533.375035:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3658:x1866818960997888:12345-0@lo:39:umount.0 Request processed in 541us (645us total) trans 81604378731 rc 0/0 00000100:00100000:3.0:1780340533.375050:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3696 00000100:00080000:3.0:1780340533.375101:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c047651e000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1780340533.375109:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818960997888:0@lo:39:umount.0 00010000:00010000:3.0:1780340533.375123:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340533.376331:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960997504 00000100:00100000:2.0:1780340533.376340:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960997504 00000100:00100000:2.0:1780340533.376395:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:2.0:1780340533.376404:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:3659:x1866818960997504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340533.376416:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340533.376435:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c046fb20200/0xa24651432772e22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432772e1b expref: 19 pid: 79969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340533.376450:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340533.376499:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:3659:x1866818960997504:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340533.376506:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:2.0:1780340533.376546:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818960997504:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1780340533.378963:0:81186:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1780340533.380122:0:81186:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 3 00000004:00080000:1.0:1780340533.380148:0:81186:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:1.0:1780340533.380207:0:81186:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1780340533.380235:0:81186:0:(import.c:65:import_set_state_nolock()) ffff8c04480af800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1780340533.380258:0:81186:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1780340533.380261:0:81186:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 3 00000004:00080000:1.0:1780340533.380275:0:81186:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:3.0:1780340533.380279:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818960998016:0@lo:9:umount.0 00000100:00080000:1.0:1780340533.380323:0:81186:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1780340533.380332:0:81186:0:(import.c:65:import_set_state_nolock()) ffff8c044d43a800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1780340533.380339:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340533.380374:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818960998144:0@lo:9:umount.0 00000020:00080000:1.0:1780340533.380376:0:81186:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8c03482b0000) has no exports 00000100:00100000:3.0:1780340533.380464:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340533.380498:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960998016 00000100:00100000:3.0:1780340533.380504:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960998016 00000100:00100000:3.0:1780340533.380538:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960998144 00000100:00100000:3.0:1780340533.380541:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960998144 00000100:00100000:3.0:1780340533.380559:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5853 00000100:00100000:3.0:1780340533.380567:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818960998016:12345-0@lo:9:umount.0 00000100:00100000:1.0:1780340533.380567:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5854 00000100:00100000:1.0:1780340533.380573:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818960998144:12345-0@lo:9:umount.0 00000020:00000080:3.0:1780340533.380588:0:25494:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772db9 00000020:00000080:1.0:1780340533.380588:0:25496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772dd5 00000100:00080000:3.0:1780340533.380595:0:25494:0:(import.c:65:import_set_state_nolock()) ffff8c046ba23800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1780340533.380595:0:25496:0:(import.c:65:import_set_state_nolock()) ffff8c045310e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780340533.380860:0:25494:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:3.0:1780340533.382100:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+2:3658:x1866818960998016:12345-0@lo:9:umount.0 Request processed in 1519us (1745us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340533.382111:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5853 00000100:00080000:0.0:1780340533.384746:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c04480af800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1780340533.384795:0:3658:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:0.0:1780340533.384798:0:3658:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:0.0:1780340533.384805:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818960998016:0@lo:9:umount.0 00000001:00000004:1.0:1780340533.385142:0:25496:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969448 00010000:00010000:0.0:1780340533.385188:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340533.385323:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+2:3658:x1866818960998144:12345-0@lo:9:umount.0 Request processed in 4749us (4857us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340533.385333:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5854 00000020:00080000:1.0:1780340533.385408:0:81186:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8c03482b0000) has no exports 00000100:00080000:0.0:1780340533.385420:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c044d43a800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1780340533.385430:0:3658:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:0.0:1780340533.385432:0:3658:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:0.0:1780340533.385435:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818960998144:0@lo:9:umount.0 00010000:00010000:3.0:1780340533.385500:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1780340533.464636:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772d81 00000020:00000080:1.0:1780340533.464665:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c0458282000/lustre-QMT0000_UUID 00000020:01000000:1.0:1780340533.464678:0:81186:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1780340533.464811:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0458282000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1780340533.464862:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780340533.464872:0:81186:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1780340533.464877:0:81186:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff8c0445ba4d40) has no exports 00000020:00000080:0.0:1780340533.465233:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772d7a 00000020:00000080:0.0:1780340533.465240:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c0345f1b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1780340533.465289:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340533.465297:0:81186:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1780340533.465299:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c0345f18800/lustre-QMT0000_UUID 00000020:00000080:0.0:1780340533.465302:0:81186:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0345f18800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1780340533.465308:0:81186:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1780340533.465500:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0345f1b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1780340533.465547:0:81186:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c044418b2a0 - data ffff8c044d093d80/ffff8c045317c800 00000020:01000000:0.0:1780340533.465671:0:81186:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c047b3c04e0 - data ffff8c04719ea510/ffff8c045f25d000 00000100:00080000:3.0:1780340533.515475:0:81186:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1780340533.515484:0:81186:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378730 gen 4 00000100:00100000:3.0:1780340533.515501:0:81186:0:(client.c:3140:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8c047a124000 x1866818960997888/t81604378731(81604378731) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340543 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340533.515537:0:81186:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1780340533.517462:0:81186:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1780340533.517467:0:81186:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 4 00000004:00080000:1.0:1780340533.517486:0:81186:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:1.0:1780340533.517489:0:81186:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1780340533.518057:0:79982:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1780340533.518062:0:79982:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x58:0x0] index 2 count 1 00000040:00080000:2.0:1780340533.518073:0:79982:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 22 count 2 00000100:00080000:1.0:1780340533.518624:0:81186:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1780340533.518692:0:81186:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 4 00000004:00080000:1.0:1780340533.518712:0:81186:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:1.0:1780340533.518714:0:81186:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1780340533.519230:0:79984:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1780340533.519234:0:79984:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x5a:0x0] index 1 count 1 00000040:00080000:2.0:1780340533.519241:0:79984:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 22 count 2 00000020:00000080:1.0:1780340533.524803:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772d34 00000020:00000080:1.0:1780340533.524814:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c047570d800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1780340533.525696:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772d49 00000020:00000080:2.0:1780340533.525703:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c046b9ab000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780340533.525708:0:81186:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1780340533.525724:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780340533.525732:0:81186:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1780340533.525735:0:81186:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8c03482b4d40) has no exports 00000004:01000000:2.0:1780340533.526157:0:81186:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1780340533.526168:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772dce 00000020:00000080:2.0:1780340533.526172:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c044d439800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780340533.526177:0:81186:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1780340533.526181:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780340533.526186:0:81186:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1780340533.526188:0:81186:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8c0349003380) has no exports 00000020:00000080:2.0:1780340533.526194:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772dc7 00000020:00000080:2.0:1780340533.526198:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c044d43f000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1780340533.526510:0:81186:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1780340533.526514:0:81186:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1780340533.526518:0:81186:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 5 00000004:00080000:2.0:1780340533.526523:0:81186:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780340533.526525:0:81186:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780340533.526548:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780340533.526553:0:81186:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780340533.526557:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772db2 00000020:00000080:2.0:1780340533.526561:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c044d43a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780340533.526564:0:81186:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1780340533.526566:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780340533.526569:0:81186:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1780340533.526571:0:81186:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8c0349000000) has no exports 00000020:00000080:2.0:1780340533.526574:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772da4 00000020:00000080:2.0:1780340533.526577:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c04480ad000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1780340533.527064:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047570d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1780340533.527079:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b9ab000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1780340533.527083:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c044d439800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1780340533.527087:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c044d43f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1780340533.527101:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c044d43a800 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1780340533.527106:0:80497:0:(genops.c:906:class_export_put()) final put ffff8c044d438800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1780340533.527108:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c044d438800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1780340533.527112:0:80497:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1780340533.527196:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c044d43a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1780340533.527200:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04480ad000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1780340533.530734:0:81186:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1780340533.530743:0:81186:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1780340533.530746:0:81186:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969448 gen 5 00000004:00080000:2.0:1780340533.530753:0:81186:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780340533.530756:0:81186:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780340533.532369:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780340533.532381:0:81186:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1780340533.532403:0:81186:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1780340533.532411:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772d96 00000020:00000080:2.0:1780340533.532419:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c046bae0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780340533.532426:0:81186:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1780340533.532432:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780340533.532436:0:81186:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1780340533.532439:0:81186:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8c047ac719c0) has no exports 00000020:00000080:2.0:1780340533.532445:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772d8f 00000020:00000080:2.0:1780340533.532448:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c0345f1d000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1780340533.532538:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c04480af800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1780340533.532546:0:80497:0:(genops.c:906:class_export_put()) final put ffff8c0458287000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1780340533.532549:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0458287000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1780340533.532554:0:80497:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1780340533.532656:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046bae0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1780340533.532661:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0345f1d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1780340533.537209:0:81186:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1780340533.537219:0:81186:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1780340533.537224:0:81186:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378730 gen 5 00000100:00100000:3.0:1780340533.537232:0:81186:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1780340533.537301:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1780340533.537312:0:81186:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1780340533.537340:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1780340533.537344:0:81186:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1780340533.537349:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c0475708000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1780340533.537368:0:81186:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0475708000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1780340533.537376:0:81186:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1780340533.537489:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772d50 00000020:00000080:3.0:1780340533.537496:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c046b9a8800/lustre-MDD0000_UUID 00000020:01000000:3.0:1780340533.537501:0:81186:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1780340533.537505:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1780340533.537510:0:81186:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1780340533.537514:0:81186:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8c047b0a19c0) has no exports 00000020:00000080:3.0:1780340533.537535:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1780340533.537539:0:81186:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1780340533.537543:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772d57 00000020:00000080:3.0:1780340533.537546:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c046b9ab800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1780340533.537552:0:81186:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c046bae2800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1780340533.537555:0:81186:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c046bae2800 3 00000020:01000004:3.0:1780340533.537559:0:81186:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c046bae2800 from lustre-MDT0000 00000020:00000080:3.0:1780340533.537577:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1780340533.537580:0:81186:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1780340533.537582:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c0475708800/lustre-MDT0000_UUID 00000020:00000080:3.0:1780340533.537585:0:81186:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0475708800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1780340533.537591:0:81186:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1780340533.537622:0:81186:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1780340533.537625:0:81186:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1780340533.537628:0:81186:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1780340533.537631:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1780340533.537633:0:81186:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1780340533.537641:0:81186:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8c046b968000 ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4 192.168.203.16@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1780340533.537648:0:81186:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8c047651f800 f26f7947-2bb0-4491-8dd4-005fa8e64f3a 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1780340533.537652:0:81186:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8c03482b3380) has exports, disconnecting them 00000020:00080000:3.0:1780340533.537657:0:81186:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.16@tcp (ffff8c046b968000), last request at 1780340318 00000020:00000080:3.0:1780340533.537673:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772edf 00000020:00010000:3.0:1780340533.537677:0:81186:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c046b968000: total 2 00000100:00080000:3.0:1780340533.537685:0:81186:0:(import.c:65:import_set_state_nolock()) ffff8c046b96f000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1780340533.537696:0:81186:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.16@tcp (ffff8c046b968000): rc 0 00000020:00080000:3.0:1780340533.537699:0:81186:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8c047651f800), last request at 1780340314 00000020:00010000:1.0:1780340533.537779:0:7442:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c046b968000: total 2 00010000:00010000:1.0:1780340533.537830:0:7442:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c046b968000, canceled 0 locks, left on hash table 4. 00000020:00000080:3.0:1780340533.537839:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772cfc 00000020:00010000:3.0:1780340533.537842:0:81186:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c047651f800: total 2 00000100:00080000:3.0:1780340533.537844:0:81186:0:(import.c:65:import_set_state_nolock()) ffff8c047651e800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1780340533.537852:0:81186:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c047651f800): rc 0 00000020:00080000:3.0:1780340533.537856:0:81186:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8c03482b3380) has no exports 00010000:00010000:1.0:1780340533.537858:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453123000/0xa24651432772ef4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21d8 expref: 5 pid: 79971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1780340533.537862:0:23160:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c047651f800: total 2 00010000:00010000:3.0:1780340533.537865:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340533.537875:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa4800/0xa24651432772eed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21d1 expref: 4 pid: 79971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.537885:0:23160:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c047651f800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1780340533.537886:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453123c00/0xa24651432772efb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21df expref: 3 pid: 79971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340533.537896:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa4c00/0xa24651432772ee6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced21ca expref: 2 pid: 79970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.537900:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03485a1e00/0xa24651432772eae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432772ea7 expref: 14 pid: 79970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340533.537904:0:7442:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c046b968000, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1780340533.537910:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03485a0600/0xa24651432772e3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432772e37 expref: 13 pid: 79975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1780340533.537920:0:7442:0:(genops.c:906:class_export_put()) final put ffff8c046b968000/ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4 00010000:00010000:3.0:1780340533.537921:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5c00/0xa24651432772ebc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432772eb5 expref: 12 pid: 79970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340533.537924:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340533.537925:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340533.537927:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340533.537932:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c046fb20400/0xa24651432772e4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432772e45 expref: 11 pid: 79971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1780340533.537941:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047651e000 for lustre-MDT0001-osp-MDT0000 00010000:00010000:3.0:1780340533.537942:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453122800/0xa24651432772eca lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432772ec3 expref: 10 pid: 79974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1780340533.537946:0:80497:0:(genops.c:906:class_export_put()) final put ffff8c047570a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780340533.537948:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047570a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00010000:00010000:3.0:1780340533.537955:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03485a1800/0xa24651432772e5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432772e53 expref: 9 pid: 79969 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1780340533.537956:0:80497:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00010000:00010000:3.0:1780340533.537965:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453122000/0xa24651432772ed8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432772ed1 expref: 8 pid: 79974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.537987:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03485a0e00/0xa24651432772e68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432772e61 expref: 7 pid: 79974 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.537996:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5a00/0xa24651432772e76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432772e6f expref: 6 pid: 79971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.538005:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03485a0800/0xa24651432772e84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432772e7d expref: 5 pid: 79971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.538015:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5000/0xa24651432772ea0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432772e99 expref: 4 pid: 79970 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.538025:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453122400/0xa24651432772e30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432772e29 expref: 3 pid: 79975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.538037:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03485a1000/0xa24651432772e92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432772e8b expref: 2 pid: 79971 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340533.538046:0:23160:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c047651f800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1780340533.538060:0:23160:0:(genops.c:906:class_export_put()) final put ffff8c047651f800/f26f7947-2bb0-4491-8dd4-005fa8e64f3a 00010000:00010000:3.0:1780340533.538069:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340533.538071:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340533.538072:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340533.538151:0:79969:0:(service.c:3186:ptlrpc_main()) ll_mgs_0000: service thread [ffff8c047a2c6200:79969] 0 exiting: rc = 1 00000020:00000080:1.0:1780340533.538178:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b9a8800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1780340533.538182:0:80497:0:(genops.c:906:class_export_put()) final put ffff8c046b9ad800/lustre-MDD0000_UUID 00000020:00000080:1.0:1780340533.538183:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b9ad800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1780340533.538186:0:80497:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1780340533.538211:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b9ab800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780340533.538215:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b968000/ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4 for MGS 00000020:00000080:1.0:1780340533.538233:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047651f800/f26f7947-2bb0-4491-8dd4-005fa8e64f3a for MGS 00000020:00000080:1.0:1780340533.538244:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c046b96f000 for MGS 00000020:00000080:1.0:1780340533.538247:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047651e800 for MGS 00000100:00100000:3.0:1780340533.538254:0:79974:0:(service.c:3186:ptlrpc_main()) ll_mgs_0003: service thread [ffff8c047654b600:79974] 3 exiting: rc = 0 00000100:00100000:1.0:1780340533.538278:0:79971:0:(service.c:3186:ptlrpc_main()) ll_mgs_0002: service thread [ffff8c047654be00:79971] 2 exiting: rc = 0 00000100:00100000:3.0:1780340533.538309:0:79975:0:(service.c:3186:ptlrpc_main()) ll_mgs_0004: service thread [ffff8c047654aa00:79975] 4 exiting: rc = 0 00000100:00100000:1.0:1780340533.538332:0:79970:0:(service.c:3186:ptlrpc_main()) ll_mgs_0001: service thread [ffff8c047a2c6800:79970] 1 exiting: rc = 0 00000100:00100000:3.0:1780340533.538358:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538365:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538371:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538383:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538390:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538395:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538400:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538406:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538411:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538416:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538422:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538427:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538433:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538439:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538444:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538450:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538455:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538460:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538466:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538471:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538476:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538480:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538485:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538490:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538494:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538499:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538504:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538508:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538513:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538518:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538523:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538528:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538533:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538537:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538542:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538546:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538551:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538556:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538570:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538575:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538579:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538584:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538589:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538593:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538598:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538602:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538607:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538611:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538616:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538622:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538626:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538631:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538636:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538641:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538645:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538650:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538655:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538660:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538665:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538670:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538674:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538679:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538685:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1780340533.538690:0:81186:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1780340533.542359:0:81186:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c044418b7e0 - data ffff8c04718e3e58/ffff8c046b9d0c00 00000020:01000000:3.0:1780340533.542510:0:81186:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c03488ad060 - data ffff8c044d0e5870/ffff8c0444a91800 00000020:00000080:3.0:1780340533.544400:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772cf5 00000020:00000080:3.0:1780340533.544412:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c0475709000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1780340533.544436:0:81186:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c046bae2800 from MGS, refs=2 00000020:01000004:3.0:1780340533.544439:0:81186:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c046bae2800 2 00000020:01000004:3.0:1780340533.544442:0:81186:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c046bae2800 from MGS 00000020:00000080:3.0:1780340533.544464:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1780340533.544484:0:81186:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1780340533.544487:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c047570e800/MGS 00000020:00000080:3.0:1780340533.544490:0:81186:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047570e800/MGS for MGS 00000020:01000000:3.0:1780340533.544496:0:81186:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1780340533.544588:0:81186:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1780340533.544592:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1780340533.544598:0:81186:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1780340533.544604:0:81186:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8c0346bbf000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1780340533.544610:0:81186:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff8c0349004d40) has exports, disconnecting them 00000020:00080000:3.0:1780340533.544615:0:81186:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8c0346bbf000), last request at 1780340314 00000020:00000080:3.0:1780340533.544619:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772e0d 00000020:00080000:3.0:1780340533.544631:0:81186:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0346bbf000): rc 0 00000020:00000080:3.0:1780340533.544636:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c0346bbf000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1780340533.545309:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0475709000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780340533.545318:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0346bbf000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1780340533.555888:0:81186:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1780340533.555896:0:81186:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1780340533.555900:0:81186:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1780340533.555908:0:81186:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1780340533.555951:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0345f1b800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1780340533.556278:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340533.556287:0:81186:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1780340533.556292:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c0345c80000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1780340533.556296:0:81186:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0345c80000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1780340533.556302:0:81186:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1780340533.556380:0:81186:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c046bae2800 1 00000020:00000080:1.0:1780340533.556397:0:81186:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772ce7 00000020:00000080:1.0:1780340533.556403:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c047570b000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1780340533.556412:0:81186:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1780340533.556420:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047570b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780340533.556430:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340533.556435:0:81186:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1780340533.556438:0:81186:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8c03490019c0) has no exports 00000020:00000080:1.0:1780340533.836470:0:81186:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340533.836482:0:81186:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1780340533.836487:0:81186:0:(genops.c:906:class_export_put()) final put ffff8c046bae4000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780340533.836491:0:81186:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046bae4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1780340533.836500:0:81186:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1780340533.836667:0:81186:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8c046bae3800 00000020:02000400:1.0:1780340533.836722:0:81186:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1780340534.120410:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340535.197799:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340535.690111:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340535.690145:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960998272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340535.690238:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340535.690409:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960998272 00000100:00100000:1.0:1780340535.690420:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960998272 00000100:00100000:1.0:1780340535.690502:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1884 00000100:00100000:1.0:1780340535.690513:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818960998272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340535.690551:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1780340535.690800:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340535.692971:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818960998272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2436us (2709us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340535.692989:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1884 00000100:00100000:2.0:1780340535.693024:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818960998272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340535.714831:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960998400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340535.714924:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340535.715006:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960998400 00000100:00100000:2.0:1780340535.715016:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960998400 00000100:00100000:2.0:1780340535.715094:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1885 00000100:00100000:2.0:1780340535.715107:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960998400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340535.715143:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340535.715194:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960998400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340535.715201:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1885 00000100:00080000:2.0:1780340535.715226:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340535.715281:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960998400:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1780340536.203805:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340537.226149:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340537.227132:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818960998784:0@lo:400:kworker.0 00000100:00100000:1.0:1780340537.227221:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340537.227263:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960999296:0@lo:400:kworker.0 00000100:00100000:1.0:1780340537.227292:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340537.227322:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1780340537.227337:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818960998656:0@lo:400:kworker.0 00000100:00100000:1.0:1780340537.227500:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340537.227521:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960999168:0@lo:400:kworker.0 00000100:00100000:1.0:1780340537.227551:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340537.227587:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960998784 00000100:00100000:1.0:1780340537.227596:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960998784 00000100:00100000:1.0:1780340537.227657:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960998656 00000100:00100000:1.0:1780340537.227660:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960998656 00000100:00100000:1.0:1780340537.227679:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1780340537.227691:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818960998784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340537.227751:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818960998784:12345-0@lo:400:kworker.0 Request processed in 62us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340537.227799:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1780340537.227819:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:1.0:1780340537.227824:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3662:x1866818960998656:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1780340537.227831:0:63711:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780340537.227858:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3662:x1866818960998656:12345-0@lo:400:kworker.0 Request processed in 33us (358us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780340537.227863:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:1.0:1780340537.227882:0:25497:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960999296 00000100:00100000:1.0:1780340537.227886:0:25497:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960999296 00000100:00100000:1.0:1780340537.227917:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2320 00000100:00100000:1.0:1780340537.227924:0:25497:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818960999296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340537.228196:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818960998912:0@lo:400:kworker.0 00000100:00100000:3.0:1780340537.228235:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340537.228259:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960999424:0@lo:400:kworker.0 00000100:00100000:3.0:1780340537.228281:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340537.228303:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1780340537.228309:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818960998528:0@lo:400:kworker.0 00000400:00000100:3.0:1780340537.228329:0:3659:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818960998528 offset 0 length 224: 4 00000100:00100000:3.0:1780340537.228352:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818960999040:0@lo:400:kworker.0 00000100:00100000:3.0:1780340537.228392:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340537.228421:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818960999552:0@lo:400:kworker.0 00000100:00100000:3.0:1780340537.228444:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340537.228467:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960999424 00000100:00100000:3.0:1780340537.228470:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960999424 00000100:00100000:3.0:1780340537.228504:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2321 00000100:00100000:3.0:1780340537.228511:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960999424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340537.228550:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818960999424:12345-0@lo:400:kworker.0 Request processed in 39us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340537.228556:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2321 00000100:00100000:3.0:1780340537.228579:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960998912 00000100:00100000:3.0:1780340537.228582:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960998912 00000100:00100000:3.0:1780340537.228595:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960999040 00000100:00100000:3.0:1780340537.228597:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960999040 00000100:00100000:3.0:1780340537.228609:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960999552 00000100:00100000:3.0:1780340537.228611:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960999552 00000100:00100000:3.0:1780340537.228620:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1780340537.228626:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b9e0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818960999040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340537.228653:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b9e0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818960999040:12345-0@lo:400:kworker.0 Request processed in 27us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340537.228659:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1780340537.228672:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:3.0:1780340537.228675:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3659:x1866818960998912:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1780340537.228680:0:70100:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1780340537.228698:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3659:x1866818960998912:12345-0@lo:400:kworker.0 Request processed in 22us (463us total) trans 0 rc -107/-107 00000100:00100000:3.0:1780340537.228705:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:0.0:1780340537.229342:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:0.0:1780340537.229351:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1866818960999552:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1780340537.229369:0:63712:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1780340537.229410:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1866818960999552:12345-0@lo:400:kworker.0 Request processed in 59us (966us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780340537.229417:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00080000:0.0:1780340537.229465:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340537.229471:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340537.229474:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340537.229485:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960999168 00000100:00100000:0.0:1780340537.229491:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960999168 00000100:00100000:0.0:1780340537.229521:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3697 00000100:00100000:0.0:1780340537.229526:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3662:x1866818960999168:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1780340537.229543:0:22660:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1780340537.229570:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3662:x1866818960999168:12345-0@lo:400:kworker.0 Request processed in 43us (2018us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780340537.229576:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3697 00000100:00080000:0.0:1780340537.229640:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780340537.229645:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780340537.229650:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780340537.229656:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340537.229661:0:3662:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3100 00000100:00080000:0.0:1780340537.229668:0:3662:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340537.229698:0:3662:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0479d8e680 x1866818960999680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340537.229723:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818960998656:0@lo:400:kworker.0 00000100:00080000:0.0:1780340537.229736:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780340537.229739:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780340537.229742:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780340537.229747:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340537.229750:0:3662:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3281 00000100:00080000:0.0:1780340537.229754:0:3662:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340537.229793:0:3662:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a124e00 x1866818960999808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340537.229804:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960999168:0@lo:400:kworker.0 00000100:00100000:0.0:1780340537.229826:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818960998784:0@lo:400:kworker.0 00000100:00100000:0.0:1780340537.229870:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818960999680:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1780340537.229903:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340537.229923:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818960999808:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1780340537.230514:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340537.230560:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960999680 00000100:00100000:0.0:1780340537.230565:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960999680 00000100:00100000:0.0:1780340537.230589:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:0.0:1780340537.230595:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818960999680:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1780340537.230619:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340537.230658:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a124000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818960999680:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 62us (755us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340537.230665:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00080000:0.0:1780340537.230694:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340537.230699:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340537.230702:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818960999680:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1780340537.230809:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818960999040:0@lo:400:kworker.0 00000100:00080000:0.0:1780340537.230822:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780340537.230826:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780340537.230830:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780340537.230833:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340537.230838:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3100 00000100:00080000:0.0:1780340537.230843:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340537.230862:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a125c00 x1866818960999936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340537.230890:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818960999552:0@lo:400:kworker.0 00000100:00080000:0.0:1780340537.230904:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780340537.230907:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780340537.230911:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780340537.230914:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340537.230918:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3100 00000100:00080000:0.0:1780340537.230922:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340537.231118:0:25497:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818960999296:12345-0@lo:400:kworker.0 Request processed in 3193us (3823us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340537.231127:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2320 00000100:00100000:1.0:1780340537.231163:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818960999296:0@lo:400:kworker.0 00000100:00100000:1.0:1780340537.231201:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818960999936:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1780340537.231231:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340537.231260:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960999936 00000100:00100000:1.0:1780340537.231265:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960999936 00000100:00100000:1.0:1780340537.231290:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:1.0:1780340537.231295:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818960999936:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1780340537.231309:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340537.231338:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818960999936:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 42us (107us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340537.231344:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1780340537.231546:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818960999808 00000100:00100000:2.0:1780340537.231552:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818960999808 00000100:00100000:2.0:1780340537.231576:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3698 00000100:00100000:2.0:1780340537.231582:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818960999808:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1780340537.231599:0:8411:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340537.231634:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a125500 x1866818961000064/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340537.231650:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818960998912:0@lo:400:kworker.0 00000100:00080000:1.0:1780340537.231677:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340537.231681:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340537.231684:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818960999936:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1780340537.231699:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961000064:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1780340537.237678:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a126d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818960999808:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 6081us (7152us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340537.237697:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3698 00000100:00100000:0.0:1780340537.241813:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818960999424:0@lo:400:kworker.0 00000100:00100000:1.0:1780340537.244534:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780340537.244663:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340537.244671:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340537.244677:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818960999808:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1780340537.245489:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961000064 00000100:00100000:0.0:1780340537.245501:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961000064 00000100:00100000:0.0:1780340537.245550:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:0.0:1780340537.245559:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961000064:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1780340537.245587:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340537.245671:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961000064:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 112us (1324us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340537.245679:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00080000:2.0:1780340537.245810:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340537.245818:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340537.245821:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961000064:0@lo:38:ptlrpcd_00_00.0 00000400:00000100:0.0:1780340537.385577:0:3653:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940376576 offset 0 length 224: 4 00000100:00100000:0.0:1780340537.385634:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340537.385672:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340537.385725:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340537.385822:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340537.385859:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940377088 00000100:00100000:0.0:1780340537.385872:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940377088 00000100:00100000:3.0:1780340537.386272:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940376960 00000100:00100000:3.0:1780340537.386278:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940376960 00000100:00100000:3.0:1780340537.386325:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2322 00000100:00100000:3.0:1780340537.386337:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2410:x1866818940377088:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340537.386452:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a124a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2410:x1866818940377088:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 117us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340537.386461:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2322 00000100:00100000:3.0:1780340537.386480:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2323 00000100:00100000:3.0:1780340537.386487:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2410:x1866818940376960:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340537.386511:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a125500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2410:x1866818940376960:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 25us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340537.386518:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2323 00000100:00080000:3.0:1780340537.386686:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340537.386691:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340537.388085:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940376832 00000100:00100000:1.0:1780340537.388101:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940376832 00000100:00100000:1.0:1780340537.388183:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940376704 00000100:00100000:1.0:1780340537.388186:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940376704 00000100:00100000:1.0:1780340537.388219:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1037 00000100:00100000:1.0:1780340537.388230:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940376832:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340537.388319:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a126300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940376832:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 91us (2684us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340537.388343:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1037 00000100:00100000:0.0:1780340537.388692:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1033 00000100:00100000:0.0:1780340537.388700:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2410:x1866818940376704:12345-192.168.203.16@tcp:400:kworker.0 00000020:00080000:0.0:1780340537.388707:0:63710:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.16@tcp 00000100:00100000:0.0:1780340537.388741:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a124380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2410:x1866818940376704:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 41us (3016us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780340537.388748:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1033 00000100:00080000:2.0:1780340537.388974:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340537.392563:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340537.392741:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940377216 00000100:00100000:1.0:1780340537.392754:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940377216 00000100:00100000:1.0:1780340537.392831:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1034 00000100:00100000:1.0:1780340537.392841:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940377216:12345-192.168.203.16@tcp:38:ptlrpcd_01_01.0 00010000:00020000:1.0:1780340537.392871:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340537.393664:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a124e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940377216:12345-192.168.203.16@tcp:38:ptlrpcd_01_01.0 Request processed in 102us (394us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340537.393675:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1034 00010000:00010000:1.0:1780340538.252825:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1780340538.771905:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340538.771926:0:8395:0:(genops.c:906:class_export_put()) final put ffff8c0349152000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780340538.772059:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0349152000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1780340538.772694:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c046ba23800 for lustre-OST0000 00000001:00100000:3.0:1780340538.774354:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1780340538.774366:0:9462:0:(genops.c:906:class_export_put()) final put ffff8c045310f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780340538.775013:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045310f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1780340538.775090:0:49688:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c045310e800 for lustre-OST0001 00000001:00100000:0.0:1780340538.778459:0:72681:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1780340538.778742:0:72681:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378731 is committed 00000020:00000080:0.0:1780340538.778751:0:72681:0:(genops.c:906:class_export_put()) final put ffff8c034a94d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780340538.778918:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c034a94d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1780340538.779013:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c034a948000 for lustre-MDT0001 00010000:00010000:1.0:1780340539.274067:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340540.298169:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340540.811401:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961000320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340540.811506:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340540.811577:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340540.811585:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961000192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340540.811613:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340540.811726:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961000320 00000100:00100000:2.0:1780340540.811737:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961000320 00000100:00100000:2.0:1780340540.811835:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961000192 00000100:00100000:2.0:1780340540.811838:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961000192 00000100:00100000:2.0:1780340540.811861:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1886 00000100:00100000:2.0:1780340540.811873:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961000320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340540.811913:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340540.811967:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a125c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961000320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340540.811974:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1886 00000100:00100000:2.0:1780340540.811992:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1887 00000100:00100000:2.0:1780340540.811999:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961000192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340540.812016:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340540.812056:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961000192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340540.812084:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1887 00000100:00080000:0.0:1780340540.813194:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340540.813204:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340540.813281:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961000192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340540.813306:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961000320:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1780340541.326398:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780340542.346912:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340542.346919:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340542.346924:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340542.346933:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3317 00000100:00080000:2.0:1780340542.346941:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780340542.346949:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340542.346974:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d875880 x1866818961000576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340542.346998:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340542.347001:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340542.347003:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340542.347007:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3317 00000100:00080000:2.0:1780340542.347010:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780340542.347013:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340542.347034:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d876a00 x1866818961000832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340542.347064:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340542.347068:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340542.347070:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340542.347074:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3317 00000100:00080000:2.0:1780340542.347077:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780340542.347080:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340542.347092:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d874380 x1866818961001088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340542.347135:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340542.347139:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340542.347141:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340542.347144:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3317 00000100:00080000:2.0:1780340542.347147:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780340542.347151:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340542.347161:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d876680 x1866818961001472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340542.347192:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961000704:0@lo:400:kworker.0 00000100:00100000:2.0:1780340542.347287:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340542.347334:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1780340542.347340:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961000448:0@lo:400:kworker.0 00000400:00000100:2.0:1780340542.347362:0:3660:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961000448 offset 0 length 224: 4 00000100:00100000:2.0:1780340542.347384:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961001344:0@lo:400:kworker.0 00000100:00100000:2.0:1780340542.347409:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340542.347438:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961000576:0@lo:38:kworker.0 00000100:00100000:2.0:1780340542.347463:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340542.347478:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961000832:0@lo:38:kworker.0 00000100:00100000:2.0:1780340542.347498:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340542.347513:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961001088:0@lo:38:kworker.0 00000100:00100000:2.0:1780340542.347535:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340542.347552:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961001472:0@lo:38:kworker.0 00000100:00100000:2.0:1780340542.347572:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340542.347611:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961000960:0@lo:400:kworker.0 00000100:00100000:2.0:1780340542.347637:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340542.347653:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780340542.347658:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961001216:0@lo:400:kworker.0 00000100:00100000:2.0:1780340542.347679:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340542.347713:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961000704 00000100:00100000:2.0:1780340542.347722:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961000704 00000100:00100000:2.0:1780340542.347828:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961000576 00000100:00100000:2.0:1780340542.347831:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961000576 00000100:00100000:2.0:1780340542.347842:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961000832 00000100:00100000:2.0:1780340542.347844:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961000832 00000100:00100000:2.0:1780340542.347852:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961001472 00000100:00100000:2.0:1780340542.347853:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961001472 00000100:00100000:2.0:1780340542.347861:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961000960 00000100:00100000:2.0:1780340542.347863:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961000960 00000100:00100000:2.0:1780340542.347902:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1780340542.347911:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961000704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340542.347971:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961000704:12345-0@lo:400:kworker.0 Request processed in 60us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340542.347979:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1780340542.348002:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:2.0:1780340542.348009:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961000960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340542.348052:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961000960:12345-0@lo:400:kworker.0 Request processed in 43us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340542.348058:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:2.0:1780340542.348073:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:2.0:1780340542.348077:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961000576:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340542.348100:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340542.348151:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961000576:12345-0@lo:38:kworker.0 Request processed in 71us (686us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340542.348159:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:2.0:1780340542.348175:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:2.0:1780340542.348179:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961000832:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340542.348189:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340542.348211:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961000832:12345-0@lo:38:kworker.0 Request processed in 31us (713us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340542.348217:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:2.0:1780340542.348228:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:2.0:1780340542.348233:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961001472:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340542.348242:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340542.348260:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961001472:12345-0@lo:38:kworker.0 Request processed in 27us (688us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340542.348266:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:2.0:1780340542.348286:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961001344 00000100:00100000:2.0:1780340542.348289:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961001344 00000100:00100000:2.0:1780340542.348318:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961001216 00000100:00100000:2.0:1780340542.348321:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961001216 00000100:00100000:2.0:1780340542.348341:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2324 00000100:00100000:2.0:1780340542.348348:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961001344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340542.348378:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961001344:12345-0@lo:400:kworker.0 Request processed in 32us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340542.348384:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2324 00000100:00100000:2.0:1780340542.348394:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2325 00000100:00100000:2.0:1780340542.348399:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961001216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340542.348435:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961001216:12345-0@lo:400:kworker.0 Request processed in 36us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340542.348441:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2325 00000100:00100000:2.0:1780340542.348466:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961001088 00000100:00100000:2.0:1780340542.348470:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961001088 00000100:00100000:2.0:1780340542.348493:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3699 00000100:00100000:2.0:1780340542.348498:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961001088:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340542.348507:0:22660:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340542.348534:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961001088:12345-0@lo:38:kworker.0 Request processed in 35us (997us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340542.348539:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3699 00000100:00080000:2.0:1780340542.348559:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340542.348564:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340542.348566:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340542.348615:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961001216:0@lo:400:kworker.0 00000100:00100000:2.0:1780340542.348626:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961000960:0@lo:400:kworker.0 00000100:00080000:2.0:1780340542.348661:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340542.348667:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340542.348670:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961000576:0@lo:38:kworker.0 00000100:00080000:2.0:1780340542.348679:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340542.348682:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340542.348685:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961000832:0@lo:38:kworker.0 00000100:00080000:2.0:1780340542.348693:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340542.348696:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340542.348705:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961001088:0@lo:38:kworker.0 00000100:00080000:2.0:1780340542.348715:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340542.348719:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340542.348721:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961001472:0@lo:38:kworker.0 00000100:00100000:2.0:1780340542.348755:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961001344:0@lo:400:kworker.0 00000100:00100000:2.0:1780340542.348812:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961000704:0@lo:400:kworker.0 00010000:00010000:3.0:1780340542.349507:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1780340542.504299:0:3654:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940377344 offset 0 length 224: 4 00000100:00100000:3.0:1780340542.504450:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340542.504671:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940377472 00000100:00100000:2.0:1780340542.504684:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940377472 00000100:00100000:2.0:1780340542.504756:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1038 00000100:00100000:2.0:1780340542.504826:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2406:x1866818940377472:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:2.0:1780340542.504856:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340542.505191:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2406:x1866818940377472:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 365us (739us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340542.505199:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1038 00000100:00100000:3.0:1780340542.518569:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340542.518699:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340542.519407:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940377600 00000100:00100000:2.0:1780340542.519423:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940377600 00000100:00100000:2.0:1780340542.519539:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1040 00000100:00100000:2.0:1780340542.519551:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940377600:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340542.519646:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940377600:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 96us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340542.519653:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1040 00000100:00080000:0.0:1780340542.519835:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340542.520044:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940377728 00000100:00100000:1.0:1780340542.520050:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940377728 00000100:00100000:1.0:1780340542.520118:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2326 00000100:00100000:1.0:1780340542.520128:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940377728:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340542.520171:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940377728:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 46us (1473us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340542.520178:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2326 00000100:00080000:0.0:1780340542.521175:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340542.528219:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340542.528356:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940377856 00000100:00100000:1.0:1780340542.528370:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940377856 00000100:00100000:3.0:1780340542.528609:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2327 00000100:00100000:3.0:1780340542.528624:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940377856:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340542.528732:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940377856:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 112us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340542.528798:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2327 00000100:00080000:0.0:1780340542.529483:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1780340543.372988:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340544.394244:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340545.421523:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340545.930202:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961001600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340545.930301:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340545.930425:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961001600 00000100:00100000:2.0:1780340545.930436:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961001600 00000100:00100000:2.0:1780340545.930533:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1888 00000100:00100000:2.0:1780340545.930545:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961001600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340545.930582:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340545.930634:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961001600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340545.930642:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1888 00000100:00080000:3.0:1780340545.930730:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340545.930802:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961001600:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340545.931037:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340545.931052:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961001728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340545.931085:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340545.931154:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961001728 00000100:00100000:1.0:1780340545.931160:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961001728 00000100:00100000:1.0:1780340545.931206:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1889 00000100:00100000:1.0:1780340545.931214:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961001728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340545.931234:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340545.931273:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961001728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340545.931280:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1889 00000100:00080000:3.0:1780340545.931397:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340545.931422:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961001728:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1780340546.443411:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1780340547.466170:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340547.466189:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340547.466195:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340547.466204:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3322 00000100:00080000:0.0:1780340547.466211:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780340547.466219:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340547.466247:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0479d8f100 x1866818961001984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340547.466286:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340547.466290:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340547.466292:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340547.466295:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3322 00000100:00080000:0.0:1780340547.466298:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780340547.466301:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340547.466313:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0479d8f480 x1866818961002240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340547.466329:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340547.466333:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340547.466334:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340547.466338:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3322 00000100:00080000:0.0:1780340547.466341:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780340547.466345:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340547.466356:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0479d8fb80 x1866818961002496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340547.466397:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340547.466401:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340547.466403:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340547.466406:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3322 00000100:00080000:0.0:1780340547.466409:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780340547.466412:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340547.466422:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0479d8ea00 x1866818961002880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340547.466458:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961002112:0@lo:400:kworker.0 00000100:00100000:0.0:1780340547.466546:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340547.466594:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340547.466600:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961002368:0@lo:400:kworker.0 00000100:00100000:0.0:1780340547.466637:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340547.466670:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961002112 00000100:00100000:0.0:1780340547.466679:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961002112 00000100:00100000:0.0:1780340547.466732:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961002368 00000100:00100000:0.0:1780340547.466734:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961002368 00000100:00100000:0.0:1780340547.466756:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1780340547.466790:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961002112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340547.466845:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961002112:12345-0@lo:400:kworker.0 Request processed in 57us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340547.466853:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1780340547.466871:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:0.0:1780340547.466877:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961002368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340547.466901:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961002368:12345-0@lo:400:kworker.0 Request processed in 25us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340547.466914:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:0.0:1780340547.466958:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961002368:0@lo:400:kworker.0 00000100:00100000:0.0:1780340547.466968:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961002112:0@lo:400:kworker.0 00000100:00080000:0.0:1780340547.467034:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340547.467166:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961002624:0@lo:400:kworker.0 00000100:00100000:2.0:1780340547.467218:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340547.467251:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1780340547.467258:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961001856:0@lo:400:kworker.0 00000400:00000100:2.0:1780340547.467279:0:3661:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961001856 offset 0 length 224: 4 00000100:00100000:2.0:1780340547.467300:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961002752:0@lo:400:kworker.0 00000100:00100000:2.0:1780340547.467325:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340547.467353:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961001984:0@lo:38:kworker.0 00000100:00100000:2.0:1780340547.467379:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340547.467398:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961002240:0@lo:38:kworker.0 00000100:00100000:2.0:1780340547.467418:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340547.467432:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961002496:0@lo:38:kworker.0 00000100:00100000:1.0:1780340547.467435:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961001984 00000100:00100000:1.0:1780340547.467439:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961001984 00000100:00100000:2.0:1780340547.467453:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340547.467462:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961002240 00000100:00100000:1.0:1780340547.467464:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961002240 00000100:00100000:2.0:1780340547.467470:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961002880:0@lo:38:kworker.0 00000100:00100000:1.0:1780340547.467475:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1780340547.467481:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961001984:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1780340547.467487:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:1.0:1780340547.467504:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340547.467508:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961002880 00000100:00100000:2.0:1780340547.467511:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961002880 00000100:00100000:2.0:1780340547.467527:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:2.0:1780340547.467532:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961002240:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1780340547.467541:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961001984:12345-0@lo:38:kworker.0 Request processed in 60us (161us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340547.467547:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00010000:00020000:2.0:1780340547.467549:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340547.467560:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:1.0:1780340547.467563:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961002880:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1780340547.467571:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961002240:12345-0@lo:38:kworker.0 Request processed in 39us (152us total) trans 0 rc -19/-19 00010000:00020000:1.0:1780340547.467572:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340547.467577:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1780340547.467590:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961002880:12345-0@lo:38:kworker.0 Request processed in 25us (101us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340547.467595:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:2.0:1780340547.467599:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961002624 00000100:00100000:2.0:1780340547.467602:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961002624 00000100:00100000:2.0:1780340547.467636:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961002752 00000100:00100000:2.0:1780340547.467639:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961002752 00000100:00100000:1.0:1780340547.467639:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961002496 00000100:00100000:1.0:1780340547.467642:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961002496 00000100:00100000:2.0:1780340547.467659:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2328 00000100:00100000:1.0:1780340547.467661:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3700 00000100:00100000:2.0:1780340547.467665:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961002624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340547.467672:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961002496:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340547.467682:0:26074:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340547.467701:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961002624:12345-0@lo:400:kworker.0 Request processed in 37us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340547.467703:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961002496:12345-0@lo:38:kworker.0 Request processed in 30us (249us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340547.467707:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2328 00000100:00100000:1.0:1780340547.467708:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3700 00000100:00100000:2.0:1780340547.467719:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2329 00000100:00100000:2.0:1780340547.467725:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04777ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961002752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340547.467753:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04777ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961002752:12345-0@lo:400:kworker.0 Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340547.467790:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2329 00000100:00100000:1.0:1780340547.467935:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961002752:0@lo:400:kworker.0 00000100:00100000:1.0:1780340547.467943:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961002624:0@lo:400:kworker.0 00000100:00080000:2.0:1780340547.468022:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340547.468028:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340547.468031:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961001984:0@lo:38:kworker.0 00000100:00080000:2.0:1780340547.468038:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340547.468041:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340547.468043:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961002240:0@lo:38:kworker.0 00000100:00080000:2.0:1780340547.468050:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340547.468059:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340547.468062:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961002496:0@lo:38:kworker.0 00000100:00080000:2.0:1780340547.468084:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340547.468087:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340547.468089:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961002880:0@lo:38:kworker.0 00000100:00080000:0.0:1780340547.471490:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340547.471504:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1780340547.475399:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1780340547.632052:0:3653:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940377984 offset 0 length 224: 4 00000100:00100000:1.0:1780340547.632107:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340547.632163:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340547.638855:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940378112 00000100:00100000:0.0:1780340547.638924:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940378112 00000100:00100000:0.0:1780340547.639064:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940378240 00000100:00100000:0.0:1780340547.639069:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940378240 00000100:00100000:0.0:1780340547.639163:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1043 00000100:00100000:0.0:1780340547.639177:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940378240:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340547.639308:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940378240:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 134us (7143us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340547.639317:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1043 00000100:00100000:1.0:1780340547.639328:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1042 00000100:00100000:1.0:1780340547.639337:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940378112:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:1.0:1780340547.639363:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340547.639401:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940378112:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 64us (7296us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340547.639408:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1042 00000100:00080000:0.0:1780340547.640318:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340547.645527:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340547.645566:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340547.646375:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940378368 00000100:00100000:1.0:1780340547.646390:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940378368 00000100:00100000:1.0:1780340547.646484:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940378496 00000100:00100000:1.0:1780340547.646487:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940378496 00000100:00100000:1.0:1780340547.646518:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5855 00000100:00100000:1.0:1780340547.646530:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2406:x1866818940378368:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:1.0:1780340547.646572:0:25486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432772c54 00000100:00080000:1.0:1780340547.646582:0:25486:0:(import.c:65:import_set_state_nolock()) ffff8c047570c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1780340547.646645:0:25486:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:1.0:1780340547.646889:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e06e5cf1-1986-4ba7-9630-fad7efb74eca+2:2406:x1866818940378368:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 360us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340547.646898:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5855 00000100:00100000:1.0:1780340547.646921:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5856 00000100:00100000:1.0:1780340547.646929:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2406:x1866818940378496:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:1.0:1780340547.646943:0:25486:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327730ec 00000100:00080000:1.0:1780340547.646948:0:25486:0:(import.c:65:import_set_state_nolock()) ffff8c0346fd3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1780340547.646974:0:25486:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:1.0:1780340547.647063:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e06e5cf1-1986-4ba7-9630-fad7efb74eca+2:2406:x1866818940378496:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 134us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340547.647069:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5856 00010000:00010000:1.0:1780340547.647101:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340547.647108:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1780340547.647343:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340547.647348:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1780340548.490884:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340549.514027:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340550.538639:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340551.054269:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961003008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340551.054339:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340551.054397:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961003008 00000100:00100000:1.0:1780340551.054405:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961003008 00000100:00100000:1.0:1780340551.054460:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1890 00000100:00100000:1.0:1780340551.054469:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961003008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340551.054499:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340551.054542:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961003008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340551.054549:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1890 00000100:00080000:1.0:1780340551.054570:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340551.054603:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961003008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340551.055355:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961003136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340551.055403:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340551.062638:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961003136 00000100:00100000:0.0:1780340551.063700:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961003136 00000100:00100000:0.0:1780340551.063932:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1891 00000100:00100000:0.0:1780340551.063942:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961003136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340551.063981:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340551.066969:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961003136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3010us (11547us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340551.066991:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1891 00000100:00080000:3.0:1780340551.069246:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340551.072254:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961003136:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1780340551.561936:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340552.586869:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1780340552.587087:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340552.587092:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340552.587096:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340552.587114:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3327 00000100:00080000:3.0:1780340552.587119:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1780340552.587125:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340552.587145:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03484f3b80 x1866818961003392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340552.587177:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340552.587181:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340552.587193:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340552.587197:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3327 00000100:00080000:3.0:1780340552.587200:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1780340552.587203:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340552.587215:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03484f1180 x1866818961003648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340552.587239:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340552.587242:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340552.587243:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340552.587246:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3327 00000100:00080000:3.0:1780340552.587248:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1780340552.587251:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340552.587263:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03484f1c00 x1866818961003904/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340552.587282:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340552.587285:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340552.587286:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340552.587290:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3327 00000100:00080000:3.0:1780340552.587292:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1780340552.587295:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340552.587307:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03484f0e00 x1866818961004288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340552.587343:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961003392:0@lo:38:kworker.0 00000100:00100000:3.0:1780340552.587413:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340552.587452:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961003648:0@lo:38:kworker.0 00000100:00100000:3.0:1780340552.587874:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340552.587890:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961003904:0@lo:38:kworker.0 00000100:00100000:3.0:1780340552.587913:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340552.587931:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961004288:0@lo:38:kworker.0 00000100:00100000:3.0:1780340552.587962:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340552.588001:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961003904 00000100:00100000:3.0:1780340552.588007:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961003904 00000100:00100000:3.0:1780340552.588043:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3701 00000100:00100000:3.0:1780340552.588049:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03474c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961003904:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780340552.588069:0:8410:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340552.588119:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03474c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961003904:12345-0@lo:38:kworker.0 Request processed in 68us (204us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340552.588125:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3701 00000100:00080000:3.0:1780340552.588166:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340552.588171:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340552.588174:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961003904:0@lo:38:kworker.0 00000100:00100000:0.0:1780340552.588589:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961003264:0@lo:400:kworker.0 00000400:00000100:0.0:1780340552.588617:0:3661:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961003264 offset 0 length 224: 4 00000100:00100000:0.0:1780340552.588639:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961004160:0@lo:400:kworker.0 00000100:00100000:0.0:1780340552.588662:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340552.588690:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780340552.588696:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961003520:0@lo:400:kworker.0 00000100:00100000:0.0:1780340552.588715:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340552.588742:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961003776:0@lo:400:kworker.0 00000100:00100000:0.0:1780340552.588785:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340552.588803:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340552.588809:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961004032:0@lo:400:kworker.0 00000100:00100000:0.0:1780340552.588839:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340552.588863:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961003392 00000100:00100000:0.0:1780340552.588867:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961003392 00000100:00100000:0.0:1780340552.588886:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961003648 00000100:00100000:0.0:1780340552.588889:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961003648 00000100:00100000:0.0:1780340552.588897:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961004288 00000100:00100000:0.0:1780340552.588900:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961004288 00000100:00100000:0.0:1780340552.588907:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961003520 00000100:00100000:0.0:1780340552.588910:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961003520 00000100:00100000:0.0:1780340552.588936:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961003776 00000100:00100000:0.0:1780340552.588939:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961003776 00000100:00100000:0.0:1780340552.588965:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:0.0:1780340552.588971:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961003520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340552.589015:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961003520:12345-0@lo:400:kworker.0 Request processed in 44us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340552.589032:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:0.0:1780340552.589046:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1780340552.589052:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961003776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340552.589084:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961003776:12345-0@lo:400:kworker.0 Request processed in 33us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340552.589090:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1780340552.589112:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1780340552.589116:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961003392:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340552.589129:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340552.589159:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961003392:12345-0@lo:38:kworker.0 Request processed in 42us (1747us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340552.589164:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1780340552.589177:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:0.0:1780340552.589181:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961003648:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340552.589190:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340552.589212:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961003648:12345-0@lo:38:kworker.0 Request processed in 30us (1339us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340552.589218:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:0.0:1780340552.589231:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1780340552.589235:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0345eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961004288:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340552.589243:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340552.589266:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0345eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961004288:12345-0@lo:38:kworker.0 Request processed in 29us (1303us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340552.589271:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1780340552.589304:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961004160 00000100:00100000:0.0:1780340552.589307:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961004160 00000100:00100000:0.0:1780340552.589328:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961004032 00000100:00100000:0.0:1780340552.589330:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961004032 00000100:00100000:0.0:1780340552.589344:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2330 00000100:00100000:0.0:1780340552.589350:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961004160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340552.589376:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961004160:12345-0@lo:400:kworker.0 Request processed in 27us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340552.589382:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2330 00000100:00100000:0.0:1780340552.589390:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2331 00000100:00100000:0.0:1780340552.589409:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961004032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340552.589430:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961004032:12345-0@lo:400:kworker.0 Request processed in 35us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340552.589435:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2331 00000100:00100000:0.0:1780340552.589618:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961004032:0@lo:400:kworker.0 00000100:00100000:0.0:1780340552.589628:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961003776:0@lo:400:kworker.0 00000100:00100000:0.0:1780340552.589652:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961003520:0@lo:400:kworker.0 00000100:00100000:0.0:1780340552.589659:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961004160:0@lo:400:kworker.0 00000100:00080000:0.0:1780340552.589678:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340552.589681:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340552.589684:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961003392:0@lo:38:kworker.0 00000100:00080000:0.0:1780340552.589691:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340552.589694:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340552.589696:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961003648:0@lo:38:kworker.0 00000100:00080000:0.0:1780340552.589711:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340552.589714:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340552.589717:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961004288:0@lo:38:kworker.0 00000100:00080000:3.0:1780340552.591268:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340552.772593:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340552.773509:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940378880 00000100:00100000:0.0:1780340552.773519:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940378880 00000100:00100000:0.0:1780340552.773577:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1046 00000100:00100000:0.0:1780340552.773586:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940378880:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340552.774534:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940378880:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 945us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340552.774544:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1046 00000100:00080000:0.0:1780340552.774569:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340552.782888:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000400:00000100:0.0:1780340552.783016:0:3654:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940378624 offset 0 length 224: 4 00000100:00100000:0.0:1780340552.783057:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940378752 00000100:00100000:0.0:1780340552.783066:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940378752 00000100:00100000:0.0:1780340552.783182:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1046 00000100:00100000:0.0:1780340552.783191:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940378752:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:0.0:1780340552.783213:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340552.783272:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940378752:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 81us (392us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340552.783280:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1046 00000001:00100000:0.0:1780340553.110874:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000020:00000080:0.0:1780340553.110882:0:9462:0:(genops.c:906:class_export_put()) final put ffff8c0349150000/e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000020:00000080:3.0:1780340553.114816:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0349150000/e06e5cf1-1986-4ba7-9630-fad7efb74eca for lustre-OST0001 00000020:00000080:3.0:1780340553.114868:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0346fd3800 for lustre-OST0001 00000001:00100000:3.0:1780340553.117231:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000020:00000080:3.0:1780340553.117243:0:8395:0:(genops.c:906:class_export_put()) final put ffff8c047570f800/e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000020:00000080:1.0:1780340553.122496:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047570f800/e06e5cf1-1986-4ba7-9630-fad7efb74eca for lustre-OST0000 00000020:00000080:1.0:1780340553.122553:0:49688:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047570c000 for lustre-OST0000 00010000:00010000:0.0:1780340553.609895:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1780340553.610020:0:3659:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780340537/real 1780340537] req@ffff8c045ec43b80 x1866818960998528/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780340553 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340553.610059:0:3659:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8c045ec43b80 x1866818960998528/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780340553 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340553.610069:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1780340553.610073:0:3659:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1780340553.628524:0:3659:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.116@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1780340553.628529:0:3659:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1780340553.628538:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c045ec43b80 x1866818960998528/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780340553 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340553.628551:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c034d875c00 x1866818961000448/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340558 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340553.628567:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c0479d8d880 x1866818961001856/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340563 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340553.628580:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c03484f3800 x1866818961003264/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340568 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1780340553.628589:0:3659:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1780340553.628592:0:3659:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1780340553.628594:0:3659:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1780340553.628596:0:3659:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00080000:2.0:1780340553.628672:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340553.628676:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1780340553.628680:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340553.628685:0:71335:0:(import.c:512:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 3094 00000100:00080000:2.0:1780340553.628693:0:71335:0:(import.c:626:import_select_connection()) MGC192.168.203.116@tcp: import ffff8c0475490800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340553.628722:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03498cb800 x1866818961004416/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340553.628738:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340553.628742:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340553.628743:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340553.628746:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3332 00000100:00080000:2.0:1780340553.628749:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340553.628753:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340553.628793:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03498ca680 x1866818961004544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340553.628813:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340553.628816:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340553.628827:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340553.628831:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3332 00000100:00080000:2.0:1780340553.628833:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340553.628836:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340553.628848:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03498c9180 x1866818961004800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340553.628863:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340553.628866:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340553.628872:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340553.628875:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3332 00000100:00080000:2.0:1780340553.628877:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340553.628881:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340553.628894:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a125180 x1866818961005056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340553.628925:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340553.628928:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340553.628930:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340553.628933:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3332 00000100:00080000:2.0:1780340553.628935:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340553.628938:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340553.628958:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d875f80 x1866818961005440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340553.629222:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961005184:0@lo:400:kworker.0 00000100:00100000:0.0:1780340553.629295:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340553.629328:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961000448:0@lo:400:kworker.0 00000100:00100000:0.0:1780340553.629349:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340553.629354:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961004928:0@lo:400:kworker.0 00000100:00100000:0.0:1780340553.629376:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340553.629401:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961005312:0@lo:400:kworker.0 00000100:00100000:0.0:1780340553.629423:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340553.629442:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961003264:0@lo:400:kworker.0 00000100:00100000:0.0:1780340553.629448:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961001856:0@lo:400:kworker.0 00000100:00100000:0.0:1780340553.629470:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780340553.629475:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961004672:0@lo:400:kworker.0 00000100:00100000:0.0:1780340553.629493:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340553.629513:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961004416:0@lo:250:kworker.0 00000400:00000100:0.0:1780340553.629529:0:3658:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961004416 offset 0 length 520: 4 00000100:00100000:0.0:1780340553.629545:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961004544:0@lo:38:kworker.0 00000100:00100000:0.0:1780340553.629561:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340553.629573:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961004800:0@lo:38:kworker.0 00000100:00100000:0.0:1780340553.629590:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340553.629603:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961005056:0@lo:38:kworker.0 00000100:00100000:0.0:1780340553.629621:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340553.629637:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961005440:0@lo:38:kworker.0 00000100:00100000:0.0:1780340553.629654:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340553.629810:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961005184 00000100:00100000:3.0:1780340553.629817:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818960998528:0@lo:400:kworker.0 00000100:00100000:0.0:1780340553.629818:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961005184 00000100:00100000:0.0:1780340553.629884:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961005312 00000100:00100000:0.0:1780340553.629888:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961005312 00000100:00100000:0.0:1780340553.629917:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2332 00000100:00100000:0.0:1780340553.629926:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961005184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340553.629986:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961005184:12345-0@lo:400:kworker.0 Request processed in 60us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340553.629997:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2332 00000100:00100000:0.0:1780340553.630014:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2333 00000100:00100000:0.0:1780340553.630020:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961005312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340553.630200:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961005312:12345-0@lo:400:kworker.0 Request processed in 180us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340553.630207:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2333 00000100:00100000:0.0:1780340553.630223:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961004928 00000100:00100000:0.0:1780340553.630226:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961004928 00000100:00100000:0.0:1780340553.630243:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961004672 00000100:00100000:0.0:1780340553.630245:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961004672 00000100:00100000:0.0:1780340553.630253:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961004544 00000100:00100000:0.0:1780340553.630255:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961004544 00000100:00100000:0.0:1780340553.630263:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961004800 00000100:00100000:0.0:1780340553.630265:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961004800 00000100:00100000:0.0:1780340553.630271:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961005440 00000100:00100000:0.0:1780340553.630273:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961005440 00000100:00100000:0.0:1780340553.630282:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:0.0:1780340553.630287:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961004928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340553.630312:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961004928:12345-0@lo:400:kworker.0 Request processed in 25us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340553.630317:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:0.0:1780340553.630334:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1780340553.630339:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961004672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340553.630361:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961004672:12345-0@lo:400:kworker.0 Request processed in 22us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340553.630366:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1780340553.630375:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:0.0:1780340553.630379:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961004544:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340553.630395:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340553.630418:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961004544:12345-0@lo:38:kworker.0 Request processed in 37us (856us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340553.630423:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:0.0:1780340553.630432:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1780340553.630436:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961004800:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340553.630443:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340553.630460:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961004800:12345-0@lo:38:kworker.0 Request processed in 23us (868us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340553.630465:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1780340553.630473:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1780340553.630477:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961005440:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340553.630484:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340553.630500:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961005440:12345-0@lo:38:kworker.0 Request processed in 22us (845us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340553.630505:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1780340553.630526:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961005056 00000100:00100000:0.0:1780340553.630529:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961005056 00000100:00100000:0.0:1780340553.630552:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3702 00000100:00100000:0.0:1780340553.630556:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961005056:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340553.630564:0:26074:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340553.630584:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961005056:12345-0@lo:38:kworker.0 Request processed in 28us (963us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340553.630589:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3702 00000100:00100000:0.0:1780340553.630625:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961004672:0@lo:400:kworker.0 00000100:00100000:0.0:1780340553.630634:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961005312:0@lo:400:kworker.0 00000100:00100000:0.0:1780340553.630653:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961004928:0@lo:400:kworker.0 00000100:00100000:0.0:1780340553.630662:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961005184:0@lo:400:kworker.0 00000100:00080000:0.0:1780340553.630678:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340553.630683:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340553.630686:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961004544:0@lo:38:kworker.0 00000100:00080000:0.0:1780340553.630692:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340553.630695:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340553.630698:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961004800:0@lo:38:kworker.0 00000100:00080000:0.0:1780340553.630704:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340553.630706:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340553.630709:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961005056:0@lo:38:kworker.0 00000100:00080000:0.0:1780340553.630715:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340553.630718:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340553.630720:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961005440:0@lo:38:kworker.0 00000100:00080000:3.0:1780340553.631265:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340553.631271:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340553.631404:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000400:00000100:0.0:1780340553.631435:0:3654:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940379008 offset 0 length 520: 4 00000100:00100000:0.0:1780340553.631500:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340553.631521:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940379264 00000100:00100000:0.0:1780340553.631525:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940379264 00000100:00100000:0.0:1780340553.631550:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940379136 00000100:00100000:0.0:1780340553.631553:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940379136 00000100:00100000:0.0:1780340553.631566:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1049 00000100:00100000:0.0:1780340553.631573:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940379264:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340553.631616:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940379264:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 44us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340553.631622:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1049 00000100:00100000:0.0:1780340553.631635:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1050 00000100:00100000:0.0:1780340553.631639:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940379136:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:0.0:1780340553.631651:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340553.631669:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940379136:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 28us (169us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340553.631675:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1050 00010000:00010000:0.0:1780340554.634161:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340555.664173:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340556.170465:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340556.170486:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961005696:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340556.170551:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340556.170604:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961005696 00000100:00100000:3.0:1780340556.170611:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961005696 00000100:00100000:3.0:1780340556.170665:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1892 00000100:00100000:3.0:1780340556.170674:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961005696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340556.170702:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340556.170745:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961005696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340556.170752:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1892 00000100:00080000:3.0:1780340556.170816:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340556.170852:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961005696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340556.171041:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961005568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340556.171073:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340556.171198:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961005568 00000100:00100000:3.0:1780340556.171202:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961005568 00000100:00100000:3.0:1780340556.171239:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1893 00000100:00100000:3.0:1780340556.171246:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961005568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340556.171264:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340556.171297:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961005568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340556.171304:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1893 00000100:00100000:3.0:1780340556.171333:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961005568:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1780340556.171391:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1780340556.682632:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340557.705954:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1780340558.296048:0:81805:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1780340558.296053:0:81805:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1780340558.296054:0:81805:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1780340558.296171:0:81805:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8c0475faf800 00000020:01000004:1.0:1780340558.296185:0:81805:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1780340558.296199:0:81805:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1780340558.296213:0:81805:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8c0445ba3380) 00000020:00000080:1.0:1780340558.296228:0:81805:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1780340558.377829:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1780340558.379498:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1780340558.383874:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1780340558.384126:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1780340558.384383:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1780340558.384618:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1780340558.384861:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1780340558.385090:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1780340558.385329:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1780340558.385572:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1780340558.388613:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1780340558.389336:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1780340558.389982:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1780340558.390247:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1780340558.390613:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1780340558.390933:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1780340558.391138:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1780340558.391961:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1780340558.393944:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1780340558.395341:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1780340558.397112:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1780340558.398273:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1780340558.399001:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1780340558.399433:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1780340558.400029:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1780340558.400564:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1780340558.401290:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1780340558.401666:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1780340558.402193:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1780340558.404467:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1780340558.406332:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1780340558.410247:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1780340558.411111:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1780340558.411479:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1780340558.414804:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1780340558.416861:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1780340558.417912:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1780340558.422919:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1780340558.423261:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1780340558.423490:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1780340558.423719:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1780340558.424082:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1780340558.424288:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1780340558.424564:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1780340558.426408:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1780340558.430270:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1780340558.431073:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1780340558.431735:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1780340558.439108:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1780340558.440297:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1780340558.441095:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1780340558.441317:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1780340558.441528:0:81805:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:3.0:1780340558.442720:0:81805:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1780340558.444247:0:81805:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1780340558.444256:0:81805:0:(osd_handler.c:8933:osd_obd_connect()) connect #0 00000020:00000080:3.0:1780340558.444270:0:81805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432773204 00000020:01000004:3.0:1780340558.444277:0:81805:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1780340558.444288:0:81805:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1780340558.444293:0:81805:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c0475faf800 from MGS 00000020:01000004:3.0:1780340558.444297:0:81805:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1780340558.444308:0:81805:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8c0349000000) 00000020:00000080:3.0:1780340558.444319:0:81805:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1780340558.444383:0:81805:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0475faf800 from MGS, refs=2 00080000:01000000:3.0:1780340558.444387:0:81805:0:(osd_handler.c:8933:osd_obd_connect()) connect #1 00000020:00000080:3.0:1780340558.444393:0:81805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432773212 00010000:00010000:3.0:1780340558.444518:0:81805:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1780340558.457426:0:81805:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1780340558.460248:0:81809:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1780340558.460334:0:81805:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1780340558.460389:0:81805:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1780340558.461400:0:81805:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1780340558.461643:0:81805:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1780340558.461975:0:81805:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1780340558.461982:0:81805:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1780340558.465315:0:81805:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1780340558.465331:0:81805:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1780340558.466171:0:81805:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1780340558.466179:0:81805:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1780340558.467871:0:81805:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1780340558.467897:0:81805:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1780340558.467899:0:81805:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.116@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1780340558.467903:0:81805:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.116@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1780340558.467918:0:81805:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8c0475490800 already not connected (conn 56, was 0): CONNECTING 00000100:00100000:1.0:1780340558.467924:0:81805:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00080000:0.0:1780340558.732727:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340558.732755:0:80497:0:(pinger.c:249:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1780340558.732781:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340558.732785:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340558.732789:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340558.732796:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3333 00000100:00080000:0.0:1780340558.732801:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340558.732808:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340558.732843:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c045ec40a80 x1866818961005824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340558.732890:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340558.732894:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340558.732895:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340558.732898:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3333 00000100:00080000:0.0:1780340558.732901:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340558.732914:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340558.732933:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c045ec41880 x1866818961006080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340558.732954:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340558.732957:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340558.732959:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340558.732961:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3333 00000100:00080000:0.0:1780340558.732964:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340558.732966:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340558.732974:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c045ec41180 x1866818961006336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340558.732998:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340558.733001:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340558.733003:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340558.733006:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3333 00000100:00080000:0.0:1780340558.733008:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340558.733011:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340558.733021:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c045ec40e00 x1866818961006720/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1780340558.733082:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340558.733154:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961005952:0@lo:400:kworker.0 00000100:00100000:3.0:1780340558.733214:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340558.733252:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340558.733257:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961006592:0@lo:400:kworker.0 00000100:00100000:3.0:1780340558.733279:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340558.733303:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961006464:0@lo:400:kworker.0 00000100:00100000:3.0:1780340558.733321:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340558.733334:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340558.733338:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961006208:0@lo:400:kworker.0 00000100:00100000:3.0:1780340558.733353:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340558.733376:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961006592 00000100:00100000:3.0:1780340558.733382:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961006592 00000100:00100000:3.0:1780340558.733423:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961006464 00000100:00100000:3.0:1780340558.733425:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961006464 00000100:00100000:3.0:1780340558.733449:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2334 00000100:00100000:3.0:1780340558.733456:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961006592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340558.733498:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961006592:12345-0@lo:400:kworker.0 Request processed in 42us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340558.733504:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2334 00000100:00100000:3.0:1780340558.733518:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2335 00000100:00100000:3.0:1780340558.733523:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961006464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340558.733561:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961006464:12345-0@lo:400:kworker.0 Request processed in 37us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340558.733567:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2335 00000100:00100000:3.0:1780340558.733585:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961005952 00000100:00100000:3.0:1780340558.733588:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961005952 00000100:00100000:3.0:1780340558.733607:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961006208 00000100:00100000:3.0:1780340558.733609:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961006208 00000100:00100000:3.0:1780340558.733621:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:3.0:1780340558.733626:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961005952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340558.733651:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961005952:12345-0@lo:400:kworker.0 Request processed in 25us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340558.733656:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:3.0:1780340558.733666:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:3.0:1780340558.733671:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961006208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340558.733692:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961006208:12345-0@lo:400:kworker.0 Request processed in 22us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340558.733697:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00080000:3.0:1780340558.733711:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780340558.733714:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340558.733716:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340558.733744:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961006208:0@lo:400:kworker.0 00000100:00100000:3.0:1780340558.733752:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961006464:0@lo:400:kworker.0 00000100:00100000:3.0:1780340558.733828:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961006592:0@lo:400:kworker.0 00000100:00100000:3.0:1780340558.733838:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961005952:0@lo:400:kworker.0 00000100:00100000:2.0:1780340558.733974:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961005824:0@lo:38:kworker.0 00000100:00100000:2.0:1780340558.734017:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340558.734042:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961006080:0@lo:38:kworker.0 00000100:00100000:2.0:1780340558.734062:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340558.734084:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961006336:0@lo:38:kworker.0 00000100:00100000:2.0:1780340558.734104:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340558.734122:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961006720:0@lo:38:kworker.0 00000100:00100000:2.0:1780340558.734140:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340558.734166:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961006336 00000100:00100000:2.0:1780340558.734170:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961006336 00000100:00100000:2.0:1780340558.734191:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3703 00000100:00100000:2.0:1780340558.734195:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961006336:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340558.734213:0:8410:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340558.734243:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961006336:12345-0@lo:38:kworker.0 Request processed in 46us (137us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340558.734256:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3703 00000100:00100000:0.0:1780340558.734265:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961005824 00000100:00100000:0.0:1780340558.734269:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961005824 00000100:00100000:2.0:1780340558.734277:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961006080 00000100:00100000:2.0:1780340558.734280:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961006080 00000100:00100000:0.0:1780340558.734285:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961006720 00000100:00100000:0.0:1780340558.734287:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961006720 00000100:00100000:2.0:1780340558.734294:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1780340558.734298:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961005824:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1780340558.734298:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1780340558.734302:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961006080:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340558.734308:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:0.0:1780340558.734310:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340558.734332:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961005824:12345-0@lo:38:kworker.0 Request processed in 33us (314us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340558.734332:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961006080:12345-0@lo:38:kworker.0 Request processed in 29us (269us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340558.734337:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1780340558.740338:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1780340558.740386:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1780340558.740395:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961006720:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340558.740420:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340558.740498:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961006720:12345-0@lo:38:kworker.0 Request processed in 103us (6356us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340558.740504:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00080000:0.0:1780340558.741707:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340558.741716:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340558.741721:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961005824:0@lo:38:kworker.0 00000100:00080000:0.0:1780340558.741733:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340558.741736:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340558.741738:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961006080:0@lo:38:kworker.0 00000100:00080000:0.0:1780340558.741748:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340558.741751:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340558.741753:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961006336:0@lo:38:kworker.0 00000100:00080000:0.0:1780340558.741777:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340558.741781:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340558.741784:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961006720:0@lo:38:kworker.0 00000100:00100000:0.0:1780340558.896794:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340558.896885:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340558.897027:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940379520 00000100:00100000:1.0:1780340558.897037:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940379520 00000100:00100000:1.0:1780340558.897117:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940379392 00000100:00100000:1.0:1780340558.897121:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940379392 00000100:00100000:1.0:1780340558.897140:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1052 00000100:00100000:1.0:1780340558.897149:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940379520:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340558.897225:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940379520:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 76us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340558.897232:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1052 00000100:00100000:1.0:1780340558.897260:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1054 00000100:00100000:1.0:1780340558.897264:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2406:x1866818940379392:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:1.0:1780340558.897284:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340558.897308:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2406:x1866818940379392:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 43us (423us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340558.897315:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1054 00000100:00080000:0.0:1780340558.897645:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1780340559.758122:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340560.780067:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340561.293789:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961006976:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340561.293877:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340561.294044:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961006976 00000100:00100000:1.0:1780340561.294053:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961006976 00000100:00100000:1.0:1780340561.294115:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1894 00000100:00100000:1.0:1780340561.294125:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961006976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340561.294155:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340561.294201:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961006976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340561.294209:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1894 00000100:00100000:2.0:1780340561.294326:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780340561.294338:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961006848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340561.294370:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340561.294439:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961006848 00000100:00100000:1.0:1780340561.294444:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961006848 00000100:00100000:1.0:1780340561.294478:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1895 00000100:00100000:1.0:1780340561.294486:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961006848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780340561.294505:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340561.294554:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961006848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340561.294560:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1895 00000100:00100000:1.0:1780340561.294598:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961006848:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1780340561.294935:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340561.294940:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340561.294964:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961006976:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1780340561.802780:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340562.829295:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340562.985252:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340562.985302:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340562.985346:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340562.985540:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940379776 00000100:00100000:0.0:1780340562.985555:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940379776 00000100:00100000:0.0:1780340562.985600:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940379904 00000100:00100000:0.0:1780340562.985603:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940379904 00000100:00100000:0.0:1780340562.985659:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1053 00000100:00100000:0.0:1780340562.985670:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940379904:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340562.985831:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940379904:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 162us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340562.985839:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1053 00000100:00100000:0.0:1780340562.985859:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1055 00000100:00100000:0.0:1780340562.985893:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940379776:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:0.0:1780340562.985920:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340562.985961:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940379776:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 57us (648us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340562.985968:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1055 00000100:00100000:3.0:1780340562.988394:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940379648 00000100:00100000:3.0:1780340562.988413:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940379648 00000100:00100000:3.0:1780340562.988478:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:3.0:1780340562.988488:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2406:x1866818940379648:12345-192.168.203.16@tcp:250:kworker.0 00010000:00080000:3.0:1780340562.988523:0:81810:0:(ldlm_lib.c:1430:target_handle_connect()) MGS: connection from ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4@192.168.203.16@tcp t0 exp 0000000000000000 cur 3342 last 0 00000020:00000080:3.0:1780340562.988560:0:81810:0:(genops.c:1406:class_connect()) connect: client ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4, cookie 0xa24651432773219 00000100:00080000:3.0:1780340562.988730:0:81810:0:(import.c:65:import_set_state_nolock()) ffff8c045f0c6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340562.988885:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+4:2406:x1866818940379648:12345-192.168.203.16@tcp:250:kworker.0 Request processed in 397us (3646us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340562.988893:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00080000:3.0:1780340562.988943:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340563.849950:0:3658:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780340553/real 1780340553] req@ffff8c03498cb800 x1866818961004416/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780340563 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340563.849988:0:3658:0:(client.c:2511:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c03498cb800 x1866818961004416/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780340563 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340563.850012:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340563.850020:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1780340563.850037:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961004416:0@lo:250:kworker.0 00010000:00010000:0.0:1780340563.850146:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1780340563.850231:0:81805:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1780340563.850254:0:81805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c046fb21600/0xa24651432772ec3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432772eca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340563.850269:0:81805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c046fb21600/0xa24651432772ec3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432772eca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340563.850276:0:81805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1780340563.850298:0:81805:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340563.850310:0:81805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c046fb21600/0xa24651432772ec3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432772eca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.850330:0:81805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c046fb21200/0xa24651432772e29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432772e30 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340563.850336:0:81805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c046fb21200/0xa24651432772e29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432772e30 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340563.850342:0:81805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340563.850346:0:81805:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340563.850350:0:81805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c046fb21200/0xa24651432772e29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432772e30 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.850391:0:81805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432772e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432772e4c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340563.850397:0:81805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432772e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432772e4c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340563.850403:0:81805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340563.850406:0:81805:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340563.850410:0:81805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432772e45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432772e4c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.850418:0:81805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c03485a0200/0xa24651432772e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432772e76 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340563.850424:0:81805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c03485a0200/0xa24651432772e6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432772e76 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340563.850429:0:81805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340563.850433:0:81805:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340563.850436:0:81805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c03485a0200/0xa24651432772e6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432772e76 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.850445:0:81805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4400/0xa24651432772e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432772e84 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340563.850451:0:81805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4400/0xa24651432772e7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432772e84 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340563.850457:0:81805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340563.850468:0:81805:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340563.850472:0:81805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4400/0xa24651432772e7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432772e84 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.850500:0:81805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0453122a00/0xa24651432772e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432772ea0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340563.850507:0:81805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0453122a00/0xa24651432772e99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432772ea0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340563.850512:0:81805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340563.850516:0:81805:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340563.850519:0:81805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0453122a00/0xa24651432772e99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432772ea0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.850527:0:81805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c046fb21000/0xa24651432772ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432772eae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340563.850533:0:81805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c046fb21000/0xa24651432772ea7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432772eae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340563.850539:0:81805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340563.850543:0:81805:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340563.850546:0:81805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c046fb21000/0xa24651432772ea7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432772eae expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.850555:0:81805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c046fb20600/0xa24651432772ed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432772ed8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340563.850561:0:81805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c046fb20600/0xa24651432772ed1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432772ed8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340563.850576:0:81805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340563.850581:0:81805:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340563.850585:0:81805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c046fb20600/0xa24651432772ed1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432772ed8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.850597:0:81805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c046fb20a00/0xa24651432772e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432772e3e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340563.850603:0:81805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c046fb20a00/0xa24651432772e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432772e3e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340563.850609:0:81805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340563.850612:0:81805:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340563.850615:0:81805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c046fb20a00/0xa24651432772e37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432772e3e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.850626:0:81805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4200/0xa24651432772e53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432772e5a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340563.850632:0:81805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4200/0xa24651432772e53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432772e5a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340563.850638:0:81805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340563.850641:0:81805:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340563.850644:0:81805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4200/0xa24651432772e53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432772e5a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.850655:0:81805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa24651432772e61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432772e68 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340563.850672:0:81805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa24651432772e61 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432772e68 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340563.850677:0:81805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1780340563.850681:0:81805:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340563.850685:0:81805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa24651432772e61 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432772e68 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.850696:0:81805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c046fb21c00/0xa24651432772e8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432772e92 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340563.850702:0:81805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c046fb21c00/0xa24651432772e8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432772e92 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340563.850707:0:81805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1780340563.850710:0:81805:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340563.850713:0:81805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c046fb21c00/0xa24651432772e8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432772e92 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.850721:0:81805:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c046fb21400/0xa24651432772eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432772ebc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340563.850727:0:81805:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c046fb21400/0xa24651432772eb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432772ebc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340563.850732:0:81805:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1780340563.850736:0:81805:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340563.850738:0:81805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c046fb21400/0xa24651432772eb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432772ebc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1780340563.850827:0:81805:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8c0475490800 already not connected (conn 56, was 0): DISCONN 00000100:00080000:1.0:1780340563.850835:0:81805:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340563.850842:0:81805:0:(import.c:512:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 3333 00000100:00080000:1.0:1780340563.850849:0:81805:0:(import.c:591:import_select_connection()) MGC192.168.203.116@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1780340563.850856:0:81805:0:(import.c:626:import_select_connection()) MGC192.168.203.116@tcp: import ffff8c0475490800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340563.850905:0:81805:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0444227100 x1866818961007104/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340563.850927:0:81805:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1780340563.853320:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961007104:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1780340563.853433:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340563.853711:0:81812:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961007104 00000100:00100000:2.0:1780340563.853723:0:81812:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961007104 00000100:00100000:2.0:1780340563.853809:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1780340563.853819:0:81812:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3658:x1866818961007104:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1780340563.853857:0:81812:0:(ldlm_lib.c:1430:target_handle_connect()) MGS: connection from f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo t0 exp 0000000000000000 cur 3343 last 0 00000020:00000080:2.0:1780340563.853908:0:81812:0:(genops.c:1406:class_connect()) connect: client f26f7947-2bb0-4491-8dd4-005fa8e64f3a, cookie 0xa24651432773220 00000100:00080000:2.0:1780340563.854064:0:81812:0:(import.c:65:import_set_state_nolock()) ffff8c0346fd0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340563.854308:0:81812:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:3658:x1866818961007104:12345-0@lo:250:mount.lustre.0 Request processed in 487us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340563.854317:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1780340563.855080:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340563.855100:0:71335:0:(pinger.c:249:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1780340563.855119:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340563.855124:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340563.855127:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340563.855134:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3338 00000100:00080000:3.0:1780340563.855139:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340563.855145:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340563.855184:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03484f3100 x1866818961007232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340563.855226:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340563.855230:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340563.855232:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340563.855236:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3338 00000100:00080000:3.0:1780340563.855239:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340563.855242:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340563.855255:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03484f1500 x1866818961007488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340563.855285:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340563.855288:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340563.855290:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340563.855294:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3338 00000100:00080000:3.0:1780340563.855296:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340563.855300:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340563.855313:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047ac7e300 x1866818961007744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340563.855351:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340563.855354:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340563.855356:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340563.855359:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3338 00000100:00080000:3.0:1780340563.855362:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340563.855365:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340563.855378:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0445594000 x1866818961008128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340563.855841:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961007360:0@lo:400:kworker.0 00000100:00100000:3.0:1780340563.855913:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340563.855949:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340563.855955:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034872b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961008000:0@lo:400:kworker.0 00000100:00100000:3.0:1780340563.855982:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340563.856017:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ac7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961007616:0@lo:400:kworker.0 00000100:00100000:3.0:1780340563.856041:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340563.856060:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340563.856066:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034872ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961007872:0@lo:400:kworker.0 00000100:00100000:0.0:1780340563.856388:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961008000 00000100:00100000:0.0:1780340563.856397:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961008000 00000100:00100000:0.0:1780340563.856458:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2336 00000100:00100000:0.0:1780340563.856469:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961008000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340563.856851:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961007360 00000100:00100000:2.0:1780340563.856857:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961007360 00000100:00100000:2.0:1780340563.856900:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961007616 00000100:00100000:2.0:1780340563.856903:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961007616 00000100:00100000:2.0:1780340563.856940:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1780340563.856947:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961007360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340563.860465:0:3658:0:(client.c:3102:ptlrpc_free_committed()) MGC192.168.203.116@tcp: committing for last_committed 0 gen 23 00000100:00080000:1.0:1780340563.860497:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.116@tcp: connect to target with instance 0 00000100:00080000:1.0:1780340563.860510:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1780340563.860517:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1780340563.860524:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1780340563.860528:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1780340563.860577:0:3658:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1780340563.860595:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444227100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961007104:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1780340563.860636:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961007232:0@lo:38:kworker.0 00000100:00100000:0.0:1780340563.864789:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961008000:12345-0@lo:400:kworker.0 Request processed in 8310us (8793us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340563.864808:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2336 00000100:00080000:0.0:1780340563.864885:0:81805:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1780340563.864902:0:81805:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1780340563.864955:0:81805:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1780340563.864978:0:81805:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1780340563.865128:0:81805:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 0 is initialized 00000020:01000004:0.0:1780340563.865169:0:81805:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.116@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1780340563.865173:0:81805:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1780340563.865175:0:81805:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780340563.865176:0:81805:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340563.865177:0:81805:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780340563.865179:0:81805:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340563.865180:0:81805:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340563.865181:0:81805:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780340563.865183:0:81805:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780340563.865184:0:81805:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780340563.865185:0:81805:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1780340563.865188:0:81805:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1780340563.865190:0:81805:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1780340563.865191:0:81805:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780340563.865192:0:81805:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340563.865193:0:81805:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780340563.865193:0:81805:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340563.865195:0:81805:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340563.865196:0:81805:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780340563.865197:0:81805:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780340563.865198:0:81805:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780340563.865199:0:81805:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1780340563.865234:0:81805:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1780340563.865257:0:81805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec41880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961008256:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1780340563.865322:0:81805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340563.865367:0:81805:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0450132180 going to sleep for 11 seconds 00000100:00100000:0.0:1780340563.865446:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034872b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961008000:0@lo:400:kworker.0 00000100:00080000:0.0:1780340563.865488:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340563.865495:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340563.865515:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1780340563.865530:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961007616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340563.865588:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961007616:12345-0@lo:400:kworker.0 Request processed in 65us (9546us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340563.865601:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000020:01000000:0.0:1780340563.865686:0:80497:0:(tgt_mount.c:1581:tgt_import_update()) NID #0: 192.168.203.116@tcp 10000000:01000000:0.0:1780340563.865699:0:80497:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1780340563.865701:0:80497:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1780340563.865703:0:80497:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1780340563.865704:0:80497:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340563.865705:0:80497:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780340563.865706:0:80497:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340563.865707:0:80497:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340563.865708:0:80497:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1780340563.865709:0:80497:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780340563.865710:0:80497:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1780340563.865738:0:80497:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1780340563.865745:0:80497:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1780340563.865746:0:80497:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1780340563.865747:0:80497:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1780340563.865748:0:80497:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340563.865749:0:80497:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780340563.865750:0:80497:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340563.865751:0:80497:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340563.865752:0:80497:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1780340563.865752:0:80497:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780340563.865754:0:80497:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1780340563.865797:0:80497:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1780340563.865802:0:80497:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1780340563.865803:0:80497:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1780340563.865804:0:80497:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1780340563.865805:0:80497:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340563.865806:0:80497:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780340563.865807:0:80497:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340563.865808:0:80497:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340563.865809:0:80497:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780340563.865810:0:80497:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780340563.865811:0:80497:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1780340563.865822:0:80497:0:(tgt_mount.c:1592:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1780340563.865904:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961008640:0@lo:253:kworker.0 00000100:00100000:0.0:1780340563.865938:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340563.865964:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340563.865970:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961008512:0@lo:253:kworker.0 00000100:00100000:0.0:1780340563.865996:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340563.866031:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961008256 00000100:00100000:0.0:1780340563.866039:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961008256 00000100:00100000:0.0:1780340563.866069:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961008640 00000100:00100000:0.0:1780340563.866071:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961008640 00000100:00100000:0.0:1780340563.866080:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961008512 00000100:00100000:0.0:1780340563.866082:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961008512 00000100:00100000:0.0:1780340563.866093:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1780340563.866099:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:81805:x1866818961008256:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1780340563.866140:0:81810:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1780340563.866143:0:81810:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1780340563.866146:0:81810:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:0.0:1780340563.866311:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961008384:0@lo:253:kworker.0 00000100:00100000:0.0:1780340563.866345:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1780340563.866390:0:81815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1780340563.866474:0:81810:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 100 00000100:00100000:0.0:1780340563.866709:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961008384 00000100:00100000:0.0:1780340563.866714:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961008384 00000100:00100000:0.0:1780340563.866732:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1780340563.866739:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3660:x1866818961008640:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1780340563.866780:0:81811:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1780340563.868074:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961007360:12345-0@lo:400:kworker.0 Request processed in 11121us (12154us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340563.868100:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1780340563.868173:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961007360:0@lo:400:kworker.0 00000100:00100000:3.0:1780340563.873415:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340563.873533:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ac7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961007616:0@lo:400:kworker.0 00000100:00100000:0.0:1780340563.873930:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961007872 00000100:00100000:0.0:1780340563.873939:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961007872 00000100:00100000:0.0:1780340563.874009:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2337 00000100:00100000:0.0:1780340563.874019:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961007872:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1780340563.874220:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340563.874329:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961007872:12345-0@lo:400:kworker.0 Request processed in 310us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340563.874351:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2337 00000100:00100000:3.0:1780340563.874519:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034872ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961007872:0@lo:400:kworker.0 00000100:00100000:1.0:1780340563.874655:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340563.874722:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961007488:0@lo:38:kworker.0 00000100:00100000:1.0:1780340563.874755:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340563.875974:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ac7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961007744:0@lo:38:kworker.0 00000100:00100000:1.0:1780340563.876023:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340563.876046:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961008128:0@lo:38:kworker.0 00000100:00100000:1.0:1780340563.876070:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340563.876187:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961007744 00000100:00100000:2.0:1780340563.876196:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961007744 00000100:00100000:2.0:1780340563.876234:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3704 00000100:00100000:2.0:1780340563.876241:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961007744:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340563.876269:0:26074:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340563.876315:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961007744:12345-0@lo:38:kworker.0 Request processed in 74us (292us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340563.876322:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3704 00000100:00100000:3.0:1780340563.876415:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961007232 00000100:00100000:3.0:1780340563.876420:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961007232 00000100:00100000:3.0:1780340563.876603:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961007488 00000100:00100000:3.0:1780340563.876613:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961007488 00000100:00100000:2.0:1780340563.876661:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1780340563.876666:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961007232:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340563.876678:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340563.876708:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961007232:12345-0@lo:38:kworker.0 Request processed in 41us (2054us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340563.876713:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1780340563.876730:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:2.0:1780340563.876734:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961007488:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340563.876743:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340563.876777:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961007488:12345-0@lo:38:kworker.0 Request processed in 25us (2005us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340563.876789:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00080000:1.0:1780340563.876895:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340563.876901:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340563.876904:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961007232:0@lo:38:kworker.0 00000100:00080000:1.0:1780340563.876913:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340563.876916:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340563.876919:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961007488:0@lo:38:kworker.0 00000100:00080000:1.0:1780340563.876926:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340563.876928:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340563.876931:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ac7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961007744:0@lo:38:kworker.0 00000100:00100000:2.0:1780340563.879018:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961008128 00000100:00100000:2.0:1780340563.879036:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961008128 00000100:00100000:2.0:1780340563.879121:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:2.0:1780340563.879130:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961008128:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340563.879157:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340563.879250:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961008128:12345-0@lo:38:kworker.0 Request processed in 120us (3178us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340563.879257:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00080000:1.0:1780340563.879829:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340563.879836:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340563.879840:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961008128:0@lo:38:kworker.0 20000000:01000000:1.0:1780340563.882923:0:81816:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1780340563.882933:0:81816:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1780340563.882936:0:81816:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1780340563.882940:0:81816:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1780340563.886233:0:81816:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1780340563.886756:0:81810:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1780340563.886806:0:81810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1780340563.887054:0:81811:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1780340563.887844:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:81805:x1866818961008256:12345-0@lo:253:mount.lustre.0 Request processed in 21736us (22513us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340563.887859:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1780340563.887921:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1780340563.887935:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:3660:x1866818961008512:12345-0@lo:253:kworker.0 00000100:00100000:0.0:1780340563.888075:0:81805:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec41880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961008256:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1780340563.888094:0:81805:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1780340563.888098:0:81805:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1780340563.888100:0:81805:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780340563.888102:0:81805:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340563.888103:0:81805:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780340563.888104:0:81805:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340563.888106:0:81805:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340563.888107:0:81805:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780340563.888109:0:81805:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780340563.888111:0:81805:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780340563.888113:0:81805:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1780340563.888140:0:81805:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c0475faf800 from lustre-MDT0000 10000000:01000000:0.0:1780340563.888184:0:81805:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1780340563.888187:0:81805:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1780340563.888199:0:81805:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c0475faf800 10000000:01000000:0.0:1780340563.888204:0:81805:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1780340563.888210:0:81805:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c0475faf800 10000000:01000000:0.0:1780340563.888213:0:81805:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1780340563.888217:0:81805:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8c0475faf800 from 1 10000000:01000000:0.0:1780340563.888220:0:81805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1780340563.888272:0:81805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa24651432773227 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340563.888283:0:81805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa24651432773227 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340563.888294:0:81805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa24651432773227 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340563.888320:0:81805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec41880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961008768:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1780340563.888391:0:81805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340563.888440:0:81805:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047a901c00 going to sleep for 11 seconds 00000100:00100000:1.0:1780340563.888616:0:81812:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1780340563.888626:0:81812:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 20000000:01000000:2.0:1780340563.888693:0:81810:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1780340563.891177:0:81812:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961008768 00000100:00100000:1.0:1780340563.891195:0:81812:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961008768 00000100:00100000:2.0:1780340563.891367:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1780340563.891600:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3662:x1866818961008384:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1780340563.891646:0:81817:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1780340563.897401:0:81811:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1780340563.897430:0:81811:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1780340563.897675:0:81815:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1780340563.897684:0:81815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1780340563.897720:0:81815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0476763800/0xa2465143277322e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.897741:0:81815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0476763800/0xa2465143277322e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1780340563.897801:0:81815:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000119445s 00010000:00010000:1.0:1780340563.897806:0:81815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0476763800/0xa2465143277322e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.897815:0:81815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0476763800/0xa2465143277322e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.897823:0:81815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0476763800/0xa2465143277322e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.897830:0:81815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0476763800/0xa2465143277322e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.897839:0:81815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476763800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340563.897845:0:81815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0476763800/0xa2465143277322e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.897854:0:81815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0476763800/0xa2465143277322e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.897884:0:81815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0476763800/0xa2465143277322e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.897898:0:81815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0476763800/0xa2465143277322e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340563.897901:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3660:x1866818961008640:12345-0@lo:253:kworker.0 Request processed in 31147us (31947us total) trans 0 rc 0/0 00010000:00010000:1.0:1780340563.897916:0:81815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0476763800/0xa2465143277322e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1780340563.897958:0:3660:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1780340563.897962:0:3660:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1780340563.897963:0:3660:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780340563.897965:0:3660:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780340563.897966:0:3660:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780340563.897968:0:3660:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780340563.897970:0:3660:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780340563.897972:0:3660:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780340563.897974:0:3660:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1780340563.897980:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961008640:0@lo:253:kworker.0 20000000:01000000:2.0:1780340563.898005:0:81810:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1780340563.898031:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1780340563.898088:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1780340563.898101:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:81805:x1866818961008768:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340563.898117:0:81811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340563.898144:0:81811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0440031600/0xa24651432773235 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773227 expref: -99 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340563.898175:0:81811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0440031600/0xa24651432773235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773227 expref: 7 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340563.898188:0:81811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0440031600/0xa24651432773235 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773227 expref: 7 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340563.898198:0:81811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440031600, rc 0) 00000100:00100000:0.0:1780340563.898248:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:81805:x1866818961008768:12345-0@lo:101:mount.lustre.0 Request processed in 151us (9857us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340563.898254:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1780340563.898350:0:81805:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec41880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961008768:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780340563.898378:0:81805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa24651432773227 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773235 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.898388:0:81805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa24651432773227 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773235 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340563.898407:0:81805:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1780340563.898427:0:81805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa24651432773227 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773235 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.898441:0:81805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa24651432773227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773235 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340563.898489:0:81805:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1780340563.898496:0:81805:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1780340563.898502:0:81805:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c0475faf800 10000000:01000000:1.0:1780340563.898505:0:81805:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1780340563.898510:0:81805:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1780340563.898513:0:81805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1780340563.898545:0:81805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476762e00/0xa2465143277323c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.898553:0:81805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0476762e00/0xa2465143277323c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.898562:0:81805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0476762e00/0xa2465143277323c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340563.898588:0:81805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444226d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961008896:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1780340563.898650:0:81805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340563.898704:0:81805:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b363b40 going to sleep for 11 seconds 00000100:00100000:3.0:1780340563.901138:0:81812:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961008896 00000100:00100000:3.0:1780340563.901157:0:81812:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961008896 00000100:00100000:3.0:1780340563.901232:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1780340563.901245:0:81812:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:81805:x1866818961008896:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780340563.901265:0:81812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340563.901295:0:81812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa5a00/0xa24651432773243 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277323c expref: -99 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340563.901329:0:81812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa5a00/0xa24651432773243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277323c expref: 8 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340563.901342:0:81812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa5a00/0xa24651432773243 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277323c expref: 8 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340563.901353:0:81812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5a00, rc 0) 00000100:00100000:3.0:1780340563.903216:0:81812:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:81805:x1866818961008896:12345-0@lo:101:mount.lustre.0 Request processed in 1961us (4554us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340563.903228:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1780340563.903276:0:81805:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444226d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961008896:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780340563.903306:0:81805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0476762e00/0xa2465143277323c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773243 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.903321:0:81805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0476762e00/0xa2465143277323c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773243 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340563.903430:0:81805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444226d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961009024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780340563.903490:0:81805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340563.903529:0:81805:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b363b40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340563.903618:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961009024 00000100:00100000:0.0:1780340563.903626:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961009024 00000100:00100000:0.0:1780340563.903667:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1780340563.903676:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:81805:x1866818961009024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780340563.903880:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:81805:x1866818961009024:12345-0@lo:501:mount.lustre.0 Request processed in 205us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340563.903905:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1780340563.904069:0:81805:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444226d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961009024:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780340563.904105:0:81805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444226d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961009152:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780340563.904151:0:81805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340563.904176:0:81805:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b363b40 going to sleep for 11 seconds 00000100:00100000:3.0:1780340563.904513:0:81812:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961009152 00000100:00100000:3.0:1780340563.904519:0:81812:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961009152 00000100:00100000:3.0:1780340563.904555:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1780340563.904571:0:81812:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:81805:x1866818961009152:12345-0@lo:503:mount.lustre.0 20000000:01000000:2.0:1780340563.907627:0:81810:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1780340563.907648:0:81810:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1780340563.907665:0:81817:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1780340563.907884:0:81815:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1780340563.907890:0:81815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1780340563.907916:0:81815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0476763800/0xa2465143277324a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.907936:0:81815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0476763800/0xa2465143277324a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1780340563.907948:0:81815:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000119445s 00010000:00010000:1.0:1780340563.907954:0:81815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0476763800/0xa2465143277324a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.907961:0:81815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0476763800/0xa2465143277324a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.907985:0:81815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0476763800/0xa2465143277324a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.907993:0:81815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0476763800/0xa2465143277324a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.908000:0:81815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476763800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340563.908005:0:81815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0476763800/0xa2465143277324a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.908013:0:81815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0476763800/0xa2465143277324a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.908027:0:81815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0476763800/0xa2465143277324a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.908035:0:81815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0476763800/0xa2465143277324a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.908040:0:81815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0476763800/0xa2465143277324a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340563.908550:0:81812:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:81805:x1866818961009152:12345-0@lo:503:mount.lustre.0 Request processed in 3973us (4390us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340563.908564:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1780340563.911374:0:81805:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444226d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961009152:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780340563.912164:0:81818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81818:1866818961009280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340563.912263:0:81818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340563.912309:0:81818:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b363b40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340563.912436:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961009280 00000100:00100000:0.0:1780340563.912500:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961009280 00000100:00100000:0.0:1780340563.912556:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1780340563.912567:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:81818:x1866818961009280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340563.913609:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:81818:x1866818961009280:12345-0@lo:502:llog_process_th.0 Request processed in 1041us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340563.913620:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1780340563.913736:0:81818:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81818:1866818961009280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780340563.913808:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780340563.913822:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340563.913825:0:81818:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1780340563.913831:0:81818:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1780340563.913834:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1780340563.913852:0:81818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8c0349003380) 00000020:00000080:3.0:1780340563.913891:0:81818:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:3.0:1780340563.913900:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1780340563.914006:0:81818:0:(osd_handler.c:8933:osd_obd_connect()) connect #2 00000020:00000080:3.0:1780340563.914015:0:81818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432773258 00000020:00000080:3.0:1780340563.914408:0:81818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1780340563.914412:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780340563.914416:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340563.914418:0:81818:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1780340563.914420:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780340563.914424:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340563.914425:0:81818:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1780340563.914428:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1780340563.914437:0:81818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8c03490019c0) 00000020:00000080:3.0:1780340563.914514:0:81818:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:3.0:1780340563.914520:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1780340563.914522:0:81818:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1780340563.914525:0:81818:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1780340563.914532:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1780340563.914590:0:81818:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0475faf800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1780340563.914611:0:81818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8c0349004d40) 00000020:00000080:3.0:1780340563.914627:0:81818:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:3.0:1780340563.914697:0:81818:0:(lod_dev.c:2290:lod_obd_connect()) connect #0 00000020:00000080:3.0:1780340563.914704:0:81818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2465143277326d 00000020:00000080:3.0:1780340563.915035:0:81818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1780340563.915044:0:81818:0:(mdd_device.c:1668:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1780340563.915051:0:81818:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa24651432773274 00080000:01000000:3.0:1780340563.915128:0:81818:0:(osd_handler.c:8933:osd_obd_connect()) connect #3 00000020:00000080:3.0:1780340563.915135:0:81818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2465143277327b 00000100:00100000:2.0:1780340563.915801:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:3660:x1866818961008512:12345-0@lo:253:kworker.0 Request processed in 27859us (49791us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340563.915818:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:2.0:1780340563.915949:0:3660:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1780340563.915952:0:3660:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1780340563.915954:0:3660:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340563.915956:0:3660:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340563.915958:0:3660:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340563.915959:0:3660:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340563.915960:0:3660:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780340563.915963:0:3660:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340563.915965:0:3660:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1780340563.915970:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961008512:0@lo:253:kworker.0 20000000:01000000:3.0:1780340563.919190:0:81817:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1780340563.919216:0:81817:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1780340563.920152:0:81815:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1780340563.920160:0:81815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1780340563.920188:0:81815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0476762800/0xa24651432773282 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.920220:0:81815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0476762800/0xa24651432773282 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1780340563.920230:0:81815:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000119445s 00010000:00010000:1.0:1780340563.920236:0:81815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0476762800/0xa24651432773282 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.920244:0:81815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0476762800/0xa24651432773282 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.920251:0:81815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0476762800/0xa24651432773282 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.920259:0:81815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0476762800/0xa24651432773282 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.920266:0:81815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340563.920271:0:81815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0476762800/0xa24651432773282 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.920280:0:81815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0476762800/0xa24651432773282 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.920296:0:81815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0476762800/0xa24651432773282 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.920304:0:81815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0476762800/0xa24651432773282 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340563.920311:0:81815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0476762800/0xa24651432773282 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340563.922629:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3662:x1866818961008384:12345-0@lo:253:kworker.0 Request processed in 31022us (56269us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340563.922647:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:1.0:1780340563.930690:0:3662:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1780340563.930699:0:3662:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1780340563.930701:0:3662:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780340563.930703:0:3662:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780340563.930704:0:3662:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780340563.930708:0:3662:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780340563.930710:0:3662:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1780340563.930712:0:3662:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780340563.930714:0:3662:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1780340563.930723:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961008384:0@lo:253:kworker.0 00010000:00010000:3.0:1780340564.051010:0:81818:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1780340564.051194:0:81818:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: e06e5cf1-1986-4ba7-9630-fad7efb74eca idx: 0 lr: 0 srv lr: 94489280512 lx: 0 gen 22 00000001:00080000:3.0:1780340564.051248:0:81818:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 94489280512 lx: 0 gen 21 00000001:00000004:3.0:1780340564.051274:0:81818:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 23, last_transno is 94489280512 00000001:00080000:3.0:1780340564.051685:0:81818:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1780340564.051850:0:81818:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8c0444c0cd80: xid 1866818940370816, transno 94489280513, client gen 22, slot idx 0 00000020:00000080:3.0:1780340564.052578:0:81818:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8c03482b3380) 00000020:00000080:3.0:1780340564.052607:0:81818:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:3.0:1780340564.052696:0:81818:0:(osd_handler.c:8933:osd_obd_connect()) connect #4 00000020:00000080:3.0:1780340564.052704:0:81818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2465143277329e 00000020:00000080:3.0:1780340564.055403:0:81818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1780340564.065657:0:81818:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa246514327732a5 00000020:00000080:3.0:1780340564.068262:0:81818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1780340564.068281:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780340564.068290:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340564.068293:0:81818:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1780340564.068309:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1780340564.068313:0:81818:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1780340564.068315:0:81818:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1780340564.068316:0:81818:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1780340564.068318:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1780340564.068321:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340564.068323:0:81818:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1780340564.068325:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780340564.068330:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340564.068332:0:81818:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1780340564.068336:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1780340564.068403:0:81818:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1780340564.068425:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780340564.068428:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340564.068430:0:81818:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1780340564.068432:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780340564.068445:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340564.068447:0:81818:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1780340564.068451:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1780340564.068457:0:81818:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:00000080:3.0:1780340564.068486:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1780340564.068506:0:81818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8c03482b0000) 00000020:00000080:3.0:1780340564.068534:0:81818:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1780340564.068540:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1780340564.068605:0:81818:0:(osp_dev.c:1197:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1780340564.068611:0:81818:0:(osd_handler.c:8933:osd_obd_connect()) connect #5 00000020:00000080:3.0:1780340564.068618:0:81818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa246514327732b3 00010000:00080000:3.0:1780340564.068662:0:81818:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c047b436000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:3.0:1780340564.071735:0:81818:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1780340564.073670:0:81818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780340564.073690:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1780340564.073733:0:81818:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1780340564.073890:0:81818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa246514327732ba 00000100:00080000:1.0:1780340564.073905:0:81818:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1780340564.073913:0:81818:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c047b436000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340564.074027:0:81818:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0444227800 x1866818961009408/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340564.074112:0:81818:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1780340564.074218:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340564.074222:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340564.074225:0:81818:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1780340564.074228:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1780340564.074231:0:81818:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1780340564.074233:0:81818:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780340564.074235:0:81818:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780340564.074236:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1780340564.074239:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340564.074240:0:81818:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1780340564.074243:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1780340564.074248:0:81818:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1780340564.074260:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340564.074261:0:81818:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1780340564.074265:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1780340564.074269:0:81818:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:01000000:1.0:1780340564.074297:0:81818:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1780340564.074299:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780340564.074315:0:81818:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c0445ba0000) 00000020:00000080:1.0:1780340564.074341:0:81818:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1780340564.074345:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1780340564.074424:0:81818:0:(osp_dev.c:1197:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1780340564.074432:0:81818:0:(osd_handler.c:8933:osd_obd_connect()) connect #6 00000020:00000080:1.0:1780340564.074491:0:81818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa246514327732c8 00010000:00080000:1.0:1780340564.074533:0:81818:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c047a289800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:1.0:1780340564.074742:0:81818:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1780340564.075254:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961009408:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1780340564.075347:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340564.075432:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961009408 00000100:00100000:2.0:1780340564.075452:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961009408 00000100:00100000:2.0:1780340564.075496:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3705 00000100:00100000:2.0:1780340564.075507:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961009408:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1780340564.075542:0:8410:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3344 last 0 00000020:00000080:2.0:1780340564.075583:0:8410:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa246514327732cf 00000004:00100000:2.0:1780340564.075603:0:8410:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1780340564.075717:0:8410:0:(import.c:65:import_set_state_nolock()) ffff8c045310e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340564.075825:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1866818961009408:12345-0@lo:38:llog_process_th.0 Request processed in 318us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340564.075832:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3705 00000100:00100000:2.0:1780340564.075904:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780340564.075913:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:2.0:1780340564.075921:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1780340564.075927:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1780340564.075929:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c047b436000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1780340564.075936:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961009408:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1780340564.076627:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340564.076641:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961009536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340564.076696:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340564.076929:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961009536 00000100:00100000:2.0:1780340564.076935:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961009536 00000100:00100000:2.0:1780340564.076986:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3706 00000100:00100000:2.0:1780340564.076994:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961009536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340564.077028:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:2.0:1780340564.077602:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961009536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 607us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340564.077610:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3706 00000100:00100000:2.0:1780340564.077665:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961009536:0@lo:41:osp-pre-1-0.0 00000040:01000000:1.0:1780340564.078663:0:81818:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1780340564.078702:0:81818:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1780340564.080234:0:81818:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 21, last_idx 22 00000100:00080000:1.0:1780340564.082690:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340564.082697:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340564.082702:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340564.082712:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3343 00000100:00080000:1.0:1780340564.082717:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340564.082726:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340564.082756:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0444227800 x1866818961009792/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340564.083174:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340564.083191:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340564.083193:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340564.083197:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3343 00000100:00080000:1.0:1780340564.083200:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340564.083204:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340564.083217:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0444226d80 x1866818961010048/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340564.083238:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340564.083242:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340564.083244:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340564.083247:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3343 00000100:00080000:1.0:1780340564.083250:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340564.083253:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340564.083266:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047207ca80 x1866818961010304/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340564.083288:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340564.083292:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340564.083294:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340564.083297:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3343 00000100:00080000:1.0:1780340564.083299:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340564.083302:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340564.083312:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047207dc00 x1866818961010688/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340564.083592:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961010432:0@lo:400:kworker.0 00000100:00100000:0.0:1780340564.083682:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340564.083725:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1780340564.083732:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961009664:0@lo:400:kworker.0 00000100:00100000:0.0:1780340564.083793:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340564.083823:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961010560:0@lo:400:kworker.0 00000100:00100000:0.0:1780340564.083846:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340564.083890:0:81812:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961009664 00000100:00100000:0.0:1780340564.083899:0:81812:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961009664 00000100:00100000:0.0:1780340564.083957:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1780340564.083966:0:81812:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3661:x1866818961009664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340564.084022:0:81812:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3661:x1866818961009664:12345-0@lo:400:kworker.0 Request processed in 56us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340564.084030:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1780340564.084137:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961010432 00000100:00100000:0.0:1780340564.084149:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961010432 00000100:00100000:0.0:1780340564.084175:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961010560 00000100:00100000:0.0:1780340564.084177:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961010560 00000100:00100000:0.0:1780340564.084197:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2338 00000100:00100000:0.0:1780340564.084202:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961010432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340564.084237:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961010432:12345-0@lo:400:kworker.0 Request processed in 34us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340564.084244:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2338 00000100:00100000:0.0:1780340564.084255:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2339 00000100:00100000:0.0:1780340564.084261:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961010560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340564.084288:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961010560:12345-0@lo:400:kworker.0 Request processed in 28us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340564.084294:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2339 00000100:00100000:0.0:1780340564.084339:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961009664:0@lo:400:kworker.0 00000100:00100000:0.0:1780340564.084353:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961010560:0@lo:400:kworker.0 00000100:00100000:0.0:1780340564.084360:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961010432:0@lo:400:kworker.0 00000100:00100000:0.0:1780340564.084410:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961009920:0@lo:400:kworker.0 00000100:00100000:0.0:1780340564.084439:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340564.084461:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340564.084467:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961010176:0@lo:400:kworker.0 00000100:00100000:0.0:1780340564.084488:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340564.084521:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961009920 00000100:00100000:0.0:1780340564.084525:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961009920 00000100:00100000:0.0:1780340564.084551:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961010176 00000100:00100000:0.0:1780340564.084554:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961010176 00000100:00100000:0.0:1780340564.084574:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:0.0:1780340564.084588:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961009920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340564.084624:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961009920:12345-0@lo:400:kworker.0 Request processed in 38us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340564.084630:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:0.0:1780340564.084642:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:0.0:1780340564.084648:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961010176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340564.084671:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961010176:12345-0@lo:400:kworker.0 Request processed in 24us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340564.084677:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:0.0:1780340564.084711:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961010176:0@lo:400:kworker.0 00000100:00100000:0.0:1780340564.084720:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961009920:0@lo:400:kworker.0 00000100:00100000:2.0:1780340564.084822:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961009792:0@lo:38:kworker.0 00000100:00100000:2.0:1780340564.084855:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340564.084886:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961010048:0@lo:38:kworker.0 00000100:00100000:2.0:1780340564.084909:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340564.084922:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961010304:0@lo:38:kworker.0 00000100:00100000:2.0:1780340564.084945:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340564.084962:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961010688:0@lo:38:kworker.0 00000100:00100000:2.0:1780340564.084982:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340564.085009:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961010304 00000100:00100000:2.0:1780340564.085012:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961010304 00000100:00100000:2.0:1780340564.085036:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3707 00000100:00100000:2.0:1780340564.085041:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961010304:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1780340564.085104:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961010304:12345-0@lo:38:kworker.0 Request processed in 61us (157us total) trans 0 rc -11/-11 00000100:00100000:2.0:1780340564.085110:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3707 00000100:00080000:2.0:1780340564.085142:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340564.085153:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1780340564.085156:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961010304:0@lo:38:kworker.0 00000100:00100000:1.0:1780340564.085515:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961009792 00000100:00100000:1.0:1780340564.085527:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961009792 00000100:00100000:1.0:1780340564.085549:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961010048 00000100:00100000:1.0:1780340564.085551:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961010048 00000100:00100000:1.0:1780340564.085563:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961010688 00000100:00100000:1.0:1780340564.085565:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961010688 00000100:00100000:1.0:1780340564.085577:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1780340564.085583:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961009792:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1780340564.085622:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961009792:12345-0@lo:38:kworker.0 Request processed in 38us (766us total) trans 0 rc -11/-11 00000100:00100000:1.0:1780340564.085628:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1780340564.085641:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:1.0:1780340564.085645:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961010048:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1780340564.085670:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961010048:12345-0@lo:38:kworker.0 Request processed in 24us (760us total) trans 0 rc -11/-11 00000100:00100000:1.0:1780340564.085676:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:1.0:1780340564.085687:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:1.0:1780340564.085691:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961010688:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1780340564.085714:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961010688:12345-0@lo:38:kworker.0 Request processed in 22us (731us total) trans 0 rc -11/-11 00000100:00100000:1.0:1780340564.085719:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00080000:2.0:1780340564.086140:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340564.086146:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1780340564.086149:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961009792:0@lo:38:kworker.0 00000100:00080000:2.0:1780340564.086159:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340564.086163:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1780340564.086165:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961010048:0@lo:38:kworker.0 00000100:00080000:2.0:1780340564.086175:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340564.086178:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1780340564.086181:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961010688:0@lo:38:kworker.0 00000040:00080000:3.0:1780340564.086569:0:81818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1780340564.086607:0:81818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].23, 64 off9664 00000040:00080000:3.0:1780340564.086827:0:81818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5c:0x0].1, 64 off8256 00000040:00080000:0.0:1780340564.087604:0:81824:0:(llog.c:800:llog_process_thread()) index: 22, lh_last_idx: 23 synced_idx: 0 lgh_last_idx: 23 00000040:00080000:0.0:1780340564.087610:0:81824:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x58:0x0] at index 22 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1780340564.089260:0:81818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340564.089277:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1780340564.089335:0:81818:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1780340564.089361:0:81818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa246514327732d6 00000100:00080000:0.0:1780340564.089376:0:81818:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1780340564.089384:0:81818:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c047a289800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340564.089490:0:81818:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c045ec40000 x1866818961010816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340564.089568:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961010816:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1780340564.089663:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780340564.089717:0:81818:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1780340564.089821:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780340564.089825:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340564.089827:0:81818:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1780340564.089831:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1780340564.089845:0:81818:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1780340564.089847:0:81818:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1780340564.089849:0:81818:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1780340564.089851:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1780340564.089854:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340564.089856:0:81818:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1780340564.089859:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1780340564.089873:0:81818:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1780340564.089877:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340564.089879:0:81818:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1780340564.089883:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1780340564.089887:0:81818:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:01000000:0.0:1780340564.089912:0:81818:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1780340564.089915:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1780340564.089930:0:81818:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c0471d54d40) 00000020:00000080:0.0:1780340564.089960:0:81818:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:0.0:1780340564.089966:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1780340564.090045:0:81818:0:(osp_dev.c:1197:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1780340564.090165:0:81818:0:(osd_handler.c:8933:osd_obd_connect()) connect #7 00000020:00000080:0.0:1780340564.090175:0:81818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa246514327732e4 00010000:00080000:0.0:1780340564.090218:0:81818:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c0452443000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:0.0:1780340564.090436:0:81818:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:0.0:1780340564.090903:0:81818:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1780340564.090923:0:81818:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1780340564.092195:0:81818:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 21, last_idx 22 00000040:00080000:2.0:1780340564.093247:0:81818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1780340564.093283:0:81818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].23, 64 off9664 00000040:00080000:2.0:1780340564.093507:0:81818:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5e:0x0].1, 64 off8256 00000100:00100000:3.0:1780340564.093883:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961010816 00000100:00100000:3.0:1780340564.093903:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961010816 00000100:00100000:3.0:1780340564.093966:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5857 00000100:00100000:3.0:1780340564.093978:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3658:x1866818961010816:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1780340564.094021:0:25493:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3344 last 0 00000020:00000080:3.0:1780340564.094245:0:25493:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa246514327732eb 00002000:00100000:3.0:1780340564.094265:0:25493:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c04858f8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211351c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1780340564.094271:0:25493:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1780340564.094275:0:25493:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1780340564.094344:0:25493:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1780340564.094382:0:25493:0:(import.c:65:import_set_state_nolock()) ffff8c04858fa000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340564.094507:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3658:x1866818961010816:12345-0@lo:8:llog_process_th.0 Request processed in 530us (4842us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340564.094515:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5857 00000100:00100000:2.0:1780340564.094646:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780340564.094656:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1780340564.094666:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1780340564.094672:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1780340564.094675:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c047a289800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1780340564.094698:0:3658:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:2.0:1780340564.094704:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961010816:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1780340564.094973:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961010944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340564.095022:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340564.095080:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961010944 00000100:00100000:3.0:1780340564.095085:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961010944 00000100:00100000:3.0:1780340564.095140:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1896 00000100:00100000:3.0:1780340564.095149:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961010944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780340564.095172:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340564.095208:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961010944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340564.095215:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1896 00000100:00080000:3.0:1780340564.095234:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340564.095261:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961010944:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1780340564.096287:0:81824:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x58:0x0] index 3 count 2 00000040:00080000:1.0:1780340564.096333:0:81824:0:(llog.c:800:llog_process_thread()) index: 23, lh_last_idx: 23 synced_idx: 23 lgh_last_idx: 23 00000040:00080000:1.0:1780340564.096337:0:81824:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000004:00080000:1.0:1780340564.096367:0:81824:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1780340564.096436:0:81824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3344085676313ns, next at 0ns, rc = 0 00080000:00080000:1.0:1780340564.096453:0:81824:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1780340564.096905:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340564.096926:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961011072:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1780340564.097007:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340564.097179:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961011072 00000100:00100000:0.0:1780340564.097187:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961011072 00000100:00100000:0.0:1780340564.097235:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5858 00000100:00100000:0.0:1780340564.097245:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961011072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1780340564.097294:0:25490:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:642 count 1 00000100:00100000:0.0:1780340564.097391:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961011072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 148us (385us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780340564.097399:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5858 00000004:00080000:0.0:1780340564.097454:0:3659:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c047207f480, transno 0 00000004:00080000:0.0:1780340564.097461:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c047207f480/1, rc -2, transno 0 00000100:00100000:0.0:1780340564.097468:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961011072:0@lo:6:osp-syn-0-0.0 00000040:00080000:1.0:1780340564.097748:0:81824:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:1.0:1780340564.098605:0:81824:0:(llog_cat.c:1250:llog_cat_cleanup()) cancel plain log [0x1:0x58:0x0] at index 22 of catalog [0x1:0x2:0x0] 00000004:00080000:3.0:1780340564.103694:0:81806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:0.0:1780340564.104741:0:81826:0:(llog.c:800:llog_process_thread()) index: 22, lh_last_idx: 23 synced_idx: 0 lgh_last_idx: 23 00000040:00080000:0.0:1780340564.104778:0:81826:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x5a:0x0] at index 22 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1780340564.105034:0:81826:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000040:00080000:0.0:1780340564.105245:0:81826:0:(llog_cat.c:1250:llog_cat_cleanup()) cancel plain log [0x1:0x5a:0x0] at index 22 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1780340564.105393:0:81826:0:(llog.c:800:llog_process_thread()) index: 23, lh_last_idx: 23 synced_idx: 23 lgh_last_idx: 23 00000040:00080000:0.0:1780340564.105397:0:81826:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1780340564.107624:0:81818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780340564.107647:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1780340564.107715:0:81818:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1780340564.109618:0:81818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa246514327732f2 00000100:00080000:2.0:1780340564.109644:0:81818:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1780340564.109655:0:81818:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c0452443000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340564.109720:0:81818:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d875c00 x1866818961011200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340564.109932:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961011200:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1780340564.110048:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1780340564.110257:0:81818:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1780340564.110373:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340564.110381:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340564.110384:0:81818:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1780340564.110388:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340564.110392:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340564.110394:0:81818:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1780340564.110396:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1780340564.110398:0:81818:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1780340564.110400:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340564.110403:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340564.110404:0:81818:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1780340564.110407:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340564.110409:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340564.110410:0:81818:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1780340564.110414:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1780340564.110632:0:81818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81818:1866818961011328:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340564.110701:0:81818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340564.110737:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961011328 00000100:00100000:2.0:1780340564.110747:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961011328 00000100:00100000:2.0:1780340564.110937:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1780340564.111009:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:81818:x1866818961011328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340564.111238:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:81818:x1866818961011328:12345-0@lo:502:llog_process_th.0 Request processed in 231us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340564.111257:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1780340564.111358:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961011200 00000100:00100000:3.0:1780340564.111363:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961011200 00000100:00100000:3.0:1780340564.111394:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5859 00000100:00100000:3.0:1780340564.111587:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3658:x1866818961011200:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1780340564.111622:0:8399:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3344 last 0 00000020:00000080:3.0:1780340564.111659:0:8399:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa246514327732f9 00002000:00100000:3.0:1780340564.111676:0:8399:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c04858fc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211351c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1780340564.111681:0:8399:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1780340564.111684:0:8399:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1780340564.111796:0:8399:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1780340564.111825:0:8399:0:(import.c:65:import_set_state_nolock()) ffff8c04858fb800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340564.114462:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1866818961011200:12345-0@lo:8:llog_process_th.0 Request processed in 2851us (4391us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340564.114488:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5859 00000100:00100000:3.0:1780340564.115159:0:81818:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445f1e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340564.115201:0:81818:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81818:1866818961011328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780340564.115259:0:81818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780340564.115274:0:81818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340564.115277:0:81818:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1780340564.115283:0:81818:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1780340564.115559:0:81805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1780340564.115594:0:81805:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1780340564.115615:0:81805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476762e00/0xa2465143277323c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773243 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.115630:0:81805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0476762e00/0xa2465143277323c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773243 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340564.115640:0:81805:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c0475faf800 from 1 10000000:01000000:1.0:1780340564.115644:0:81805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1780340564.115692:0:81805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa24651432773300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.115701:0:81805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa24651432773300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.115711:0:81805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa24651432773300 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340564.115736:0:81805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961011456:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1780340564.115913:0:81805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340564.116018:0:81805:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047a9ddf00 going to sleep for 11 seconds 00000100:00100000:0.0:1780340564.116247:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1780340564.116257:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1780340564.116266:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1780340564.116273:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1780340564.116278:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0452443000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1780340564.116301:0:3658:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:0.0:1780340564.116307:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961011200:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1780340564.116343:0:81812:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961011456 00000100:00100000:0.0:1780340564.116349:0:81812:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961011456 00000100:00100000:0.0:1780340564.116398:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1780340564.116409:0:81812:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:81805:x1866818961011456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340564.116583:0:81812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340564.116602:0:81812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0440030e00/0xa24651432773307 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773300 expref: -99 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340564.116631:0:81812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0440030e00/0xa24651432773307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773300 expref: 8 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340564.116643:0:81812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0440030e00/0xa24651432773307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773300 expref: 8 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340564.116653:0:81812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440030e00, rc 0) 00000100:00100000:0.0:1780340564.116701:0:81812:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:81805:x1866818961011456:12345-0@lo:101:mount.lustre.0 Request processed in 294us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340564.116709:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:0.0:1780340564.116897:0:81826:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1780340564.117167:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:0.0:1780340564.117248:0:81826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3344106488017ns, next at 0ns, rc = 0 00080000:00080000:0.0:1780340564.117256:0:81826:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1780340564.117306:0:81805:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961011456:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340564.117328:0:81805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa24651432773300 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773307 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340564.117339:0:81805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa24651432773300 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773307 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340564.118246:0:81805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961011712:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1780340564.118315:0:81805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340564.118393:0:81805:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034740b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340564.118498:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961011712 00000100:00100000:2.0:1780340564.118506:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961011712 00000100:00100000:2.0:1780340564.118557:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1780340564.118566:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:81805:x1866818961011712:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1780340564.118586:0:81810:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1780340564.118620:0:81810:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1780340564.118625:0:81810:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1780340564.118628:0:81810:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1780340564.118631:0:81810:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 103 00000100:00100000:2.0:1780340564.118729:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:81805:x1866818961011712:12345-0@lo:256:mount.lustre.0 Request processed in 164us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340564.118738:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1780340564.118816:0:81805:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec41f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961011712:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1780340564.119703:0:81805:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1780340564.119727:0:81805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa24651432773300 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773307 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340564.119825:0:81805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa24651432773300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773307 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340564.119838:0:81805:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c0475faf800 from 1 10000000:01000000:2.0:1780340564.119841:0:81805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1780340564.119890:0:81805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa2465143277330e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340564.119899:0:81805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa2465143277330e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340564.119921:0:81805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa2465143277330e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340564.120167:0:81805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961011840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780340564.120224:0:81805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340564.120249:0:81805:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445f1ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1780340564.120292:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961011840 00000100:00100000:2.0:1780340564.120299:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961011840 00000100:00100000:2.0:1780340564.120336:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1780340564.120345:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:81805:x1866818961011840:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780340564.120358:0:81811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340564.120377:0:81811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c6e00/0xa24651432773315 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277330e expref: -99 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340564.120401:0:81811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c6e00/0xa24651432773315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277330e expref: 9 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340564.120412:0:81811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c6e00/0xa24651432773315 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277330e expref: 9 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340564.120421:0:81811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6e00, rc 0) 00000100:00100000:2.0:1780340564.120456:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:81805:x1866818961011840:12345-0@lo:101:mount.lustre.0 Request processed in 111us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340564.120463:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1780340564.120516:0:81805:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961011840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780340564.120529:0:81805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa2465143277330e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773315 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340564.120551:0:81805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa2465143277330e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773315 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340564.120618:0:81805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961011968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780340564.120647:0:81805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340564.120659:0:81805:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445f1ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1780340564.120672:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961011968 00000100:00100000:2.0:1780340564.120675:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961011968 00000100:00100000:2.0:1780340564.120692:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1780340564.120697:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046bad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:81805:x1866818961011968:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780340564.121413:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046bad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:81805:x1866818961011968:12345-0@lo:501:mount.lustre.0 Request processed in 712us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340564.121422:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1780340564.121556:0:81805:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961011968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780340564.121596:0:81805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961012096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780340564.121643:0:81805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340564.121716:0:81805:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445f1ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1780340564.121819:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961011584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340564.121875:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340564.122300:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961011584 00000100:00100000:3.0:1780340564.122306:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961011584 00000100:00100000:3.0:1780340564.122363:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1897 00000100:00100000:3.0:1780340564.122371:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961011584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340564.122411:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340564.122467:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961011584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340564.122475:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1897 00000100:00080000:3.0:1780340564.122508:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340564.122540:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961011584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340564.123861:0:81812:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961012096 00000100:00100000:0.0:1780340564.123887:0:81812:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961012096 00000100:00100000:0.0:1780340564.123938:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000004:00080000:3.0:1780340564.124484:0:81806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1780340564.124625:0:81812:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046badb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:81805:x1866818961012096:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780340564.124833:0:81812:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046badb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:81805:x1866818961012096:12345-0@lo:503:mount.lustre.0 Request processed in 887us (3189us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340564.124842:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1780340564.125380:0:81805:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961012096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780340564.127572:0:81828:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445595500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81828:1866818961012224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340564.127666:0:81828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340564.127718:0:81828:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04451cb240 going to sleep for 11 seconds 00000100:00100000:0.0:1780340564.127873:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961012224 00000100:00100000:0.0:1780340564.127881:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961012224 00000100:00100000:0.0:1780340564.127931:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1780340564.128002:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046bad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:81828:x1866818961012224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340564.128660:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046bad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:81828:x1866818961012224:12345-0@lo:502:llog_process_th.0 Request processed in 718us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340564.128670:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1780340564.128912:0:81828:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445595500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81828:1866818961012224:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780340564.129006:0:81828:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780340564.129019:0:81828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340564.129021:0:81828:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1780340564.129031:0:81828:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0475faf800 00000020:00000080:3.0:1780340564.129034:0:81828:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1780340564.129044:0:81828:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780340564.129047:0:81828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340564.129049:0:81828:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1780340564.129111:0:81828:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780340564.129116:0:81828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340564.129118:0:81828:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1780340564.129122:0:81828:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0475faf800 00000020:00000080:3.0:1780340564.129124:0:81828:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1780340564.129219:0:81828:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445595500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81828:1866818961012352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340564.129259:0:81828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340564.129287:0:81828:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04451cb240 going to sleep for 11 seconds 00000100:00100000:2.0:1780340564.131063:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961012352 00000100:00100000:2.0:1780340564.131077:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961012352 00000100:00100000:2.0:1780340564.131143:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1780340564.131154:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046bada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:81828:x1866818961012352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340564.131337:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046bada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:81828:x1866818961012352:12345-0@lo:502:llog_process_th.0 Request processed in 185us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340564.131346:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1780340564.132117:0:81828:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445595500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81828:1866818961012352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780340564.132159:0:81828:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780340564.132170:0:81828:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340564.132172:0:81828:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1780340564.132176:0:81828:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1780340564.134241:0:81805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1780340564.134287:0:81805:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1780340564.139904:0:81805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa2465143277330e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773315 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340564.139931:0:81805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa2465143277330e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773315 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340564.140046:0:81805:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1780340564.140060:0:81805:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c0475faf800 10000000:01000000:0.0:1780340564.140064:0:81805:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c0475faf800 10000000:01000000:0.0:1780340564.140069:0:81805:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1780340564.140077:0:81805:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c0475faf800 from 1 10000000:01000000:0.0:1780340564.140080:0:81805:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780340564.140128:0:81805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440031c00/0xa2465143277331c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340564.140145:0:81805:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0440031c00/0xa2465143277331c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340564.140160:0:81805:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0440031c00/0xa2465143277331c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340564.140197:0:81805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961012480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1780340564.140292:0:81805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340564.140359:0:81805:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034740b000 going to sleep for 11 seconds 00000100:00100000:0.0:1780340564.140402:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961012480 00000100:00100000:0.0:1780340564.140411:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961012480 00000100:00100000:0.0:1780340564.140474:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1780340564.140486:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046bad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:81805:x1866818961012480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340564.140503:0:81810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340564.140519:0:81810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0440031400/0xa24651432773323 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277331c expref: -99 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340564.140550:0:81810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0440031400/0xa24651432773323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277331c expref: 10 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340564.140563:0:81810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0440031400/0xa24651432773323 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277331c expref: 10 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340564.140575:0:81810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440031400, rc 0) 00000100:00100000:0.0:1780340564.140619:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046bad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:81805:x1866818961012480:12345-0@lo:101:mount.lustre.0 Request processed in 135us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340564.140627:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1780340564.140691:0:81805:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961012480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340564.140707:0:81805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0440031c00/0xa2465143277331c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773323 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340564.140717:0:81805:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0440031c00/0xa2465143277331c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773323 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340564.140824:0:81805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961012608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780340564.140851:0:81805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340564.140882:0:81805:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034740b000 going to sleep for 11 seconds 00000100:00100000:1.0:1780340564.141354:0:81817:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961012608 00000100:00100000:1.0:1780340564.141361:0:81817:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961012608 00000100:00100000:1.0:1780340564.141400:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1780340564.141409:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046badb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:81805:x1866818961012608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780340564.141569:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046badb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:81805:x1866818961012608:12345-0@lo:501:mount.lustre.0 Request processed in 160us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340564.141577:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1780340564.142701:0:81805:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961012608:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780340564.143048:0:81805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961012736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780340564.143589:0:81805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340564.143623:0:81805:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034740b000 going to sleep for 11 seconds 00000100:00100000:1.0:1780340564.143684:0:81817:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961012736 00000100:00100000:1.0:1780340564.143692:0:81817:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961012736 00000100:00100000:1.0:1780340564.143755:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1780340564.143785:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046bad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:81805:x1866818961012736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780340564.143921:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046bad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:81805:x1866818961012736:12345-0@lo:503:mount.lustre.0 Request processed in 138us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340564.143930:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1780340564.144262:0:81805:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961012736:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780340564.145217:0:81830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81830:1866818961012864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340564.145277:0:81830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340564.145315:0:81830:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034740b840 going to sleep for 11 seconds 00000100:00100000:1.0:1780340564.145354:0:81817:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961012864 00000100:00100000:1.0:1780340564.145360:0:81817:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961012864 00000100:00100000:1.0:1780340564.145396:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1780340564.145404:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:81830:x1866818961012864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340564.145632:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:81830:x1866818961012864:12345-0@lo:502:llog_process_th.0 Request processed in 228us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340564.145640:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1780340564.146416:0:81830:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81830:1866818961012864:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1780340564.146559:0:81830:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1780340564.146581:0:81830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8c0471d519c0) 00000020:00000080:0.0:1780340564.146615:0:81830:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1780340564.147644:0:81830:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0475faf800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1780340564.147649:0:81830:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0475faf800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1780340564.147652:0:81830:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c0475faf800 4 00010000:00080000:0.0:1780340564.147699:0:81830:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c0349150000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:0.0:1780340564.155317:0:81830:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1780340564.156537:0:81830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1780340564.156606:0:81830:0:(lwp_dev.c:494:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1780340564.156627:0:81830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa24651432773331 00000100:00080000:0.0:1780340564.156640:0:81830:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1780340564.156648:0:81830:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c0349150000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340564.156695:0:81830:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c045ec40380 x1866818961012992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340564.156800:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961012992:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1780340564.156903:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780340564.157208:0:81830:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1780340564.158226:0:81830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445595500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81830:1866818961013120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340564.158301:0:81830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340564.158332:0:81830:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04451cbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340564.158353:0:81812:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961013120 00000100:00100000:3.0:1780340564.158361:0:81812:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961013120 00000100:00100000:3.0:1780340564.158413:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1780340564.158422:0:81812:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:81830:x1866818961013120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340564.158578:0:81812:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:81830:x1866818961013120:12345-0@lo:502:llog_process_th.0 Request processed in 155us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340564.158587:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1780340564.158655:0:81830:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445595500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81830:1866818961013120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340564.158696:0:81830:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445595500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81830:1866818961013248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340564.158730:0:81830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340564.158799:0:81830:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04451cbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340564.158812:0:81817:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961013248 00000100:00100000:3.0:1780340564.158815:0:81817:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961013248 00000100:00100000:3.0:1780340564.158838:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1780340564.158844:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:81830:x1866818961013248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340564.158916:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:81830:x1866818961013248:12345-0@lo:502:llog_process_th.0 Request processed in 72us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340564.158933:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1780340564.159939:0:81830:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445595500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81830:1866818961013248:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1780340564.160051:0:81830:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1780340564.160305:0:81805:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1780340564.160333:0:81805:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780340564.160351:0:81805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440031c00/0xa2465143277331c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773323 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340564.160364:0:81805:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0440031c00/0xa2465143277331c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773323 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1780340564.160426:0:81805:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1780340564.160429:0:81805:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1780340564.160431:0:81805:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780340564.160432:0:81805:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780340564.160433:0:81805:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780340564.160435:0:81805:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780340564.161528:0:81805:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780340564.161534:0:81805:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1780340564.161536:0:81805:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780340564.161538:0:81805:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1780340564.161543:0:81805:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1780340564.161547:0:81805:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1780340564.161548:0:81805:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1780340564.161549:0:81805:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780340564.161551:0:81805:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780340564.161552:0:81805:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780340564.161553:0:81805:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780340564.161554:0:81805:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780340564.161555:0:81805:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1780340564.161556:0:81805:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780340564.161557:0:81805:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1780340564.161587:0:81805:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1780340564.161610:0:81805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445595500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961013376:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1780340564.161695:0:81805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340564.163159:0:81805:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04451cbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340564.163205:0:81812:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961013376 00000100:00100000:3.0:1780340564.163217:0:81812:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961013376 00000100:00100000:3.0:1780340564.163287:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1780340564.163298:0:81812:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:81805:x1866818961013376:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1780340564.163339:0:81812:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1780340564.163357:0:81812:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1780340564.166167:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961012992 00000100:00100000:3.0:1780340564.166186:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961012992 00000100:00100000:3.0:1780340564.166244:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:3.0:1780340564.166256:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961012992:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1780340564.168119:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961012992:12345-0@lo:38:llog_process_th.0 Request processed in 1853us (11204us total) trans 0 rc -11/-11 00000100:00100000:3.0:1780340564.168134:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1780340564.173608:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780340564.173626:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0349150000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340564.173635:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1780340564.173641:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961012992:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1780340564.180236:0:81812:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1780340564.180291:0:81812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1780340564.180621:0:81815:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1780340564.180628:0:81815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1780340564.180656:0:81815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0476763800/0xa24651432773338 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.180679:0:81815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0440030e00/0xa24651432773307 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773300 expref: 10 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.180688:0:81815:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c0476763800/0xa24651432773338 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340564.184241:0:81812:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:81805:x1866818961013376:12345-0@lo:253:mount.lustre.0 Request processed in 20929us (22530us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340564.184261:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1780340564.184362:0:81805:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445595500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:81805:1866818961013376:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1780340564.184383:0:81805:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1780340564.184387:0:81805:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1780340564.184389:0:81805:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1780340564.184391:0:81805:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340564.184392:0:81805:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340564.184394:0:81805:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340564.184395:0:81805:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340564.184397:0:81805:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780340564.184398:0:81805:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1780340564.184400:0:81805:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340564.184401:0:81805:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1780340564.184422:0:81805:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1780340564.185874:0:81815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0440030e00/0xa24651432773307 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432773300 expref: 10 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.185910:0:81815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0440030e00/0xa24651432773307 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432773300 expref: 9 pid: 81812 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340564.186019:0:81815:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:81815:1866818961013504:0@lo:104: 00000100:00100000:1.0:1780340564.186163:0:81815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340564.186215:0:81815:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047a9dd540 going to sleep for 11 seconds 00000100:00100000:1.0:1780340564.186250:0:6499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961013504 00000100:00100000:1.0:1780340564.186259:0:6499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961013504 00000100:00100000:1.0:1780340564.186312:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1780340564.186322:0:6499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:81815:x1866818961013504:12345-0@lo:104: 00010000:00010000:1.0:1780340564.186340:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa24651432773300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432773307 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.186395:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1780340564.186401:0:6499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:81815:x1866818961013504:12345-0@lo:104: Request processed in 81us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340564.186408:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00010000:00010000:1.0:1780340564.186433:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340564.187527:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa24651432773300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432773307 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.187540:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762800 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340564.187545:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa24651432773300 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432773307 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.187555:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa24651432773300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432773307 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340564.187562:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa24651432773300 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432773307 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340564.187588:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340564.187643:0:6504:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa24651432773300 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432773307 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.187650:0:6504:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340564.187676:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa24651432773300 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432773307 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.187683:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa24651432773300 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432773307 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.187705:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340564.187708:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340564.187710:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340564.187729:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961013632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340564.190644:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340564.190736:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961013632 00000100:00100000:1.0:1780340564.191033:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961013632 00010000:00010000:1.0:1780340564.191140:0:25498:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0440030e00/0xa24651432773307 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432773300 expref: 10 pid: 81812 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340564.191186:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:1.0:1780340564.191195:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:3662:x1866818961013632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340564.191213:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340564.191218:0:25498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0440030e00/0xa24651432773307 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432773300 expref: 10 pid: 81812 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.191233:0:25498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0440030e00/0xa24651432773307 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432773300 expref: 10 pid: 81812 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.191279:0:25498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c0476763800/0xa24651432773338 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.191289:0:25498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0476763800/0xa24651432773338 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1780340564.191311:0:25498:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010683970s 00010000:00010000:1.0:1780340564.191316:0:25498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0476763800/0xa24651432773338 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.191325:0:25498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0476763800/0xa24651432773338 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.191332:0:25498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0476763800/0xa24651432773338 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.191339:0:25498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0476763800/0xa24651432773338 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.191346:0:25498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476763800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340564.191351:0:25498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0476763800/0xa24651432773338 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.191360:0:25498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0476763800/0xa24651432773338 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.191370:0:25498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0476763800/0xa24651432773338 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.191381:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340564.191435:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:3662:x1866818961013632:12345-0@lo:103:ldlm_bl.0 Request processed in 240us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340564.192284:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961013632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340564.193205:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00010000:00010000:1.0:1780340564.193287:0:81815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0440030e00/0xa24651432773307 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432773300 expref: 9 pid: 81812 timeout: 3444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340564.193308:0:81815:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:81815:1866818961013504:0@lo:104: 00010000:00010000:1.0:1780340564.193329:0:81815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c0476763800/0xa24651432773338 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.193340:0:81815:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c0476763800/0xa24651432773338 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.193347:0:81815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0476763800/0xa24651432773338 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.193355:0:81815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0476763800/0xa24651432773338 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1780340564.223974:0:81805:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444069 00000040:01000000:3.0:1780340564.225333:0:81805:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1780340564.225749:0:81837:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1780340564.225876:0:81837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1780340564.226037:0:81805:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:0.0:1780340564.227786:0:81836:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444069 00000020:00080000:0.0:1780340564.227797:0:81836:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444069 00000100:00100000:0.0:1780340564.228658:0:81838:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:81838:1866818961013760:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780340564.229159:0:81838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340564.229207:0:81838:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034740b300 going to sleep for 11 seconds 00000100:00100000:1.0:1780340564.229225:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961013760 00000100:00100000:1.0:1780340564.229235:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961013760 00000100:00100000:1.0:1780340564.229300:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3708 00000100:00100000:1.0:1780340564.229311:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:81838:x1866818961013760:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780340564.229426:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:81838:x1866818961013760:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 116us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340564.229434:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3708 00000100:00100000:0.0:1780340564.229902:0:81838:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:81838:1866818961013760:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1780340564.231038:0:81838:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1780340564.231241:0:81805:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000100:00100000:1.0:1780340564.231242:0:81838:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:81838:1866818961013888:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1780340564.231320:0:81805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1780340564.231322:0:81838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340564.231438:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961013888 00000100:00100000:1.0:1780340564.231461:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961013888 00000100:00100000:1.0:1780340564.231508:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3709 00000100:00100000:1.0:1780340564.231516:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:81838:x1866818961013888:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780340564.231631:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:81838:x1866818961013888:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 116us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340564.231639:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3709 00000100:00100000:1.0:1780340564.231664:0:81838:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443719180 going to sleep for 11 seconds 00000100:00100000:1.0:1780340564.231683:0:81838:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:81838:1866818961013888:0@lo:1000:lod0000_rec0001.0 00000004:00000080:2.0:1780340564.231740:0:81805:0:(mdd_device.c:556:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1780340564.231747:0:81805:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000100:00100000:1.0:1780340564.231772:0:81838:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:81838:1866818961014016:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780340564.231795:0:81838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1780340564.231798:0:81805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1780340564.231821:0:81838:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443719180 going to sleep for 11 seconds 00000100:00100000:0.0:1780340564.231925:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961014016 00000100:00100000:0.0:1780340564.231929:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961014016 00000100:00100000:0.0:1780340564.231961:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3710 00000100:00100000:0.0:1780340564.231968:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:81838:x1866818961014016:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780340564.232023:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:81838:x1866818961014016:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 55us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340564.232029:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3710 00000100:00100000:1.0:1780340564.232094:0:81838:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ea00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:81838:1866818961014016:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1780340564.232140:0:81838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1780340564.237350:0:81838:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1780340564.237444:0:81838:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1780340564.238619:0:81805:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1780340564.240131:0:81837:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1780340564.240224:0:81837:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1780340564.240229:0:81837:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1780340564.241461:0:81805:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1780340564.241694:0:81805:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1780340564.241895:0:81805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1780340564.242544:0:81805:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4a:0x0] (8/32) registered 00010000:00080000:2.0:1780340564.255611:0:81805:0:(ldlm_lib.c:3035:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 94489280513 00010000:00080000:2.0:1780340564.258678:0:81839:0:(ldlm_lib.c:2838:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 81839 00010000:02000000:2.0:1780340564.258704:0:81839:0:(ldlm_lib.c:2320:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000020:01000004:1.0:1780340564.258858:0:81805:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1780340564.258902:0:81805:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.116@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1780340564.258930:0:81805:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=47 00000080:00000004:1.0:1780340564.258980:0:81805:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1780340564.260221:0:81805:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1780340564.260519:0:81805:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00080000:2.0:1780340564.276841:0:81839:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1780340564.276851:0:81839:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1780340564.406144:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340564.406267:0:81817:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940380032 00000100:00100000:3.0:1780340564.406280:0:81817:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940380032 00000100:00100000:3.0:1780340564.406337:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:3.0:1780340564.406345:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+4:41995:x1866818940380032:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340564.406371:0:81817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340564.406388:0:81817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa4000/0xa2465143277333f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2225 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340564.406414:0:81817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa4000/0xa2465143277333f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2225 expref: 5 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340564.406424:0:81817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa4000/0xa2465143277333f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2225 expref: 5 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340564.406433:0:81817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4000, rc 0) 00000100:00100000:3.0:1780340564.406495:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+5:41995:x1866818940380032:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 151us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340564.406502:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:0.0:1780340564.423149:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340564.423240:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940380160 00000100:00100000:3.0:1780340564.423251:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940380160 00000100:00100000:3.0:1780340564.423310:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 28 00000100:00100000:3.0:1780340564.423321:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+5:41995:x1866818940380160:12345-192.168.203.16@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1780340564.423345:0:81811:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1780340564.423363:0:81811:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1780340564.423367:0:81811:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1780340564.423370:0:81811:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1780340564.423373:0:81811:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1780340564.423375:0:81811:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 104 00000100:00100000:1.0:1780340564.445519:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+5:41995:x1866818940380160:12345-192.168.203.16@tcp:256:ll_cfg_requeue.0 Request processed in 22185us (22363us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340564.445537:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 28 00000100:00100000:3.0:1780340564.464067:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340564.464122:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340564.464274:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940380288 00000100:00100000:0.0:1780340564.464284:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940380288 00000100:00100000:0.0:1780340564.464329:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1063 00000100:00100000:0.0:1780340564.464337:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1866818940380288:12345-192.168.203.16@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1780340564.464371:0:63710:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'e06e5cf1-1986-4ba7-9630-fad7efb74eca' at ffff8c046ba24000, cookie 0xa24651432773289 00010000:00080000:0.0:1780340564.464378:0:63710:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp recovering/t94489280514 exp ffff8c046ba24000 cur 3344 last 1780340564 00010000:02000400:0.0:1780340564.464386:0:63710:0:(ldlm_lib.c:2021:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1780340564.464392:0:63710:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1780340564.464412:0:63710:0:(mdt_handler.c:7301:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1780340564.464547:0:63710:0:(import.c:65:import_set_state_nolock()) ffff8c034a94d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340564.464628:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940380288:12345-192.168.203.16@tcp:38:ll_cfg_requeue.0 Request processed in 288us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340564.464638:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1063 00000100:00100000:1.0:1780340564.465039:0:81817:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940380416 00000100:00100000:1.0:1780340564.465046:0:81817:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940380416 00000100:00100000:1.0:1780340564.465106:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 29 00000100:00100000:1.0:1780340564.465114:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+5:41995:x1866818940380416:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340564.465125:0:81817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340564.465142:0:81817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0476763200/0xa24651432773346 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced222c expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.465166:0:81817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0476763200/0xa24651432773346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced222c expref: 6 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.465177:0:81817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0476763200/0xa24651432773346 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced222c expref: 6 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.465185:0:81817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0476763200, rc 0) 00000100:00100000:1.0:1780340564.465224:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+6:41995:x1866818940380416:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 112us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340564.465230:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 29 00000100:00100000:3.0:1780340564.471034:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340564.471171:0:81812:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940380544 00000100:00100000:2.0:1780340564.471190:0:81812:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940380544 00000100:00100000:2.0:1780340564.471271:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 30 00000100:00100000:2.0:1780340564.471283:0:81812:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034dd19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+6:41995:x1866818940380544:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340564.471504:0:81812:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034dd19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+7:41995:x1866818940380544:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 222us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340564.471513:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 30 00000100:00100000:3.0:1780340564.477396:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340564.479110:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940373248 00000100:00100000:0.0:1780340564.479135:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940373248 00000100:00100000:0.0:1780340564.479227:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1064 00000100:00100000:0.0:1780340564.479240:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940373248:12345-192.168.203.16@tcp:36:mcreate.0 00010000:00080000:0.0:1780340564.479266:0:63711:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 94489280514, current: 94489280514, replaying 00000100:00100000:0.0:1780340564.479291:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940373248:12345-192.168.203.16@tcp:36:mcreate.0 Request processed in 54us (1905us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340564.479299:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1064 00010000:00080000:3.0:1780340564.479358:0:81839:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1780340564.483733:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340564.485143:0:81817:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940380672 00000100:00100000:3.0:1780340564.485158:0:81817:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940380672 00000100:00100000:3.0:1780340564.485227:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 31 00000100:00100000:3.0:1780340564.485251:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034dd19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+7:41995:x1866818940380672:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340564.485416:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034dd19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+7:41995:x1866818940380672:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 170us (1694us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340564.485425:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 31 00000100:00100000:1.0:1780340564.497117:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340564.497173:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940380800 00000100:00100000:1.0:1780340564.497186:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940380800 00000100:00100000:1.0:1780340564.497252:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 32 00000100:00100000:1.0:1780340564.497263:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034dd1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+7:41995:x1866818940380800:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340564.497285:0:81811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340564.497306:0:81811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0476763400/0xa2465143277334d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2233 expref: -99 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.497346:0:81811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0476763400/0xa2465143277334d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2233 expref: 8 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.497382:0:81811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0476763400/0xa2465143277334d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2233 expref: 8 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340564.497405:0:81811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0476763400, rc 0) 00000100:00100000:1.0:1780340564.497478:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034dd1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940380800:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 216us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340564.497498:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 32 00000100:00100000:1.0:1780340564.505067:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340564.505193:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940380928 00000100:00100000:1.0:1780340564.505207:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940380928 00000100:00100000:1.0:1780340564.505270:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 33 00000100:00100000:1.0:1780340564.505282:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034dd18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940380928:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340564.505474:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034dd18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940380928:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 193us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340564.505498:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 33 00000100:00100000:1.0:1780340564.513015:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340564.513111:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940381056 00000100:00100000:3.0:1780340564.513126:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940381056 00000100:00100000:3.0:1780340564.513232:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 34 00000100:00100000:3.0:1780340564.513244:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034dd1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940381056:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340564.513446:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034dd1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940381056:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 203us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340564.513454:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 34 00000100:00100000:1.0:1780340564.536848:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340564.536978:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940381184 00000100:00100000:2.0:1780340564.536993:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940381184 00000100:00100000:2.0:1780340564.537056:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 35 00000100:00100000:2.0:1780340564.537068:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034dd1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940381184:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340564.537088:0:81810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340564.537110:0:81810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c6600/0xa24651432773354 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced223a expref: -99 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340564.537147:0:81810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c6600/0xa24651432773354 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced223a expref: 9 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340564.537160:0:81810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c6600/0xa24651432773354 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced223a expref: 9 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340564.537170:0:81810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6600, rc 0) 00000100:00100000:2.0:1780340564.537255:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034dd1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:41995:x1866818940381184:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 190us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340564.537263:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 35 00000100:00100000:0.0:1780340564.550073:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340564.550920:0:81812:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940381312 00000100:00100000:2.0:1780340564.550936:0:81812:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940381312 00000100:00100000:2.0:1780340564.551007:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 36 00000100:00100000:2.0:1780340564.551019:0:81812:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034dd18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:41995:x1866818940381312:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340564.551159:0:81812:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034dd18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:41995:x1866818940381312:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 141us (1094us total) trans 0 rc -2/-2 00000100:00100000:2.0:1780340564.551169:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 36 00010000:00010000:1.0:1780340564.875478:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1780340565.451225:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1780340565.451235:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c0475faf800 from 104 10000000:01000000:1.0:1780340565.451243:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1780340565.451305:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa2465143277335b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.451319:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa2465143277335b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.451343:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa2465143277335b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340565.451376:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961014144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340565.451465:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340565.451520:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0448106780 going to sleep for 11 seconds 00000100:00100000:3.0:1780340565.451585:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961014144 00000100:00100000:3.0:1780340565.451597:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961014144 00000100:00100000:3.0:1780340565.451667:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1780340565.451677:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034dd19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:6514:x1866818961014144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340565.451695:0:81810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340565.451710:0:81810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa5400/0xa24651432773362 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277335b expref: -99 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.451750:0:81810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa5400/0xa24651432773362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277335b expref: 10 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.451787:0:81810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa5400/0xa24651432773362 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277335b expref: 10 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.451806:0:81810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5400, rc 0) 00000100:00100000:3.0:1780340565.451865:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034dd19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961014144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340565.451872:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1780340565.452036:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961014144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340565.452051:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa2465143277335b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773362 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.452061:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa2465143277335b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773362 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340565.452141:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961014272:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1780340565.452179:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340565.452202:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0448106780 going to sleep for 11 seconds 00000100:00100000:1.0:1780340565.452215:0:81812:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961014272 00000100:00100000:1.0:1780340565.452219:0:81812:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961014272 00000100:00100000:1.0:1780340565.452247:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1780340565.452254:0:81812:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034dd1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961014272:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1780340565.452269:0:81812:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1780340565.452288:0:81812:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1780340565.452291:0:81812:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 104 00000100:00100000:1.0:1780340565.452361:0:81812:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034dd1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961014272:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340565.452369:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1780340565.452410:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961014272:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1780340565.452465:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1780340565.452473:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa2465143277335b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773362 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.452482:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa2465143277335b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773362 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340565.452491:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1780340565.452493:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c045f0c4800 from 52 10000000:01000000:1.0:1780340565.452496:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780340565.452515:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa24651432773369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.452523:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa24651432773369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.452532:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa24651432773369 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340565.452544:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961014400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340565.452568:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340565.452580:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0448106780 going to sleep for 11 seconds 00000100:00100000:3.0:1780340565.452786:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961014400 00000100:00100000:3.0:1780340565.452792:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961014400 00000100:00100000:3.0:1780340565.452814:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1780340565.452820:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034dd1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961014400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340565.452829:0:81810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340565.452841:0:81810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa5800/0xa24651432773370 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773369 expref: -99 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.452868:0:81810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa5800/0xa24651432773370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773369 expref: 11 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.452877:0:81810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa5800/0xa24651432773370 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773369 expref: 11 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.452884:0:81810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5800, rc 0) 00000100:00100000:3.0:1780340565.452911:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034dd1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961014400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340565.452916:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1780340565.453051:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961014400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340565.453062:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa24651432773369 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773370 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.453069:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa24651432773369 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773370 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340565.453143:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961014528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340565.453172:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340565.453205:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0448106780 going to sleep for 11 seconds 00000100:00100000:3.0:1780340565.453873:0:81812:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961014528 00000100:00100000:3.0:1780340565.453879:0:81812:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961014528 00000100:00100000:3.0:1780340565.453912:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1780340565.453920:0:81812:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034dd1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961014528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340565.454087:0:81812:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034dd1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961014528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340565.454102:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1780340565.454147:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961014528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340565.454184:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961014656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340565.454224:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340565.454238:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348723d80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340565.454249:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961014656 00000100:00100000:3.0:1780340565.454252:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961014656 00000100:00100000:3.0:1780340565.454272:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1780340565.454278:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961014656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340565.454348:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961014656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340565.454354:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1780340565.454396:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961014656:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780340565.455464:0:81889:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1780340565.461184:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1780340565.461242:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1780340565.461257:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa24651432773369 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773370 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.461273:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa24651432773369 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773370 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340565.461284:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1780340565.461288:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c045f0c4800 from 101 10000000:01000000:1.0:1780340565.461291:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1780340565.461344:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476762c00/0xa24651432773377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.461353:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0476762c00/0xa24651432773377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.461366:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0476762c00/0xa24651432773377 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340565.461399:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961014784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340565.461483:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340565.461538:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04481063c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340565.462029:0:81812:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961014784 00000100:00100000:2.0:1780340565.462039:0:81812:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961014784 00000100:00100000:2.0:1780340565.462107:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1780340565.462117:0:81812:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961014784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340565.462133:0:81812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340565.462149:0:81812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c7800/0xa2465143277337e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773377 expref: -99 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.462177:0:81812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c7800/0xa2465143277337e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773377 expref: 12 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.462190:0:81812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c7800/0xa2465143277337e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773377 expref: 12 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.462200:0:81812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7800, rc 0) 00000100:00100000:2.0:1780340565.462252:0:81812:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961014784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340565.462259:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1780340565.462395:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961014784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340565.462420:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0476762c00/0xa24651432773377 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277337e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.462431:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0476762c00/0xa24651432773377 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277337e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340565.462486:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961014912:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1780340565.462518:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340565.462549:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04481063c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340565.462597:0:81817:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961014912 00000100:00100000:0.0:1780340565.462602:0:81817:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961014912 00000100:00100000:0.0:1780340565.462637:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1780340565.462644:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961014912:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1780340565.462667:0:81817:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1780340565.462685:0:81817:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1780340565.462689:0:81817:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1780340565.462693:0:81817:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1780340565.462696:0:81817:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1780340565.462699:0:81817:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 104 00000100:00100000:0.0:1780340565.462811:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961014912:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 167us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340565.462818:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1780340565.462952:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961014912:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1780340565.463033:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1780340565.463041:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476762c00/0xa24651432773377 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277337e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.463050:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0476762c00/0xa24651432773377 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277337e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340565.463058:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1780340565.463060:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1780340565.463063:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1780340565.463083:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6800/0xa24651432773385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.463090:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04754c6800/0xa24651432773385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.463099:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04754c6800/0xa24651432773385 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340565.463111:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961015040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340565.463136:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340565.463165:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a854e40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340565.463202:0:81812:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961015040 00000100:00100000:0.0:1780340565.463206:0:81812:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961015040 00000100:00100000:0.0:1780340565.463235:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1780340565.463241:0:81812:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961015040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340565.463250:0:81812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340565.463261:0:81812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0440030800/0xa2465143277338c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773385 expref: -99 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.463276:0:81812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0440030800/0xa2465143277338c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773385 expref: 13 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.463286:0:81812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0440030800/0xa2465143277338c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773385 expref: 13 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.463293:0:81812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440030800, rc 0) 00000100:00100000:0.0:1780340565.463318:0:81812:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961015040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340565.463325:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1780340565.465410:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961015040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340565.465451:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04754c6800/0xa24651432773385 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277338c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.465465:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04754c6800/0xa24651432773385 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277338c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340565.465619:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961015168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340565.465692:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340565.465748:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a854e40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340565.465896:0:81817:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961015168 00000100:00100000:0.0:1780340565.465905:0:81817:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961015168 00000100:00100000:0.0:1780340565.465970:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1780340565.465980:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961015168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340565.466155:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961015168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340565.466163:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1780340565.466251:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961015168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340565.466282:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961015296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340565.466324:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340565.466353:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a854e40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340565.466390:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961015296 00000100:00100000:0.0:1780340565.466394:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961015296 00000100:00100000:0.0:1780340565.466422:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1780340565.466428:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961015296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340565.467253:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961015296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 820us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340565.467262:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1780340565.467342:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961015296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340565.479290:0:81890:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1780340565.479575:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1780340565.479615:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1780340565.479632:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6800/0xa24651432773385 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277338c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.479647:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04754c6800/0xa24651432773385 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277338c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340565.479659:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1780340565.479662:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8c045f0c4800 from 1 10000000:01000000:0.0:1780340565.479666:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1780340565.479716:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440030200/0xa24651432773393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.479724:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0440030200/0xa24651432773393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.479807:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0440030200/0xa24651432773393 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340565.479843:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961015424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340565.479946:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340565.480000:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0450132cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340565.480146:0:81817:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961015424 00000100:00100000:2.0:1780340565.480155:0:81817:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961015424 00000100:00100000:2.0:1780340565.480208:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1780340565.480220:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961015424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340565.480237:0:81817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340565.480251:0:81817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c7400/0xa2465143277339a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773393 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.480278:0:81817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c7400/0xa2465143277339a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773393 expref: 14 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.480291:0:81817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c7400/0xa2465143277339a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773393 expref: 14 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.480301:0:81817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7400, rc 0) 00000100:00100000:2.0:1780340565.480348:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:6514:x1866818961015424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340565.480363:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1780340565.480466:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961015424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340565.480483:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0440030200/0xa24651432773393 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277339a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.480493:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0440030200/0xa24651432773393 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277339a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340565.480512:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1780340565.480516:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440030200/0xa24651432773393 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277339a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.480524:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0440030200/0xa24651432773393 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277339a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340565.480532:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1780340565.480534:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c045f0c4800 from 7 10000000:01000000:0.0:1780340565.480536:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1780340565.480553:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440030e00/0xa246514327733a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.480561:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0440030e00/0xa246514327733a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.480579:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0440030e00/0xa246514327733a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340565.480594:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961015552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340565.480624:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340565.480654:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0450132cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340565.480704:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961015552 00000100:00100000:2.0:1780340565.480708:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961015552 00000100:00100000:2.0:1780340565.480749:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1780340565.480776:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:6514:x1866818961015552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340565.480783:0:81810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340565.480792:0:81810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c7600/0xa246514327733a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327733a1 expref: -99 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.480806:0:81810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c7600/0xa246514327733a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327733a1 expref: 15 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.480813:0:81810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c7600/0xa246514327733a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327733a1 expref: 15 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.480819:0:81810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7600, rc 0) 00000100:00100000:2.0:1780340565.480842:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961015552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340565.480848:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1780340565.480972:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961015552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340565.480981:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0440030e00/0xa246514327733a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733a8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.480989:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0440030e00/0xa246514327733a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327733a8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340565.481045:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961015680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340565.481069:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340565.481091:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0450132cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340565.481229:0:81817:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961015680 00000100:00100000:2.0:1780340565.481233:0:81817:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961015680 00000100:00100000:2.0:1780340565.481264:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1780340565.481271:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961015680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340565.481394:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961015680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340565.481402:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1780340565.481471:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961015680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340565.481502:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961015808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340565.481544:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340565.481571:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0450132cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340565.481960:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961015808 00000100:00100000:2.0:1780340565.481971:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961015808 00000100:00100000:2.0:1780340565.481998:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1780340565.482004:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961015808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340565.482091:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961015808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340565.482098:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1780340565.482366:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961015808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780340565.486817:0:81892:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1780340565.487142:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1780340565.487176:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1780340565.487191:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440030e00/0xa246514327733a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733a8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.487204:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0440030e00/0xa246514327733a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733a8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340565.487215:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1780340565.487218:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c04773ad000 from 52 10000000:01000000:2.0:1780340565.487222:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780340565.487279:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c7a00/0xa246514327733af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.487288:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04754c7a00/0xa246514327733af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.487302:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04754c7a00/0xa246514327733af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340565.487336:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961015936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340565.487431:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340565.487489:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a854540 going to sleep for 11 seconds 00000100:00100000:0.0:1780340565.487638:0:81817:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961015936 00000100:00100000:0.0:1780340565.487647:0:81817:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961015936 00000100:00100000:0.0:1780340565.487710:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1780340565.487744:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961015936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340565.487782:0:81817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340565.487798:0:81817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0440031000/0xa246514327733b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327733af expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.487828:0:81817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0440031000/0xa246514327733b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327733af expref: 16 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.487839:0:81817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0440031000/0xa246514327733b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327733af expref: 16 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.487848:0:81817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440031000, rc 0) 00000100:00100000:0.0:1780340565.487905:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961015936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340565.487912:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1780340565.488075:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961015936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340565.488099:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04754c7a00/0xa246514327733af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.488109:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04754c7a00/0xa246514327733af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327733b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340565.488185:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961016064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340565.488215:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340565.488246:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a854540 going to sleep for 11 seconds 00000100:00100000:0.0:1780340565.493720:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961016064 00000100:00100000:0.0:1780340565.493749:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961016064 00000100:00100000:0.0:1780340565.493850:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1780340565.493873:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961016064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340565.494102:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961016064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (5884us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340565.494110:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1780340565.494307:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961016064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340565.494378:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961016192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340565.494447:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340565.494492:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a854540 going to sleep for 11 seconds 00000100:00100000:0.0:1780340565.494990:0:81817:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961016192 00000100:00100000:0.0:1780340565.494996:0:81817:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961016192 00000100:00100000:0.0:1780340565.495038:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1780340565.495049:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961016192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340565.495176:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961016192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340565.495194:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1780340565.495302:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961016192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780340565.496205:0:81893:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1780340565.496850:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1780340565.496900:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1780340565.496913:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c7a00/0xa246514327733af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.496928:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04754c7a00/0xa246514327733af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340565.496939:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1780340565.496942:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1780340565.496945:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1780340565.496990:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6c00/0xa246514327733bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.496999:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04754c6c00/0xa246514327733bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.497017:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04754c6c00/0xa246514327733bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340565.497046:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961016320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340565.497114:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340565.497154:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a854cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340565.497588:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961016320 00000100:00100000:0.0:1780340565.497597:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961016320 00000100:00100000:0.0:1780340565.497662:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1780340565.497673:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961016320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340565.497690:0:81810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340565.497707:0:81810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c045ec6d200/0xa246514327733c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327733bd expref: -99 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.497746:0:81810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c045ec6d200/0xa246514327733c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327733bd expref: 17 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.497778:0:81810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c045ec6d200/0xa246514327733c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327733bd expref: 17 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.497787:0:81810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c045ec6d200, rc 0) 00000100:00100000:0.0:1780340565.497838:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961016320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340565.497845:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1780340565.498054:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961016320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340565.498071:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04754c6c00/0xa246514327733bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.498080:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04754c6c00/0xa246514327733bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327733c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340565.498159:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961016448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340565.498201:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340565.498235:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c03487236c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340565.500807:0:81817:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961016448 00000100:00100000:0.0:1780340565.500826:0:81817:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961016448 00000100:00100000:0.0:1780340565.500913:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1780340565.500926:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b2d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961016448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340565.501157:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b2d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961016448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (2954us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340565.501165:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1780340565.501357:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961016448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340565.501423:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961016576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340565.501491:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340565.501529:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c03487236c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340565.502223:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961016576 00000100:00100000:0.0:1780340565.502239:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961016576 00000100:00100000:0.0:1780340565.502290:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1780340565.502300:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b2d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961016576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340565.506994:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b2d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961016576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4682us (5489us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340565.507013:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1780340565.512383:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961016576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780340565.515944:0:81894:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1780340565.522172:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1780340565.522226:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1780340565.522240:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6c00/0xa246514327733bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.522256:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04754c6c00/0xa246514327733bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340565.530027:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1780340565.530038:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c04773ad000 from 7 10000000:01000000:2.0:1780340565.530046:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1780340565.530112:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa246514327733cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.530128:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa246514327733cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.530141:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa246514327733cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340565.530178:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961016704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340565.530288:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340565.530362:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a854e40 going to sleep for 11 seconds 00000100:00100000:1.0:1780340565.530569:0:81817:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961016704 00000100:00100000:1.0:1780340565.530579:0:81817:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961016704 00000100:00100000:1.0:1780340565.530648:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1780340565.530661:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b2d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961016704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340565.530678:0:81817:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340565.530695:0:81817:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0476762400/0xa246514327733d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327733cb expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.530726:0:81817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0476762400/0xa246514327733d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327733cb expref: 18 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.530738:0:81817:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0476762400/0xa246514327733d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327733cb expref: 18 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.530748:0:81817:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0476762400, rc 0) 00000100:00100000:1.0:1780340565.530817:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b2d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961016704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340565.530824:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1780340565.531023:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961016704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340565.531041:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa246514327733cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.531051:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa246514327733cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327733d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340565.531153:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961016832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340565.531183:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340565.531242:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a854e40 going to sleep for 11 seconds 00000100:00100000:1.0:1780340565.533628:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961016832 00000100:00100000:1.0:1780340565.533647:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961016832 00000100:00100000:1.0:1780340565.533716:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1780340565.533727:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b2d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961016832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340565.534173:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b2d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961016832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 446us (2988us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340565.534181:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1780340565.534290:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961016832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340565.534352:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961016960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340565.534406:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340565.534442:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04455afc00 going to sleep for 11 seconds 00000100:00100000:1.0:1780340565.535676:0:81817:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961016960 00000100:00100000:1.0:1780340565.535690:0:81817:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961016960 00000100:00100000:1.0:1780340565.535880:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1780340565.535892:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034de93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961016960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340565.536049:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034de93c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961016960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (1642us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340565.536057:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1780340565.540970:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961016960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780340565.542172:0:81896:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1780340565.550162:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1780340565.550224:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1780340565.550237:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa246514327733cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.550253:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa246514327733cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340565.550351:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780340565.550354:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c047b065000 from 52 10000000:01000000:0.0:1780340565.550358:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780340565.550410:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa246514327733d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.550420:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa246514327733d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.550431:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa246514327733d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340565.550460:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961017088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340565.550547:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340565.550937:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0450132cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340565.559475:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961017088 00000100:00100000:3.0:1780340565.559495:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961017088 00000100:00100000:3.0:1780340565.559564:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1780340565.559576:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034de90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961017088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340565.559599:0:81810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340565.559624:0:81810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa5e00/0xa246514327733e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327733d9 expref: -99 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.559660:0:81810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa5e00/0xa246514327733e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327733d9 expref: 19 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.559673:0:81810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa5e00/0xa246514327733e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327733d9 expref: 19 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.559683:0:81810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5e00, rc 0) 00000100:00100000:3.0:1780340565.559816:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034de90450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961017088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 242us (9269us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340565.559823:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1780340565.560201:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961017088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340565.560224:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa246514327733d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340565.560234:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa246514327733d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327733e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340565.560334:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961017216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340565.560372:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340565.560413:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0450132cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340565.560455:0:81812:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961017216 00000100:00100000:3.0:1780340565.560468:0:81812:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961017216 00000100:00100000:3.0:1780340565.560507:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1780340565.560514:0:81812:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034de91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961017216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340565.560639:0:81812:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034de91450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961017216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340565.560646:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1780340565.561053:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961017216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340565.561087:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961017344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340565.561139:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340565.561161:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0450132cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340565.561201:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961017344 00000100:00100000:3.0:1780340565.561206:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961017344 00000100:00100000:3.0:1780340565.561240:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1780340565.561248:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034ac0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961017344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340565.561338:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034ac0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961017344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340565.561346:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1780340565.561415:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961017344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780340565.562354:0:81898:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1780340565.562639:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1780340565.562678:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780340565.562691:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa246514327733d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.562704:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa246514327733d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340565.562715:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1780340565.562717:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1780340565.562720:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1780340565.562787:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa246514327733e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.562796:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa246514327733e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.562822:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa246514327733e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340565.562844:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961017472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340565.562909:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340565.562936:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348723840 going to sleep for 11 seconds 00000100:00100000:1.0:1780340565.563040:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961017472 00000100:00100000:1.0:1780340565.563048:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961017472 00000100:00100000:1.0:1780340565.563101:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1780340565.563109:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476ed7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961017472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340565.563122:0:81811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340565.563137:0:81811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0476763a00/0xa246514327733ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327733e7 expref: -99 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.563164:0:81811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0476763a00/0xa246514327733ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327733e7 expref: 20 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.563174:0:81811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0476763a00/0xa246514327733ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327733e7 expref: 20 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.563196:0:81811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0476763a00, rc 0) 00000100:00100000:1.0:1780340565.563233:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476ed7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961017472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340565.563240:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1780340565.563321:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961017472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340565.563334:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa246514327733e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.563344:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa246514327733e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327733ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340565.563402:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961017600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340565.563426:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340565.563449:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348723840 going to sleep for 11 seconds 00000100:00100000:1.0:1780340565.563487:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961017600 00000100:00100000:1.0:1780340565.563491:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961017600 00000100:00100000:1.0:1780340565.563519:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1780340565.563526:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961017600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340565.563669:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961017600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340565.563676:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1780340565.563746:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961017600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340565.563807:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961017728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340565.563862:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340565.563878:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348723840 going to sleep for 11 seconds 00000100:00100000:1.0:1780340565.563983:0:81817:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961017728 00000100:00100000:1.0:1780340565.563988:0:81817:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961017728 00000100:00100000:1.0:1780340565.564019:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1780340565.564026:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961017728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340565.566599:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961017728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2559us (2732us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340565.566615:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1780340565.566743:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961017728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780340565.569011:0:81899:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1780340565.570002:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1780340565.570042:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1780340565.570057:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa246514327733e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.570071:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa246514327733e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340565.570082:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1780340565.570085:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c047b065000 from 7 10000000:01000000:2.0:1780340565.570088:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1780340565.570139:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa246514327733f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.570147:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa246514327733f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.570159:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa246514327733f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340565.570191:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961017856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340565.570280:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340565.570328:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a854e40 going to sleep for 11 seconds 00000100:00100000:3.0:1780340565.570426:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961017856 00000100:00100000:3.0:1780340565.570436:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961017856 00000100:00100000:3.0:1780340565.570499:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1780340565.570522:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961017856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340565.570538:0:81811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340565.570553:0:81811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa4200/0xa246514327733fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327733f5 expref: -99 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.570582:0:81811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa4200/0xa246514327733fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327733f5 expref: 21 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.570594:0:81811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa4200/0xa246514327733fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327733f5 expref: 21 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.570605:0:81811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4200, rc 0) 00000100:00100000:3.0:1780340565.570655:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961017856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340565.570663:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1780340565.571000:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961017856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340565.571025:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa246514327733f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733fc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.571036:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa246514327733f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327733fc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340565.571111:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961017984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340565.571143:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340565.571172:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a854e40 going to sleep for 11 seconds 00000100:00100000:3.0:1780340565.572375:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961017984 00000100:00100000:3.0:1780340565.572386:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961017984 00000100:00100000:3.0:1780340565.572453:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1780340565.572463:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961017984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340565.572661:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961017984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340565.572669:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1780340565.572799:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961017984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340565.572864:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961018112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340565.572925:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340565.572955:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a854e40 going to sleep for 11 seconds 00000100:00100000:1.0:1780340565.573157:0:81817:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961018112 00000100:00100000:1.0:1780340565.573163:0:81817:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961018112 00000100:00100000:1.0:1780340565.573209:0:81817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1780340565.573217:0:81817:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961018112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340565.573314:0:81817:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961018112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340565.573321:0:81817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1780340565.573443:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961018112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340565.574666:0:81901:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1780340565.575133:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1780340565.575167:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1780340565.575181:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa246514327733f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733fc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.575195:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa246514327733f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327733fc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340565.575222:0:6514:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1780340565.575225:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8c0471e119c0 from 1 10000000:01000000:3.0:1780340565.575228:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1780340565.575277:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4400/0xa24651432773403 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.575286:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4400/0xa24651432773403 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.575296:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4400/0xa24651432773403 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340565.575323:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961018240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340565.575391:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340565.575442:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348723f00 going to sleep for 11 seconds 00000100:00100000:1.0:1780340565.579021:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961018240 00000100:00100000:1.0:1780340565.579039:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961018240 00000100:00100000:1.0:1780340565.579114:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1780340565.579126:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961018240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340565.579146:0:81810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340565.579170:0:81810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0476763000/0xa2465143277340a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773403 expref: -99 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.579203:0:81810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0476763000/0xa2465143277340a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773403 expref: 22 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.579215:0:81810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0476763000/0xa2465143277340a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773403 expref: 22 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.579226:0:81810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0476763000, rc 0) 00000100:00100000:1.0:1780340565.579315:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961018240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (3924us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340565.579322:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1780340565.579431:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961018240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340565.579454:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4400/0xa24651432773403 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277340a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.579465:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4400/0xa24651432773403 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277340a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340565.579497:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1780340565.579503:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4400/0xa24651432773403 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277340a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.579513:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4400/0xa24651432773403 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277340a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340565.579536:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1780340565.579539:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8c0471e119c0 from 1 10000000:01000000:3.0:1780340565.579542:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1780340565.579571:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773411 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.579579:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773411 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.579588:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773411 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340565.579613:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961018368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340565.579654:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340565.579684:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348723f00 going to sleep for 11 seconds 00000100:00100000:1.0:1780340565.579863:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961018368 00000100:00100000:1.0:1780340565.579868:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961018368 00000100:00100000:1.0:1780340565.579904:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1780340565.579912:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961018368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340565.579922:0:81811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340565.579931:0:81811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0476762a00/0xa24651432773418 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773411 expref: -99 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.579946:0:81811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0476762a00/0xa24651432773418 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773411 expref: 23 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.579955:0:81811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0476762a00/0xa24651432773418 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773411 expref: 23 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.579970:0:81811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0476762a00, rc 0) 00000100:00100000:1.0:1780340565.580001:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961018368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340565.580007:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1780340565.580072:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961018368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340565.580082:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773411 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773418 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340565.580090:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773411 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773418 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340565.580148:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961018496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340565.580174:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340565.580194:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348723f00 going to sleep for 11 seconds 00000100:00100000:1.0:1780340565.580526:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961018496 00000100:00100000:1.0:1780340565.580531:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961018496 00000100:00100000:1.0:1780340565.580570:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1780340565.580577:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961018496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340565.580662:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961018496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (487us total) trans 0 rc -2/-2 00000100:00100000:1.0:1780340565.580669:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1780340565.580699:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961018496:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1780340565.580742:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1780340565.580749:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773411 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773418 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340565.580779:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773411 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773418 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340565.904115:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340566.414712:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961018624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340566.414857:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340566.418637:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961018752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340566.418745:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340566.418860:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961018624 00000100:00100000:3.0:1780340566.418870:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961018624 00000100:00100000:3.0:1780340566.418935:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961018752 00000100:00100000:3.0:1780340566.418939:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961018752 00000100:00100000:3.0:1780340566.418965:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898 00000100:00100000:3.0:1780340566.418975:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961018624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340566.419014:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340566.419066:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961018624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (4209us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340566.419074:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898 00000100:00100000:3.0:1780340566.419094:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1899 00000100:00100000:3.0:1780340566.419100:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961018752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340566.419120:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340566.419152:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961018752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340566.419158:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1899 00000100:00080000:3.0:1780340566.419182:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340566.419185:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340566.419232:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961018752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340566.423396:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961018624:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1780340566.924303:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340567.947292:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340568.106820:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340568.106962:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340568.107006:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940381440 00000100:00100000:1.0:1780340568.107021:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940381440 00000100:00100000:0.0:1780340568.107035:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940381568 00000100:00100000:0.0:1780340568.107042:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940381568 00000100:00100000:1.0:1780340568.107093:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 72 00000100:00100000:1.0:1780340568.107107:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2409:x1866818940381440:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340568.107147:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1058 00000100:00100000:0.0:1780340568.107158:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940381568:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340568.107215:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2409:x1866818940381440:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 109us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340568.107216:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940381568:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 57us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340568.107234:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1058 00000100:00100000:1.0:1780340568.107235:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 72 00000100:00080000:2.0:1780340568.107946:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1780340568.973141:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340569.128626:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340569.129670:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340569.130680:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940381824 00000100:00100000:0.0:1780340569.130696:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940381824 00000100:00100000:0.0:1780340569.130802:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1059 00000100:00100000:0.0:1780340569.130816:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940381824:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340569.130934:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940381824:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 121us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340569.130943:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1059 00000100:00100000:3.0:1780340569.133823:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940381696 00000100:00100000:3.0:1780340569.133866:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940381696 00000100:00100000:3.0:1780340569.133949:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 73 00000100:00100000:3.0:1780340569.133960:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940381696:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340569.134067:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940381696:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 109us (5456us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340569.134076:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 73 00000100:00080000:0.0:1780340569.483252:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340569.483260:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340569.483266:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340569.483283:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340569.483314:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c045ec41f80 x1866818961019008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340569.483367:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340569.483370:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340569.483372:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340569.483377:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340569.483390:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d875c00 x1866818961019264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340569.483420:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340569.483423:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340569.483425:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340569.483430:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340569.483442:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0444227800 x1866818961019520/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340569.483462:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340569.483466:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340569.483467:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340569.483472:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340569.483482:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034872ad80 x1866818961019904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340569.483509:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1780340569.483512:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340569.483514:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0349150000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340569.483518:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c0349150000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340569.483529:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a124700 x1866818961020416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340569.483568:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961019136:0@lo:400:kworker.0 00000100:00100000:0.0:1780340569.483674:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340569.483716:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034872b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961020032:0@lo:400:kworker.0 00000100:00100000:0.0:1780340569.483748:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340569.484114:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1780340569.484124:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961018880:0@lo:400:kworker.0 00000100:00100000:0.0:1780340569.484171:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340569.484203:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961019776:0@lo:400:kworker.0 00000100:00100000:0.0:1780340569.484229:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340569.484267:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961019392:0@lo:400:kworker.0 00000100:00100000:0.0:1780340569.484295:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340569.484313:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961020160:0@lo:400:kworker.0 00000100:00100000:0.0:1780340569.484479:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340569.484504:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1780340569.484510:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961019648:0@lo:400:kworker.0 00000100:00100000:0.0:1780340569.484533:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340569.484551:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961020288:0@lo:400:kworker.0 00000100:00100000:0.0:1780340569.484572:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340569.484608:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961019136 00000100:00100000:0.0:1780340569.484618:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961019136 00000100:00100000:0.0:1780340569.484680:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961019392 00000100:00100000:0.0:1780340569.484683:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961019392 00000100:00100000:0.0:1780340569.484708:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:0.0:1780340569.484718:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961019136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340569.485055:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a125500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961019136:12345-0@lo:400:kworker.0 Request processed in 337us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340569.485065:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:0.0:1780340569.485085:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1780340569.485092:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961019392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340569.485138:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961019392:12345-0@lo:400:kworker.0 Request processed in 47us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340569.485144:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1780340569.485168:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961019776 00000100:00100000:0.0:1780340569.485172:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961019776 00000100:00100000:0.0:1780340569.485203:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961020160 00000100:00100000:0.0:1780340569.485207:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961020160 00000100:00100000:0.0:1780340569.485226:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961019648 00000100:00100000:0.0:1780340569.485228:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961019648 00000100:00100000:0.0:1780340569.485246:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961020288 00000100:00100000:0.0:1780340569.485248:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961020288 00000100:00100000:0.0:1780340569.485265:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2340 00000100:00100000:0.0:1780340569.485270:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961019776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340569.485301:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961019776:12345-0@lo:400:kworker.0 Request processed in 31us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340569.485307:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2340 00000100:00100000:0.0:1780340569.485316:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2341 00000100:00100000:0.0:1780340569.485321:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961020160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340569.485460:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961020032 00000100:00100000:1.0:1780340569.485466:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961020032 00000100:00100000:1.0:1780340569.485501:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3711 00000100:00100000:1.0:1780340569.485507:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961020032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340569.485542:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961020032:12345-0@lo:400:kworker.0 Request processed in 37us (1794us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340569.485548:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3711 00000100:00100000:1.0:1780340569.485565:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961018880 00000100:00100000:1.0:1780340569.485569:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961018880 00000100:00100000:1.0:1780340569.485593:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1780340569.485598:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961018880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340569.485626:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961018880:12345-0@lo:400:kworker.0 Request processed in 28us (1455us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340569.485631:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1780340569.485661:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2342 00000100:00100000:1.0:1780340569.485667:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961019648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340569.485692:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961019648:12345-0@lo:400:kworker.0 Request processed in 26us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340569.485698:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2342 00000100:00100000:1.0:1780340569.485708:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2343 00000100:00100000:1.0:1780340569.485713:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961020288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340569.485733:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961020288:12345-0@lo:400:kworker.0 Request processed in 21us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340569.485745:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2343 00000100:00080000:1.0:1780340569.485851:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780340569.485856:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340569.485859:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340569.485925:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961019648:0@lo:400:kworker.0 00000100:00100000:1.0:1780340569.485948:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961020288:0@lo:400:kworker.0 00000100:00100000:1.0:1780340569.485960:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961019392:0@lo:400:kworker.0 00000100:00100000:1.0:1780340569.485999:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961018880:0@lo:400:kworker.0 00000100:00100000:1.0:1780340569.486011:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961019776:0@lo:400:kworker.0 00000100:00100000:1.0:1780340569.486023:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961019136:0@lo:400:kworker.0 00000100:00100000:1.0:1780340569.486035:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034872b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961020032:0@lo:400:kworker.0 00000100:00100000:0.0:1780340569.486523:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961020160:12345-0@lo:400:kworker.0 Request processed in 1198us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340569.486532:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2341 00000100:00100000:1.0:1780340569.486621:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961020160:0@lo:400:kworker.0 00000100:00100000:2.0:1780340569.488238:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961019008:0@lo:38:kworker.0 00000100:00100000:2.0:1780340569.488340:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340569.488380:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961019264:0@lo:38:kworker.0 00000100:00100000:2.0:1780340569.488425:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340569.488445:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961019520:0@lo:38:kworker.0 00000100:00100000:2.0:1780340569.488478:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340569.488498:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034872ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961019904:0@lo:38:kworker.0 00000100:00100000:2.0:1780340569.488525:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340569.488545:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961020416:0@lo:38:kworker.0 00000100:00100000:2.0:1780340569.488571:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340569.488639:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961019008 00000100:00100000:2.0:1780340569.488649:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961019008 00000100:00100000:2.0:1780340569.488684:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961019264 00000100:00100000:2.0:1780340569.488686:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961019264 00000100:00100000:2.0:1780340569.488695:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961019904 00000100:00100000:2.0:1780340569.488698:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961019904 00000100:00100000:3.0:1780340569.488815:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961020416 00000100:00100000:3.0:1780340569.488821:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961020416 00000100:00100000:3.0:1780340569.488855:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1780340569.488864:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961019008:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1780340569.488900:0:63710:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3349 last 0 00000020:00000080:3.0:1780340569.488952:0:63710:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa2465143277341f 00000004:00100000:3.0:1780340569.488974:0:63710:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1780340569.488981:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961020544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340569.489021:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340569.489067:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961019520 00000100:00100000:1.0:1780340569.489072:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961019520 00000100:00100000:1.0:1780340569.489097:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961020544 00000100:00100000:1.0:1780340569.489100:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961020544 00000100:00100000:1.0:1780340569.489138:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3712 00000100:00100000:1.0:1780340569.489143:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961019520:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780340569.489160:0:22660:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8c046ba21000, cookie 0xa24651432773290 00010000:00080000:1.0:1780340569.489165:0:22660:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff8c046ba21000 cur 3349 last 1780340564 00000100:00080000:3.0:1780340569.489184:0:63710:0:(import.c:65:import_set_state_nolock()) ffff8c044d43d000 : changing import state from RECOVER to FULL 00000004:00100000:1.0:1780340569.489189:0:22660:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780340569.489213:0:22660:0:(import.c:65:import_set_state_nolock()) ffff8c0458286000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340569.489259:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1866818961019008:12345-0@lo:38:kworker.0 Request processed in 393us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340569.489268:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818961019520:12345-0@lo:38:kworker.0 Request processed in 123us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340569.489269:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:1.0:1780340569.489280:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3712 00000100:00100000:3.0:1780340569.489296:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1780340569.489301:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3713 00000100:00100000:3.0:1780340569.489304:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961019264:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1780340569.489312:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961020544:12345-0@lo:41:osp-pre-1-0.0 00010000:00080000:3.0:1780340569.489321:0:63710:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3349 last 0 00000020:00000080:3.0:1780340569.489349:0:63710:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa24651432773426 00000004:00100000:3.0:1780340569.489357:0:63710:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000004:00000024:1.0:1780340569.489360:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00080000:3.0:1780340569.489377:0:63710:0:(import.c:65:import_set_state_nolock()) ffff8c044d43b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780340569.489404:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961020544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340569.489411:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3713 00000100:00100000:3.0:1780340569.489421:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1866818961019264:12345-0@lo:38:kworker.0 Request processed in 116us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340569.489429:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00010000:00080000:1.0:1780340569.489436:0:81839:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1780340569.489443:0:81839:0:(ldlm_lib.c:2668:replay_request_or_update()) Waiting for transno 94489280514 00000100:00100000:3.0:1780340569.489446:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000020:00080000:1.0:1780340569.489450:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000100:00100000:3.0:1780340569.489451:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961020416:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780340569.489457:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 94489280514, next_transno: 94489280514 00010000:00080000:1.0:1780340569.489464:0:81839:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (94489280514) 00000020:00080000:1.0:1780340569.489466:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340569.489468:0:63710:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3349 last 0 00010000:00080000:1.0:1780340569.489481:0:81839:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940373248 t94489280514 from 192.168.203.16@tcp req@ffff8c0445597480 x1866818940373248/t0(94489280514) o36->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:745/0 lens 528/0 e 0 to 0 dl 1780340575 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000020:00000080:3.0:1780340569.489496:0:63710:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa2465143277342d 00000004:00100000:3.0:1780340569.489503:0:63710:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1780340569.489517:0:63710:0:(import.c:65:import_set_state_nolock()) ffff8c04530a7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340569.489558:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1866818961020416:12345-0@lo:38:kworker.0 Request processed in 105us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340569.489566:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00010000:00080000:3.0:1780340569.489616:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c045ec41f80 x1866818961019008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340569.489624:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961020544:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1780340569.489636:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 23 00000100:00100000:2.0:1780340569.489912:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:2.0:1780340569.489918:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961019904:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1780340569.489936:0:70100:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3349 last 0 00000020:00000080:2.0:1780340569.489967:0:70100:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa24651432773434 00000004:00100000:2.0:1780340569.489974:0:70100:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1780340569.489993:0:70100:0:(import.c:65:import_set_state_nolock()) ffff8c04480ab800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340569.490029:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1866818961019904:12345-0@lo:38:kworker.0 Request processed in 110us (1502us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340569.490036:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00080000:3.0:1780340569.490511:0:3658:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8c045ec41f80 x1866818961019008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340594 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780340569.490520:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1780340569.490525:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1780340569.490530:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1780340569.490536:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961019008:0@lo:38:kworker.0 00010000:00080000:3.0:1780340569.490557:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c034d875c00 x1866818961019264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780340569.490571:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 23 00000100:00080000:3.0:1780340569.491464:0:3658:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8c034d875c00 x1866818961019264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340594 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780340569.491475:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1780340569.491480:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1780340569.491485:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1780340569.491491:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961019264:0@lo:38:kworker.0 00000100:00080000:3.0:1780340569.491518:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 23 00000100:00080000:3.0:1780340569.491529:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1780340569.491533:0:3658:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1780340569.491544:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:3.0:1780340569.491549:0:3658:0:(recover.c:53:ptlrpc_replay_next()) import ffff8c034a39c800 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:3.0:1780340569.491552:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000004:00080000:3.0:1780340569.495511:0:81839:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5965us 00000100:00100000:1.0:1780340569.495736:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961019520:0@lo:38:kworker.0 00010000:00080000:1.0:1780340569.495812:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c034872ad80 x1866818961019904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340594 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1780340569.495821:0:82052:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1780340569.495839:0:82052:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00000100:00080000:1.0:1780340569.495844:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 23 00010000:00010000:3.0:1780340569.495845:0:82052:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1780340569.497431:0:82052:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:1.0:1780340569.501531:0:3658:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8c034872ad80 x1866818961019904/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340594 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340569.501548:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1780340569.501662:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1780340569.501669:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1780340569.501677:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034872ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961019904:0@lo:38:kworker.0 00010000:00080000:0.0:1780340569.501804:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c047a124700 x1866818961020416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340569.503937:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 23 00000100:00080000:0.0:1780340569.503960:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1780340569.503969:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1780340569.503975:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0349150000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1780340569.503989:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961020416:0@lo:38:kworker.0 00000100:00100000:0.0:1780340569.504059:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961020672:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1780340569.504155:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340569.504261:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961020672 00000100:00100000:2.0:1780340569.504272:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961020672 00000100:00100000:2.0:1780340569.504343:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3714 00000100:00100000:2.0:1780340569.504353:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818961020672:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1780340569.504382:0:22660:0:(ldlm_lib.c:3119:target_queue_recovery_request()) @@@ queue final req req@ffff8c04587b7100 x1866818961020672/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:750/0 lens 224/0 e 0 to 0 dl 1780340580 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340569.504404:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818961020672:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 52us (248us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340569.504413:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3714 00010000:00010000:1.0:1780340569.518957:0:81839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277343b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.518986:0:81839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277343b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.519002:0:81839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277343b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.519016:0:81839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773442 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.519022:0:81839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773442 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.519028:0:81839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773442 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.519579:0:81839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277343b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.519590:0:81839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277343b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.519596:0:81839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277343b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.519609:0:81839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476763600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340569.519613:0:81839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277343b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.519621:0:81839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277343b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.519636:0:81839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04506cfe00) 00010000:00010000:1.0:1780340569.519640:0:81839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340569.519645:0:81839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277343b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.519650:0:81839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277343b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340569.519665:0:81839:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e5d0376c reply state 000000009a3f1e50 transno 94489280514 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773442 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.519675:0:81839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773442 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.519681:0:81839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04506cfb00) 00010000:00010000:1.0:1780340569.519683:0:81839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340569.519687:0:81839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1780340569.520023:0:81839:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:1.0:1780340569.520049:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340569.520052:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280515 00000020:00080000:1.0:1780340569.520057:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340569.520059:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280515 00000100:00100000:0.0:1780340569.525970:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340569.526241:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940373760 00000100:00100000:3.0:1780340569.526257:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940373760 00000100:00100000:3.0:1780340569.526347:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1069 00000100:00100000:3.0:1780340569.526361:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2406:x1866818940373760:12345-192.168.203.16@tcp:36:rm.0 00010000:00080000:3.0:1780340569.526387:0:63710:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 94489280515, current: 94489280515, replaying 00000100:00100000:3.0:1780340569.526409:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2406:x1866818940373760:12345-192.168.203.16@tcp:36:rm.0 Request processed in 52us (455us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340569.526417:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1069 00000020:00080000:1.0:1780340569.526730:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340569.526750:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280515, next_transno: 94489280515 00010000:00080000:1.0:1780340569.526755:0:81839:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (94489280515) 00000020:00080000:1.0:1780340569.526776:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340569.526800:0:81839:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940373760 t94489280515 from 192.168.203.16@tcp req@ffff8c04587b6a00 x1866818940373760/t0(94489280515) o36->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:750/0 lens 512/0 e 0 to 0 dl 1780340580 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1780340569.526941:0:81839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773449 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.526962:0:81839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773449 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.526977:0:81839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773449 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.526992:0:81839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763e00/0xa24651432773450 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.526999:0:81839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763e00/0xa24651432773450 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.527006:0:81839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763e00/0xa24651432773450 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.527115:0:81839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa24651432773457 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.527123:0:81839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa24651432773457 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.527131:0:81839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa24651432773457 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.528129:0:81839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa24651432773457 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.528144:0:81839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa24651432773457 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.528152:0:81839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa24651432773457 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.528160:0:81839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340569.528165:0:81839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa24651432773457 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.528175:0:81839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa24651432773457 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.528194:0:81839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff8c04428a8c00) 00010000:00010000:1.0:1780340569.528198:0:81839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1780340569.528204:0:81839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa24651432773457 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.528211:0:81839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa24651432773457 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.528244:0:81839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773449 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.528251:0:81839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773449 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.528257:0:81839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773449 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.528272:0:81839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340569.528276:0:81839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773449 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.528282:0:81839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773449 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.528291:0:81839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8700) 00010000:00010000:1.0:1780340569.528294:0:81839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340569.528297:0:81839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773449 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.528302:0:81839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773449 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340569.528318:0:81839:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ca33cb5a reply state 000000006a8b5a4e transno 94489280515 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763e00/0xa24651432773450 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1780340569.528411:0:81806:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280514 is committed 00010000:00010000:1.0:1780340569.528452:0:81839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763e00/0xa24651432773450 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.539081:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773442 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.539104:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773442 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.539113:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773442 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.539121:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476763c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340569.539126:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773442 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.539138:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773442 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.539172:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04506cfb00) 00010000:00010000:0.0:1780340569.539176:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340569.539202:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773442 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.539210:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773442 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340569.539313:0:81839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04506cfb00) 00010000:00010000:1.0:1780340569.539319:0:81839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340569.539325:0:81839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1780340569.539491:0:81839:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1780340569.539524:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340569.539527:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280516 00000020:00080000:1.0:1780340569.539532:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340569.539545:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280516 00000100:00100000:1.0:1780340569.549855:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340569.551061:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940374912 00000100:00100000:2.0:1780340569.551078:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940374912 00000100:00100000:2.0:1780340569.551157:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1070 00000100:00100000:2.0:1780340569.551169:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2406:x1866818940374912:12345-192.168.203.16@tcp:101:lfs.0 00010000:00080000:2.0:1780340569.551194:0:63711:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 94489280516, current: 94489280516, replaying 00000100:00100000:2.0:1780340569.551215:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2406:x1866818940374912:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 49us (1373us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340569.551222:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1070 00000020:00080000:1.0:1780340569.551526:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340569.551531:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280516, next_transno: 94489280516 00010000:00080000:1.0:1780340569.551536:0:81839:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (94489280516) 00000020:00080000:1.0:1780340569.551540:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340569.551568:0:81839:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940374912 t94489280516 from 192.168.203.16@tcp req@ffff8c047207c000 x1866818940374912/t0(94489280516) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:750/0 lens 536/0 e 0 to 0 dl 1780340580 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1780340569.551596:0:81839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340569.551630:0:81839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277345e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2217 expref: -99 pid: 81839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.551954:0:81839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432773465 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.551973:0:81839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432773465 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.551988:0:81839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432773465 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.552003:0:81839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c000/0xa2465143277346c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.552010:0:81839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c000/0xa2465143277346c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.552016:0:81839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c000/0xa2465143277346c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340569.552455:0:81839:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00000004:00080000:0.0:1780340569.552477:0:81839:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x2:0x0], cookie = 0xa246514327731e1 00000004:00080000:0.0:1780340569.552480:0:81839:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xa246514327731e1 in new mfd 00010000:00010000:0.0:1780340569.552493:0:81839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432773465 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.552500:0:81839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432773465 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.552508:0:81839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432773465 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.552523:0:81839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6c400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340569.552529:0:81839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432773465 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.552538:0:81839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432773465 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.552551:0:81839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8a00) 00010000:00010000:0.0:1780340569.552554:0:81839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340569.552558:0:81839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432773465 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.552563:0:81839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432773465 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340569.552575:0:81839:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ff7ec6e6 reply state 00000000effff4f1 transno 94489280516 ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c000/0xa2465143277346c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.552583:0:81839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c000/0xa2465143277346c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.552587:0:81839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8c046b231300) 00010000:00010000:0.0:1780340569.552589:0:81839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340569.552591:0:81839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1780340569.552620:0:81839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277345e lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2217 expref: 10 pid: 81839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.552631:0:81839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8a00) 00010000:00010000:0.0:1780340569.552634:0:81839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340569.552637:0:81839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277345e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2217 expref: 10 pid: 81839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.552661:0:81839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0476763600, rc 0) 00010000:00080000:0.0:1780340569.552794:0:81839:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1780340569.552816:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780340569.552820:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280517 00000020:00080000:0.0:1780340569.552833:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780340569.552835:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280517 00000100:00100000:0.0:1780340569.609923:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340569.609971:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940375168 00000100:00100000:0.0:1780340569.609983:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940375168 00000100:00100000:0.0:1780340569.610046:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1071 00000100:00100000:0.0:1780340569.610058:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2406:x1866818940375168:12345-192.168.203.16@tcp:101:lfs.0 00010000:00080000:0.0:1780340569.610085:0:64454:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 94489280517, current: 94489280517, replaying 00000100:00100000:0.0:1780340569.610101:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2406:x1866818940375168:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 46us (190us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340569.610109:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1071 00000020:00080000:0.0:1780340569.618027:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780340569.618037:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280517, next_transno: 94489280517 00010000:00080000:0.0:1780340569.618043:0:81839:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (94489280517) 00000020:00080000:0.0:1780340569.618048:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780340569.618069:0:81839:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940375168 t94489280517 from 192.168.203.16@tcp req@ffff8c04587b4e00 x1866818940375168/t0(94489280517) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:750/0 lens 736/0 e 0 to 0 dl 1780340580 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1780340569.618558:0:81839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340569.618594:0:81839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa2465143277347a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced221e expref: -99 pid: 81839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340569.618750:0:81839:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00000004:00080000:0.0:1780340569.619020:0:81839:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x2:0x0], cookie = 0xa246514327731f6 00000004:00080000:0.0:1780340569.619023:0:81839:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xa246514327731f6 in new mfd 00010000:00010000:0.0:1780340569.619065:0:81839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa2465143277347a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced221e expref: 12 pid: 81839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.619085:0:81839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c046b231700) 00010000:00010000:0.0:1780340569.619088:0:81839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1780340569.619094:0:81839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa2465143277347a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced221e expref: 12 pid: 81839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.619114:0:81839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c045ec6c400, rc 0) 00010000:00080000:0.0:1780340569.619210:0:81839:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1780340569.619238:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780340569.619242:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280518 00000020:00080000:0.0:1780340569.619248:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780340569.619251:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280518 00000100:00100000:1.0:1780340569.629747:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340569.630382:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940375552 00000100:00100000:3.0:1780340569.630400:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940375552 00000100:00100000:3.0:1780340569.640665:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 217 00000100:00100000:3.0:1780340569.640690:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034af3ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:2406:x1866818940375552:12345-192.168.203.16@tcp:35:lfs.0 00010000:00080000:3.0:1780340569.640718:0:63713:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 94489280518, current: 94489280518, replaying 00000100:00100000:3.0:1780340569.640734:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034af3ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:2406:x1866818940375552:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 57us (11000us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340569.640741:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 217 00000020:00080000:1.0:1780340569.641809:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340569.641816:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280518, next_transno: 94489280518 00010000:00080000:1.0:1780340569.641830:0:81839:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (94489280518) 00000020:00080000:1.0:1780340569.641835:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340569.641848:0:81839:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940375552 t94489280518 from 192.168.203.16@tcp req@ffff8c034af3ac50 x1866818940375552/t0(94489280518) o35->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:750/0 lens 392/0 e 0 to 0 dl 1780340580 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780340569.642858:0:81839:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1780340569.642982:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340569.642986:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280519 00000020:00080000:1.0:1780340569.642990:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340569.642993:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280519 00000100:00100000:1.0:1780340569.651504:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340569.653144:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940375808 00000100:00100000:2.0:1780340569.653166:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940375808 00000100:00100000:2.0:1780340569.653239:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 218 00000100:00100000:2.0:1780340569.653307:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:2406:x1866818940375808:12345-192.168.203.16@tcp:35:lfs.0 00010000:00080000:2.0:1780340569.653335:0:63714:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 94489280519, current: 94489280519, replaying 00000100:00100000:2.0:1780340569.653359:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:2406:x1866818940375808:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 57us (1871us total) trans 0 rc 0/-999 00000020:00080000:3.0:1780340569.653403:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340569.653415:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280519, next_transno: 94489280519 00010000:00080000:3.0:1780340569.653421:0:81839:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (94489280519) 00000020:00080000:3.0:1780340569.653424:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340569.653435:0:81839:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940375808 t94489280519 from 192.168.203.16@tcp req@ffff8c047207f480 x1866818940375808/t0(94489280519) o35->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:750/0 lens 392/0 e 0 to 0 dl 1780340580 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780340569.653813:0:81839:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1780340569.653832:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340569.653835:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280520 00000020:00080000:3.0:1780340569.653838:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340569.653839:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280520 00000100:00100000:2.0:1780340569.655112:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 218 00000100:00100000:1.0:1780340569.661941:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340569.662011:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940381952 00000100:00100000:1.0:1780340569.662023:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940381952 00000100:00100000:1.0:1780340569.662112:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1062 00000100:00100000:1.0:1780340569.662133:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:2406:x1866818940381952:12345-192.168.203.16@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1780340569.662166:0:70100:0:(ldlm_lib.c:3119:target_queue_recovery_request()) @@@ queue final req req@ffff8c047207dc00 x1866818940381952/t0(0) o400->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:750/0 lens 224/0 e 0 to 0 dl 1780340580 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340569.662188:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:2406:x1866818940381952:12345-192.168.203.16@tcp:400:ldlm_lock_repla.0 Request processed in 60us (262us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780340569.662196:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1062 00000020:00080000:1.0:1780340569.662224:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340569.662228:0:81839:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 94489280520 00010000:00080000:1.0:1780340569.662231:0:81839:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1780340569.662235:0:81839:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340569.662244:0:81839:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1780340569.662248:0:81839:0:(ldlm_lib.c:2270:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1780340569.662396:0:81839:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 23, last_transno is 98784247808 00000001:00100000:1.0:1780340569.668952:0:81806:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000001:00100000:1.0:1780340569.668966:0:81806:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1780340569.669003:0:81806:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280519 is committed 00010000:00010000:3.0:1780340569.669223:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763e00/0xa24651432773450 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.669239:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763e00/0xa24651432773450 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780340569.669247:0:81839:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:3.0:1780340569.669249:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763e00/0xa24651432773450 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.669259:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476763e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340569.669265:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763e00/0xa24651432773450 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1780340569.669296:0:81839:0:(ldlm_lib.c:1981:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1780340569.669314:0:81839:0:(ldlm_lib.c:2922:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8c04587b7100 x1866818961020672/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:750/0 lens 224/0 e 0 to 0 dl 1780340580 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1780340569.669337:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763e00/0xa24651432773450 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.669364:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04506cfb00) 00010000:00010000:3.0:1780340569.669368:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340569.669375:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763e00/0xa24651432773450 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.669394:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763e00/0xa24651432773450 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.669427:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c000/0xa2465143277346c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.669433:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c000/0xa2465143277346c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.669440:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c000/0xa2465143277346c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.669444:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6c000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340569.669447:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c000/0xa2465143277346c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.669453:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c000/0xa2465143277346c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:2.0:1780340569.669461:0:81839:0:(ldlm_lib.c:2922:target_recovery_thread()) @@@ processing final ping from 192.168.203.16@tcp: req@ffff8c047207dc00 x1866818940381952/t0(0) o400->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:750/0 lens 224/0 e 0 to 0 dl 1780340580 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1780340569.669465:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8c046b231300) 00010000:00010000:3.0:1780340569.669471:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340569.669475:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c000/0xa2465143277346c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.669495:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c000/0xa2465143277346c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:02000000:2.0:1780340569.669554:0:81839:0:(ldlm_lib.c:1853:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1780340569.669649:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1780340569.669848:0:3658:0:(client.c:3224:ptlrpc_resend_req()) @@@ going to resend req@ffff8c0445597100 x1866818961020672/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340585 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340569.669858:0:3658:0:(client.c:3233:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8c0445597100 x1866818961020672/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340585 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340569.669866:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1780340569.669882:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1780340569.669888:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961020672:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1780340569.670849:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961020800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340569.670931:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340569.671360:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961020800 00000100:00100000:3.0:1780340569.671372:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961020800 00000100:00100000:3.0:1780340569.671436:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3715 00000100:00100000:3.0:1780340569.671447:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818961020800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340569.671512:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:3.0:1780340569.671568:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818961020800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340569.671576:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3715 00000100:00100000:1.0:1780340569.671670:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961020800:0@lo:41:osp-pre-0-1.0 00000004:00000080:2.0:1780340569.718391:0:81839:0:(mdd_device.c:2374:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff992747f2fe10 00100000:10000000:2.0:1780340569.718412:0:81839:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1780340569.720400:0:81827:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x90:0x0] 00000100:00100000:2.0:1780340569.720468:0:81827:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:81827:1866818961020928:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1780340569.720579:0:81827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340569.720621:0:81827:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034839bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340569.720651:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961020928 00000100:00100000:2.0:1780340569.720660:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961020928 00000100:00100000:2.0:1780340569.721040:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5860 00000100:00100000:2.0:1780340569.721054:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:81827:x1866818961020928:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1780340569.721159:0:8401:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 705 -> diff = -561 00002000:02000040:2.0:1780340569.721165:0:8401:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:145 to 0x2c0000401:705) 00000004:00080000:3.0:1780340569.721654:0:81825:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x282:0x0] 00000100:00100000:3.0:1780340569.721691:0:81825:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445594000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:81825:1866818961021056:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1780340569.721887:0:81825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340569.721914:0:81825:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471e66c00 going to sleep for 11 seconds 00000100:00100000:3.0:1780340569.721943:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961021056 00000100:00100000:3.0:1780340569.721950:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961021056 00000100:00100000:3.0:1780340569.722156:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5861 00000100:00100000:3.0:1780340569.722166:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:81825:x1866818961021056:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1780340569.722191:0:8400:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 705 -> diff = -63 00002000:02000040:3.0:1780340569.722196:0:8400:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:643 to 0x280000401:705) 00002000:00010000:2.0:1780340569.742163:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.742179:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773488 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.742200:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.742203:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.742209:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773488 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.742229:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773488 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.742241:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773488 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.742258:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773488 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.743178:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.743198:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.743206:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773488 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.743219:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.743225:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773488 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.743238:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773488 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.743260:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773488 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.743340:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773488 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.743371:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.743373:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.743376:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.744445:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.744475:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5ee531c/0xa2465143277348f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.745694:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.746348:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.746360:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5ee531c/0xa2465143277348f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.746382:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5ee531c/0xa2465143277348f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.746396:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5ee531c/0xa2465143277348f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.746405:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5ee531c/0xa2465143277348f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.746436:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.746454:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.746461:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5ee531c/0xa2465143277348f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.746470:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.746475:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5ee531c/0xa2465143277348f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.747637:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5ee531c/0xa2465143277348f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.747676:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5ee531c/0xa2465143277348f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.747683:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5ee531c/0xa2465143277348f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.750426:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.750435:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.750438:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.754125:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.754142:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000802885fc/0xa24651432773496 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.754164:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.754166:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.754172:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000802885fc/0xa24651432773496 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.754190:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000802885fc/0xa24651432773496 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.754202:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000802885fc/0xa24651432773496 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.754210:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000802885fc/0xa24651432773496 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.754247:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.754262:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.755817:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000802885fc/0xa24651432773496 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.755848:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.755854:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000802885fc/0xa24651432773496 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.755866:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000802885fc/0xa24651432773496 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.755894:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000802885fc/0xa24651432773496 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.755902:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000802885fc/0xa24651432773496 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.755935:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.755937:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.755939:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.756632:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.756640:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa2465143277349d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.756655:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.756670:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.756675:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa2465143277349d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.756688:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa2465143277349d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1780340569.757190:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1780340569.758369:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa2465143277349d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.758388:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa2465143277349d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.759573:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340569.759728:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.759737:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000506a0a43/0xa246514327734a4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.759753:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.759755:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.759781:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000506a0a43/0xa246514327734a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.759797:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000506a0a43/0xa246514327734a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.759806:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000506a0a43/0xa246514327734a4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.759837:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000506a0a43/0xa246514327734a4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.763854:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780340569.763872:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa2465143277349d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.763889:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340569.763894:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa2465143277349d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.763924:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa2465143277349d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.763951:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa2465143277349d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.763959:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa2465143277349d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.764058:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340569.764124:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000506a0a43/0xa246514327734a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.764133:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340569.764136:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000506a0a43/0xa246514327734a4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.764143:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000506a0a43/0xa246514327734a4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.764154:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000506a0a43/0xa246514327734a4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.764162:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340569.764164:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340569.764172:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340569.764249:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.764257:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa246514327734ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.764799:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.764804:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.764812:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa246514327734ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.764840:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa246514327734ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.764851:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa246514327734ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.764859:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa246514327734ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.764886:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340569.764907:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340569.764914:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa246514327734ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.764926:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6d800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340569.764929:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa246514327734ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.764939:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa246514327734ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.764952:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa246514327734ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.764969:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa246514327734ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.764986:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340569.764988:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340569.764990:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.765094:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1780340569.765101:0:8401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000506a0a43/0xa246514327734a4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340569.765208:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.765215:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6ae8967/0xa246514327734b2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765223:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.765224:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.765226:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6ae8967/0xa246514327734b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765236:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6ae8967/0xa246514327734b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765243:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6ae8967/0xa246514327734b2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765250:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6ae8967/0xa246514327734b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765266:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.765395:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.765401:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6ae8967/0xa246514327734b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765409:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.765412:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6ae8967/0xa246514327734b2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765419:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6ae8967/0xa246514327734b2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765431:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6ae8967/0xa246514327734b2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765439:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6ae8967/0xa246514327734b2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765454:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.765455:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.765457:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.765502:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.765507:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051d5dd63/0xa246514327734b9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765514:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.765516:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.765518:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051d5dd63/0xa246514327734b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765537:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051d5dd63/0xa246514327734b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765545:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051d5dd63/0xa246514327734b9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765552:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051d5dd63/0xa246514327734b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765565:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.765573:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.765577:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051d5dd63/0xa246514327734b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765583:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eba00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.765586:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051d5dd63/0xa246514327734b9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765592:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051d5dd63/0xa246514327734b9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765601:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051d5dd63/0xa246514327734b9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765607:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051d5dd63/0xa246514327734b9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765626:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.765628:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.765629:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340569.765657:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.765673:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.765678:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b81ab740/0xa246514327734c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.765685:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.765686:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.765689:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b81ab740/0xa246514327734c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340569.765851:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.765856:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa246514327734c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.765865:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.765867:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.765870:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa246514327734c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.765893:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa246514327734c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.765901:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa246514327734c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.765909:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa246514327734c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.765924:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340569.765933:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340569.765937:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa246514327734c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.765945:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6d400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340569.765948:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa246514327734c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.765955:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa246514327734c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.765965:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa246514327734c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.766809:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa246514327734c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.766844:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340569.766847:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340569.766849:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340569.766943:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.766949:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa246514327734ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.766959:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.766961:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.766964:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa246514327734ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.767130:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b81ab740/0xa246514327734c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.767143:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b81ab740/0xa246514327734c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.767151:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b81ab740/0xa246514327734c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.767172:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340569.767182:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340569.767189:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b81ab740/0xa246514327734c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.767200:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ebc00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340569.767204:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b81ab740/0xa246514327734c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.767215:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b81ab740/0xa246514327734c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340569.767229:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340569.767231:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b81ab740/0xa246514327734c0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.767236:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2caaf8f/0xa246514327734d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.767247:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b81ab740/0xa246514327734c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.767265:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.767267:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340569.767268:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340569.767270:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340569.767278:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1780340569.767425:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1780340569.767465:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa246514327734ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.767475:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa246514327734ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.767483:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa246514327734ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.767509:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340569.767564:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.767569:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327734dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.767587:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.767588:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.767592:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327734dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.767599:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327734dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.767606:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327734dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.767612:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327734dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.767633:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780340569.767661:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340569.767668:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa246514327734ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340569.767671:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.767681:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f0f1eb7/0xa246514327734e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.767683:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6cc00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340569.767689:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa246514327734ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.767693:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340569.767710:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa246514327734ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.767721:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa246514327734ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.767728:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa246514327734ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.767742:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340569.767746:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327734dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.767752:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6d000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340569.767756:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327734dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.767803:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327734dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.767815:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327734dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.767832:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327734dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.767851:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340569.767852:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340569.767856:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.768129:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2caaf8f/0xa246514327734d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768142:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2caaf8f/0xa246514327734d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768151:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2caaf8f/0xa246514327734d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768159:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2caaf8f/0xa246514327734d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768172:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.768192:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340569.768330:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.768335:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f0f1eb7/0xa246514327734e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.768346:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f0f1eb7/0xa246514327734e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.768365:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f0f1eb7/0xa246514327734e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.768372:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f0f1eb7/0xa246514327734e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340569.768452:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.768461:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2ae5ba2/0xa246514327734ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768469:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.768470:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.768473:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2ae5ba2/0xa246514327734ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768484:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2ae5ba2/0xa246514327734ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768504:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2ae5ba2/0xa246514327734ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768511:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2ae5ba2/0xa246514327734ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768527:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780340569.768536:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340569.768540:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2caaf8f/0xa246514327734d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768547:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.768551:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2caaf8f/0xa246514327734d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768558:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2caaf8f/0xa246514327734d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768570:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2caaf8f/0xa246514327734d5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768577:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2caaf8f/0xa246514327734d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768596:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.768605:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2ae5ba2/0xa246514327734ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768612:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.768615:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2ae5ba2/0xa246514327734ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768623:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2ae5ba2/0xa246514327734ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768633:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2ae5ba2/0xa246514327734ea lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768640:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2ae5ba2/0xa246514327734ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.768654:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.768655:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.768657:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.769129:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.769135:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaa560a1/0xa246514327734f1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769144:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.769146:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.769149:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa560a1/0xa246514327734f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769170:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaa560a1/0xa246514327734f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769179:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aaa560a1/0xa246514327734f1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769187:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa560a1/0xa246514327734f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769199:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340569.769244:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.769249:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c808233/0xa246514327734f8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769257:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.769258:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.769261:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c808233/0xa246514327734f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.769584:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780340569.769620:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c808233/0xa246514327734f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769630:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c808233/0xa246514327734f8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769637:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c808233/0xa246514327734f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340569.769650:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.769654:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2c67601/0xa246514327734ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769656:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1780340569.769663:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.769664:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.769665:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1780340569.769667:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2c67601/0xa246514327734ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769671:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aaa560a1/0xa246514327734f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.769677:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2c67601/0xa246514327734ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769678:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.769682:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaa560a1/0xa246514327734f1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.769685:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2c67601/0xa246514327734ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769691:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aaa560a1/0xa246514327734f1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.769692:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2c67601/0xa246514327734ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.769706:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1780340569.769753:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.769772:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e370453/0xa24651432773506 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.769781:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.769782:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.769785:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e370453/0xa24651432773506 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769787:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aaa560a1/0xa246514327734f1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.769794:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e370453/0xa24651432773506 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769795:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaa560a1/0xa246514327734f1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.769813:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e370453/0xa24651432773506 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769814:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1780340569.769817:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f0f1eb7/0xa246514327734e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.769829:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e370453/0xa24651432773506 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769833:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6c600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.769836:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f0f1eb7/0xa246514327734e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.769839:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1780340569.769854:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f0f1eb7/0xa246514327734e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769865:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f0f1eb7/0xa246514327734e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769873:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f0f1eb7/0xa246514327734e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769890:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1780340569.769893:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c808233/0xa246514327734f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769900:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eaa00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.769903:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c808233/0xa246514327734f8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769910:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c808233/0xa246514327734f8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769920:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c808233/0xa246514327734f8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769926:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c808233/0xa246514327734f8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769950:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340569.769953:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2c67601/0xa246514327734ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.769960:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6c800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.769962:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2c67601/0xa246514327734ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340569.770025:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.770031:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077977387/0xa2465143277350d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770039:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.770040:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.770043:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077977387/0xa2465143277350d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770051:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077977387/0xa2465143277350d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770065:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077977387/0xa2465143277350d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770072:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077977387/0xa2465143277350d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770082:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1780340569.770134:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.770138:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432773514 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770146:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.770147:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.770150:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432773514 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770158:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432773514 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770165:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432773514 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770172:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432773514 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770179:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1780340569.770220:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.770224:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277351b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770230:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.770231:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.770233:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277351b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770326:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2c67601/0xa246514327734ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770339:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2c67601/0xa246514327734ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770347:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2c67601/0xa246514327734ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770362:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1780340569.770365:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e370453/0xa24651432773506 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770372:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6c000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.770375:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e370453/0xa24651432773506 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770394:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e370453/0xa24651432773506 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770405:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e370453/0xa24651432773506 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770413:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e370453/0xa24651432773506 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770426:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340569.770429:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077977387/0xa2465143277350d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770435:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6c400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.770438:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077977387/0xa2465143277350d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770446:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077977387/0xa2465143277350d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770456:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077977387/0xa2465143277350d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770461:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277351b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770463:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077977387/0xa2465143277350d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770471:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277351b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770479:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277351b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770487:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340569.770487:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.770490:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432773514 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770496:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6ca00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.770499:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432773514 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770506:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432773514 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770516:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432773514 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770523:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432773514 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340569.770524:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.770528:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432773522 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770534:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340569.770536:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.770537:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277351b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770537:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.770540:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432773522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770543:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6c200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.770547:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277351b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770549:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432773522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770564:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277351b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770564:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432773522 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770573:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432773522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770574:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277351b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770581:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.770582:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277351b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770593:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.770596:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432773522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770603:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6de00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.770605:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432773522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770612:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432773522 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340569.770615:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.770619:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432773529 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770622:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432773522 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770627:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.770629:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432773522 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770629:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.770632:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432773529 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770640:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432773529 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770648:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432773529 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.770650:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.770652:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.770655:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340569.770655:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432773529 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770669:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340569.770711:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.770716:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432773530 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770724:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.770726:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.770728:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432773530 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770737:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432773530 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770746:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432773530 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.770753:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432773530 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.771455:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340569.771462:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432773529 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.771472:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6d600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.771476:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432773529 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.771485:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432773529 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.771497:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432773529 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.771504:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432773529 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.771526:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.771530:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432773530 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.771536:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6da00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.771546:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432773530 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.771554:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432773530 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.771563:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432773530 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.771570:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.771571:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.771573:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.771581:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.771644:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.771648:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9db288e/0xa24651432773537 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.771657:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.771658:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.771662:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9db288e/0xa24651432773537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.771671:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9db288e/0xa24651432773537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.771680:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a9db288e/0xa24651432773537 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772340:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a9db288e/0xa24651432773537 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772367:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.772378:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.772382:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a9db288e/0xa24651432773537 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772389:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eac00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.772393:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9db288e/0xa24651432773537 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772402:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a9db288e/0xa24651432773537 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772415:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a9db288e/0xa24651432773537 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772423:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a9db288e/0xa24651432773537 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772442:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.772444:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.772445:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.772502:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.772515:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b3b4fce/0xa2465143277353e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772523:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.772525:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.772528:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b3b4fce/0xa2465143277353e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772537:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b3b4fce/0xa2465143277353e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772546:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b3b4fce/0xa2465143277353e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772553:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b3b4fce/0xa2465143277353e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772564:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.772570:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.772574:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b3b4fce/0xa2465143277353e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772580:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.772584:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b3b4fce/0xa2465143277353e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772591:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b3b4fce/0xa2465143277353e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772610:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b3b4fce/0xa2465143277353e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772618:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b3b4fce/0xa2465143277353e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772630:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.772632:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.772633:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.772665:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.772670:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b0cb94b/0xa24651432773545 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772678:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.772679:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.772682:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007b0cb94b/0xa24651432773545 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.772690:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007b0cb94b/0xa24651432773545 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.773350:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007b0cb94b/0xa24651432773545 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.773363:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007b0cb94b/0xa24651432773545 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.773396:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.773407:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.773411:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007b0cb94b/0xa24651432773545 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.773418:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.773422:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007b0cb94b/0xa24651432773545 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.773430:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007b0cb94b/0xa24651432773545 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.773443:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007b0cb94b/0xa24651432773545 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.773450:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007b0cb94b/0xa24651432773545 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.773469:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.773471:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.773472:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.773527:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.773532:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c6a85c5/0xa2465143277354c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.773541:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.773547:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.773551:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c6a85c5/0xa2465143277354c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.773560:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c6a85c5/0xa2465143277354c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.773568:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c6a85c5/0xa2465143277354c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.773575:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c6a85c5/0xa2465143277354c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.773587:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.773593:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.773596:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c6a85c5/0xa2465143277354c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.774803:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.774809:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c6a85c5/0xa2465143277354c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.774832:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c6a85c5/0xa2465143277354c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.774851:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c6a85c5/0xa2465143277354c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.774870:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c6a85c5/0xa2465143277354c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.774898:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.774900:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.774903:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340569.777694:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1780340569.777717:0:8400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432773530 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340569.777936:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.777954:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa24651432773553 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.777970:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.777972:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.777997:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa24651432773553 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.778013:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa24651432773553 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.778035:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa24651432773553 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.778044:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa24651432773553 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.779888:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340569.780032:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.780041:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa7796b0/0xa2465143277355a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780059:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780062:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780067:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa7796b0/0xa2465143277355a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780083:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa7796b0/0xa2465143277355a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780093:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa7796b0/0xa2465143277355a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780114:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa7796b0/0xa2465143277355a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780127:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1780340569.780168:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.780174:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2d7d37f/0xa24651432773561 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780182:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780183:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780187:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2d7d37f/0xa24651432773561 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780196:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2d7d37f/0xa24651432773561 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780205:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2d7d37f/0xa24651432773561 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780213:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2d7d37f/0xa24651432773561 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780221:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1780340569.780255:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.780260:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa24651432773568 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780278:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780280:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780283:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa24651432773568 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780292:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa24651432773568 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780300:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa24651432773568 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780307:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa24651432773568 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780316:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1780340569.780350:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.780355:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa2465143277356f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780363:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780365:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780368:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa2465143277356f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780376:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa2465143277356f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780395:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa2465143277356f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780403:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa2465143277356f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780412:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1780340569.780446:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.780451:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa24651432773576 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780459:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780461:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780464:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa24651432773576 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780473:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa24651432773576 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780480:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa24651432773576 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780489:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa24651432773576 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780496:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1780340569.780534:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.780539:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa2465143277357d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780547:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780549:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780552:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa2465143277357d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780560:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa2465143277357d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780569:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa2465143277357d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780575:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa2465143277357d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780584:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1780340569.780618:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.780623:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa24651432773584 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780630:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780632:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780634:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa24651432773584 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780643:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa24651432773584 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780658:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa24651432773584 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780665:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa24651432773584 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780674:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1780340569.780714:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.780718:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087efbfc1/0xa2465143277358b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780727:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780728:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780731:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087efbfc1/0xa2465143277358b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780740:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087efbfc1/0xa2465143277358b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780747:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087efbfc1/0xa2465143277358b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780754:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087efbfc1/0xa2465143277358b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780797:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1780340569.780852:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.780858:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa24651432773592 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780866:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780868:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780871:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa24651432773592 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780879:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa24651432773592 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780887:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa24651432773592 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780894:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa24651432773592 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780904:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:0.0:1780340569.780941:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.780946:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9a7ca80/0xa24651432773599 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780953:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780955:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.780957:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9a7ca80/0xa24651432773599 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780965:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9a7ca80/0xa24651432773599 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780979:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b9a7ca80/0xa24651432773599 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780987:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9a7ca80/0xa24651432773599 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.780996:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:0.0:1780340569.781031:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.781036:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327735a0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781042:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.781044:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.781046:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327735a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781054:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327735a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781062:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327735a0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781069:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327735a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781077:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:0.0:1780340569.781117:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.781121:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c9b2bab/0xa246514327735a7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781129:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.781130:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.781133:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c9b2bab/0xa246514327735a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781141:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c9b2bab/0xa246514327735a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781148:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c9b2bab/0xa246514327735a7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781155:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c9b2bab/0xa246514327735a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781165:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:0.0:1780340569.781198:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.781203:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327735ae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781210:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.781211:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.781214:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327735ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781222:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327735ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781236:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327735ae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781244:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327735ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781252:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:0.0:1780340569.781289:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.781294:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327735b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781301:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.781303:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.781306:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327735b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781315:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327735b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781322:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327735b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781328:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327735b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781337:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:0.0:1780340569.781382:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.781387:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327735bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781395:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.781397:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.781399:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327735bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781407:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327735bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781414:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327735bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781422:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327735bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781429:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:0.0:1780340569.781465:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.781469:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d096c3c9/0xa246514327735c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781476:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.781478:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.781480:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d096c3c9/0xa246514327735c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781489:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d096c3c9/0xa246514327735c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781503:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d096c3c9/0xa246514327735c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781510:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d096c3c9/0xa246514327735c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781519:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:0.0:1780340569.781556:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.781560:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033ce026f/0xa246514327735ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781568:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.781569:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.781572:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033ce026f/0xa246514327735ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781580:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033ce026f/0xa246514327735ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781587:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033ce026f/0xa246514327735ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781594:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033ce026f/0xa246514327735ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781602:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:0.0:1780340569.781645:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340569.781651:0:8400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2da3a38/0xa246514327735d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781659:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.781661:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340569.781664:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2da3a38/0xa246514327735d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781672:0:8400:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2da3a38/0xa246514327735d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781679:0:8400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2da3a38/0xa246514327735d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781687:0:8400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2da3a38/0xa246514327735d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340569.781696:0:8400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00080000:0.0:1780340569.782002:0:8400:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:642 00000100:00100000:0.0:1780340569.782132:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:81825:x1866818961021056:12345-0@lo:5:osp-pre-0-0.0 Request processed in 59963us (60241us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340569.782143:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5861 00000100:00100000:0.0:1780340569.782230:0:81825:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445594000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:81825:1866818961021056:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1780340569.782249:0:81825:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x2c1:0x0] from OST, last_created [0x280000401:0x2c1:0x0]last_used is [0x280000401:0x282:0x0] 00000100:00100000:0.0:1780340569.782337:0:81825:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:81825:1866818961021312:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1780340569.782386:0:81825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340569.782415:0:81825:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443caf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340569.782436:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961021184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340569.782461:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340569.782503:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961021184 00000100:00100000:0.0:1780340569.782510:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961021184 00000100:00100000:0.0:1780340569.782559:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900 00000100:00100000:0.0:1780340569.782569:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961021184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340569.782601:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340569.782638:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961021184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340569.782644:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900 00000100:00100000:0.0:1780340569.782679:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961021184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340569.782696:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961021312 00000100:00100000:0.0:1780340569.782700:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961021312 00000100:00100000:0.0:1780340569.782729:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5862 00000100:00100000:0.0:1780340569.782735:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:81825:x1866818961021312:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1780340569.782795:0:25493:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 706 00010000:00010000:3.0:1780340569.786898:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:3.0:1780340569.786916:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa24651432773553 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.786933:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6dc00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340569.786939:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa24651432773553 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.786951:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa24651432773553 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.786979:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa24651432773553 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787003:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa24651432773553 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787031:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:2.0:1780340569.787035:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:3.0:1780340569.787037:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa7796b0/0xa2465143277355a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787045:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2d7d37f/0xa24651432773561 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787046:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340569.787051:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa7796b0/0xa2465143277355a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787064:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa7796b0/0xa2465143277355a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787074:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340569.787079:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa7796b0/0xa2465143277355a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787080:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2d7d37f/0xa24651432773561 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787102:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa7796b0/0xa2465143277355a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787114:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:3.0:1780340569.787118:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa24651432773568 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787125:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340569.787135:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa24651432773568 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787143:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa24651432773568 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787152:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa24651432773568 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787159:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa24651432773568 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787172:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:3.0:1780340569.787176:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa2465143277356f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787182:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340569.787184:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa2465143277356f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787191:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa2465143277356f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787199:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa2465143277356f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787205:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa2465143277356f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787223:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:3.0:1780340569.787226:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa24651432773576 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787234:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722afa00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340569.787238:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa24651432773576 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787246:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa24651432773576 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787257:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa24651432773576 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787264:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa24651432773576 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787278:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:3.0:1780340569.787281:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa2465143277357d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787288:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722afc00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340569.787291:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa2465143277357d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787313:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa2465143277357d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787323:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa2465143277357d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787330:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa2465143277357d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787344:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1780340569.787348:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa24651432773584 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787355:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722aea00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340569.787358:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa24651432773584 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787365:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa24651432773584 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787375:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa24651432773584 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787381:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa24651432773584 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787407:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1780340569.787411:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087efbfc1/0xa2465143277358b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787418:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340569.787421:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087efbfc1/0xa2465143277358b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787428:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087efbfc1/0xa2465143277358b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787439:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087efbfc1/0xa2465143277358b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787445:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087efbfc1/0xa2465143277358b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787458:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1780340569.787462:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa24651432773592 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787468:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340569.787470:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa24651432773592 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787487:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa24651432773592 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787495:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa24651432773592 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787502:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa24651432773592 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787515:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1780340569.787515:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2d7d37f/0xa24651432773561 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787521:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9a7ca80/0xa24651432773599 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787535:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340569.787538:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9a7ca80/0xa24651432773599 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787538:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2d7d37f/0xa24651432773561 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787559:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9a7ca80/0xa24651432773599 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787559:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2d7d37f/0xa24651432773561 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787584:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9a7ca80/0xa24651432773599 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787588:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1780340569.787595:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9a7ca80/0xa24651432773599 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787595:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327735a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787624:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722afe00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.787627:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327735a0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787632:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1780340569.787635:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327735a0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787637:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c9b2bab/0xa246514327735a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787654:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722aec00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.787657:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327735a0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787658:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c9b2bab/0xa246514327735a7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787677:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327735a0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.787678:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c9b2bab/0xa246514327735a7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787710:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1780340569.787715:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327735ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787721:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.787725:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327735ae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787731:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327735ae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787742:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327735ae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787754:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327735ae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787788:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1780340569.787793:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327735b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787799:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.787802:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327735b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787810:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327735b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787828:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327735b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787836:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327735b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.787851:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1780340569.787855:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327735bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789207:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.789223:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327735bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789237:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327735bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789266:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327735bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789280:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327735bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789304:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1780340569.789309:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d096c3c9/0xa246514327735c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789315:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722aee00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.789318:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d096c3c9/0xa246514327735c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789325:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d096c3c9/0xa246514327735c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789335:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d096c3c9/0xa246514327735c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789342:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d096c3c9/0xa246514327735c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789364:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340569.789368:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033ce026f/0xa246514327735ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789375:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c4600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.789378:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033ce026f/0xa246514327735ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789385:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033ce026f/0xa246514327735ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789395:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033ce026f/0xa246514327735ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789402:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033ce026f/0xa246514327735ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789415:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.789419:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2da3a38/0xa246514327735d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789425:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c5c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.789429:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2da3a38/0xa246514327735d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789448:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2da3a38/0xa246514327735d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789458:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2da3a38/0xa246514327735d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789464:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2da3a38/0xa246514327735d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789478:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.789480:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.789482:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.789496:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.789512:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.789518:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.789594:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.789602:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e0b8c4/0xa246514327735d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789615:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.789618:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.789624:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009e0b8c4/0xa246514327735d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789637:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009e0b8c4/0xa246514327735d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789659:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009e0b8c4/0xa246514327735d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789667:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009e0b8c4/0xa246514327735d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789687:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.789699:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.789703:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009e0b8c4/0xa246514327735d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789710:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eae00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.789713:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e0b8c4/0xa246514327735d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789720:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009e0b8c4/0xa246514327735d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789730:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009e0b8c4/0xa246514327735d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789737:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009e0b8c4/0xa246514327735d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789757:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.789788:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.789790:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.789891:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.789897:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008739ed8/0xa246514327735df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789905:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.789907:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.789910:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008739ed8/0xa246514327735df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789919:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008739ed8/0xa246514327735df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789926:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008739ed8/0xa246514327735df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789933:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008739ed8/0xa246514327735df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789947:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.789955:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.789959:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008739ed8/0xa246514327735df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789967:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ebe00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.789970:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008739ed8/0xa246514327735df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.789990:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008739ed8/0xa246514327735df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790002:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008739ed8/0xa246514327735df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790010:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008739ed8/0xa246514327735df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790026:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.790028:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.790030:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.790083:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.790089:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ca73517/0xa246514327735e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790097:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.790111:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.790115:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ca73517/0xa246514327735e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790126:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ca73517/0xa246514327735e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790135:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ca73517/0xa246514327735e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790157:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ca73517/0xa246514327735e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790173:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.790182:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.790186:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ca73517/0xa246514327735e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790194:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.790198:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ca73517/0xa246514327735e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790206:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ca73517/0xa246514327735e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790220:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ca73517/0xa246514327735e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790227:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ca73517/0xa246514327735e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790242:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.790244:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.790246:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.790300:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.790314:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4e90bc2/0xa246514327735ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790322:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.790323:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.790326:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4e90bc2/0xa246514327735ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790335:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4e90bc2/0xa246514327735ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790344:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4e90bc2/0xa246514327735ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790350:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4e90bc2/0xa246514327735ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790365:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.790373:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.790378:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4e90bc2/0xa246514327735ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790385:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.790388:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4e90bc2/0xa246514327735ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790396:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4e90bc2/0xa246514327735ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790419:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4e90bc2/0xa246514327735ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790427:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4e90bc2/0xa246514327735ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790442:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.790444:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.790447:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.790495:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.790501:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009750d1e5/0xa246514327735f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790510:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.790512:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.790515:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009750d1e5/0xa246514327735f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790523:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009750d1e5/0xa246514327735f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790531:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009750d1e5/0xa246514327735f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790538:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009750d1e5/0xa246514327735f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790563:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.790570:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.790574:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009750d1e5/0xa246514327735f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790581:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.790584:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009750d1e5/0xa246514327735f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790592:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009750d1e5/0xa246514327735f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790602:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009750d1e5/0xa246514327735f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790609:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009750d1e5/0xa246514327735f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790621:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.790623:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.790625:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.790671:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.790677:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa246514327735fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790684:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.790691:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.790695:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa246514327735fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790704:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa246514327735fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790711:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa246514327735fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790718:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa246514327735fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790730:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.790737:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.790740:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa246514327735fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790747:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.790750:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa246514327735fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790756:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa246514327735fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790790:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa246514327735fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790809:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6a39078/0xa246514327735fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790833:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.790834:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.790837:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.790880:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.790884:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773602 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790891:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.790893:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.790895:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773602 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790904:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773602 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790912:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773602 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790919:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773602 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790931:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.790937:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.790946:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773602 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790953:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.790956:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773602 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790963:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773602 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790974:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773602 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790981:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005eba0e7a/0xa24651432773602 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.790993:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.790994:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.790996:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.791036:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.791042:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432773609 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791049:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.791051:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.791054:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432773609 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791075:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432773609 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791084:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432773609 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.791085:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c9b2bab/0xa246514327735a7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791101:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432773609 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.791108:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c9b2bab/0xa246514327735a7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791115:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.791123:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.791127:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432773609 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.791133:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.791134:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340569.791135:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340569.791138:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.791139:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432773609 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791149:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432773609 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791159:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432773609 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791166:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432773609 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791191:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.791193:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.791195:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.791237:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.791242:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432773610 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791249:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.791251:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.791254:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432773610 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791263:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432773610 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791272:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432773610 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791279:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432773610 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791306:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340569.791345:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.791350:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432773617 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791370:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.791372:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.791375:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432773617 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791384:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432773617 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791393:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432773617 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791401:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432773617 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791415:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780340569.791422:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340569.791426:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432773610 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791434:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32ba00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.791437:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432773610 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791445:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432773610 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791466:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432773610 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791474:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432773610 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791487:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.791490:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432773617 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791496:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.791499:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432773617 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791507:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432773617 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791515:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432773617 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791521:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432773617 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791531:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.791532:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.791539:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.791580:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.791584:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa2465143277361e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791592:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.791593:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.791596:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa2465143277361e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791604:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa2465143277361e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791612:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa2465143277361e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791619:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa2465143277361e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791631:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.791637:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.791640:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa2465143277361e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791646:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.791649:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa2465143277361e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791667:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa2465143277361e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791677:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa2465143277361e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791684:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa2465143277361e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791698:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.791699:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.791701:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.791741:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.791746:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773625 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791754:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.791755:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.791776:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791786:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791794:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773625 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.791812:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773625 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.792965:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340569.797262:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:81825:x1866818961021312:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14520us (14870us total) trans 4294969449 rc 0/0 00000100:00100000:0.0:1780340569.797274:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5862 00010000:00010000:2.0:1780340569.802486:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340569.802680:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.802691:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa2465143277362c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.802714:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.802716:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.802722:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa2465143277362c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.802739:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa2465143277362c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.802751:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa2465143277362c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.802775:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa2465143277362c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.802794:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.802804:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.802811:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa2465143277362c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.802851:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.802856:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa2465143277362c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.802867:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa2465143277362c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.802887:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa2465143277362c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.802894:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa2465143277362c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.802918:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.802920:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.802922:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340569.803110:0:81825:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:81825:1866818961021312:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1780340569.803129:0:81825:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2c1:0x0]-[0x280000401:0x2e1:0x0] 00010000:00010000:3.0:1780340569.803138:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340569.803148:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773625 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.803158:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340569.803171:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773625 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.803180:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773625 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.803193:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773625 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.803200:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773625 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340569.803218:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340569.803220:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340569.803222:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.804517:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.804528:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432773633 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804543:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.804546:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.804550:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432773633 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804564:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432773633 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804582:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432773633 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804590:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432773633 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804610:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.804626:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.804632:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432773633 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804639:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32ae00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.804643:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432773633 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804652:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432773633 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804666:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432773633 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804673:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432773633 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804692:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.804701:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.804702:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.804805:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.804810:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa2465143277363a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804829:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.804831:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.804834:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa2465143277363a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804843:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa2465143277363a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804850:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa2465143277363a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804856:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa2465143277363a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804871:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.804878:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.804882:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa2465143277363a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804888:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.804891:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa2465143277363a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804909:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa2465143277363a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804918:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa2465143277363a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804925:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa2465143277363a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.804938:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.804939:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.804941:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340569.804995:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340569.804999:0:8401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432773641 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.805006:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.805008:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340569.805011:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432773641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.805020:0:8401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432773641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.805027:0:8401:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432773641 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.805045:0:8401:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432773641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.805074:0:8401:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340569.805084:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340569.805088:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432773641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.805096:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32be00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340569.805109:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432773641 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.805117:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432773641 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.805130:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432773641 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.805136:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432773641 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340569.805153:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.805155:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340569.805158:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1780340569.825585:0:8401:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:144 00000100:00100000:3.0:1780340569.825730:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:81827:x1866818961020928:12345-0@lo:5:osp-pre-1-0.0 Request processed in 104673us (105145us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340569.825745:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5860 00000100:00100000:2.0:1780340569.825798:0:81827:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:81827:1866818961020928:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1780340569.825863:0:81827:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2c1:0x0] from OST, last_created [0x2c0000401:0x2c1:0x0]last_used is [0x2c0000401:0x90:0x0] 00000100:00100000:0.0:1780340569.826238:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961021440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340569.826285:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340569.826376:0:81827:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:81827:1866818961021568:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1780340569.826407:0:81827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340569.826423:0:81827:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034839bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340569.826445:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961021568 00000100:00100000:2.0:1780340569.826451:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961021568 00000100:00100000:2.0:1780340569.826497:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5863 00000100:00100000:2.0:1780340569.826506:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:81827:x1866818961021568:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1780340569.826556:0:25490:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 706 00000100:00100000:3.0:1780340569.827618:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961021440 00000100:00100000:3.0:1780340569.827630:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961021440 00000100:00100000:3.0:1780340569.827791:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1901 00000100:00100000:3.0:1780340569.827803:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961021440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340569.827838:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 896 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340569.827930:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961021440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340569.827938:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1901 00000100:00100000:0.0:1780340569.829277:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961021440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340569.829746:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:81827:x1866818961021568:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3239us (3335us total) trans 4294969449 rc 0/0 00000100:00100000:2.0:1780340569.829780:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5863 00000100:00100000:3.0:1780340569.829871:0:81827:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:81827:1866818961021568:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1780340569.829893:0:81827:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2c1:0x0]-[0x2c0000401:0x2e1:0x0] 00000001:02000400:0.0:1780340569.852418:0:82075:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1780340569.995550:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1780340569.998473:0:72681:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1780340571.018876:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1780340571.283707:0:82128:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1780340571.283999:0:82128:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1780340571.533227:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961021696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340571.533332:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340571.533407:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961021696 00000100:00100000:0.0:1780340571.533416:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961021696 00000100:00100000:0.0:1780340571.533493:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1902 00000100:00100000:0.0:1780340571.533505:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961021696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340571.533545:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340571.533596:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961021696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340571.533604:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1902 00000100:00100000:0.0:1780340571.533659:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961021696:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1780340571.534792:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340571.537056:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961021824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340571.537141:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340571.537254:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961021824 00000100:00100000:1.0:1780340571.537265:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961021824 00000100:00100000:1.0:1780340571.537342:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1903 00000100:00100000:1.0:1780340571.537355:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961021824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340571.537406:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340571.542966:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961021824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5600us (5810us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340571.542982:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1903 00000100:00080000:1.0:1780340571.543579:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340571.546123:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961021824:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1780340572.045373:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1780340572.352210:0:82178:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1780340572.352482:0:82178:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1780340573.065983:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340574.092806:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340574.256161:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340574.256216:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340574.256255:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340574.256422:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940382080 00000100:00100000:3.0:1780340574.256435:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940382080 00000100:00100000:3.0:1780340574.256499:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 75 00000100:00100000:3.0:1780340574.256511:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2410:x1866818940382080:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340574.256597:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2410:x1866818940382080:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 89us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340574.256605:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 75 00000100:00100000:1.0:1780340574.258179:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940382336 00000100:00100000:1.0:1780340574.258195:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940382336 00000100:00100000:1.0:1780340574.258586:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940382208 00000100:00100000:1.0:1780340574.258592:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940382208 00000100:00100000:3.0:1780340574.258659:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1063 00000100:00100000:3.0:1780340574.258683:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940382336:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340574.258805:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940382336:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 135us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340574.258813:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1063 00000100:00080000:0.0:1780340574.263497:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780340574.263511:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340574.266464:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1064 00000100:00100000:1.0:1780340574.266509:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940382208:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340574.266636:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940382208:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 151us (10379us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340574.266644:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1064 00000100:00100000:0.0:1780340574.385260:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340574.386112:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940382464 00000100:00100000:1.0:1780340574.386128:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940382464 00000100:00100000:1.0:1780340574.386210:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1072 00000100:00100000:1.0:1780340574.386225:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64638:x1866818940382464:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1780340574.386252:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340574.386293:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa24651432773648 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2241 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340574.386381:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa2465143277364f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340574.386398:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa2465143277364f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340574.386413:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa2465143277364f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340574.386477:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1780340574.386482:0:63712:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780340574.386512:0:63712:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa2465143277364f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340574.386541:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa24651432773648 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2241 expref: 8 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340574.386562:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa2465143277364f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2241 expref: 7 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340574.386572:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8500) 00010000:00010000:1.0:1780340574.386576:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1780340574.386580:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0476763c00, rc 0) 00000100:00100000:1.0:1780340574.387412:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:64638:x1866818940382464:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1186us (2158us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340574.387422:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1072 00000100:00100000:3.0:1780340574.406091:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340574.411243:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940382592 00000100:00100000:2.0:1780340574.411265:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940382592 00000100:00100000:2.0:1780340574.411370:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1073 00000100:00100000:2.0:1780340574.411383:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:64638:x1866818940382592:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:2.0:1780340574.411446:0:63711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:2.0:1780340574.412309:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:64638:x1866818940382592:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 923us (6228us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340574.412320:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1073 00000100:00100000:2.0:1780340574.421283:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340574.424314:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940382720 00000100:00100000:1.0:1780340574.424353:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940382720 00000100:00100000:1.0:1780340574.424521:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1074 00000100:00100000:1.0:1780340574.424535:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64638:x1866818940382720:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:1.0:1780340574.424587:0:70100:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:1.0:1780340574.424708:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64638:x1866818940382720:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 175us (3436us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340574.424717:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1074 00000100:00100000:0.0:1780340574.437946:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340574.438332:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940382848 00000100:00100000:3.0:1780340574.438347:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940382848 00000100:00100000:3.0:1780340574.438412:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5864 00000100:00100000:3.0:1780340574.438422:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2406:x1866818940382848:12345-192.168.203.16@tcp:8:lfs.0 00010000:00080000:3.0:1780340574.438464:0:8399:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0000: connection from e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp t0 exp 0000000000000000 cur 3354 last 0 00000020:00000080:3.0:1780340574.438501:0:8399:0:(genops.c:1406:class_connect()) connect: client e06e5cf1-1986-4ba7-9630-fad7efb74eca, cookie 0xa24651432773656 00002000:00100000:3.0:1780340574.438516:0:8399:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e06e5cf1-1986-4ba7-9630-fad7efb74eca/ffff8c0475708000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211351c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1780340574.438540:0:8399:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1780340574.438650:0:8399:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1780340574.438691:0:8399:0:(import.c:65:import_set_state_nolock()) ffff8c0475708800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340574.438839:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940382848:12345-192.168.203.16@tcp:8:lfs.0 Request processed in 417us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340574.438846:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5864 00000100:00100000:3.0:1780340574.448517:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340574.449455:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940382976 00000100:00100000:0.0:1780340574.449471:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940382976 00000100:00100000:0.0:1780340574.450945:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1904 00000100:00100000:0.0:1780340574.450975:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64638:x1866818940382976:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:0.0:1780340574.451013:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340574.451301:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64638:x1866818940382976:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 331us (2784us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340574.451312:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1904 00000100:00080000:1.0:1780340574.451707:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340574.455652:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340574.456246:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940383104 00000100:00100000:1.0:1780340574.456262:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940383104 00000100:00100000:1.0:1780340574.456487:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5865 00000100:00100000:1.0:1780340574.456498:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2406:x1866818940383104:12345-192.168.203.16@tcp:8:lfs.0 00010000:00080000:1.0:1780340574.456551:0:25494:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0001: connection from e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp t0 exp 0000000000000000 cur 3354 last 0 00000020:00000080:1.0:1780340574.456607:0:25494:0:(genops.c:1406:class_connect()) connect: client e06e5cf1-1986-4ba7-9630-fad7efb74eca, cookie 0xa2465143277365d 00002000:00100000:1.0:1780340574.456623:0:25494:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e06e5cf1-1986-4ba7-9630-fad7efb74eca/ffff8c046b9af800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211351c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1780340574.456645:0:25494:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1780340574.456748:0:25494:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1780340574.457653:0:25494:0:(import.c:65:import_set_state_nolock()) ffff8c046b9a8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780340574.457964:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940383104:12345-192.168.203.16@tcp:8:lfs.0 Request processed in 1463us (2323us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340574.457976:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5865 00000100:00100000:3.0:1780340574.463236:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340574.463421:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940383232 00000100:00100000:1.0:1780340574.463434:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940383232 00000100:00100000:1.0:1780340574.463564:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1905 00000100:00100000:1.0:1780340574.463577:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64638:x1866818940383232:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:1.0:1780340574.463608:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340574.463709:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:64638:x1866818940383232:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 136us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340574.463717:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1905 00000100:00080000:0.0:1780340574.464433:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340574.602501:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961021952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340574.602620:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340574.603001:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961022336:0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.603039:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340574.603068:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961022848:0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.603097:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340574.603119:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961023360:0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.603142:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340574.603161:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1780340574.603167:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961022208:0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.603191:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340574.603205:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961022720:0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.603227:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340574.603245:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961023232:0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.603266:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340574.603329:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961022848 00000100:00100000:0.0:1780340574.603339:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961022848 00000100:00100000:0.0:1780340574.603403:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961023360 00000100:00100000:0.0:1780340574.603406:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961023360 00000100:00100000:0.0:1780340574.603425:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961023232 00000100:00100000:0.0:1780340574.603428:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961023232 00000100:00100000:0.0:1780340574.603452:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2344 00000100:00100000:0.0:1780340574.603461:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961022848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.603523:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961022848:12345-0@lo:400:kworker.0 Request processed in 63us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340574.603532:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2344 00000100:00100000:0.0:1780340574.603551:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2345 00000100:00100000:0.0:1780340574.603557:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961023360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.603585:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961023360:12345-0@lo:400:kworker.0 Request processed in 29us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340574.603591:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2345 00000100:00100000:0.0:1780340574.603601:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2346 00000100:00100000:0.0:1780340574.603607:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961023232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.603629:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961023232:12345-0@lo:400:kworker.0 Request processed in 23us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340574.603635:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2346 00000100:00100000:0.0:1780340574.603659:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961021952 00000100:00100000:0.0:1780340574.603662:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961021952 00000100:00100000:0.0:1780340574.603684:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961022720 00000100:00100000:0.0:1780340574.603687:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961022720 00000100:00100000:0.0:1780340574.603701:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3716 00000100:00100000:0.0:1780340574.603707:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047758b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961021952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780340574.603731:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:0.0:1780340574.603818:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047758b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961021952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340574.603825:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3716 00000100:00100000:0.0:1780340574.604183:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3717 00000100:00100000:0.0:1780340574.604193:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818961022720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.604232:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818961022720:12345-0@lo:400:kworker.0 Request processed in 41us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340574.604238:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3717 00000100:00080000:0.0:1780340574.604266:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340574.604271:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340574.604288:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961022464:0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.604316:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340574.604338:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961022976:0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.604362:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340574.604381:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961023488:0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.604399:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340574.604438:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961021952:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340574.604460:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1780340574.604466:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961022080:0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.604496:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340574.604524:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961022592:0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.604547:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340574.604561:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961023104:0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.604584:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340574.604607:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961022976 00000100:00100000:0.0:1780340574.604619:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961022976 00000100:00100000:0.0:1780340574.604662:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2347 00000100:00100000:0.0:1780340574.604669:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961022976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.604703:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961022976:12345-0@lo:400:kworker.0 Request processed in 36us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340574.604709:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2347 00000100:00080000:0.0:1780340574.604727:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340574.604748:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961022720:0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.604806:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961023232:0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.604819:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961022848:0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.604830:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961023360:0@lo:400:kworker.0 00000100:00100000:0.0:1780340574.604862:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961022976:0@lo:400:kworker.0 00000100:00100000:2.0:1780340574.605342:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961022336 00000100:00100000:2.0:1780340574.605349:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961022336 00000100:00100000:2.0:1780340574.605395:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961022208 00000100:00100000:2.0:1780340574.605398:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961022208 00000100:00100000:2.0:1780340574.605413:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1780340574.605419:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961022336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340574.605487:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961022336:12345-0@lo:400:kworker.0 Request processed in 68us (2447us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340574.605493:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1780340574.605505:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961022464 00000100:00100000:2.0:1780340574.605509:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961022464 00000100:00100000:2.0:1780340574.605523:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961023488 00000100:00100000:2.0:1780340574.605526:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961023488 00000100:00100000:2.0:1780340574.605536:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961022592 00000100:00100000:2.0:1780340574.605538:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961022592 00000100:00100000:2.0:1780340574.605550:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961023104 00000100:00100000:2.0:1780340574.605552:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961023104 00000100:00100000:2.0:1780340574.605564:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:2.0:1780340574.605570:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818961022208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340574.605599:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818961022208:12345-0@lo:400:kworker.0 Request processed in 30us (2407us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340574.605606:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:2.0:1780340574.605617:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:2.0:1780340574.605622:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961022464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340574.605655:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961022464:12345-0@lo:400:kworker.0 Request processed in 33us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340574.605661:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:2.0:1780340574.605685:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:2.0:1780340574.605691:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961023488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340574.605719:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961023488:12345-0@lo:400:kworker.0 Request processed in 29us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340574.605724:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:2.0:1780340574.605733:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:2.0:1780340574.605738:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961022592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340574.605804:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961022592:12345-0@lo:400:kworker.0 Request processed in 65us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340574.605809:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:2.0:1780340574.605820:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1780340574.605825:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961023104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340574.605851:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961023104:12345-0@lo:400:kworker.0 Request processed in 27us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340574.605858:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1780340574.605893:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961022592:0@lo:400:kworker.0 00000100:00100000:2.0:1780340574.605903:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961023104:0@lo:400:kworker.0 00000100:00100000:2.0:1780340574.605914:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961022464:0@lo:400:kworker.0 00000100:00100000:2.0:1780340574.605937:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961023488:0@lo:400:kworker.0 00000100:00100000:3.0:1780340574.606103:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961022208:0@lo:400:kworker.0 00000100:00100000:3.0:1780340574.606117:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961022336:0@lo:400:kworker.0 00000100:00100000:1.0:1780340574.606599:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961022080 00000100:00100000:1.0:1780340574.606606:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961022080 00000100:00100000:1.0:1780340574.606664:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1780340574.606673:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961022080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340574.606745:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961022080:12345-0@lo:400:kworker.0 Request processed in 73us (2247us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340574.606753:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1780340574.606906:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961022080:0@lo:400:kworker.0 00000100:00080000:0.0:1780340574.607262:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780340574.607270:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340575.115491:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961023616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340575.115587:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340575.116080:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961023872:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340575.116145:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340575.116170:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340575.116176:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961023744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340575.116196:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340575.116225:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961023872 00000100:00100000:3.0:1780340575.116234:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961023872 00000100:00100000:3.0:1780340575.116278:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961023744 00000100:00100000:3.0:1780340575.116280:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961023744 00000100:00100000:3.0:1780340575.116301:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1906 00000100:00100000:3.0:1780340575.116310:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961023872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340575.116338:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340575.116383:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961023872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340575.116408:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1906 00000100:00100000:3.0:1780340575.116425:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1907 00000100:00100000:3.0:1780340575.116431:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961023744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780340575.116441:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340575.116463:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961023744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340575.116469:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1907 00000100:00100000:3.0:1780340575.116511:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961023744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340575.116522:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961023872:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1780340575.116892:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340575.116921:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961023616 00000100:00100000:1.0:1780340575.116926:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961023616 00000100:00100000:1.0:1780340575.116970:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3718 00000100:00100000:1.0:1780340575.116978:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818961023616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780340575.117009:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:1.0:1780340575.117062:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818961023616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340575.117069:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3718 00000100:00100000:0.0:1780340575.117375:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961023616:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1780340576.142552:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1780340576.152221:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000001:00080000:0.0:1780340576.152254:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969449 is committed 00000001:00100000:1.0:1780340576.160041:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000001:00080000:1.0:1780340576.160065:0:9462:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969449 is committed 00000100:00100000:0.0:1780340576.654243:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340576.654280:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961024000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340576.654411:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340576.654538:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961024000 00000100:00100000:3.0:1780340576.654552:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961024000 00000100:00100000:3.0:1780340576.654659:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1908 00000100:00100000:3.0:1780340576.654674:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961024000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340576.654727:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340576.654838:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961024000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 168us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340576.654847:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1908 00000100:00080000:0.0:1780340576.654923:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340576.654973:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446f21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961024000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340576.655159:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961024128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340576.655222:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340576.655321:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961024128 00000100:00100000:1.0:1780340576.655328:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961024128 00000100:00100000:1.0:1780340576.655398:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909 00000100:00100000:1.0:1780340576.655411:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961024128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340576.655441:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340576.655490:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961024128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340576.655506:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909 00000100:00080000:0.0:1780340576.655572:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340576.655604:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961024128:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1780340577.162858:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340578.194355:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1780340578.661081:0:82275:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:2.0:1780340579.209993:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340579.370441:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340579.370490:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340579.370534:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340579.370572:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340579.370595:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340579.370683:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940383744 00000100:00100000:0.0:1780340579.370693:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940383744 00000100:00100000:0.0:1780340579.370745:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940383872 00000100:00100000:0.0:1780340579.370748:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940383872 00000100:00100000:0.0:1780340579.370813:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2348 00000100:00100000:0.0:1780340579.370823:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2410:x1866818940383744:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340579.370900:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2410:x1866818940383744:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 80us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340579.370907:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2348 00000100:00100000:0.0:1780340579.370926:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2349 00000100:00100000:0.0:1780340579.370934:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2410:x1866818940383872:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340579.370957:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2410:x1866818940383872:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340579.370962:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2349 00000100:00100000:2.0:1780340579.371149:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940383488 00000100:00100000:2.0:1780340579.371154:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940383488 00000100:00100000:2.0:1780340579.371208:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940383616 00000100:00100000:2.0:1780340579.371212:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940383616 00000100:00100000:2.0:1780340579.371236:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1071 00000100:00100000:2.0:1780340579.371243:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2410:x1866818940383488:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340579.371273:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2410:x1866818940383488:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 32us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340579.371279:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1071 00000100:00100000:2.0:1780340579.371290:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1072 00000100:00100000:2.0:1780340579.371296:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940383616:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340579.371318:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940383616:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340579.371324:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1072 00000100:00100000:1.0:1780340579.371511:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940383360 00000100:00100000:1.0:1780340579.371516:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940383360 00000100:00100000:1.0:1780340579.371555:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:1.0:1780340579.371570:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2410:x1866818940383360:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340579.371599:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2410:x1866818940383360:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 38us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340579.371605:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00080000:3.0:1780340579.372028:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780340579.372040:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780340579.372044:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340579.372046:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340579.722469:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961024512:0@lo:400:kworker.0 00000100:00100000:0.0:1780340579.722535:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340579.722605:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961024640:0@lo:400:kworker.0 00000100:00100000:0.0:1780340579.722645:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340579.722686:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961024512 00000100:00100000:0.0:1780340579.722694:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961024512 00000100:00100000:0.0:1780340579.722744:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961024640 00000100:00100000:0.0:1780340579.722755:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961024640 00000100:00100000:0.0:1780340579.722985:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1780340579.722996:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961024512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340579.723064:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961024512:12345-0@lo:400:kworker.0 Request processed in 71us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340579.723072:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1780340579.723089:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1780340579.723096:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961024640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340579.723128:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961024640:12345-0@lo:400:kworker.0 Request processed in 34us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340579.723134:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1780340579.723174:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961024640:0@lo:400:kworker.0 00000100:00100000:0.0:1780340579.723203:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961024512:0@lo:400:kworker.0 00000100:00100000:0.0:1780340579.723247:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961025024:0@lo:400:kworker.0 00000100:00100000:0.0:1780340579.723273:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340579.723305:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961025024 00000100:00100000:0.0:1780340579.723309:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961025024 00000100:00100000:0.0:1780340579.723338:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2350 00000100:00100000:0.0:1780340579.723345:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961025024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340579.723379:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961025024:12345-0@lo:400:kworker.0 Request processed in 35us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340579.723384:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2350 00000100:00100000:0.0:1780340579.723407:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961025024:0@lo:400:kworker.0 00000100:00100000:0.0:1780340579.723435:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961025152:0@lo:400:kworker.0 00000100:00100000:0.0:1780340579.723456:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340579.723515:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961025536:0@lo:400:kworker.0 00000100:00100000:0.0:1780340579.723536:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340579.723576:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961025664:0@lo:400:kworker.0 00000100:00100000:0.0:1780340579.723598:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340579.723851:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961024256:0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.723885:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340579.723920:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961024768:0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.723944:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340579.723958:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961025280:0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.723975:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340579.723990:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961025792:0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.724008:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340579.724040:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1780340579.724047:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961024384:0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.724066:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340579.724082:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961024896:0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.724116:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340579.724131:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961025408:0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.724149:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340579.724174:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961025152 00000100:00100000:2.0:1780340579.724179:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961025152 00000100:00100000:2.0:1780340579.724208:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961025536 00000100:00100000:2.0:1780340579.724211:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961025536 00000100:00100000:2.0:1780340579.724231:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961025664 00000100:00100000:2.0:1780340579.724234:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961025664 00000100:00100000:2.0:1780340579.724254:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2351 00000100:00100000:2.0:1780340579.724260:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03474c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961025152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.724301:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03474c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961025152:12345-0@lo:400:kworker.0 Request processed in 41us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340579.724307:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2351 00000100:00100000:2.0:1780340579.724320:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2352 00000100:00100000:2.0:1780340579.724326:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961025536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.724358:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961025536:12345-0@lo:400:kworker.0 Request processed in 32us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340579.724364:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2352 00000100:00100000:2.0:1780340579.724375:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2353 00000100:00100000:2.0:1780340579.724381:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961025664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.724405:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961025664:12345-0@lo:400:kworker.0 Request processed in 25us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340579.724410:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2353 00000100:00100000:2.0:1780340579.724438:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961024768 00000100:00100000:2.0:1780340579.724441:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961024768 00000100:00100000:2.0:1780340579.724460:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961025280 00000100:00100000:2.0:1780340579.724468:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961025280 00000100:00100000:2.0:1780340579.724483:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961025792 00000100:00100000:2.0:1780340579.724486:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961025792 00000100:00100000:2.0:1780340579.724494:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961024384 00000100:00100000:2.0:1780340579.724496:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961024384 00000100:00100000:2.0:1780340579.724507:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:2.0:1780340579.724512:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961024768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.724547:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961024768:12345-0@lo:400:kworker.0 Request processed in 35us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340579.724553:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:2.0:1780340579.724564:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1780340579.724569:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961025280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.724592:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961025280:12345-0@lo:400:kworker.0 Request processed in 24us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340579.724596:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1780340579.724606:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:2.0:1780340579.724611:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961025792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.724647:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961025792:12345-0@lo:400:kworker.0 Request processed in 36us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340579.724653:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:2.0:1780340579.724663:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1780340579.724669:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961024384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.724695:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961024384:12345-0@lo:400:kworker.0 Request processed in 26us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340579.724700:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1780340579.724730:0:3660:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 2 00000100:00100000:2.0:1780340579.724744:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961025664:0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.724801:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961025152:0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.724835:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961024384:0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.724845:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961024768:0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.724854:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961025280:0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.724862:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961025792:0@lo:400:kworker.0 00000100:00100000:2.0:1780340579.724887:0:3659:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 2 00000100:00100000:2.0:1780340579.724897:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961025536:0@lo:400:kworker.0 00000100:00100000:0.0:1780340579.728394:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961024256 00000100:00100000:0.0:1780340579.728408:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961024256 00000100:00100000:0.0:1780340579.728481:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1780340579.728491:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961024256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340579.728588:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961024256:12345-0@lo:400:kworker.0 Request processed in 99us (4701us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340579.728595:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1780340579.729082:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961024896 00000100:00100000:1.0:1780340579.729086:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961024896 00000100:00100000:1.0:1780340579.729120:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961025408 00000100:00100000:1.0:1780340579.729123:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961025408 00000100:00100000:1.0:1780340579.729140:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3719 00000100:00100000:1.0:1780340579.729146:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961024896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340579.729190:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961024896:12345-0@lo:400:kworker.0 Request processed in 44us (5073us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340579.729196:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3719 00000100:00100000:1.0:1780340579.729209:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3720 00000100:00100000:1.0:1780340579.729216:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961025408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340579.729241:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961025408:12345-0@lo:400:kworker.0 Request processed in 26us (5091us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340579.729246:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3720 00000100:00100000:1.0:1780340579.729312:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961024896:0@lo:400:kworker.0 00000100:00100000:1.0:1780340579.729324:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961025408:0@lo:400:kworker.0 00000100:00100000:1.0:1780340579.729333:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961024256:0@lo:400:kworker.0 00000100:00100000:1.0:1780340579.729368:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340579.729379:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961025920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340579.729412:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340579.729442:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961025920 00000100:00100000:1.0:1780340579.729445:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961025920 00000100:00100000:1.0:1780340579.729467:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3721 00000100:00100000:1.0:1780340579.729473:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961025920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780340579.729498:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:1.0:1780340579.729535:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961025920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340579.729541:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3721 00000100:00100000:1.0:1780340579.729571:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961025920:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1780340579.730897:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340579.730905:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340579.730908:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780340579.730911:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340580.234093:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340580.234123:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961026048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340580.234216:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340580.234290:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961026048 00000100:00100000:3.0:1780340580.234300:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961026048 00000100:00100000:3.0:1780340580.234363:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910 00000100:00100000:3.0:1780340580.234373:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961026048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340580.234411:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340580.234461:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961026048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340580.234469:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910 00000100:00100000:3.0:1780340580.234527:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961026048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340580.235021:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340580.235034:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961026176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340580.235075:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340580.235107:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961026176 00000100:00100000:0.0:1780340580.235111:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961026176 00000100:00100000:0.0:1780340580.235146:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1911 00000100:00100000:0.0:1780340580.235153:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961026176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340580.235177:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340580.235214:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961026176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340580.235220:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1911 00010000:00010000:0.0:1780340580.235302:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340580.235330:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961026176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340580.235531:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961026304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340580.235564:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340580.235665:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961026304 00000100:00100000:1.0:1780340580.235671:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961026304 00000100:00100000:1.0:1780340580.235711:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3722 00000100:00100000:1.0:1780340580.235719:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961026304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780340580.235800:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:1.0:1780340580.235844:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961026304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340580.235851:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3722 00000100:00100000:0.0:1780340580.236067:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961026304:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1780340580.918004:0:82323:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1780340581.258977:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340581.771641:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961026432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340581.771707:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340581.772118:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961026432 00000100:00100000:3.0:1780340581.772128:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961026432 00000100:00100000:3.0:1780340581.772202:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912 00000100:00100000:3.0:1780340581.772212:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961026432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340581.772236:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340581.772284:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961026432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340581.772291:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912 00000100:00080000:2.0:1780340581.772347:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340581.772368:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340581.772379:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961026560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340581.772411:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340581.772540:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961026560 00000100:00100000:1.0:1780340581.772545:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961026560 00000100:00100000:1.0:1780340581.772584:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913 00000100:00100000:1.0:1780340581.772592:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961026560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340581.772605:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340581.772645:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961026560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340581.772665:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913 00000100:00100000:0.0:1780340581.772786:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961026432:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1780340581.772854:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340581.772875:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961026560:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1780340582.282161:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340583.036569:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340583.036719:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940384000 00000100:00100000:3.0:1780340583.036750:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940384000 00000100:00100000:3.0:1780340583.036860:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1075 00000100:00100000:3.0:1780340583.036871:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:65085:x1866818940384000:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:3.0:1780340583.036908:0:63712:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:3.0:1780340583.036980:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:65085:x1866818940384000:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 111us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340583.036988:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1075 00000100:00080000:2.0:1780340583.037424:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780340583.038848:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340583.039031:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940384128 00000100:00100000:2.0:1780340583.039040:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940384128 00000100:00100000:2.0:1780340583.039108:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1076 00000100:00100000:2.0:1780340583.039118:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:65085:x1866818940384128:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:2.0:1780340583.039165:0:63710:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:2.0:1780340583.039232:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:65085:x1866818940384128:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 116us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340583.039254:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1076 00000100:00080000:3.0:1780340583.039799:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340583.046363:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340583.046468:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940384256 00000100:00100000:0.0:1780340583.046478:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940384256 00000100:00100000:0.0:1780340583.046550:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1914 00000100:00100000:0.0:1780340583.046562:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:65085:x1866818940384256:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:0.0:1780340583.046594:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340583.046672:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:65085:x1866818940384256:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 113us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340583.046678:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1914 00000100:00080000:3.0:1780340583.047750:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340583.050918:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340583.051155:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940384384 00000100:00100000:3.0:1780340583.051166:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940384384 00000100:00100000:3.0:1780340583.051234:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1915 00000100:00100000:3.0:1780340583.051245:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:65085:x1866818940384384:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:3.0:1780340583.051278:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340583.051349:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:65085:x1866818940384384:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 106us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340583.051357:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1915 00000100:00080000:2.0:1780340583.051479:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340583.136290:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340583.136598:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940384640 00000100:00100000:1.0:1780340583.136617:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940384640 00000100:00100000:1.0:1780340583.136677:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1077 00000100:00100000:1.0:1780340583.136686:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:65103:x1866818940384640:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1780340583.136707:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340583.136747:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763e00/0xa24651432773664 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2248 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137244:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa2465143277366b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137260:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa2465143277366b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137271:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa2465143277366b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137287:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773672 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137294:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773672 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137301:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773672 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137381:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa2465143277366b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137388:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa2465143277366b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137407:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa2465143277366b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137413:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340583.137417:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa2465143277366b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137424:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa2465143277366b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137435:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8500) 00010000:00010000:1.0:1780340583.137438:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340583.137442:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa2465143277366b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137448:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa2465143277366b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137461:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773672 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137467:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773672 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137471:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773672 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137476:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340583.137478:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773672 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137493:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773672 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.137501:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8c04428a8000) 00010000:00010000:1.0:1780340583.137503:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340583.138931:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773672 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.138945:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa24651432773672 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.138998:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763e00/0xa24651432773664 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2248 expref: 8 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.139010:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8500) 00010000:00010000:1.0:1780340583.139013:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1780340583.139017:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763e00/0xa24651432773664 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2248 expref: 8 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340583.139027:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0476763e00, rc 0) 00000100:00100000:1.0:1780340583.139107:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:65103:x1866818940384640:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 2422us (2825us total) trans 0 rc 301/301 00000100:00100000:1.0:1780340583.139116:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1077 00000100:00100000:1.0:1780340583.146422:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340583.146497:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940384768 00000100:00100000:2.0:1780340583.146517:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940384768 00000100:00100000:2.0:1780340583.146579:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1078 00000100:00100000:2.0:1780340583.146590:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:65103:x1866818940384768:12345-192.168.203.16@tcp:34:lfs.0 00010000:00010000:2.0:1780340583.146661:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b000/0xa24651432773679 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.146679:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b000/0xa24651432773679 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.146692:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b000/0xa24651432773679 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.146705:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a800/0xa24651432773680 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.146712:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a800/0xa24651432773680 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.146717:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a800/0xa24651432773680 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.146839:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b400/0xa24651432773687 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.146848:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b400/0xa24651432773687 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.146871:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b400/0xa24651432773687 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340583.146918:0:63711:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780340583.146929:0:63711:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b400/0xa24651432773687 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.146942:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b000/0xa24651432773679 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.146948:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b000/0xa24651432773679 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.146953:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b000/0xa24651432773679 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.146959:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b000/0xa24651432773679 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.146965:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340583.146969:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b000/0xa24651432773679 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.146977:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b000/0xa24651432773679 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.146988:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8500) 00010000:00010000:2.0:1780340583.146992:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340583.146996:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b000/0xa24651432773679 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.147002:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b000/0xa24651432773679 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.147024:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a800/0xa24651432773680 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.147031:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a800/0xa24651432773680 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.147036:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a800/0xa24651432773680 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.147042:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340583.147045:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a800/0xa24651432773680 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.147052:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a800/0xa24651432773680 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.147059:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff8c0455c3ba00) 00010000:00010000:2.0:1780340583.147062:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340583.147064:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a800/0xa24651432773680 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.147069:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a800/0xa24651432773680 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.147082:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b400/0xa24651432773687 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.147087:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b400/0xa24651432773687 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.147093:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b400/0xa24651432773687 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.147104:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340583.147107:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b400/0xa24651432773687 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.147113:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b400/0xa24651432773687 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.147120:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff8c0455c3bf00) 00010000:00010000:2.0:1780340583.147122:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340583.147125:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b400/0xa24651432773687 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340583.147130:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b400/0xa24651432773687 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340583.147203:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:65103:x1866818940384768:12345-192.168.203.16@tcp:34:lfs.0 Request processed in 614us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340583.147211:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1078 00010000:00010000:2.0:1780340583.305995:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340584.341183:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340584.492633:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340584.492678:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340584.492701:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340584.492843:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940385152 00000100:00100000:0.0:1780340584.492854:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940385152 00000100:00100000:0.0:1780340584.492907:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1079 00000100:00100000:0.0:1780340584.492916:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940385152:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340584.493003:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940385152:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 87us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340584.493010:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1079 00000100:00100000:1.0:1780340584.493400:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940384896 00000100:00100000:1.0:1780340584.493405:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940384896 00000100:00100000:1.0:1780340584.493450:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 79 00000100:00100000:1.0:1780340584.493458:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940384896:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340584.493499:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940384896:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 42us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340584.493506:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 79 00000100:00100000:2.0:1780340584.495059:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340584.495095:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340584.495110:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940385024 00000100:00100000:1.0:1780340584.495126:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940385024 00000100:00100000:1.0:1780340584.495187:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1080 00000100:00100000:1.0:1780340584.495197:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2408:x1866818940385024:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340584.495264:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2408:x1866818940385024:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 68us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340584.495271:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1080 00000100:00100000:3.0:1780340584.499356:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940385408 00000100:00100000:3.0:1780340584.499371:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940385408 00000100:00100000:3.0:1780340584.499486:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940385280 00000100:00100000:3.0:1780340584.499491:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940385280 00000100:00100000:1.0:1780340584.500754:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2354 00000100:00100000:1.0:1780340584.500787:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940385408:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340584.500872:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940385408:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 94us (8169us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340584.500880:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2354 00000100:00100000:1.0:1780340584.500898:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2355 00000100:00100000:1.0:1780340584.500906:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940385280:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340584.500993:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940385280:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 27us (5836us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340584.501000:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2355 00000100:00100000:0.0:1780340584.842029:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961026816:0@lo:400:kworker.0 00000100:00100000:0.0:1780340584.842096:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340584.842127:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961027328:0@lo:400:kworker.0 00000100:00100000:0.0:1780340584.842166:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340584.842182:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961027840:0@lo:400:kworker.0 00000100:00100000:0.0:1780340584.842203:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340584.842224:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1780340584.842230:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961026944:0@lo:400:kworker.0 00000100:00100000:0.0:1780340584.842250:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340584.842269:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961027456:0@lo:400:kworker.0 00000100:00100000:0.0:1780340584.842289:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340584.842301:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961027968:0@lo:400:kworker.0 00000100:00100000:0.0:1780340584.842318:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340584.842349:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961026816 00000100:00100000:0.0:1780340584.842356:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961026816 00000100:00100000:0.0:1780340584.842407:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961026944 00000100:00100000:0.0:1780340584.842410:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961026944 00000100:00100000:0.0:1780340584.842430:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1780340584.842440:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961026816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.842584:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961027072:0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.842612:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340584.842632:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961027584:0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.842653:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340584.842680:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961028096:0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.842701:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340584.842731:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1780340584.842737:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961026688:0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.842795:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340584.842819:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961027200:0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.842838:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340584.842846:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961027712:0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.842864:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340584.842873:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961028224:0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.842895:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340584.842916:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961027328 00000100:00100000:3.0:1780340584.842919:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961027328 00000100:00100000:3.0:1780340584.842946:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961027840 00000100:00100000:3.0:1780340584.842950:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961027840 00000100:00100000:3.0:1780340584.842969:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3723 00000100:00100000:3.0:1780340584.842976:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961027328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.843009:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961027328:12345-0@lo:400:kworker.0 Request processed in 34us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340584.843016:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3723 00000100:00100000:3.0:1780340584.843034:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3724 00000100:00100000:3.0:1780340584.843040:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961027840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.843065:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961027840:12345-0@lo:400:kworker.0 Request processed in 26us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340584.843071:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3724 00000100:00100000:3.0:1780340584.843092:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961027072 00000100:00100000:3.0:1780340584.843101:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961027072 00000100:00100000:3.0:1780340584.843119:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961027200 00000100:00100000:3.0:1780340584.843122:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961027200 00000100:00100000:3.0:1780340584.843132:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961027712 00000100:00100000:3.0:1780340584.843134:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961027712 00000100:00100000:3.0:1780340584.843143:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961028224 00000100:00100000:3.0:1780340584.843145:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961028224 00000100:00100000:3.0:1780340584.843158:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:3.0:1780340584.843163:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961026944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.843192:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961026944:12345-0@lo:400:kworker.0 Request processed in 29us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340584.843197:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:3.0:1780340584.843209:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:3.0:1780340584.843214:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961027072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.843244:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961027072:12345-0@lo:400:kworker.0 Request processed in 30us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340584.843250:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:3.0:1780340584.843261:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:3.0:1780340584.843267:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961027200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.843293:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961027200:12345-0@lo:400:kworker.0 Request processed in 27us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340584.843298:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:3.0:1780340584.843308:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:3.0:1780340584.843313:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961027712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.843335:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961027712:12345-0@lo:400:kworker.0 Request processed in 23us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340584.843340:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:3.0:1780340584.843358:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:3.0:1780340584.843364:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961028224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.843389:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961028224:12345-0@lo:400:kworker.0 Request processed in 26us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340584.843394:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:3.0:1780340584.843412:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961027456 00000100:00100000:3.0:1780340584.843416:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961027456 00000100:00100000:3.0:1780340584.843436:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961027968 00000100:00100000:3.0:1780340584.843439:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961027968 00000100:00100000:3.0:1780340584.843454:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961027584 00000100:00100000:3.0:1780340584.843456:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961027584 00000100:00100000:3.0:1780340584.843474:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961028096 00000100:00100000:3.0:1780340584.843477:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961028096 00000100:00100000:3.0:1780340584.843511:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2356 00000100:00100000:3.0:1780340584.843517:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961027456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.843547:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961027456:12345-0@lo:400:kworker.0 Request processed in 31us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340584.843552:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2356 00000100:00100000:3.0:1780340584.843563:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2357 00000100:00100000:3.0:1780340584.843569:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961027968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.843593:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349954700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961027968:12345-0@lo:400:kworker.0 Request processed in 25us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340584.843598:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2357 00000100:00100000:3.0:1780340584.843609:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2358 00000100:00100000:3.0:1780340584.843614:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961027584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.843638:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961027584:12345-0@lo:400:kworker.0 Request processed in 24us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340584.843651:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2358 00000100:00100000:3.0:1780340584.843664:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2359 00000100:00100000:3.0:1780340584.843670:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961028096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.843694:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961028096:12345-0@lo:400:kworker.0 Request processed in 25us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340584.843699:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2359 00000100:00100000:3.0:1780340584.843729:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961026688 00000100:00100000:3.0:1780340584.843733:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961026688 00000100:00100000:3.0:1780340584.843755:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1780340584.843783:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046bad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961026688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.843809:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046bad8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961026688:12345-0@lo:400:kworker.0 Request processed in 49us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340584.843815:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1780340584.843869:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961026688:0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.843881:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961027200:0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.843889:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961027712:0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.843897:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961028224:0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.843905:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961027072:0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.843914:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961027584:0@lo:400:kworker.0 00000100:00100000:3.0:1780340584.843924:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961028096:0@lo:400:kworker.0 00000100:00100000:0.0:1780340584.844178:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961026816:12345-0@lo:400:kworker.0 Request processed in 1739us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340584.844186:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00080000:0.0:1780340584.844206:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340584.844210:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340584.844212:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340584.844214:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780340584.844237:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961026944:0@lo:400:kworker.0 00000100:00100000:0.0:1780340584.844247:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961027456:0@lo:400:kworker.0 00000100:00100000:0.0:1780340584.844257:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961027968:0@lo:400:kworker.0 00000100:00100000:0.0:1780340584.844279:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961026816:0@lo:400:kworker.0 00000100:00100000:0.0:1780340584.844289:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961027328:0@lo:400:kworker.0 00000100:00100000:0.0:1780340584.844298:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961027840:0@lo:400:kworker.0 00000100:00100000:1.0:1780340584.844445:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340584.844455:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961028352:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340584.844496:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340584.844591:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961028352 00000100:00100000:3.0:1780340584.844595:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961028352 00000100:00100000:3.0:1780340584.844633:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3725 00000100:00100000:3.0:1780340584.844639:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961028352:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780340584.844667:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:3.0:1780340584.844703:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961028352:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340584.844718:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3725 00000100:00100000:1.0:1780340584.844797:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961028352:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340585.354049:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780340585.354072:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961028480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340585.354139:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340585.354423:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961028480 00000100:00100000:3.0:1780340585.354432:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961028480 00000100:00100000:3.0:1780340585.354487:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916 00000100:00100000:3.0:1780340585.354496:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961028480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340585.354524:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340585.354571:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961028480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340585.354578:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916 00000100:00100000:3.0:1780340585.354622:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961028480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340585.354865:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340585.354877:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961028608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340585.354908:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1780340585.354934:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340585.354943:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961028608 00000100:00100000:0.0:1780340585.354947:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961028608 00000100:00100000:0.0:1780340585.354973:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917 00000100:00100000:0.0:1780340585.354979:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961028608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340585.354995:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340585.355026:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961028608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340585.355033:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917 00000100:00100000:0.0:1780340585.355062:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961028608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340585.355251:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340585.355261:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961028736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340585.355290:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340585.355318:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961028736 00000100:00100000:3.0:1780340585.355322:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961028736 00000100:00100000:3.0:1780340585.355349:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3726 00000100:00100000:3.0:1780340585.355356:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961028736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340585.355380:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:3.0:1780340585.355414:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961028736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340585.355420:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3726 00000100:00100000:3.0:1780340585.355460:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961028736:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1780340586.377981:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340586.890952:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340586.890979:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961028864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340586.891054:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340586.891184:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961028992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340586.891210:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340586.891274:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961028864 00000100:00100000:2.0:1780340586.891283:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961028864 00000100:00100000:2.0:1780340586.891342:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918 00000100:00100000:2.0:1780340586.891352:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961028864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340586.891377:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340586.891425:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349956d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961028864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340586.891431:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918 00000100:00100000:2.0:1780340586.891447:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961028992 00000100:00100000:2.0:1780340586.891450:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961028992 00000100:00100000:2.0:1780340586.891472:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919 00000100:00100000:2.0:1780340586.891478:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961028992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340586.891502:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340586.891532:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349955500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961028992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340586.891538:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919 00000100:00100000:2.0:1780340586.891583:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471572300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961028992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340586.891596:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961028864:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1780340586.891717:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340586.891721:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1780340587.401971:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340588.432084:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340589.450031:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340589.639511:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340589.639570:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340589.639797:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940385536 00000100:00100000:3.0:1780340589.639807:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940385536 00000100:00100000:3.0:1780340589.639860:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 81 00000100:00100000:3.0:1780340589.639870:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046badb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940385536:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340589.639942:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046badb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940385536:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 75us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340589.639949:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 81 00000100:00100000:0.0:1780340589.640027:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940385664 00000100:00100000:0.0:1780340589.640043:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940385664 00000100:00100000:0.0:1780340589.640094:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1087 00000100:00100000:0.0:1780340589.640102:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2408:x1866818940385664:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340589.640135:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2408:x1866818940385664:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 35us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340589.640142:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1087 00000100:00080000:3.0:1780340589.640202:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780340589.640957:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340589.640994:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340589.641073:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940386048 00000100:00100000:3.0:1780340589.641079:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940386048 00000100:00100000:3.0:1780340589.641134:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2360 00000100:00100000:3.0:1780340589.641143:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940386048:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340589.641185:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940386048:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 44us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340589.641191:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2360 00000100:00080000:0.0:1780340589.641362:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340589.641583:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940385792 00000100:00100000:1.0:1780340589.641589:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940385792 00000100:00100000:1.0:1780340589.641640:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1088 00000100:00100000:1.0:1780340589.641648:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940385792:12345-192.168.203.16@tcp:400:kworker.0 00000100:00080000:0.0:1780340589.641803:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340589.641987:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940385792:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 340us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340589.641994:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1088 00000100:00100000:2.0:1780340589.647062:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340589.647148:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940385920 00000100:00100000:0.0:1780340589.647159:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940385920 00000100:00100000:0.0:1780340589.647227:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2361 00000100:00100000:0.0:1780340589.647237:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940385920:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340589.647326:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940385920:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 90us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340589.647334:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2361 00000100:00080000:3.0:1780340589.648030:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340589.962867:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961029504:0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.962940:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340589.962976:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961030016:0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.963002:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340589.963017:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961030528:0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.963036:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340589.963057:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1780340589.963064:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961029376:0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.963084:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340589.963101:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961029888:0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.963120:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340589.963137:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961030400:0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.963157:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340589.963183:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961029504 00000100:00100000:1.0:1780340589.963190:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961029504 00000100:00100000:1.0:1780340589.963244:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961029376 00000100:00100000:1.0:1780340589.963247:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961029376 00000100:00100000:1.0:1780340589.963268:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:1.0:1780340589.963277:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034872b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961029504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.963325:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034872b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961029504:12345-0@lo:400:kworker.0 Request processed in 49us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340589.963332:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:1.0:1780340589.963348:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:1.0:1780340589.963355:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961029376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.963379:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961029376:12345-0@lo:400:kworker.0 Request processed in 25us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340589.963384:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:1.0:1780340589.963416:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961030016 00000100:00100000:1.0:1780340589.963419:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961030016 00000100:00100000:1.0:1780340589.963446:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961030528 00000100:00100000:1.0:1780340589.963449:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961030528 00000100:00100000:1.0:1780340589.963465:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961029888 00000100:00100000:1.0:1780340589.963467:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961029888 00000100:00100000:1.0:1780340589.963495:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961030400 00000100:00100000:1.0:1780340589.963498:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961030400 00000100:00100000:1.0:1780340589.963515:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2362 00000100:00100000:1.0:1780340589.963521:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961030016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.963548:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961030016:12345-0@lo:400:kworker.0 Request processed in 28us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340589.963554:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2362 00000100:00100000:1.0:1780340589.963564:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2363 00000100:00100000:1.0:1780340589.963569:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961030528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.963592:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961030528:12345-0@lo:400:kworker.0 Request processed in 24us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340589.963604:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2363 00000100:00100000:1.0:1780340589.963615:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2364 00000100:00100000:1.0:1780340589.963622:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961029888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.963649:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961029888:12345-0@lo:400:kworker.0 Request processed in 28us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340589.963654:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2364 00000100:00100000:1.0:1780340589.963664:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2365 00000100:00100000:1.0:1780340589.963680:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961030400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.963706:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961030400:12345-0@lo:400:kworker.0 Request processed in 37us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340589.963711:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2365 00000100:00100000:1.0:1780340589.963791:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961029376:0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.963804:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961029888:0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.963813:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961030400:0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.963822:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961029504:0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.963831:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961030016:0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.963839:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961030528:0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.963928:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961029120:0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.963965:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340589.964003:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961029632:0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.964026:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340589.964041:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961030144:0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.964060:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340589.964075:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034872ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961030656:0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.964108:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340589.964125:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1780340589.964131:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961029248:0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.964163:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340589.964179:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961029760:0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.964202:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340589.964218:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961030272:0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.964239:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340589.964267:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961029760 00000100:00100000:0.0:1780340589.964271:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961029760 00000100:00100000:0.0:1780340589.964297:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961030272 00000100:00100000:0.0:1780340589.964299:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961030272 00000100:00100000:0.0:1780340589.964316:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3727 00000100:00100000:0.0:1780340589.964323:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961029760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.964362:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961029760:12345-0@lo:400:kworker.0 Request processed in 40us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340589.964369:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3727 00000100:00100000:0.0:1780340589.964384:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3728 00000100:00100000:0.0:1780340589.964390:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961030272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.964415:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961030272:12345-0@lo:400:kworker.0 Request processed in 26us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340589.964420:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3728 00000100:00100000:0.0:1780340589.964437:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961029632 00000100:00100000:0.0:1780340589.964441:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961029632 00000100:00100000:0.0:1780340589.964463:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961030144 00000100:00100000:0.0:1780340589.964466:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961030144 00000100:00100000:0.0:1780340589.964476:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961030656 00000100:00100000:0.0:1780340589.964478:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961030656 00000100:00100000:0.0:1780340589.964487:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961029248 00000100:00100000:0.0:1780340589.964489:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961029248 00000100:00100000:0.0:1780340589.964501:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1780340589.964515:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961029632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.964547:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349955c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961029632:12345-0@lo:400:kworker.0 Request processed in 35us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340589.964553:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1780340589.964565:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:0.0:1780340589.964571:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961030144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.964596:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961030144:12345-0@lo:400:kworker.0 Request processed in 25us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340589.964601:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:0.0:1780340589.964611:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1780340589.964617:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961030656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.964640:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961030656:12345-0@lo:400:kworker.0 Request processed in 24us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340589.964645:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1780340589.964655:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1780340589.964661:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961029248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.964697:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961029248:12345-0@lo:400:kworker.0 Request processed in 36us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340589.964702:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1780340589.964739:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961029248:0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.964748:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961029760:0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.964756:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961030272:0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.964794:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961029632:0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.964815:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961030144:0@lo:400:kworker.0 00000100:00100000:0.0:1780340589.964822:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034872ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961030656:0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.966521:0:81811:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961029120 00000100:00100000:1.0:1780340589.966532:0:81811:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961029120 00000100:00100000:1.0:1780340589.966636:0:81811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1780340589.966647:0:81811:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046bad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961029120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340589.966744:0:81811:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046bad9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961029120:12345-0@lo:400:kworker.0 Request processed in 100us (2778us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340589.966789:0:81811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1780340589.966950:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961030784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780340589.966988:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1780340589.967026:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340589.967031:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340589.967034:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780340589.967037:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780340589.967046:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961030784 00000100:00100000:3.0:1780340589.967050:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961030784 00000100:00100000:3.0:1780340589.967075:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3729 00000100:00100000:3.0:1780340589.967081:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961030784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780340589.967114:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:3.0:1780340589.967152:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961030784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340589.967158:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3729 00000100:00100000:3.0:1780340589.967212:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961030784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340589.967436:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961029120:0@lo:400:kworker.0 00000100:00100000:1.0:1780340590.475025:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961030912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340590.475095:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340590.475140:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340590.475146:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961031040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340590.475172:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340590.475256:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961031040 00000100:00100000:2.0:1780340590.475265:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961031040 00000100:00100000:2.0:1780340590.475319:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920 00000100:00100000:2.0:1780340590.475329:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961031040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780340590.475371:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340590.475414:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961031040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340590.475422:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920 00010000:00010000:0.0:1780340590.475560:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340590.475659:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340590.475676:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961031168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340590.475705:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340590.475731:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961031168 00000100:00100000:2.0:1780340590.475735:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961031168 00000100:00100000:2.0:1780340590.475792:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:2.0:1780340590.475799:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961031168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780340590.475814:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340590.475846:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961031168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340590.475851:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000100:00100000:2.0:1780340590.475892:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961031168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340590.476141:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961031040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340590.476357:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961030912 00000100:00100000:3.0:1780340590.476363:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961030912 00000100:00100000:3.0:1780340590.476404:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3730 00000100:00100000:3.0:1780340590.476412:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961030912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340590.476439:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:3.0:1780340590.476489:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961030912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (1393us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340590.476495:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3730 00000100:00100000:1.0:1780340590.476658:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961030912:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1780340591.500451:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1780340591.577173:0:82518:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130b: DoM file create (inherited) replay ========================================================== 15:03:09 (1780340589) 00000100:00100000:1.0:1780340592.010849:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340592.010873:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961031296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340592.010941:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340592.011105:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961031296 00000100:00100000:2.0:1780340592.011113:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961031296 00000100:00100000:2.0:1780340592.011178:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922 00000100:00100000:2.0:1780340592.011187:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961031296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340592.011208:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340592.011252:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961031296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340592.011260:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922 00000100:00100000:2.0:1780340592.011632:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961031424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340592.011688:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780340592.011935:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340592.011977:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961031296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340592.012453:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961031424 00000100:00100000:3.0:1780340592.012459:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961031424 00000100:00100000:3.0:1780340592.012514:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923 00000100:00100000:3.0:1780340592.012523:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961031424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340592.012553:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340592.012609:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471570700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961031424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340592.012616:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923 00000100:00100000:0.0:1780340592.012799:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961031424:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1780340592.012966:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340592.053696:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340592.053794:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940386176 00000100:00100000:0.0:1780340592.053804:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940386176 00000100:00100000:0.0:1780340592.053868:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1079 00000100:00100000:0.0:1780340592.053879:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:65683:x1866818940386176:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1780340592.053897:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340592.053913:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5200/0xa2465143277368e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced224f expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.053972:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa24651432773695 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.053987:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa24651432773695 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.053999:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa24651432773695 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054013:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa2465143277369c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054020:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa2465143277369c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054039:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa2465143277369c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054077:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa24651432773695 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054084:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa24651432773695 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054091:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa24651432773695 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054097:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa24651432773695 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054103:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c4400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340592.054106:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa24651432773695 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054113:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa24651432773695 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054123:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8500) 00010000:00010000:0.0:1780340592.054126:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340592.054130:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa24651432773695 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054136:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa24651432773695 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054149:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa2465143277369c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054159:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa2465143277369c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054176:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa2465143277369c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054181:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c4a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340592.054184:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa2465143277369c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054189:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa2465143277369c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054196:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff8c044412bf00) 00010000:00010000:0.0:1780340592.054198:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340592.054201:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa2465143277369c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054206:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa2465143277369c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054233:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5200/0xa2465143277368e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced224f expref: 8 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054242:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8500) 00010000:00010000:0.0:1780340592.054244:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340592.054248:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5200/0xa2465143277368e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced224f expref: 8 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.054256:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04441c5200, rc 0) 00000100:00100000:0.0:1780340592.054317:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:65683:x1866818940386176:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 441us (628us total) trans 0 rc 301/301 00000100:00100000:0.0:1780340592.054325:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1079 00000100:00080000:1.0:1780340592.054539:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340592.065406:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340592.065529:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940386432 00000100:00100000:0.0:1780340592.065552:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940386432 00000100:00100000:0.0:1780340592.065612:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1080 00000100:00100000:0.0:1780340592.065624:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:65683:x1866818940386432:12345-192.168.203.16@tcp:36:lfs.0 00010000:00010000:0.0:1780340592.065692:0:63712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340592.065720:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa2465143277364f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2241 expref: 7 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.065741:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8500) 00010000:00010000:0.0:1780340592.065751:0:63712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780340592.065865:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5200/0xa246514327736a3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.065880:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5200/0xa246514327736a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.065889:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5200/0xa246514327736a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.065900:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa246514327736aa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.065907:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa246514327736aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.065914:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa246514327736aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.068707:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa246514327736b1 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.068730:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa246514327736b1 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.068743:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa246514327736b1 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340592.069261:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ac758d18 reply state 0000000001016d56 transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa246514327736b1 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.069277:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa246514327736b1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.069285:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff8c044412ba00) 00010000:00010000:0.0:1780340592.069287:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340592.069292:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1780340592.069298:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1780340592.069308:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5200/0xa246514327736a3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.069315:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5200/0xa246514327736a3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.069321:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5200/0xa246514327736a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.069327:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5200/0xa246514327736a3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.069334:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c5200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340592.069350:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5200/0xa246514327736a3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.069358:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5200/0xa246514327736a3 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.069369:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c044412bf00) 00010000:00010000:0.0:1780340592.069371:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340592.069375:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5200/0xa246514327736a3 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.069382:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5200/0xa246514327736a3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340592.070332:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ac758d18 reply state 0000000001016d56 transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa246514327736aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.070350:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa246514327736aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.070357:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff8c044412b000) 00010000:00010000:0.0:1780340592.070360:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340592.070363:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1780340592.070985:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:65683:x1866818940386432:12345-192.168.203.16@tcp:36:lfs.0 Request processed in 5216us (5452us total) trans 98784247809 rc 0/0 00000100:00100000:0.0:1780340592.070995:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1080 00000100:00100000:3.0:1780340592.107249:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340592.110931:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940386560 00000100:00100000:2.0:1780340592.110945:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940386560 00000100:00100000:2.0:1780340592.111058:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1081 00000100:00100000:2.0:1780340592.111068:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:65687:x1866818940386560:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1780340592.111092:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340592.111111:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327736b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2256 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340592.111179:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32ae00/0xa246514327736bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340592.111194:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32ae00/0xa246514327736bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340592.111204:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32ae00/0xa246514327736bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340592.111245:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1780340592.111249:0:63710:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780340592.111266:0:63710:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32ae00/0xa246514327736bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340592.111285:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327736b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2256 expref: 10 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340592.111302:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32ae00/0xa246514327736bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2256 expref: 9 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340592.111311:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455c3ba00) 00010000:00010000:2.0:1780340592.111324:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780340592.111328:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32ae00, rc 0) 00000100:00100000:2.0:1780340592.111402:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:65687:x1866818940386560:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 324us (4151us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340592.111409:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1081 00000100:00100000:1.0:1780340592.118090:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340592.118179:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940386688 00000100:00100000:0.0:1780340592.118188:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940386688 00000100:00100000:0.0:1780340592.118265:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1082 00000100:00100000:0.0:1780340592.118274:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:65687:x1866818940386688:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1780340592.118291:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340592.118320:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5200/0xa246514327736c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced225d expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118376:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa246514327736cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118399:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa246514327736cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118410:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa246514327736cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118420:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5800/0xa246514327736d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118427:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5800/0xa246514327736d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118433:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5800/0xa246514327736d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118491:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5400/0xa246514327736db lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118497:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5400/0xa246514327736db lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118503:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5400/0xa246514327736db lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340592.118534:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1780340592.118548:0:63711:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780340592.118565:0:63711:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5400/0xa246514327736db lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118581:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa246514327736cd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118587:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa246514327736cd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118593:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa246514327736cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118599:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa246514327736cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118604:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c4c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340592.118608:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa246514327736cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118615:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa246514327736cd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118625:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455c3ba00) 00010000:00010000:0.0:1780340592.118628:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340592.118632:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa246514327736cd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118638:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa246514327736cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118652:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5800/0xa246514327736d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118666:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5800/0xa246514327736d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118677:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5800/0xa246514327736d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118682:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c5800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340592.118685:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5800/0xa246514327736d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118691:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5800/0xa246514327736d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118698:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff8c044412b000) 00010000:00010000:0.0:1780340592.118700:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340592.118703:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5800/0xa246514327736d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118709:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5800/0xa246514327736d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118730:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5200/0xa246514327736c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced225d expref: 11 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118741:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5400/0xa246514327736db lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced225d expref: 10 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.118749:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff8c044412ba00) 00010000:00010000:0.0:1780340592.118751:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780340592.118753:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04441c5400, rc 0) 00000100:00100000:0.0:1780340592.119918:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:65687:x1866818940386688:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 567us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340592.119944:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1082 00000100:00100000:3.0:1780340592.123710:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340592.124324:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940386944 00000100:00100000:0.0:1780340592.124335:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940386944 00000100:00100000:0.0:1780340592.124408:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1083 00000100:00100000:0.0:1780340592.124418:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:65687:x1866818940386944:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1780340592.124438:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340592.124460:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4000/0xa246514327736e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2264 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340592.124573:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1780340592.124682:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4000/0xa246514327736e2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2264 expref: 12 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.124696:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455c3ba00) 00010000:00010000:0.0:1780340592.124699:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1780340592.124705:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4000/0xa246514327736e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2264 expref: 12 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.124720:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04441c4000, rc 0) 00000100:00100000:0.0:1780340592.124802:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:65687:x1866818940386944:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 386us (1100us total) trans 98784247810 rc 301/301 00000100:00100000:0.0:1780340592.124810:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1083 00000100:00100000:3.0:1780340592.143179:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340592.143402:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940387200 00000100:00100000:0.0:1780340592.143414:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940387200 00000100:00100000:0.0:1780340592.143474:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1084 00000100:00100000:0.0:1780340592.143484:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:65687:x1866818940387200:12345-192.168.203.16@tcp:36:lfs.0 00010000:00010000:0.0:1780340592.143563:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340592.143590:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5400/0xa246514327736db lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced225d expref: 11 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.143611:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff8c044412ba00) 00010000:00010000:0.0:1780340592.143616:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780340592.143636:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4000/0xa246514327736f0 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.143650:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4000/0xa246514327736f0 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.143670:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4000/0xa246514327736f0 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340592.144155:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ac75d63a reply state 000000005ba133d2 transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4000/0xa246514327736f0 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.144240:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4000/0xa246514327736f0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340592.144247:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff8c044412ba00) 00010000:00010000:0.0:1780340592.144250:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1780340592.144253:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1780340592.144261:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000100:00100000:0.0:1780340592.144387:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:65687:x1866818940387200:12345-192.168.203.16@tcp:36:lfs.0 Request processed in 903us (1228us total) trans 98784247811 rc 0/0 00000100:00100000:0.0:1780340592.144407:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1084 00000100:00100000:3.0:1780340592.147505:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340592.149988:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940387456 00000100:00100000:0.0:1780340592.150005:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940387456 00000100:00100000:0.0:1780340592.150092:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 219 00000100:00100000:0.0:1780340592.150104:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:65687:x1866818940387456:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:0.0:1780340592.150336:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:65687:x1866818940387456:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 234us (2837us total) trans 98784247812 rc 0/0 00000100:00100000:0.0:1780340592.150345:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 219 00010000:00010000:2.0:1780340592.521906:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1780340593.276719:0:81806:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247812 is committed 00010000:00010000:0.0:1780340593.277018:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa246514327736aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277040:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa246514327736aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277048:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa246514327736aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277054:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c4a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340593.277059:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa246514327736aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277067:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa246514327736aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277082:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff8c044412b000) 00010000:00010000:0.0:1780340593.277085:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340593.277090:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa246514327736aa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277096:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa246514327736aa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277118:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa246514327736b1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277138:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa246514327736b1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277144:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa246514327736b1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277148:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c4400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340593.277151:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa246514327736b1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277157:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa246514327736b1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277165:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff8c044412ba00) 00010000:00010000:0.0:1780340593.277167:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340593.277170:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa246514327736b1 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277175:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4400/0xa246514327736b1 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277192:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4000/0xa246514327736f0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277198:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4000/0xa246514327736f0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277203:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4000/0xa246514327736f0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277208:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c4000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340593.277216:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4000/0xa246514327736f0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277223:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4000/0xa246514327736f0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277231:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff8c044412ba00) 00010000:00010000:0.0:1780340593.277234:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1780340593.277236:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4000/0xa246514327736f0 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340593.277242:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4000/0xa246514327736f0 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340593.341273:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340593.341340:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940387584 00000100:00100000:2.0:1780340593.341351:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940387584 00000100:00100000:2.0:1780340593.341426:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1085 00000100:00100000:2.0:1780340593.341436:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:65703:x1866818940387584:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:2.0:1780340593.341478:0:63712:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:2.0:1780340593.341603:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:65703:x1866818940387584:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 168us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340593.341611:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1085 00000100:00100000:3.0:1780340593.345333:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340593.345481:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940387712 00000100:00100000:1.0:1780340593.345492:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940387712 00000100:00080000:3.0:1780340593.345560:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340593.345565:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1086 00000100:00100000:1.0:1780340593.345579:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:65703:x1866818940387712:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:1.0:1780340593.345615:0:70100:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:1.0:1780340593.345702:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:65703:x1866818940387712:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 127us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340593.345710:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1086 00000100:00100000:1.0:1780340593.351282:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340593.351965:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940387840 00000100:00100000:2.0:1780340593.351975:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940387840 00000100:00100000:2.0:1780340593.352043:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1924 00000100:00100000:2.0:1780340593.352055:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:65703:x1866818940387840:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:2.0:1780340593.352080:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340593.352147:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:65703:x1866818940387840:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 95us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340593.352156:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1924 00000100:00080000:1.0:1780340593.352225:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340593.362677:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340593.362713:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940387968 00000100:00100000:3.0:1780340593.362723:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940387968 00000100:00100000:3.0:1780340593.362814:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1925 00000100:00100000:3.0:1780340593.362826:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:65703:x1866818940387968:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:3.0:1780340593.362860:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340593.362930:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:65703:x1866818940387968:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 107us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340593.362938:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1925 00000100:00080000:3.0:1780340593.362961:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340593.454925:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340593.454982:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940388224 00000100:00100000:3.0:1780340593.454992:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940388224 00000100:00100000:3.0:1780340593.455051:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1087 00000100:00100000:3.0:1780340593.455061:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:65710:x1866818940388224:12345-192.168.203.16@tcp:36:mcreate.0 00010000:00010000:3.0:1780340593.455120:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340593.455146:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32ae00/0xa246514327736bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2256 expref: 7 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.455161:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455c3ba00) 00010000:00010000:3.0:1780340593.455171:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340593.455229:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa246514327736f7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.455244:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa246514327736f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.455267:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa246514327736f7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.455278:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa246514327736fe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.455284:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa246514327736fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.455290:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa246514327736fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.455620:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa246514327736f7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.455630:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa246514327736f7 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.455637:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa246514327736f7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.455643:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa246514327736f7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.455663:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340593.455667:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa246514327736f7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.455674:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa246514327736f7 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.455683:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04764c1800) 00010000:00010000:3.0:1780340593.455690:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340593.455694:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa246514327736f7 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.455700:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa246514327736f7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340593.455713:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dcfc215c reply state 0000000076f69988 transno 98784247813 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa246514327736fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.455723:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa246514327736fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.455730:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04764c1a00) 00010000:00010000:3.0:1780340593.455732:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340593.455735:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780340593.455830:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:65710:x1866818940388224:12345-192.168.203.16@tcp:36:mcreate.0 Request processed in 769us (912us total) trans 98784247813 rc 0/0 00000100:00100000:3.0:1780340593.455838:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1087 00000100:00100000:1.0:1780340593.523237:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340593.527055:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940388352 00000100:00100000:3.0:1780340593.527070:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940388352 00000100:00100000:3.0:1780340593.527132:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1088 00000100:00100000:3.0:1780340593.527142:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:65713:x1866818940388352:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:3.0:1780340593.527165:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340593.527185:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432773705 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced226b expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.527245:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4800/0xa2465143277370c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.527260:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4800/0xa2465143277370c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.527279:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4800/0xa2465143277370c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340593.527320:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1780340593.527324:0:64454:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780340593.527346:0:64454:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4800/0xa2465143277370c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.527369:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432773705 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced226b expref: 10 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.527385:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4800/0xa2465143277370c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced226b expref: 9 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.527393:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04764c1800) 00010000:00010000:3.0:1780340593.527396:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1780340593.527399:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4800, rc 0) 00000100:00100000:3.0:1780340593.527459:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:65713:x1866818940388352:12345-192.168.203.16@tcp:101:rm.0 Request processed in 319us (4229us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340593.527467:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1088 00000100:00100000:3.0:1780340593.530979:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340593.531138:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940388480 00000100:00100000:1.0:1780340593.531153:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940388480 00000100:00100000:1.0:1780340593.531207:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1089 00000100:00100000:1.0:1780340593.531217:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:65713:x1866818940388480:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:1.0:1780340593.531236:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340593.531256:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762200/0xa24651432773713 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2272 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531319:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277371a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531334:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277371a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531345:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277371a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531356:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773721 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531363:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531369:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531444:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa24651432773728 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531452:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa24651432773728 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531459:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa24651432773728 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340593.531499:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x4:0x0]: returning size 0 00000004:00200000:1.0:1780340593.531503:0:63710:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780340593.531520:0:63710:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa24651432773728 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531530:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa24651432773728 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531538:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277371a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531544:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277371a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531550:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277371a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531556:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277371a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531562:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476763600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340593.531566:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277371a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531579:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277371a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531590:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04764c1800) 00010000:00010000:1.0:1780340593.531593:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340593.531598:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277371a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531604:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763600/0xa2465143277371a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531614:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773721 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531619:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773721 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531625:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773721 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531629:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476763c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340593.531631:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773721 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531636:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773721 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531642:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04764c1a00) 00010000:00010000:1.0:1780340593.531656:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340593.531659:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773721 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531673:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476763c00/0xa24651432773721 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531698:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762200/0xa24651432773713 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2272 expref: 11 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531712:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa24651432773728 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2272 expref: 10 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.531720:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff8c04428a8f00) 00010000:00010000:1.0:1780340593.531722:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780340593.531725:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0476762600, rc 0) 00000100:00100000:1.0:1780340593.531819:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:65713:x1866818940388480:12345-192.168.203.16@tcp:101:rm.0 Request processed in 603us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340593.531825:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1089 00000100:00100000:2.0:1780340593.540515:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340593.540821:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940388736 00000100:00100000:3.0:1780340593.540831:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940388736 00000100:00100000:3.0:1780340593.540881:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1090 00000100:00100000:3.0:1780340593.540890:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:65713:x1866818940388736:12345-192.168.203.16@tcp:36:rm.0 00010000:00010000:3.0:1780340593.540939:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1780340593.540965:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa24651432773728 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2272 expref: 10 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.540988:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff8c04428a8f00) 00010000:00010000:3.0:1780340593.541006:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4800/0xa2465143277370c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced226b expref: 9 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541014:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04764c1800) 00010000:00010000:3.0:1780340593.541019:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340593.541042:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa2465143277372f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541053:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa2465143277372f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541062:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa2465143277372f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541072:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773736 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541079:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773736 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541085:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773736 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541277:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21400/0xa2465143277373d lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541287:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21400/0xa2465143277373d lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541305:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21400/0xa2465143277373d lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541633:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21c00/0xa24651432773744 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541643:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21c00/0xa24651432773744 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541829:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21c00/0xa24651432773744 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541837:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21c00/0xa24651432773744 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541843:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21c00/0xa24651432773744 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541847:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21c00/0xa24651432773744 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541901:0:63711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340593.541922:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21400/0xa2465143277373d lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541928:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21400/0xa2465143277373d lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541934:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21400/0xa2465143277373d lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541940:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c046fb21400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340593.541950:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21400/0xa2465143277373d lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541960:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21400/0xa2465143277373d lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541968:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff8c04764c1400) 00010000:00010000:3.0:1780340593.541970:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1780340593.541973:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21400/0xa2465143277373d lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541978:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21400/0xa2465143277373d lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.541993:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa2465143277372f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.542000:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa2465143277372f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.542005:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa2465143277372f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.542010:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa2465143277372f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.542015:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340593.542017:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa2465143277372f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.542021:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa2465143277372f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.542040:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04764c1000) 00010000:00010000:3.0:1780340593.542042:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340593.542045:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa2465143277372f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.542050:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa2465143277372f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340593.542065:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dd65d912 reply state 000000006068703a transno 98784247814 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773736 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.542075:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773736 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340593.542081:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04764c1a00) 00010000:00010000:3.0:1780340593.542083:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340593.542086:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780340593.542175:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:65713:x1866818940388736:12345-192.168.203.16@tcp:36:rm.0 Request processed in 1284us (1667us total) trans 98784247814 rc 0/0 00000100:00100000:3.0:1780340593.542183:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1090 00010000:00010000:2.0:1780340593.549691:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340593.549705:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21c00/0xa24651432773744 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340593.549729:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c046fb21c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340593.549733:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21c00/0xa24651432773744 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340593.549743:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21c00/0xa24651432773744 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340593.549790:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff8c04764c1400) 00010000:00010000:2.0:1780340593.549793:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1780340593.549798:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21c00/0xa24651432773744 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340593.549803:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c046fb21c00/0xa24651432773744 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340593.551042:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340593.551046:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340593.551049:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340593.560292:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340594.573472:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340594.734698:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340594.734743:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340594.734798:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340594.734821:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340594.734845:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340594.734874:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940389248 00000100:00100000:3.0:1780340594.734884:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940389248 00000100:00100000:3.0:1780340594.734940:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940389376 00000100:00100000:3.0:1780340594.734955:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940389376 00000100:00100000:3.0:1780340594.734985:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2366 00000100:00100000:3.0:1780340594.734996:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940389248:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340594.735070:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940389248:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 76us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340594.735078:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2366 00000100:00100000:3.0:1780340594.735093:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2367 00000100:00100000:3.0:1780340594.735100:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940389376:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340594.735124:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940389376:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 25us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340594.735129:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2367 00000100:00100000:3.0:1780340594.735148:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940388864 00000100:00100000:3.0:1780340594.735151:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940388864 00000100:00100000:3.0:1780340594.735174:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 83 00000100:00100000:3.0:1780340594.735181:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046bada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940388864:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340594.735203:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046bada450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940388864:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340594.735209:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 83 00000100:00100000:3.0:1780340594.737246:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940388992 00000100:00100000:3.0:1780340594.737256:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940388992 00000100:00100000:3.0:1780340594.737373:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940389120 00000100:00100000:3.0:1780340594.737378:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940389120 00000100:00100000:3.0:1780340594.737405:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1095 00000100:00100000:3.0:1780340594.737415:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2407:x1866818940388992:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000080:3.0:1780340594.737443:0:63710:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046fd68a80 x1866818940388992/t0(0) o400->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:20/0 lens 224/224 e 0 to 0 dl 1780340605 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340594.737496:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2407:x1866818940388992:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 83us (2807us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340594.737503:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1095 00000100:00100000:3.0:1780340594.738006:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1096 00000100:00100000:3.0:1780340594.738015:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940389120:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340594.738047:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940389120:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 34us (3226us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340594.738053:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1096 00000100:00080000:3.0:1780340594.738084:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780340595.085960:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961031936:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.086032:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340595.086067:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961032448:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.086088:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340595.086104:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961032960:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.086121:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340595.086158:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1780340595.086163:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961031552:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.086188:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340595.086212:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961032064:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.086231:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340595.086247:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961032576:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.086276:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340595.086292:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961033088:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.086310:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340595.086334:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961031680:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.086355:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340595.086371:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961032192:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.086391:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340595.086408:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961032704:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.086427:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340595.086445:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1780340595.086450:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961031808:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.086470:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340595.086481:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961032320:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.086499:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340595.086693:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961032832:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.086715:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340595.086747:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961031936 00000100:00100000:2.0:1780340595.086754:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961031936 00000100:00100000:2.0:1780340595.086817:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961032064 00000100:00100000:2.0:1780340595.086820:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961032064 00000100:00100000:2.0:1780340595.086832:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961032576 00000100:00100000:2.0:1780340595.086835:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961032576 00000100:00100000:2.0:1780340595.086845:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961033088 00000100:00100000:2.0:1780340595.086847:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961033088 00000100:00100000:2.0:1780340595.086856:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961031680 00000100:00100000:2.0:1780340595.086858:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961031680 00000100:00100000:2.0:1780340595.086869:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961031808 00000100:00100000:2.0:1780340595.086878:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961031808 00000100:00100000:2.0:1780340595.086897:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:2.0:1780340595.086905:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961031936:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340595.086928:0:63711:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046ba2d500 x1866818961031936/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:21/0 lens 224/224 e 0 to 0 dl 1780340606 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340595.086969:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961031936:12345-0@lo:400:kworker.0 Request processed in 64us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340595.086977:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:2.0:1780340595.086994:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:2.0:1780340595.086999:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961032064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.087024:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961032064:12345-0@lo:400:kworker.0 Request processed in 26us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340595.087030:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:2.0:1780340595.087040:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1780340595.087045:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961032576:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340595.087054:0:63711:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046ba2dc00 x1866818961032576/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:21/0 lens 224/224 e 0 to 0 dl 1780340606 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340595.087077:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961032576:12345-0@lo:400:kworker.0 Request processed in 33us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340595.087083:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1780340595.087094:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1780340595.087100:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961033088:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340595.087109:0:63711:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046ba2f480 x1866818961033088/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:21/0 lens 224/224 e 0 to 0 dl 1780340606 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340595.087133:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961033088:12345-0@lo:400:kworker.0 Request processed in 33us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340595.087650:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1780340595.087669:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:2.0:1780340595.087677:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961031680:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340595.087689:0:63711:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046ba2e300 x1866818961031680/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:21/0 lens 224/224 e 0 to 0 dl 1780340606 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340595.087789:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961031680:12345-0@lo:400:kworker.0 Request processed in 114us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340595.087796:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:2.0:1780340595.087808:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1780340595.087815:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961031808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.087843:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961031808:12345-0@lo:400:kworker.0 Request processed in 29us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340595.087848:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1780340595.087869:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961032448 00000100:00100000:2.0:1780340595.087873:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961032448 00000100:00100000:2.0:1780340595.087907:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961032960 00000100:00100000:2.0:1780340595.087910:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961032960 00000100:00100000:2.0:1780340595.087927:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961032320 00000100:00100000:2.0:1780340595.087930:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961032320 00000100:00100000:2.0:1780340595.087947:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961032832 00000100:00100000:2.0:1780340595.087950:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961032832 00000100:00100000:2.0:1780340595.087972:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2368 00000100:00100000:2.0:1780340595.087978:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961032448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.088007:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961032448:12345-0@lo:400:kworker.0 Request processed in 30us (1918us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340595.088013:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2368 00000100:00100000:2.0:1780340595.088031:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2369 00000100:00100000:2.0:1780340595.088037:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961032960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.088065:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961032960:12345-0@lo:400:kworker.0 Request processed in 28us (1942us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340595.088070:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2369 00000100:00100000:2.0:1780340595.088080:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2370 00000100:00100000:2.0:1780340595.088085:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961032320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.088113:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a212680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961032320:12345-0@lo:400:kworker.0 Request processed in 27us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340595.088119:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2370 00000100:00100000:2.0:1780340595.088128:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2371 00000100:00100000:2.0:1780340595.088133:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961032832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.088170:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a210a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961032832:12345-0@lo:400:kworker.0 Request processed in 37us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340595.088176:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2371 00000100:00100000:2.0:1780340595.088199:0:81812:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961031552 00000100:00100000:2.0:1780340595.088203:0:81812:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961031552 00000100:00100000:2.0:1780340595.088228:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1780340595.088235:0:81812:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046bad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961031552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.088264:0:81812:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046bad9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961031552:12345-0@lo:400:kworker.0 Request processed in 30us (2075us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340595.088270:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1780340595.088312:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961032192 00000100:00100000:2.0:1780340595.088316:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961032192 00000100:00100000:2.0:1780340595.088340:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961032704 00000100:00100000:2.0:1780340595.088343:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961032704 00000100:00100000:2.0:1780340595.088361:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3731 00000100:00100000:2.0:1780340595.088374:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961032192:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340595.088386:0:8410:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046ba2fb80 x1866818961032192/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:21/0 lens 224/224 e 0 to 0 dl 1780340606 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340595.088413:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961032192:12345-0@lo:400:kworker.0 Request processed in 41us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340595.088419:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3731 00000100:00100000:2.0:1780340595.088430:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3732 00000100:00100000:2.0:1780340595.088436:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961032704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.088462:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961032704:12345-0@lo:400:kworker.0 Request processed in 26us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340595.088467:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3732 00000100:00080000:2.0:1780340595.088491:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340595.088495:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340595.088497:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340595.088499:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780340595.088550:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961031552:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.088565:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961032064:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.088575:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471573b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961032576:0@lo:400:kworker.0 00000100:00100000:3.0:1780340595.089563:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340595.089578:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961033216:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780340595.089623:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340595.089665:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961033216 00000100:00100000:3.0:1780340595.089670:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961033216 00000100:00100000:3.0:1780340595.089701:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3733 00000100:00100000:3.0:1780340595.089708:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961033216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780340595.089735:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:3.0:1780340595.089788:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961033216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340595.089794:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3733 00000100:00100000:3.0:1780340595.089830:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961033216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340595.090368:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961033088:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.090387:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471570380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961031936:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.090398:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471570a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961032448:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.090409:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961032960:0@lo:400:kworker.0 00000100:00100000:0.0:1780340595.095840:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961031680:0@lo:400:kworker.0 00000100:00100000:0.0:1780340595.095860:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961032192:0@lo:400:kworker.0 00000100:00100000:0.0:1780340595.095871:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961032704:0@lo:400:kworker.0 00000100:00100000:0.0:1780340595.095900:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961031808:0@lo:400:kworker.0 00000100:00100000:0.0:1780340595.095910:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961032320:0@lo:400:kworker.0 00000100:00100000:0.0:1780340595.095920:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961032832:0@lo:400:kworker.0 00000100:00100000:2.0:1780340595.600059:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961033344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340595.600150:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340595.600215:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961033344 00000100:00100000:2.0:1780340595.600223:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961033344 00000100:00100000:2.0:1780340595.600270:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926 00000100:00100000:2.0:1780340595.600279:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961033344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780340595.600323:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340595.600367:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a210e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961033344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340595.600374:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926 00000100:00100000:2.0:1780340595.600422:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961033344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340595.604882:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961033600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340595.604956:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340595.605008:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780340595.605015:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961033472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340595.605041:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340595.605076:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961033472 00000100:00100000:2.0:1780340595.605084:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961033472 00000100:00100000:2.0:1780340595.605138:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3734 00000100:00100000:2.0:1780340595.605147:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818961033472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780340595.605180:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00010000:00000080:2.0:1780340595.605195:0:8411:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047a210700 x1866818961033472/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:21/0 lens 224/368 e 0 to 0 dl 1780340606 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340595.605234:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818961033472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340595.605241:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3734 00000100:00100000:2.0:1780340595.605300:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a211f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961033472:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1780340595.605518:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340595.608781:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961033600 00000100:00100000:2.0:1780340595.608796:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961033600 00000100:00100000:2.0:1780340595.608858:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927 00000100:00100000:2.0:1780340595.608868:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961033600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780340595.608901:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340595.608975:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961033600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (4018us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340595.608982:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927 00000100:00100000:2.0:1780340595.609037:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961033600:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1780340596.620939:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340597.129981:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961033728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340597.129996:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961033856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340597.130049:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340597.130137:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340597.130213:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961033856 00000100:00100000:2.0:1780340597.130221:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961033856 00000100:00100000:2.0:1780340597.130277:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961033728 00000100:00100000:2.0:1780340597.130280:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961033728 00000100:00100000:2.0:1780340597.130303:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:2.0:1780340597.130313:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961033856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340597.130342:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1780340597.130418:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340597.130433:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340597.134838:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:3.0:1780340597.134858:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034872ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961033728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340597.134891:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340597.135795:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034872ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961033728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 944us (5654us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340597.135805:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00100000:0.0:1780340597.137128:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961033728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340597.140799:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961033856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10479us (10740us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340597.140812:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000100:00100000:1.0:1780340597.141398:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961033856:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1780340597.653723:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340598.672815:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1780340599.498529:0:81806:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247814 is committed 00010000:00010000:3.0:1780340599.498551:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa246514327736fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340599.498564:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa246514327736fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340599.498571:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa246514327736fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340599.498576:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340599.498581:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa246514327736fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340599.498589:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa246514327736fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340599.498617:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04764c1a00) 00010000:00010000:3.0:1780340599.498621:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340599.498625:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa246514327736fe lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340599.498632:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa246514327736fe lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340599.498647:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773736 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340599.498654:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773736 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340599.498666:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773736 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340599.498671:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340599.498674:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773736 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340599.498680:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773736 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340599.498688:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04764c1a00) 00010000:00010000:3.0:1780340599.498691:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340599.498693:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773736 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340599.498699:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773736 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340599.689876:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340599.851807:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340599.851845:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340599.851869:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340599.851884:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340599.851905:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340599.851927:0:81810:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940389504 00000100:00100000:3.0:1780340599.851936:0:81810:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940389504 00000100:00100000:3.0:1780340599.851982:0:81810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 85 00000100:00100000:3.0:1780340599.851992:0:81810:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046badb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940389504:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340599.852055:0:81810:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046badb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940389504:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 64us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340599.852075:0:81810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 85 00000100:00100000:0.0:1780340599.852942:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940389632 00000100:00100000:0.0:1780340599.852949:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940389632 00000100:00100000:0.0:1780340599.852999:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940389760 00000100:00100000:0.0:1780340599.853003:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940389760 00000100:00100000:0.0:1780340599.853030:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1103 00000100:00100000:0.0:1780340599.853039:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940389632:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000080:0.0:1780340599.853061:0:63710:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04587a5c00 x1866818940389632/t0(0) o400->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:25/0 lens 224/224 e 0 to 0 dl 1780340610 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340599.853096:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940389632:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 59us (1299us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340599.853114:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1103 00000100:00100000:0.0:1780340599.853129:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1104 00000100:00100000:0.0:1780340599.853135:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940389760:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340599.853157:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940389760:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340599.853163:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1104 00000100:00080000:0.0:1780340599.853181:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340599.853185:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340599.853721:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940389888 00000100:00100000:1.0:1780340599.853727:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940389888 00000100:00100000:1.0:1780340599.853791:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940390016 00000100:00100000:1.0:1780340599.853794:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940390016 00000100:00100000:1.0:1780340599.853828:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2372 00000100:00100000:1.0:1780340599.853835:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a205880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940389888:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340599.853867:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a205880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940389888:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 33us (2022us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340599.853873:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2372 00000100:00100000:1.0:1780340599.853886:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2373 00000100:00100000:1.0:1780340599.853892:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a204700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940390016:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340599.853911:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a204700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940390016:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 20us (2006us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340599.853917:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2373 00000100:00080000:0.0:1780340599.854593:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340599.854607:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340600.202190:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961034368:0@lo:400:kworker.0 00000100:00100000:1.0:1780340600.202247:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340600.202274:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961034880:0@lo:400:kworker.0 00000100:00100000:1.0:1780340600.202298:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340600.202322:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961035392:0@lo:400:kworker.0 00000100:00100000:1.0:1780340600.202343:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340600.202362:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1780340600.202368:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961034240:0@lo:400:kworker.0 00000100:00100000:1.0:1780340600.202384:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340600.202394:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961034752:0@lo:400:kworker.0 00000100:00100000:1.0:1780340600.202409:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340600.202421:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961035264:0@lo:400:kworker.0 00000100:00100000:1.0:1780340600.202440:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340600.202465:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961034880 00000100:00100000:1.0:1780340600.202481:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961034880 00000100:00100000:1.0:1780340600.202523:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961035392 00000100:00100000:1.0:1780340600.202526:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961035392 00000100:00100000:1.0:1780340600.202545:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961034752 00000100:00100000:1.0:1780340600.202548:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961034752 00000100:00100000:1.0:1780340600.202563:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961035264 00000100:00100000:1.0:1780340600.202565:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961035264 00000100:00100000:1.0:1780340600.202585:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2374 00000100:00100000:2.0:1780340600.202684:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961033984:0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.202718:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340600.202743:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961034496:0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.202784:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340600.202799:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961035008:0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.202829:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340600.202846:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961035520:0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.202864:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340600.202880:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1780340600.202885:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961034112:0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.202906:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340600.202916:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961034624:0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.202934:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340600.202948:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961035136:0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.202967:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340600.202991:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961034368 00000100:00100000:2.0:1780340600.202994:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961034368 00000100:00100000:2.0:1780340600.203015:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961034240 00000100:00100000:2.0:1780340600.203017:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961034240 00000100:00100000:2.0:1780340600.203030:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961034496 00000100:00100000:2.0:1780340600.203032:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961034496 00000100:00100000:2.0:1780340600.203043:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961035008 00000100:00100000:2.0:1780340600.203046:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961035008 00000100:00100000:2.0:1780340600.203055:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961035520 00000100:00100000:2.0:1780340600.203057:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961035520 00000100:00100000:2.0:1780340600.203066:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961034112 00000100:00100000:2.0:1780340600.203068:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961034112 00000100:00100000:2.0:1780340600.203080:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:2.0:1780340600.203087:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961034368:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340600.203106:0:70100:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0444227800 x1866818961034368/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:26/0 lens 224/224 e 0 to 0 dl 1780340611 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340600.203146:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961034368:12345-0@lo:400:kworker.0 Request processed in 59us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340600.203162:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:2.0:1780340600.203180:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1780340600.203186:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961034240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.203215:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961034240:12345-0@lo:400:kworker.0 Request processed in 30us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340600.203220:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1780340600.203230:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1780340600.203234:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961034496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.203261:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a211f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961034496:12345-0@lo:400:kworker.0 Request processed in 27us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340600.203267:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1780340600.203277:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1780340600.203283:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961035008:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340600.203293:0:70100:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047a211500 x1866818961035008/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:26/0 lens 224/224 e 0 to 0 dl 1780340611 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340600.203316:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a211500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961035008:12345-0@lo:400:kworker.0 Request processed in 34us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340600.203321:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1780340600.203331:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:2.0:1780340600.203335:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961035520:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340600.203343:0:70100:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047a211c00 x1866818961035520/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:26/0 lens 224/224 e 0 to 0 dl 1780340611 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340600.203361:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a211c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961035520:12345-0@lo:400:kworker.0 Request processed in 26us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340600.203375:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:2.0:1780340600.203387:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:2.0:1780340600.203393:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961034112:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340600.203403:0:70100:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047a211180 x1866818961034112/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:26/0 lens 224/224 e 0 to 0 dl 1780340611 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340600.203424:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a211180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961034112:12345-0@lo:400:kworker.0 Request processed in 33us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340600.203429:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:2.0:1780340600.203446:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2375 00000100:00100000:2.0:1780340600.203451:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961035392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.203473:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444226d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961035392:12345-0@lo:400:kworker.0 Request processed in 22us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340600.203478:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2375 00000100:00100000:2.0:1780340600.203489:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2376 00000100:00100000:2.0:1780340600.203494:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961034752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.203519:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961034752:12345-0@lo:400:kworker.0 Request processed in 25us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340600.203524:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2376 00000100:00100000:2.0:1780340600.203535:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2377 00000100:00100000:2.0:1780340600.203540:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04777c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961035264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.203568:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04777c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961035264:12345-0@lo:400:kworker.0 Request processed in 27us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340600.203573:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2377 00000100:00100000:2.0:1780340600.203662:0:81812:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961033984 00000100:00100000:2.0:1780340600.203671:0:81812:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961033984 00000100:00100000:2.0:1780340600.203695:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1780340600.203700:0:81812:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046bad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961033984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.203725:0:81812:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046bad8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961033984:12345-0@lo:400:kworker.0 Request processed in 25us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340600.203730:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1780340600.203788:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961034624 00000100:00100000:2.0:1780340600.203792:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961034624 00000100:00100000:2.0:1780340600.203812:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961035136 00000100:00100000:2.0:1780340600.203814:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961035136 00000100:00100000:2.0:1780340600.203826:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3735 00000100:00100000:2.0:1780340600.203830:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961034624:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340600.203841:0:26074:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047a210000 x1866818961034624/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:26/0 lens 224/224 e 0 to 0 dl 1780340611 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340600.203864:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961034624:12345-0@lo:400:kworker.0 Request processed in 34us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340600.203870:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3735 00000100:00100000:2.0:1780340600.203880:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3736 00000100:00100000:2.0:1780340600.203886:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961035136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.203910:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a213480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961035136:12345-0@lo:400:kworker.0 Request processed in 25us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340600.203915:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3736 00000100:00100000:2.0:1780340600.203962:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961034240:0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.203973:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961034752:0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.203983:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961035264:0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.204003:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961034368:0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.204012:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961035392:0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.204046:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961034112:0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.204054:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961034624:0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.204061:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961035136:0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.204068:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961033984:0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.204077:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961034496:0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.204086:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961035008:0@lo:400:kworker.0 00000100:00100000:2.0:1780340600.204095:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961035520:0@lo:400:kworker.0 00000100:00100000:1.0:1780340600.204392:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961034880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340600.204436:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961034880:12345-0@lo:400:kworker.0 Request processed in 1844us (2137us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340600.204441:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2374 00000100:00100000:2.0:1780340600.204711:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961034880:0@lo:400:kworker.0 00000100:00080000:0.0:1780340600.204823:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340600.204828:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780340600.204831:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340600.204833:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340600.207428:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961035648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340600.207485:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340600.209678:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961035648 00000100:00100000:1.0:1780340600.209692:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961035648 00000100:00100000:1.0:1780340600.209744:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3737 00000100:00100000:1.0:1780340600.209753:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961035648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780340600.209795:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:1.0:1780340600.215106:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961035648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5345us (7612us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340600.215121:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3737 00000100:00100000:2.0:1780340600.215476:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961035648:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1780340600.589934:0:82914:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1780340600.699361:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340600.704388:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940390144 00000100:00100000:2.0:1780340600.704402:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940390144 00000100:00100000:2.0:1780340600.704682:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1091 00000100:00100000:2.0:1780340600.704693:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:65780:x1866818940390144:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:2.0:1780340600.704712:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340600.704732:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa2465143277374b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2279 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340600.704831:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32be00/0xa24651432773752 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340600.704845:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32be00/0xa24651432773752 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340600.704856:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32be00/0xa24651432773752 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340600.704904:0:70100:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1780340600.704908:0:70100:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780340600.704940:0:70100:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32be00/0xa24651432773752 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340600.704964:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa2465143277374b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2279 expref: 8 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340600.704981:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32be00/0xa24651432773752 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2279 expref: 7 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340600.704989:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455c3bb00) 00010000:00010000:2.0:1780340600.704992:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780340600.704996:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32be00, rc 0) 00010000:00000080:2.0:1780340600.705003:0:70100:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04587b4380 x1866818940390144/t0(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:26/0 lens 576/688 e 0 to 0 dl 1780340611 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340600.705061:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:65780:x1866818940390144:12345-192.168.203.16@tcp:101:touch.0 Request processed in 371us (5709us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340600.705068:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1091 00000100:00100000:2.0:1780340600.714411:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340600.714431:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961035776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340600.714499:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340600.714719:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340600.714729:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961035904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340600.714845:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340600.714952:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961035904 00000100:00100000:0.0:1780340600.714960:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961035904 00000100:00100000:0.0:1780340600.715005:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3738 00000100:00100000:0.0:1780340600.715013:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961035904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780340600.715045:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00010000:00000080:0.0:1780340600.715058:0:8411:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04587b4a80 x1866818961035904/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:26/0 lens 224/368 e 0 to 0 dl 1780340611 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340600.715097:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961035904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340600.715104:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3738 00010000:00010000:0.0:1780340600.715154:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340600.715183:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961035904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340600.716027:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340600.716091:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961035776 00000100:00100000:3.0:1780340600.716096:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961035776 00000100:00100000:3.0:1780340600.716131:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930 00000100:00100000:3.0:1780340600.716139:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961035776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340600.716160:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340600.716203:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a211880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961035776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340600.716209:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930 00000100:00100000:2.0:1780340600.716548:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780340600.716561:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961036032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340600.716711:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340600.716959:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940390272 00000100:00100000:0.0:1780340600.716965:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940390272 00000100:00100000:0.0:1780340600.717008:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1092 00000100:00100000:0.0:1780340600.717015:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:65780:x1866818940390272:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:0.0:1780340600.717028:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340600.717046:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4600/0xa24651432773759 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2280 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.717104:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773760 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.717133:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.717145:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.717160:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa24651432773767 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.717167:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa24651432773767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.717174:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa24651432773767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340600.717680:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961036032 00000100:00100000:3.0:1780340600.717685:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961036032 00000100:00100000:3.0:1780340600.717708:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1931 00000100:00100000:3.0:1780340600.717714:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b48ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961036032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780340600.717731:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340600.717946:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b48ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961036032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 232us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340600.717954:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1931 00000100:00100000:3.0:1780340600.718180:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961036032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340600.718209:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961035776:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1780340600.718664:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5e00/0xa2465143277376e lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.718677:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5e00/0xa2465143277376e lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.718686:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5e00/0xa2465143277376e lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340600.718720:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1780340600.718723:0:63712:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780340600.718743:0:63712:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5e00/0xa2465143277376e lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.718754:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773760 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.719308:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773760 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.719314:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773760 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.719321:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773760 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.719327:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c5c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340600.719330:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773760 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.719338:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773760 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.719349:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455c3bb00) 00010000:00010000:0.0:1780340600.719352:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340600.719357:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773760 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.719363:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773760 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.719375:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa24651432773767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.719380:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa24651432773767 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.719386:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa24651432773767 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.719394:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c5a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340600.719397:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa24651432773767 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.719402:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa24651432773767 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.719408:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff8c0443bb9d00) 00010000:00010000:0.0:1780340600.719410:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340600.719413:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa24651432773767 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.719418:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa24651432773767 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.719447:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4600/0xa24651432773759 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2280 expref: 9 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.719458:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5e00/0xa2465143277376e lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2280 expref: 8 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.719464:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff8c0443bb9b00) 00010000:00010000:0.0:1780340600.719466:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1780340600.719468:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04441c5e00, rc 0) 00010000:00000080:0.0:1780340600.719485:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c034a207b80 x1866818940390272/t0(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:26/0 lens 592/688 e 0 to 0 dl 1780340611 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340600.719547:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:65780:x1866818940390272:12345-192.168.203.16@tcp:101:touch.0 Request processed in 2532us (3524us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340600.719562:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1092 00000100:00100000:3.0:1780340600.723574:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340600.731462:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940390528 00000100:00100000:0.0:1780340600.731685:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940390528 00000100:00100000:0.0:1780340600.732384:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1093 00000100:00100000:0.0:1780340600.732401:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:65780:x1866818940390528:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:0.0:1780340600.732422:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340600.732440:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4600/0xa24651432773775 lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2287 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.732560:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa2465143277377c lrc: 3/0,1 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.732574:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa2465143277377c lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.732598:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa2465143277377c lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.732613:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773783 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.732619:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773783 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.732626:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773783 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.733989:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5600/0xa2465143277378a lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.734020:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5600/0xa2465143277378a lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.734028:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5600/0xa2465143277378a lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340600.734067:0:63710:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1780340600.734070:0:63710:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb mtime from disk: 0 -> 1780340601 00000004:00010000:0.0:1780340600.734073:0:63710:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb atime from disk: 0 -> 1780340601 00000004:00010000:0.0:1780340600.734074:0:63710:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb ctime from disk: 0 -> 1780340601 00000004:00010000:0.0:1780340600.734077:0:63710:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:0.0:1780340600.734080:0:63710:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:0.0:1780340600.734085:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa2465143277377c lrc: 4/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.734092:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa2465143277377c lrc: 4/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.734436:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa2465143277377c lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.734446:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa2465143277377c lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.734451:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c5a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340600.734455:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa2465143277377c lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.734462:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa2465143277377c lrc: 5/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.735037:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff8c0443bb9b00) 00010000:00010000:0.0:1780340600.735039:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340600.735045:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa2465143277377c lrc: 3/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.735051:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5a00/0xa2465143277377c lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340600.735069:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000042efc6ff reply state 00000000725fb94b transno 98784247815 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773783 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.735080:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773783 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.735087:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff8c0443bb9d00) 00010000:00010000:0.0:1780340600.735089:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340600.735092:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1780340600.735200:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4600/0xa24651432773775 lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2287 expref: 11 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.735220:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5600/0xa2465143277378a lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2287 expref: 10 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.735227:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff8c0443bb9a00) 00010000:00010000:0.0:1780340600.735229:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1780340600.735231:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04441c5600, rc 0) 00010000:00000080:0.0:1780340600.735366:0:63710:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c034a204380 x1866818940390528/t98784247815(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:26/0 lens 752/824 e 0 to 0 dl 1780340611 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340600.735547:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:65780:x1866818940390528:12345-192.168.203.16@tcp:101:touch.0 Request processed in 3151us (11980us total) trans 98784247815 rc 0/0 00000100:00100000:0.0:1780340600.739180:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1093 00000100:00100000:0.0:1780340600.750564:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340600.750616:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940390784 00000100:00100000:0.0:1780340600.750625:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940390784 00000100:00100000:0.0:1780340600.750678:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1094 00000100:00100000:0.0:1780340600.750688:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:65780:x1866818940390784:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:0.0:1780340600.750824:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa24651432773798 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.750841:0:70100:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5600/0xa2465143277378a lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2287 expref: 11 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.750850:0:70100:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa24651432773798 lrc: 4/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.750889:0:70100:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5600/0xa2465143277378a lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2287 expref: 11 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340600.750903:0:70100:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5600/0xa2465143277378a lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2287 expref: 11 pid: 63710 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340600.750917:0:70100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:70100:1866818961036160:192.168.203.16@tcp:104: 00000100:00100000:0.0:1780340600.750989:0:70100:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c03483c06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340600.767752:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340600.767835:0:70100:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:70100:1866818961036160:192.168.203.16@tcp:104: 00010000:00010000:1.0:1780340600.767861:0:70100:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa24651432773798 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340600.768058:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940390912 00000100:00100000:1.0:1780340600.768064:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940390912 00010000:00010000:1.0:1780340600.768096:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5600/0xa2465143277378a lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2287 expref: 12 pid: 63710 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340600.768146:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2539 00000100:00100000:1.0:1780340600.768155:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:2408:x1866818940390912:12345-192.168.203.16@tcp:102:ldlm_bl.0 00010000:00010000:1.0:1780340600.768171:0:6501:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5600/0xa2465143277378a lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2287 expref: 12 pid: 63710 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340600.768181:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5600/0xa2465143277378a lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2287 expref: 12 pid: 63710 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340600.768191:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5600/0xa2465143277378a lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2287 expref: 12 pid: 63710 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340600.768198:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff8c0443bb9a00) 00010000:00010000:1.0:1780340600.768201:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1780340600.768204:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa24651432773798 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340600.768212:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa24651432773798 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340600.768217:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa24651432773798 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340600.768250:0:6501:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5600/0xa2465143277378a lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2287 expref: 12 pid: 63710 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340600.768302:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:2408:x1866818940390912:12345-192.168.203.16@tcp:102:ldlm_bl.0 Request processed in 148us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340600.768318:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2539 00010000:00010000:1.0:1780340600.768700:0:70100:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa24651432773798 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340600.768708:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa24651432773798 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340600.769037:0:70100:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1780340600.769042:0:70100:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb mtime from disk: 1780340601 -> 1780340601 00000004:00010000:1.0:1780340600.769044:0:70100:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb atime from disk: 1780340601 -> 1780340601 00000004:00010000:1.0:1780340600.769046:0:70100:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb ctime from disk: 1780340601 -> 1780340601 00000004:00010000:1.0:1780340600.769048:0:70100:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:1.0:1780340600.769054:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003b9106af reply state 00000000bf6b3740 transno 98784247816 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa24651432773798 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340600.769067:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa24651432773798 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340600.769074:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff8c0443bb9a00) 00010000:00010000:1.0:1780340600.769076:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340600.769079:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:1.0:1780340600.769136:0:70100:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04587b4700 x1866818940390784/t98784247816(0) o36->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:26/0 lens 488/456 e 0 to 0 dl 1780340611 ref 1 fl Interpret:/200/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340600.769180:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:65780:x1866818940390784:12345-192.168.203.16@tcp:36:touch.0 Request processed in 18495us (18625us total) trans 98784247816 rc 0/0 00000100:00100000:1.0:1780340600.769187:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1094 00000100:00100000:2.0:1780340600.782112:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340600.782148:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940391168 00000100:00100000:2.0:1780340600.782158:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940391168 00000100:00100000:2.0:1780340600.782205:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 220 00000100:00100000:2.0:1780340600.782215:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:65780:x1866818940391168:12345-192.168.203.16@tcp:35:touch.0 00010000:00000080:2.0:1780340600.782391:0:77826:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047a212a00 x1866818940391168/t98784247817(0) o35->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:26/0 lens 392/456 e 0 to 0 dl 1780340611 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340600.782447:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+14:65780:x1866818940391168:12345-192.168.203.16@tcp:35:touch.0 Request processed in 234us (343us total) trans 98784247817 rc 0/0 00000100:00100000:2.0:1780340600.782456:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 220 00010000:00010000:2.0:1780340601.738106:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340602.250006:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a204a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961036416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340602.250077:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340602.250126:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961036288:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340602.250168:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340602.250391:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961036416 00000100:00100000:3.0:1780340602.250400:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961036416 00000100:00100000:3.0:1780340602.250472:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961036288 00000100:00100000:3.0:1780340602.250476:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961036288 00000100:00100000:3.0:1780340602.250502:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932 00000100:00100000:3.0:1780340602.250519:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961036416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340602.250549:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340602.250604:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961036416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340602.250612:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932 00000100:00100000:3.0:1780340602.250628:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:3.0:1780340602.250635:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961036288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340602.250650:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340602.250678:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961036288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340602.250684:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00000100:00080000:0.0:1780340602.251003:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340602.251007:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340602.251042:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a204a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961036416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340602.251056:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961036288:0@lo:13:osp-pre-1-1.0 00000020:01000004:3.0:1780340602.637038:0:83012:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1780340602.637082:0:83012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440031c00/0xa2465143277331c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773323 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.637093:0:83012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440031c00/0xa2465143277331c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773323 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.637099:0:83012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440031c00/0xa2465143277331c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773323 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.637104:0:83012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c0440031c00/0xa2465143277331c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773323 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.637118:0:83012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1780340602.637121:0:83012:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1780340602.637145:0:83012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1780340602.637148:0:83012:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1780340602.637159:0:83012:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1780340602.637181:0:83012:0:(import.c:65:import_set_state_nolock()) ffff8c0349150000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1780340602.637369:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340602.637377:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0440031c00/0xa2465143277331c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773323 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.637405:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031c00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340602.637410:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0440031c00/0xa2465143277331c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773323 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.637419:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0440031c00/0xa2465143277331c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432773323 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340602.637426:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0440031c00/0xa2465143277331c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432773323 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340602.637432:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1780340602.637435:0:7442:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1780340602.637437:0:7442:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1780340602.637461:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0440031c00/0xa2465143277331c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773323 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.637469:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340602.637509:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0440031c00/0xa2465143277331c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773323 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.637517:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0440031c00/0xa2465143277331c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773323 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.637530:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340602.637532:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340602.637535:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340602.637553:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961036544:0@lo:39:umount.0 00000100:00100000:2.0:1780340602.637554:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961036672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340602.637840:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340602.637845:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340602.637963:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961036544 00000100:00100000:1.0:1780340602.637977:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961036544 00000100:00100000:1.0:1780340602.638027:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1780340602.638037:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1866818961036544:12345-0@lo:39:umount.0 00000020:00000080:1.0:1780340602.638061:0:63712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277342d 00000100:00080000:1.0:1780340602.638075:0:63712:0:(import.c:65:import_set_state_nolock()) ffff8c04530a7800 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1780340602.638104:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04529d6300 x1866818961036544/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:28/0 lens 224/224 e 0 to 0 dl 1780340613 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340602.638150:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3658:x1866818961036544:12345-0@lo:39:umount.0 Request processed in 115us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340602.638157:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000020:00000080:1.0:1780340602.638167:0:63712:0:(genops.c:906:class_export_put()) final put ffff8c04506d1800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1780340602.638212:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1780340602.638220:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04506d1800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1780340602.638262:0:49688:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c04530a7800 for lustre-MDT0000 00000100:00100000:3.0:1780340602.638292:0:25499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961036672 00000100:00080000:1.0:1780340602.638295:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0349150000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1780340602.638298:0:25499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961036672 00000100:00100000:1.0:1780340602.638308:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961036544:0@lo:39:umount.0 00000100:00100000:3.0:1780340602.638432:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1780340602.638440:0:25499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961036672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340602.638450:0:25499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340602.638464:0:25499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0440031400/0xa24651432773323 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2465143277331c expref: 23 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.638476:0:25499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340602.638514:0:25499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a210380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3659:x1866818961036672:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340602.638521:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00080000:3.0:1780340602.638543:0:83012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1780340602.638545:0:83012:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1780340602.638550:0:83012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1780340602.638636:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961036672:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340602.639624:0:83012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476762e00/0xa2465143277323c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773243 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.639640:0:83012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476762e00/0xa2465143277323c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773243 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.639648:0:83012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476762e00/0xa2465143277323c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773243 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.639655:0:83012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c0476762e00/0xa2465143277323c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773243 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.639694:0:83012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340602.639700:0:83012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa2465143277335b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773362 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.639706:0:83012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa2465143277335b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773362 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.639712:0:83012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa2465143277335b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773362 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.639718:0:83012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa2465143277335b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773362 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.639740:0:83012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780340602.639747:0:83012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa2465143277330e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773315 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.639754:0:83012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa2465143277330e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773315 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.639786:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780340602.639793:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0476762e00/0xa2465143277323c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773243 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.639795:0:83012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa2465143277330e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773315 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.639812:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762e00 already unused, calling callback (ffffffffc129ac20) 00010000:00010000:3.0:1780340602.639813:0:83012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa2465143277330e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773315 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340602.639819:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0476762e00/0xa2465143277323c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773243 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.639830:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0476762e00/0xa2465143277323c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432773243 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.639837:0:83012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:00010000:1.0:1780340602.639837:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0476762e00/0xa2465143277323c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432773243 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.639843:0:83012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa24651432773227 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773235 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340602.639858:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780340602.639860:0:83012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa24651432773227 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773235 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340602.639863:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1780340602.639866:0:83012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa24651432773227 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773235 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.639869:0:83012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa24651432773227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773235 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340602.639880:0:83012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1780340602.639883:0:83012:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1780340602.639886:0:83012:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1780340602.639900:0:6504:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0476762e00/0xa2465143277323c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773243 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.639908:0:6504:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:3.0:1780340602.639914:0:83012:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1780340602.639918:0:83012:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1780340602.639921:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1780340602.639925:0:83012:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1780340602.639930:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0476762e00/0xa2465143277323c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773243 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.639939:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0476762e00/0xa2465143277323c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773243 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.639953:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1780340602.639956:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa2465143277335b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773362 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.639962:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762800 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340602.639965:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa2465143277335b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773362 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.639972:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa2465143277335b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432773362 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340602.639974:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340602.639982:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa2465143277330e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773315 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340602.639982:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa2465143277335b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432773362 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340602.640001:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340602.640003:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7200 already unused, calling callback (ffffffffc129ac20) 10000000:01000000:1.0:1780340602.640004:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1780340602.640008:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:00010000:2.0:1780340602.640009:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa2465143277330e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773315 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.640020:0:6504:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa2465143277335b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773362 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340602.640025:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa2465143277330e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432773315 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340602.640043:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa2465143277330e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432773315 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.640043:0:6504:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:2.0:1780340602.640053:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1780340602.640055:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1780340602.640058:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1780340602.640063:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa2465143277335b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773362 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.640071:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0476762800/0xa2465143277335b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773362 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340602.640079:0:6505:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa2465143277330e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773315 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.640082:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340602.640088:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa24651432773227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773235 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340602.640091:0:6505:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780340602.640092:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340602.640098:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031800 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340602.640102:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa24651432773227 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773235 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340602.640104:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa2465143277330e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773315 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.640116:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa24651432773227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432773235 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340602.640124:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa24651432773227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432773235 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340602.640129:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1780340602.640131:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1780340602.640133:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1780340602.640135:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa2465143277330e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773315 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.640145:0:6504:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa24651432773227 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773235 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340602.640149:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340602.640152:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340602.640154:0:6504:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780340602.640155:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340602.640161:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa24651432773227 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773235 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.640177:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa24651432773227 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773235 expref: -99 pid: 81805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.640199:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340602.640201:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340602.640203:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340602.640219:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961036800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340602.640270:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340602.640317:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780340602.640324:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961037184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780340602.640329:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961036800 00000100:00100000:0.0:1780340602.640337:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961036800 00000100:00100000:1.0:1780340602.640349:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340602.640385:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961037184 00000100:00100000:0.0:1780340602.640389:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961037184 00000100:00100000:1.0:1780340602.640391:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961036928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780340602.640418:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:1.0:1780340602.640424:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340602.640432:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961036800:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340602.640444:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1780340602.640445:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1780340602.640453:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961037056:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780340602.640461:0:25498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5a00/0xa24651432773243 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2465143277323c expref: 23 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340602.640477:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340602.640481:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340602.640522:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3660:x1866818961036800:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340602.640529:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:0.0:1780340602.640542:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961036928 00000100:00100000:0.0:1780340602.640545:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961036928 00000100:00100000:0.0:1780340602.640564:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961037056 00000100:00100000:0.0:1780340602.640566:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961037056 00000100:00100000:0.0:1780340602.640592:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1780340602.640598:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961037184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780340602.640605:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340602.640612:0:25498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0440031600/0xa24651432773235 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773227 expref: 23 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340602.640627:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340602.640651:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3660:x1866818961037184:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340602.640657:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1780340602.640670:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1780340602.640676:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04757d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:3661:x1866818961036928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780340602.640695:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340602.640704:0:25498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5400/0xa24651432773362 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2465143277335b expref: 21 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340602.640713:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340602.640745:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04757d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3661:x1866818961036928:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340602.640752:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1780340602.640846:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961036928:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340602.640896:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1780340602.640906:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:3661:x1866818961037056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340602.640917:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340602.640929:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04754c6e00/0xa24651432773315 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2465143277330e expref: 19 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.640938:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340602.640971:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:3661:x1866818961037056:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340602.640984:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:1.0:1780340602.641022:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961037184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340602.641030:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961036800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340602.641044:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340602.641328:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961037056:0@lo:103:ldlm_bl.0 00000004:00000080:3.0:1780340602.641622:0:83012:0:(mdt_handler.c:8186:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:0.0:1780340602.642885:0:81806:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247817 is committed 00010000:00010000:1.0:1780340602.642923:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773783 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.642935:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773783 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.642942:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773783 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.642949:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c5c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340602.642954:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773783 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.642961:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773783 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.642980:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff8c0443bb9d00) 00010000:00010000:1.0:1780340602.642984:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340602.642989:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773783 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.642995:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5c00/0xa24651432773783 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.643020:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa24651432773798 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.643032:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa24651432773798 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.643038:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa24651432773798 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.643043:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c4c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340602.643046:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa24651432773798 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.643052:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa24651432773798 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.643060:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff8c0443bb9a00) 00010000:00010000:1.0:1780340602.643063:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340602.643066:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa24651432773798 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.643072:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4c00/0xa24651432773798 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1780340602.643159:0:83012:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1780340602.643167:0:83012:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c04480af000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780340602.643172:0:83012:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c044d43c000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780340602.643176:0:83012:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c044d43a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780340602.643180:0:83012:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c046ba21000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780340602.643186:0:83012:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c046ba24000 e06e5cf1-1986-4ba7-9630-fad7efb74eca 192.168.203.16@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 98784247817 stale:0 00000020:00080000:2.0:1780340602.643197:0:83012:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff8c03490019c0) has exports, disconnecting them 00000020:00080000:2.0:1780340602.643201:0:83012:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c04480af000), last request at 1780340569 00000020:00000080:2.0:1780340602.643207:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773434 00000100:00080000:2.0:1780340602.643214:0:83012:0:(import.c:65:import_set_state_nolock()) ffff8c04480ab800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780340602.643242:0:83012:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c04480af000): rc 0 00000020:00000080:2.0:1780340602.643244:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c04480af000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1780340602.643262:0:83012:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c044d43c000), last request at 1780340600 00000020:00000080:2.0:1780340602.643266:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773426 00000100:00080000:2.0:1780340602.643270:0:83012:0:(import.c:65:import_set_state_nolock()) ffff8c044d43b000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780340602.643288:0:83012:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c044d43c000): rc 0 00000020:00000080:2.0:1780340602.643291:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c044d43c000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1780340602.643294:0:83012:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c044d43a800), last request at 1780340600 00000020:00000080:2.0:1780340602.643297:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277341f 00000100:00080000:2.0:1780340602.643303:0:83012:0:(import.c:65:import_set_state_nolock()) ffff8c044d43d000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1780340602.643319:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1780340602.643326:0:83012:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c044d43a800): rc 0 00000020:00000080:2.0:1780340602.643328:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c044d43a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1780340602.643332:0:83012:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c046ba21000), last request at 1780340564 00000020:00000080:2.0:1780340602.643340:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773290 00000100:00080000:2.0:1780340602.643349:0:83012:0:(import.c:65:import_set_state_nolock()) ffff8c0458286000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780340602.643384:0:83012:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c046ba21000): rc 0 00000020:00000080:2.0:1780340602.643386:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c046ba21000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:2.0:1780340602.643391:0:83012:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.16@tcp (ffff8c046ba24000), last request at 1780340600 00000020:00000080:2.0:1780340602.643395:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773289 00010000:00010000:0.0:1780340602.643400:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00010000:2.0:1780340602.643402:0:83012:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c046ba24000: total 4 00000100:00080000:2.0:1780340602.643406:0:83012:0:(import.c:65:import_set_state_nolock()) ffff8c034a94d800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780340602.643427:0:83012:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.16@tcp (ffff8c046ba24000): rc 0 00000004:00000080:2.0:1780340602.643433:0:83012:0:(mdd_device.c:2374:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff992741cfbae0 00000020:00010000:0.0:1780340602.643461:0:7442:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c046ba24000: total 4 00000100:00080000:2.0:1780340602.643470:0:83012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1780340602.643474:0:83012:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1780340602.643506:0:7442:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c046ba24000, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1780340602.643534:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5600/0xa2465143277378a lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2287 expref: 4 pid: 63710 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340602.643557:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32be00/0xa24651432773752 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2279 expref: 3 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340602.643589:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c5e00/0xa2465143277376e lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2280 expref: 2 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340602.643615:0:7442:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c046ba24000, canceled 3 locks, left on hash table 0. 00000100:00080000:2.0:1780340602.645549:0:83012:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1780340602.645589:0:83012:0:(import.c:65:import_set_state_nolock()) ffff8c047b436000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1780340602.646517:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340602.646537:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961037312:0@lo:39:umount.0 00000100:00100000:1.0:1780340602.646632:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340602.646685:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961037312 00000100:00100000:1.0:1780340602.646692:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961037312 00000100:00100000:1.0:1780340602.646733:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3739 00000100:00100000:1.0:1780340602.646740:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818961037312:12345-0@lo:39:umount.0 00000020:00000080:1.0:1780340602.646780:0:22660:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327732cf 00000100:00080000:1.0:1780340602.646799:0:22660:0:(import.c:65:import_set_state_nolock()) ffff8c045310e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1780340602.646817:0:22660:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378731 00000020:00000080:3.0:1780340602.646916:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04480af000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00100000:1.0:1780340602.646957:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3658:x1866818961037312:12345-0@lo:39:umount.0 Request processed in 215us (325us total) trans 81604378732 rc 0/0 00000100:00100000:1.0:1780340602.646965:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3739 00000020:00000080:3.0:1780340602.646967:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c044d43c000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1780340602.646993:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1780340602.646996:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c044d43a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1780340602.647018:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046ba21000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000100:00080000:1.0:1780340602.647020:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c047b436000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1780340602.647027:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961037312:0@lo:39:umount.0 00000020:00000080:3.0:1780340602.647039:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c04480ab800 for lustre-MDT0000 00010000:00010000:1.0:1780340602.647039:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1780340602.647046:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c044d43b000 for lustre-MDT0000 00000020:00000080:3.0:1780340602.647050:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c044d43d000 for lustre-MDT0000 00000020:00000080:3.0:1780340602.647052:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0458286000 for lustre-MDT0000 00000100:00080000:2.0:1780340602.651875:0:83012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1780340602.651882:0:83012:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 3 00000004:00080000:2.0:1780340602.651900:0:83012:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:2.0:1780340602.651972:0:83012:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1780340602.651998:0:83012:0:(import.c:65:import_set_state_nolock()) ffff8c047a289800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1780340602.652017:0:83012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1780340602.652020:0:83012:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 3 00000004:00080000:2.0:1780340602.652034:0:83012:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:2.0:1780340602.652095:0:83012:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1780340602.652101:0:83012:0:(import.c:65:import_set_state_nolock()) ffff8c0452443000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1780340602.652140:0:83012:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8c03490019c0) has no exports 00000100:00100000:1.0:1780340602.652386:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961037440:0@lo:9:umount.0 00000100:00100000:1.0:1780340602.652447:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340602.652486:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961037568:0@lo:9:umount.0 00000100:00100000:1.0:1780340602.652512:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340602.652560:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961037440 00000100:00100000:1.0:1780340602.652567:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961037440 00000100:00100000:3.0:1780340602.652614:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961037568 00000100:00100000:3.0:1780340602.652620:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961037568 00000100:00100000:1.0:1780340602.652629:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5866 00000100:00100000:1.0:1780340602.652639:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818961037440:12345-0@lo:9:umount.0 00000100:00100000:3.0:1780340602.652662:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5867 00000020:00000080:1.0:1780340602.652662:0:25496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327732eb 00000100:00080000:1.0:1780340602.652670:0:25496:0:(import.c:65:import_set_state_nolock()) ffff8c04858fa000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1780340602.652673:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818961037568:12345-0@lo:9:umount.0 00000001:00000004:1.0:1780340602.652708:0:25496:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969449 00000020:00000080:3.0:1780340602.652713:0:25488:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327732f9 00000100:00080000:3.0:1780340602.652719:0:25488:0:(import.c:65:import_set_state_nolock()) ffff8c04858fb800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1780340602.652861:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+2:3658:x1866818961037440:12345-0@lo:9:umount.0 Request processed in 224us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340602.652869:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5866 00000100:00080000:1.0:1780340602.652887:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340602.652893:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1780340602.652902:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1780340602.652924:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c047a289800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1780340602.652943:0:3658:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:1.0:1780340602.652945:0:3658:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:1.0:1780340602.652949:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961037440:0@lo:9:umount.0 00000001:00000004:3.0:1780340602.652968:0:25488:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969449 00000100:00100000:3.0:1780340602.653077:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2:3658:x1866818961037568:12345-0@lo:9:umount.0 Request processed in 406us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340602.653084:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5867 00010000:00010000:3.0:1780340602.653108:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1780340602.653159:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0452443000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1780340602.653175:0:3658:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:1.0:1780340602.653177:0:3658:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:1.0:1780340602.653180:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961037568:0@lo:9:umount.0 00000020:00080000:2.0:1780340602.653479:0:83012:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8c03490019c0) has no exports 00000020:00000080:0.0:1780340602.708561:0:7442:0:(genops.c:906:class_export_put()) final put ffff8c046ba24000/e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000020:00000080:3.0:1780340602.710347:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046ba24000/e06e5cf1-1986-4ba7-9630-fad7efb74eca for lustre-MDT0000 00000020:00000080:3.0:1780340602.710429:0:49688:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c034a94d800 for lustre-MDT0000 00010000:00010000:1.0:1780340602.711729:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340602.711736:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340602.711739:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1780340602.738506:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327732a5 00000020:00000080:2.0:1780340602.738520:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c047651b800/lustre-QMT0000_UUID 00000020:01000000:2.0:1780340602.738544:0:83012:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1780340602.738737:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1780340602.738749:0:83012:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1780340602.738754:0:83012:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff8c03482b3380) has no exports 00000020:00000080:3.0:1780340602.739117:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277329e 00000020:00000080:3.0:1780340602.739123:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c047a95c000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1780340602.739173:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1780340602.739180:0:83012:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1780340602.739228:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047651b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1780340602.739234:0:71335:0:(genops.c:906:class_export_put()) final put ffff8c0476518800/lustre-QMT0000_UUID 00000020:00000080:0.0:1780340602.739236:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0476518800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1780340602.739243:0:71335:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1780340602.739357:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047a95c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1780340602.740451:0:83012:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c04612d0960 - data ffff8c0471b621b0/ffff8c0476322800 00000020:01000000:3.0:1780340602.741513:0:83012:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c047a94d0c0 - data ffff8c044d184948/ffff8c0476479000 00010000:00010000:2.0:1780340602.762661:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1780340602.841186:0:83012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1780340602.841195:0:83012:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1780340602.841210:0:83012:0:(client.c:3140:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8c047a210e00 x1866818961037312/t81604378732(81604378732) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340612 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340602.841238:0:83012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1780340602.842598:0:83012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1780340602.842603:0:83012:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 4 00000004:00080000:0.0:1780340602.842623:0:83012:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:0.0:1780340602.842626:0:83012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1780340602.843061:0:81824:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1780340602.843066:0:81824:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x5c:0x0] index 1 count 1 00000040:00080000:1.0:1780340602.843076:0:81824:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 23 count 2 00000100:00080000:0.0:1780340602.846106:0:83012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1780340602.846112:0:83012:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 4 00000004:00080000:0.0:1780340602.846133:0:83012:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:0.0:1780340602.846135:0:83012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1780340602.846353:0:81826:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1780340602.846357:0:81826:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 1 count 1 00000040:00080000:0.0:1780340602.846367:0:81826:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 23 count 2 00000020:00000080:0.0:1780340602.848263:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773258 00000020:00000080:0.0:1780340602.848274:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c034a39e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780340602.848325:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c034a39e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780340602.849418:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277326d 00000020:00000080:0.0:1780340602.849428:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c046ba23800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1780340602.849513:0:83012:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1780340602.849528:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780340602.849537:0:83012:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1780340602.849541:0:83012:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8c0349003380) has no exports 00000004:01000000:0.0:1780340602.849710:0:83012:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1780340602.849719:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327732f2 00000020:00000080:0.0:1780340602.849723:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c046b9ad000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780340602.850509:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046ba23800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1780340602.850600:0:83012:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1780340602.850608:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780340602.850615:0:83012:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1780340602.850618:0:83012:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8c0471d54d40) has no exports 00000020:00000080:0.0:1780340602.850626:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327732e4 00000020:00000080:0.0:1780340602.850630:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c0442c0b800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780340602.850808:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b9ad000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1780340602.850814:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0442c0b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1780340602.851280:0:83012:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1780340602.851284:0:83012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1780340602.851288:0:83012:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 5 00000004:00080000:0.0:1780340602.851293:0:83012:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:0.0:1780340602.851295:0:83012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1780340602.851335:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0452443000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1780340602.851412:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340602.851421:0:83012:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340602.851424:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c047b1fb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340602.851427:0:83012:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047b1fb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1780340602.851432:0:83012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340602.851592:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327732d6 00000020:00000080:0.0:1780340602.851598:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c047b1fd000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1780340602.851608:0:83012:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1780340602.851612:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780340602.851617:0:83012:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1780340602.851619:0:83012:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8c0445ba0000) has no exports 00000020:00000080:0.0:1780340602.851628:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327732c8 00000020:00000080:1.0:1780340602.851631:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047b1fd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1780340602.851632:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c047a0a0800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780340602.851735:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047a0a0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1780340602.852413:0:83012:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1780340602.852417:0:83012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1780340602.852429:0:83012:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 5 00000004:00080000:0.0:1780340602.852434:0:83012:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:0.0:1780340602.852502:0:83012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1780340602.852593:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340602.852599:0:83012:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1780340602.852613:0:83012:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1780340602.852618:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327732ba 00000020:00000080:0.0:1780340602.852627:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c047b1f8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780340602.852658:0:49688:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047a289800 for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1780340602.852660:0:83012:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1780340602.852664:0:49688:0:(genops.c:906:class_export_put()) final put ffff8c047b1fc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340602.852664:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780340602.852666:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047b1fc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1780340602.852667:0:83012:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1780340602.852670:0:83012:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8c03482b0000) has no exports 00000020:01000000:2.0:1780340602.852674:0:49688:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340602.852675:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327732b3 00000020:00000080:0.0:1780340602.852678:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c045f0c6000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1780340602.852741:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047b1f8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1780340602.852746:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045f0c6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1780340602.854903:0:83012:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1780340602.854910:0:83012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1780340602.854914:0:83012:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1780340602.854920:0:83012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1780340602.854968:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340602.854979:0:83012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780340602.855004:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780340602.855030:0:49688:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047b436000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1780340602.855040:0:49688:0:(genops.c:906:class_export_put()) final put ffff8c047a0a2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780340602.855043:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047a0a2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1780340602.855059:0:49688:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780340602.855133:0:83012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780340602.855137:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c045f0c3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780340602.855145:0:83012:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045f0c3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1780340602.855150:0:83012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780340602.855231:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773274 00000020:00000080:1.0:1780340602.855237:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c046ba27000/lustre-MDD0000_UUID 00000020:01000000:1.0:1780340602.855247:0:83012:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1780340602.855261:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340602.855266:0:83012:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1780340602.855269:0:83012:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8c0349004d40) has no exports 00000020:00000080:1.0:1780340602.855286:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340602.855290:0:83012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1780340602.855293:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277327b 00000020:00000080:1.0:1780340602.855297:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c046ba26000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1780340602.855310:0:83012:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0475faf800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1780340602.855313:0:83012:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c0475faf800 3 00000020:01000004:1.0:1780340602.855316:0:83012:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c0475faf800 from lustre-MDT0000 00000020:00000080:1.0:1780340602.855331:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340602.855334:0:83012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1780340602.855336:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c034a399800/lustre-MDT0000_UUID 00000020:00000080:1.0:1780340602.855338:0:83012:0:(genops.c:865:class_export_destroy()) destroying export ffff8c034a399800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1780340602.855344:0:83012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1780340602.855376:0:83012:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1780340602.855379:0:83012:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1780340602.855382:0:83012:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1780340602.855385:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340602.855388:0:83012:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1780340602.855393:0:83012:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8c0346fd7000 f26f7947-2bb0-4491-8dd4-005fa8e64f3a 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780340602.855401:0:83012:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8c045f0c2000 ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4 192.168.203.16@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780340602.855404:0:83012:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8c0349000000) has exports, disconnecting them 00000020:00080000:1.0:1780340602.855408:0:83012:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8c0346fd7000), last request at 1780340563 00000020:00000080:1.0:1780340602.855424:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773220 00000020:00010000:1.0:1780340602.855429:0:83012:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c0346fd7000: total 2 00000100:00080000:1.0:1780340602.855438:0:83012:0:(import.c:65:import_set_state_nolock()) ffff8c0346fd0800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780340602.855448:0:83012:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0346fd7000): rc 0 00000020:00080000:1.0:1780340602.855452:0:83012:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.16@tcp (ffff8c045f0c2000), last request at 1780340562 00000020:00010000:1.0:1780340602.855490:0:6504:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c0346fd7000: total 2 00010000:00010000:1.0:1780340602.855515:0:6504:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c0346fd7000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1780340602.855544:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04754c7600/0xa246514327733a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327733a1 expref: 14 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.855559:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0440031000/0xa246514327733b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327733af expref: 13 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.855571:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c045ec6d200/0xa246514327733c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327733bd expref: 12 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.855595:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0476762400/0xa246514327733d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327733cb expref: 11 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.855606:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5e00/0xa246514327733e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327733d9 expref: 10 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.855618:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa4200/0xa246514327733fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327733f5 expref: 9 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.855627:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5800/0xa24651432773370 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773369 expref: 8 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.855637:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0476763a00/0xa246514327733ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327733e7 expref: 7 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.855648:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04754c7800/0xa2465143277337e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773377 expref: 6 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.855673:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0440030800/0xa2465143277338c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773385 expref: 5 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.855684:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0476763000/0xa2465143277340a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773403 expref: 4 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.855696:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04754c7400/0xa2465143277339a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773393 expref: 3 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.855707:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0476762a00/0xa24651432773418 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773411 expref: 2 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.855715:0:6504:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c0346fd7000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1780340602.855734:0:6504:0:(genops.c:906:class_export_put()) final put ffff8c0346fd7000/f26f7947-2bb0-4491-8dd4-005fa8e64f3a 00010000:00010000:1.0:1780340602.855744:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340602.855747:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340602.855748:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1780340602.856650:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046ba27000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1780340602.856657:0:49688:0:(genops.c:906:class_export_put()) final put ffff8c047a28d800/lustre-MDD0000_UUID 00000020:00000080:2.0:1780340602.856659:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047a28d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1780340602.856667:0:49688:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1780340602.856706:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046ba26000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1780340602.856711:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0346fd7000/f26f7947-2bb0-4491-8dd4-005fa8e64f3a for MGS 00000020:00000080:2.0:1780340602.856738:0:49688:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0346fd0800 for MGS 00000020:00000080:1.0:1780340602.860873:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773219 00000020:00010000:1.0:1780340602.860887:0:83012:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c045f0c2000: total 0 00000100:00080000:1.0:1780340602.860892:0:83012:0:(import.c:65:import_set_state_nolock()) ffff8c045f0c6800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780340602.860915:0:83012:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.16@tcp (ffff8c045f0c2000): rc 0 00000020:00080000:1.0:1780340602.860922:0:83012:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8c0349000000) has no exports 00000020:00010000:1.0:1780340602.860939:0:23160:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c045f0c2000: total 0 00010000:00010000:1.0:1780340602.861005:0:23160:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c045f0c2000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1780340602.861036:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0476763400/0xa2465143277334d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2233 expref: 5 pid: 81811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.861059:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa4000/0xa2465143277333f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2225 expref: 4 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.861095:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0476763200/0xa24651432773346 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced222c expref: 3 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.861105:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04754c6600/0xa24651432773354 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced223a expref: 2 pid: 81810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340602.861115:0:23160:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c045f0c2000, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1780340602.861131:0:23160:0:(genops.c:906:class_export_put()) final put ffff8c045f0c2000/ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4 00010000:00010000:1.0:1780340602.861156:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340602.861158:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340602.861160:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1780340602.861279:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045f0c2000/ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4 for MGS 00000020:00000080:2.0:1780340602.861315:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c045f0c6800 for MGS 00000100:00100000:2.0:1780340602.861346:0:81812:0:(service.c:3186:ptlrpc_main()) ll_mgs_0002: service thread [ffff8c0472287600:81812] 2 exiting: rc = 0 00000100:00100000:2.0:1780340602.861432:0:81811:0:(service.c:3186:ptlrpc_main()) ll_mgs_0001: service thread [ffff8c0472286200:81811] 1 exiting: rc = 0 00000100:00100000:3.0:1780340602.861603:0:81810:0:(service.c:3186:ptlrpc_main()) ll_mgs_0000: service thread [ffff8c0472286e00:81810] 0 exiting: rc = 1 00000100:00100000:3.0:1780340602.861663:0:81817:0:(service.c:3186:ptlrpc_main()) ll_mgs_0003: service thread [ffff8c047575e400:81817] 3 exiting: rc = 0 00000100:00100000:1.0:1780340602.861873:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861880:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861886:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861892:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861898:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861904:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861910:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861915:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861921:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861926:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861932:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861937:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861943:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861948:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861953:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861959:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861964:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861969:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861975:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861980:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861994:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.861999:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862004:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862010:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862015:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862021:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862026:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862031:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862036:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862041:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862046:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862051:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862057:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862063:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862068:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862073:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862078:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862083:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862088:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862093:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862098:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862104:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862110:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862116:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862120:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862125:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862130:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862135:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862141:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862145:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862150:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862155:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862160:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862165:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862171:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862187:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862193:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862198:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862202:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862207:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862212:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862218:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862223:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340602.862229:0:83012:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1780340602.865994:0:83012:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c034776f360 - data ffff8c044d100e58/ffff8c0443ad7c00 00000020:01000000:1.0:1780340602.866113:0:83012:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c044418b7e0 - data ffff8c044d053360/ffff8c034aa98c00 00000020:00000080:1.0:1780340602.866532:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773212 00000020:00000080:1.0:1780340602.866540:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c0475faa800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780340602.866554:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0475faa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1780340602.866563:0:83012:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0475faf800 from MGS, refs=2 00000020:01000004:1.0:1780340602.866566:0:83012:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c0475faf800 2 00000020:01000004:1.0:1780340602.866569:0:83012:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c0475faf800 from MGS 00000020:00000080:1.0:1780340602.866600:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340602.866607:0:83012:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1780340602.866609:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c046bf8b800/MGS 00000020:00000080:1.0:1780340602.866611:0:83012:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046bf8b800/MGS for MGS 00000020:01000000:1.0:1780340602.866617:0:83012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1780340602.866690:0:83012:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1780340602.866695:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340602.866701:0:83012:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1780340602.866707:0:83012:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8c0346bbf000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780340602.866712:0:83012:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff8c0471d519c0) has exports, disconnecting them 00000020:00080000:1.0:1780340602.866717:0:83012:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8c0346bbf000), last request at 1780340564 00000020:00000080:1.0:1780340602.866721:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773331 00000020:00080000:1.0:1780340602.866729:0:83012:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0346bbf000): rc 0 00000020:00000080:1.0:1780340602.866733:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c0346bbf000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1780340602.866755:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0346bbf000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1780340602.869019:0:83012:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1780340602.869025:0:83012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1780340602.869029:0:83012:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1780340602.869035:0:83012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780340602.869149:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780340602.869156:0:83012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1780340602.869163:0:83012:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c0475faf800 1 00000020:00000080:2.0:1780340602.869169:0:83012:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773204 00000020:00000080:2.0:1780340602.869175:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c046bf89000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1780340602.869180:0:83012:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1780340602.869185:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780340602.869189:0:83012:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1780340602.869192:0:83012:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8c0445ba3380) has no exports 00000020:00000080:1.0:1780340602.890687:0:49688:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0349150000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1780340602.890703:0:49688:0:(genops.c:906:class_export_put()) final put ffff8c044d43e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1780340602.890707:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c044d43e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1780340602.890713:0:49688:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1780340602.890816:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046bf89000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1780340602.948617:0:83012:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780340602.948629:0:83012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1780340602.948635:0:83012:0:(genops.c:906:class_export_put()) final put ffff8c0475fad000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1780340602.948639:0:83012:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0475fad000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1780340602.948652:0:83012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1780340602.948934:0:83012:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8c0475faf000 00000020:02000400:2.0:1780340602.948996:0:83012:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1780340603.795647:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340604.811742:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1780340605.019040:0:3653:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940391296 offset 0 length 224: 4 00000100:00100000:0.0:1780340605.019088:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340605.019123:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340605.019205:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940391552 00000100:00100000:1.0:1780340605.019214:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940391552 00000100:00100000:1.0:1780340605.019287:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1111 00000100:00100000:1.0:1780340605.019299:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940391552:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340605.019372:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940391552:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 75us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340605.019379:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1111 00000100:00080000:1.0:1780340605.019400:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340605.020451:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340605.020481:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340605.020532:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940391424 00000100:00100000:1.0:1780340605.020538:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940391424 00000100:00100000:1.0:1780340605.020580:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1096 00000100:00100000:1.0:1780340605.020586:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2407:x1866818940391424:12345-192.168.203.16@tcp:400:kworker.0 00000020:00080000:1.0:1780340605.020593:0:70100:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.16@tcp 00000100:00100000:1.0:1780340605.020648:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2407:x1866818940391424:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 61us (210us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780340605.020654:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1096 00000100:00100000:3.0:1780340605.041116:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940391808 00000100:00100000:3.0:1780340605.041130:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940391808 00000100:00080000:3.0:1780340605.041169:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340605.046140:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940391680 00000100:00100000:1.0:1780340605.046156:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940391680 00000100:00100000:1.0:1780340605.046242:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2378 00000100:00100000:1.0:1780340605.046253:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940391680:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340605.046333:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940391680:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 81us (25850us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340605.046354:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2378 00000100:00100000:2.0:1780340605.054056:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2379 00000100:00100000:2.0:1780340605.054071:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940391808:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340605.054150:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940391808:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 83us (35025us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340605.054160:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2379 00000100:00080000:2.0:1780340605.054192:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340605.062316:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340605.062732:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940391936 00000100:00100000:3.0:1780340605.062742:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940391936 00000100:00100000:3.0:1780340605.062810:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1097 00000100:00100000:3.0:1780340605.062819:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940391936:12345-192.168.203.16@tcp:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1780340605.062841:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340605.062911:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940391936:12345-192.168.203.16@tcp:38:ptlrpcd_00_00.0 Request processed in 91us (602us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340605.062919:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1097 00000100:00100000:3.0:1780340605.322274:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961038080:0@lo:400:kworker.0 00000100:00100000:3.0:1780340605.322357:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340605.322394:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961038592:0@lo:400:kworker.0 00000100:00100000:3.0:1780340605.322417:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340605.322436:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1780340605.322448:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961037696:0@lo:400:kworker.0 00000400:00000100:3.0:1780340605.322466:0:3659:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961037696 offset 0 length 224: 4 00000100:00100000:3.0:1780340605.322486:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961038208:0@lo:400:kworker.0 00000100:00100000:3.0:1780340605.322504:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340605.322518:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961038720:0@lo:400:kworker.0 00000100:00100000:3.0:1780340605.322536:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340605.322669:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961037952:0@lo:400:kworker.0 00000100:00100000:1.0:1780340605.322698:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340605.322723:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961038464:0@lo:400:kworker.0 00000100:00100000:1.0:1780340605.322742:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340605.322786:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1780340605.322792:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961037824:0@lo:400:kworker.0 00000100:00100000:1.0:1780340605.322821:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340605.322837:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961038336:0@lo:400:kworker.0 00000100:00100000:1.0:1780340605.322858:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340605.322885:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961038592 00000100:00100000:1.0:1780340605.322891:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961038592 00000100:00100000:1.0:1780340605.322940:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961038464 00000100:00100000:1.0:1780340605.322943:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961038464 00000100:00100000:1.0:1780340605.322964:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380 00000100:00100000:1.0:1780340605.322974:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961038592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340605.323025:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a206a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961038592:12345-0@lo:400:kworker.0 Request processed in 53us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340605.323032:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380 00000100:00100000:1.0:1780340605.323046:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2381 00000100:00100000:1.0:1780340605.323052:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961038464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340605.323079:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961038464:12345-0@lo:400:kworker.0 Request processed in 27us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340605.323083:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2381 00000100:00100000:1.0:1780340605.323099:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961038080 00000100:00100000:1.0:1780340605.323114:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961038080 00000100:00100000:1.0:1780340605.323130:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961038208 00000100:00100000:1.0:1780340605.323132:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961038208 00000100:00100000:1.0:1780340605.323145:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961038720 00000100:00100000:1.0:1780340605.323147:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961038720 00000100:00100000:1.0:1780340605.323154:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961037952 00000100:00100000:1.0:1780340605.323156:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961037952 00000100:00100000:1.0:1780340605.323166:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961037824 00000100:00100000:1.0:1780340605.323168:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961037824 00000100:00100000:1.0:1780340605.323178:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:1.0:1780340605.323183:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961038208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340605.323213:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a204e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961038208:12345-0@lo:400:kworker.0 Request processed in 30us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340605.323219:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:1.0:1780340605.323231:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1780340605.323237:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961037952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340605.323264:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961037952:12345-0@lo:400:kworker.0 Request processed in 27us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340605.323270:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1780340605.323281:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:1.0:1780340605.323285:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3659:x1866818961038080:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1780340605.323289:0:70100:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780340605.323309:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3659:x1866818961038080:12345-0@lo:400:kworker.0 Request processed in 24us (953us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780340605.323314:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:1.0:1780340605.323322:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1780340605.323325:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3659:x1866818961038720:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1780340605.323329:0:70100:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1780340605.323514:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:0.0:1780340605.323521:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3662:x1866818961037824:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1780340605.323526:0:63710:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1780340605.323553:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3662:x1866818961037824:12345-0@lo:400:kworker.0 Request processed in 32us (742us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780340605.323568:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:0.0:1780340605.323603:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961038336 00000100:00100000:0.0:1780340605.323607:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961038336 00000100:00100000:0.0:1780340605.323630:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3740 00000100:00100000:0.0:1780340605.323634:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3662:x1866818961038336:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1780340605.323646:0:8411:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1780340605.323670:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3662:x1866818961038336:12345-0@lo:400:kworker.0 Request processed in 34us (810us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780340605.323676:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3740 00000100:00080000:0.0:1780340605.323717:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780340605.323721:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780340605.323726:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780340605.323732:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340605.323736:0:3662:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3349 00000100:00080000:0.0:1780340605.323753:0:3662:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340605.323806:0:3662:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c048527c700 x1866818961038848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340605.323829:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961037824:0@lo:400:kworker.0 00000100:00080000:0.0:1780340605.323840:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780340605.323842:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780340605.323845:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780340605.323849:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340605.323852:0:3662:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3349 00000100:00080000:0.0:1780340605.323855:0:3662:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340605.323867:0:3662:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c048527ed80 x1866818961038976/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340605.323877:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a212d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961038336:0@lo:400:kworker.0 00000100:00100000:0.0:1780340605.323892:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961037952:0@lo:400:kworker.0 00000100:00100000:0.0:1780340605.323910:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961038464:0@lo:400:kworker.0 00000100:00100000:0.0:1780340605.323946:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048527c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961038848:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1780340605.323973:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340605.323990:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048527ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961038976:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1780340605.324010:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340605.324034:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961038848 00000100:00100000:0.0:1780340605.324037:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961038848 00000100:00100000:0.0:1780340605.324053:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:0.0:1780340605.324057:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961038848:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1780340605.324074:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340605.324102:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961038848:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 44us (128us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340605.324108:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00080000:0.0:1780340605.324131:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340605.324135:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340605.324138:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048527c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961038848:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1780340605.324159:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961038976 00000100:00100000:0.0:1780340605.324162:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961038976 00000100:00100000:0.0:1780340605.324181:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3741 00000100:00100000:0.0:1780340605.324185:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961038976:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1780340605.324194:0:22660:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340605.324223:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961038976:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 36us (212us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340605.324228:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3741 00000100:00080000:0.0:1780340605.324258:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340605.324261:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340605.324264:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048527ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961038976:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1780340605.324477:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3659:x1866818961038720:12345-0@lo:400:kworker.0 Request processed in 1150us (1939us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780340605.324484:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00080000:2.0:1780340605.324555:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340605.324570:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340605.324571:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340605.325481:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961038208:0@lo:400:kworker.0 00000100:00080000:3.0:1780340605.325494:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1780340605.325498:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1780340605.325501:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1780340605.325505:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340605.325508:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3349 00000100:00080000:3.0:1780340605.325513:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340605.325536:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034a207480 x1866818961039104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340605.325587:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961038720:0@lo:400:kworker.0 00000100:00080000:3.0:1780340605.325601:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1780340605.325604:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1780340605.325607:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1780340605.325610:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340605.325613:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3349 00000100:00080000:3.0:1780340605.325616:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340605.325629:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034a206300 x1866818961039232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340605.325638:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961038080:0@lo:400:kworker.0 00000100:00100000:3.0:1780340605.325652:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961038592:0@lo:400:kworker.0 00000100:00100000:0.0:1780340605.329953:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a207480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961039104:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1780340605.330035:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340605.330087:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a206300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961039232:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1780340605.330109:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340605.330214:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961039104 00000100:00100000:2.0:1780340605.330223:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961039104 00000100:00100000:2.0:1780340605.330261:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961039232 00000100:00100000:2.0:1780340605.330265:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961039232 00000100:00100000:2.0:1780340605.330293:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1780340605.330300:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961039104:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1780340605.330321:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340605.330379:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961039104:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 78us (344us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340605.330386:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1780340605.330402:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:2.0:1780340605.330406:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961039232:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1780340605.330416:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340605.330438:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961039232:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 31us (328us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340605.330461:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00080000:2.0:1780340605.330496:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340605.330501:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340605.330504:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a207480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961039104:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1780340605.330513:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340605.330516:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340605.330518:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a206300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961039232:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:2.0:1780340605.837266:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340606.859723:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340607.370284:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340607.370314:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a206300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961039360:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340607.370398:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340607.370447:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961039488:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340607.370469:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340607.370611:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961039360 00000100:00100000:3.0:1780340607.370620:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961039360 00000100:00100000:3.0:1780340607.370684:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961039488 00000100:00100000:3.0:1780340607.370688:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961039488 00000100:00100000:3.0:1780340607.370708:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934 00000100:00100000:3.0:1780340607.370718:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961039360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340607.370748:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340607.370818:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961039360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340607.370826:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934 00000100:00100000:3.0:1780340607.370844:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935 00000100:00100000:3.0:1780340607.370850:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961039488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340607.370883:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340607.370918:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961039488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340607.370924:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935 00000100:00100000:1.0:1780340607.371643:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961039488:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1780340607.371661:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340607.371662:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a206300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961039360:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1780340607.371669:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1780340607.883932:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1780340607.884831:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780340607.884839:0:9462:0:(genops.c:906:class_export_put()) final put ffff8c04858fc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780340607.884907:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04858fc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1780340607.884953:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c04858fb800 for lustre-OST0001 00000001:00100000:0.0:1780340607.890939:0:72681:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1780340607.890955:0:72681:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378732 is committed 00000020:00000080:0.0:1780340607.890961:0:72681:0:(genops.c:906:class_export_put()) final put ffff8c045310f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780340607.891205:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045310f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1780340607.891275:0:49688:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c045310e800 for lustre-MDT0001 00000001:00100000:2.0:1780340607.891601:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780340607.891605:0:8395:0:(genops.c:906:class_export_put()) final put ffff8c04858f8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780340607.891669:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04858f8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1780340607.891706:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c04858fa000 for lustre-OST0000 00010000:00010000:1.0:1780340608.905988:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340609.931744:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340610.092686:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340610.092730:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000400:00000100:1.0:1780340610.092795:0:3654:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940392064 offset 0 length 224: 4 00000100:00100000:1.0:1780340610.092814:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340610.092869:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340610.092982:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940392576 00000100:00100000:0.0:1780340610.092993:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940392576 00000100:00100000:0.0:1780340610.093055:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940392448 00000100:00100000:0.0:1780340610.093059:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940392448 00000100:00100000:0.0:1780340610.093082:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2382 00000100:00100000:0.0:1780340610.093092:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940392576:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340610.093173:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445596d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940392576:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 84us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340610.093182:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2382 00000100:00100000:0.0:1780340610.093199:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2383 00000100:00100000:0.0:1780340610.093206:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940392448:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340610.093230:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940392448:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 25us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340610.093236:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2383 00000100:00080000:1.0:1780340610.093455:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780340610.093459:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340610.093780:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940392320 00000100:00100000:3.0:1780340610.093785:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940392320 00000100:00080000:1.0:1780340610.093911:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340610.093946:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940392192 00000100:00100000:3.0:1780340610.093950:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940392192 00000100:00100000:3.0:1780340610.093979:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1114 00000100:00100000:3.0:1780340610.093987:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940392320:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340610.094114:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1104 00000100:00100000:1.0:1780340610.094185:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2406:x1866818940392192:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:1.0:1780340610.094205:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340610.094937:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940392320:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 45us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340610.094949:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1114 00000100:00100000:1.0:1780340610.134936:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2406:x1866818940392192:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 40806us (42057us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340610.134951:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1104 00000100:00080000:2.0:1780340610.442844:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340610.442851:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340610.442854:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340610.442870:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3385 00000100:00080000:2.0:1780340610.442876:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780340610.442883:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340610.442908:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047207f800 x1866818961039744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340610.442932:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340610.442935:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340610.442936:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340610.442955:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3385 00000100:00080000:2.0:1780340610.442958:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780340610.442961:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340610.442974:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047207df80 x1866818961040000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340610.443004:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340610.443008:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340610.443010:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340610.443013:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3385 00000100:00080000:2.0:1780340610.443015:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780340610.443019:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340610.443142:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961039744:0@lo:38:kworker.0 00000100:00100000:0.0:1780340610.443207:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340610.443238:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961040000:0@lo:38:kworker.0 00000100:00100000:0.0:1780340610.443259:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340610.443315:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961039744 00000100:00100000:0.0:1780340610.443322:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961039744 00000100:00100000:0.0:1780340610.443351:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961040000 00000100:00100000:0.0:1780340610.443353:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961040000 00000100:00100000:0.0:1780340610.443371:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1780340610.443378:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961039744:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340610.443410:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340610.443452:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961039744:12345-0@lo:38:kworker.0 Request processed in 73us (245us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340610.443470:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1780340610.443486:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:0.0:1780340610.443490:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961040000:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340610.443499:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340610.443535:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961040000:12345-0@lo:38:kworker.0 Request processed in 43us (275us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340610.443541:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00080000:0.0:1780340610.443574:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340610.443578:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340610.443582:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961039744:0@lo:38:kworker.0 00000100:00080000:0.0:1780340610.443807:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340610.443812:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340610.443822:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961040000:0@lo:38:kworker.0 00000100:00100000:0.0:1780340610.443862:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340610.443872:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961040128:0@lo:400:kworker.0 00000100:00100000:0.0:1780340610.443900:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340610.443937:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961040128 00000100:00100000:0.0:1780340610.443940:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961040128 00000100:00100000:0.0:1780340610.443980:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1780340610.443986:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961040128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340610.444291:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961039616:0@lo:400:kworker.0 00000400:00000100:3.0:1780340610.444317:0:3659:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961039616 offset 0 length 224: 4 00000100:00100000:3.0:1780340610.444340:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340610.444346:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961039872:0@lo:400:kworker.0 00000100:00100000:3.0:1780340610.444367:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340610.444393:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961039872 00000100:00100000:3.0:1780340610.444408:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961039872 00000100:00100000:3.0:1780340610.444432:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:3.0:1780340610.444438:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961039872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340610.444479:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961039872:12345-0@lo:400:kworker.0 Request processed in 42us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340610.444486:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:3.0:1780340610.444515:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961039872:0@lo:400:kworker.0 00000100:00100000:0.0:1780340610.444881:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961040128:12345-0@lo:400:kworker.0 Request processed in 39us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340610.444892:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1780340610.444922:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961040128:0@lo:400:kworker.0 00000100:00080000:1.0:1780340610.445058:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340610.445890:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047207c380 x1866818961040256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340610.445984:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780340610.446023:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961040256:0@lo:38:kworker.0 00000100:00100000:0.0:1780340610.446077:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340610.446131:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961040256 00000100:00100000:0.0:1780340610.446136:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961040256 00000100:00100000:0.0:1780340610.446164:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3742 00000100:00100000:0.0:1780340610.446170:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961040256:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340610.446190:0:8411:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340610.446225:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961040256:12345-0@lo:38:kworker.0 Request processed in 54us (148us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340610.446232:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3742 00000100:00080000:0.0:1780340610.446261:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340610.446265:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340610.446269:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961040256:0@lo:38:kworker.0 00000100:00080000:2.0:1780340610.446418:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340610.446422:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340610.446425:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340610.446429:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3385 00000100:00080000:2.0:1780340610.446433:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780340610.446438:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340610.446454:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047207ca80 x1866818961040640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340610.446488:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340610.446497:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961040512:0@lo:400:kworker.0 00000100:00100000:2.0:1780340610.446539:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340610.447154:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961040512 00000100:00100000:3.0:1780340610.447160:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961040512 00000100:00100000:3.0:1780340610.447218:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2384 00000100:00100000:3.0:1780340610.447225:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961040512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340610.447273:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961040512:12345-0@lo:400:kworker.0 Request processed in 49us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340610.447280:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2384 00000100:00100000:0.0:1780340610.447561:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961040640:0@lo:38:kworker.0 00000100:00100000:0.0:1780340610.447607:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340610.447831:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961040640 00000100:00100000:3.0:1780340610.447846:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961040640 00000100:00100000:3.0:1780340610.447882:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:3.0:1780340610.447887:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961040640:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780340610.447904:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340610.447939:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961040640:12345-0@lo:38:kworker.0 Request processed in 50us (331us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340610.447945:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00080000:0.0:1780340610.448915:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340610.448922:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340610.448926:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961040640:0@lo:38:kworker.0 00000100:00080000:2.0:1780340610.449063:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340610.449105:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961040512:0@lo:400:kworker.0 00000100:00100000:1.0:1780340610.452292:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961040384:0@lo:400:kworker.0 00000100:00100000:1.0:1780340610.452371:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340610.452540:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961040384 00000100:00100000:2.0:1780340610.452549:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961040384 00000100:00100000:2.0:1780340610.452638:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2385 00000100:00100000:2.0:1780340610.452647:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961040384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340610.452711:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445594e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961040384:12345-0@lo:400:kworker.0 Request processed in 65us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340610.452718:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2385 00000100:00100000:0.0:1780340610.452855:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961040384:0@lo:400:kworker.0 00000100:00080000:1.0:1780340610.453495:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1780340610.954005:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340611.978879:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340612.492269:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340612.492289:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961040768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340612.492351:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340612.492586:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961040768 00000100:00100000:0.0:1780340612.492594:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961040768 00000100:00100000:0.0:1780340612.492671:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936 00000100:00100000:0.0:1780340612.492682:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a204a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961040768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340612.492707:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340612.492751:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a204a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961040768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340612.492796:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936 00000100:00080000:1.0:1780340612.492932:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340612.493295:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340612.493306:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961040896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340612.493336:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340612.493411:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961040896 00000100:00100000:2.0:1780340612.493416:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961040896 00000100:00100000:2.0:1780340612.493463:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1937 00000100:00100000:2.0:1780340612.493472:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961040896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340612.493489:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340612.493537:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961040896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340612.493543:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1937 00000100:00080000:1.0:1780340612.493797:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340612.493830:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961040896:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340612.494994:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961040768:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1780340613.002710:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340614.026072:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340615.050006:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340615.216315:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000400:00000100:0.0:1780340615.216349:0:3652:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940392704 offset 0 length 224: 4 00000100:00100000:0.0:1780340615.216368:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340615.216397:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340615.216461:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340615.216501:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940393088 00000100:00100000:0.0:1780340615.216510:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940393088 00000100:00100000:0.0:1780340615.216561:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940393216 00000100:00100000:0.0:1780340615.216565:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940393216 00000100:00100000:0.0:1780340615.216585:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5868 00000100:00100000:0.0:1780340615.216596:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2406:x1866818940393088:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:0.0:1780340615.216640:0:25494:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773656 00000100:00080000:0.0:1780340615.216650:0:25494:0:(import.c:65:import_set_state_nolock()) ffff8c0475708800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1780340615.216703:0:25494:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969449 00000100:00100000:0.0:1780340615.216884:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e06e5cf1-1986-4ba7-9630-fad7efb74eca+2:2406:x1866818940393088:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 289us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340615.216891:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5868 00000100:00100000:0.0:1780340615.216907:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5869 00000100:00100000:0.0:1780340615.216915:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2406:x1866818940393216:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:0.0:1780340615.216926:0:25494:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277365d 00000100:00080000:0.0:1780340615.216932:0:25494:0:(import.c:65:import_set_state_nolock()) ffff8c046b9a8000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1780340615.216952:0:25494:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969449 00000100:00100000:2.0:1780340615.217067:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940392960 00000100:00100000:2.0:1780340615.217072:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940392960 00000100:00100000:2.0:1780340615.217102:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940392832 00000100:00100000:2.0:1780340615.217105:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940392832 00000100:00100000:2.0:1780340615.217124:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1117 00000100:00100000:2.0:1780340615.217131:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940392960:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340615.217163:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940392960:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 33us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340615.217180:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1117 00000100:00100000:2.0:1780340615.217194:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1108 00000100:00100000:2.0:1780340615.217199:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1866818940392832:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:2.0:1780340615.217217:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340615.217242:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1866818940392832:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 41us (873us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340615.217248:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1108 00010000:00010000:2.0:1780340615.217265:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780340615.217293:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340615.217297:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340615.217299:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340615.217523:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e06e5cf1-1986-4ba7-9630-fad7efb74eca+2:2406:x1866818940393216:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 608us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340615.217530:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5869 00010000:00010000:1.0:1780340615.217607:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780340615.562045:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340615.562052:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340615.562056:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340615.562063:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3390 00000100:00080000:2.0:1780340615.562068:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780340615.562074:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340615.562094:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047207f800 x1866818961041152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340615.562124:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340615.562127:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340615.562129:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340615.562133:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3390 00000100:00080000:2.0:1780340615.562135:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780340615.562149:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340615.562160:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047207ed80 x1866818961041408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340615.562175:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340615.562178:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340615.562179:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340615.562182:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3390 00000100:00080000:2.0:1780340615.562184:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780340615.562187:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340615.562196:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0444225c00 x1866818961041664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340615.562213:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340615.562216:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340615.562217:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340615.562221:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3390 00000100:00080000:2.0:1780340615.562223:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780340615.562225:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340615.562233:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0444227b80 x1866818961042048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340615.562260:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961041792:0@lo:400:kworker.0 00000100:00100000:2.0:1780340615.562316:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340615.562352:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1780340615.562360:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961041024:0@lo:400:kworker.0 00000400:00000100:2.0:1780340615.562376:0:3661:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961041024 offset 0 length 224: 4 00000100:00100000:2.0:1780340615.562417:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961041920:0@lo:400:kworker.0 00000100:00100000:2.0:1780340615.562437:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340615.562470:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961041152:0@lo:38:kworker.0 00000100:00100000:2.0:1780340615.562503:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340615.562520:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961041408:0@lo:38:kworker.0 00000100:00100000:2.0:1780340615.562542:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340615.562559:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961041664:0@lo:38:kworker.0 00000100:00100000:2.0:1780340615.562582:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340615.562602:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961042048:0@lo:38:kworker.0 00000100:00100000:2.0:1780340615.562632:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340615.562675:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961041280:0@lo:400:kworker.0 00000100:00100000:2.0:1780340615.562703:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340615.562724:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780340615.562730:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961041536:0@lo:400:kworker.0 00000100:00100000:2.0:1780340615.562753:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340615.562805:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961041792 00000100:00100000:2.0:1780340615.562812:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961041792 00000100:00100000:2.0:1780340615.562858:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961041920 00000100:00100000:2.0:1780340615.562861:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961041920 00000100:00100000:2.0:1780340615.562885:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2386 00000100:00100000:2.0:1780340615.562894:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961041792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340615.562940:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961041792:12345-0@lo:400:kworker.0 Request processed in 47us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340615.562947:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2386 00000100:00100000:2.0:1780340615.562960:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2387 00000100:00100000:2.0:1780340615.562966:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961041920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340615.563000:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961041920:12345-0@lo:400:kworker.0 Request processed in 34us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340615.563005:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2387 00000100:00100000:2.0:1780340615.563021:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961041152 00000100:00100000:2.0:1780340615.563024:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961041152 00000100:00100000:2.0:1780340615.563036:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961041408 00000100:00100000:2.0:1780340615.563039:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961041408 00000100:00100000:2.0:1780340615.563049:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961042048 00000100:00100000:2.0:1780340615.563051:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961042048 00000100:00100000:2.0:1780340615.563062:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961041280 00000100:00100000:2.0:1780340615.563065:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961041280 00000100:00100000:2.0:1780340615.563083:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961041536 00000100:00100000:2.0:1780340615.563086:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961041536 00000100:00100000:2.0:1780340615.563107:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:2.0:1780340615.563113:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961041280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340615.563140:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a126a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961041280:12345-0@lo:400:kworker.0 Request processed in 28us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340615.563145:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:2.0:1780340615.563156:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:2.0:1780340615.563161:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961041536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340615.563196:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a125c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961041536:12345-0@lo:400:kworker.0 Request processed in 35us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340615.563203:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:2.0:1780340615.563220:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:2.0:1780340615.563230:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961041152:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340615.563247:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340615.563280:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961041152:12345-0@lo:38:kworker.0 Request processed in 49us (776us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340615.563292:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:2.0:1780340615.563308:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:2.0:1780340615.563313:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961041408:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340615.563323:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340615.563360:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a127480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961041408:12345-0@lo:38:kworker.0 Request processed in 45us (816us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340615.563366:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:2.0:1780340615.563380:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1780340615.563385:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961042048:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340615.563394:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340615.563413:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a127b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961042048:12345-0@lo:38:kworker.0 Request processed in 28us (782us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340615.563420:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1780340615.563443:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961041664 00000100:00100000:2.0:1780340615.563447:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961041664 00000100:00100000:2.0:1780340615.563467:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3743 00000100:00100000:2.0:1780340615.563471:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961041664:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340615.563480:0:26074:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340615.563520:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961041664:12345-0@lo:38:kworker.0 Request processed in 47us (937us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340615.563526:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3743 00000100:00080000:2.0:1780340615.563554:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340615.563559:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340615.563561:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340615.563595:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961041536:0@lo:400:kworker.0 00000100:00100000:2.0:1780340615.563613:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961041280:0@lo:400:kworker.0 00000100:00080000:2.0:1780340615.563702:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340615.563706:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340615.563710:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961041152:0@lo:38:kworker.0 00000100:00080000:2.0:1780340615.563721:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340615.563725:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340615.563728:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961041408:0@lo:38:kworker.0 00000100:00080000:2.0:1780340615.563735:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340615.563737:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340615.563740:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961041664:0@lo:38:kworker.0 00000100:00080000:2.0:1780340615.563750:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340615.564922:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340615.564930:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961042048:0@lo:38:kworker.0 00000100:00100000:2.0:1780340615.564987:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961041920:0@lo:400:kworker.0 00000100:00100000:2.0:1780340615.564997:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961041792:0@lo:400:kworker.0 00010000:00010000:2.0:1780340616.074995:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340617.098945:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340617.610164:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961042176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340617.610228:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340617.610271:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961042176 00000100:00100000:0.0:1780340617.610277:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961042176 00000100:00100000:0.0:1780340617.610336:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938 00000100:00100000:0.0:1780340617.610346:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961042176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340617.610373:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340617.610422:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961042176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340617.610429:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938 00000100:00080000:0.0:1780340617.610449:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340617.610509:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961042176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340617.613302:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961042304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340617.613371:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340617.613527:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961042304 00000100:00100000:0.0:1780340617.613535:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961042304 00000100:00100000:0.0:1780340617.613586:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939 00000100:00100000:0.0:1780340617.613595:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961042304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340617.613621:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340617.619809:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961042304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6207us (6429us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340617.619823:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939 00000100:00080000:0.0:1780340617.619862:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340617.620611:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961042304:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1780340618.122066:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340619.147990:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340620.170340:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1780340620.329211:0:3652:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940393344 offset 0 length 224: 4 00000100:00100000:3.0:1780340620.329275:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340620.330173:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340620.341103:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940393600 00000100:00100000:2.0:1780340620.341118:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940393600 00000100:00100000:2.0:1780340620.341195:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940393472 00000100:00100000:2.0:1780340620.341199:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940393472 00000100:00100000:2.0:1780340620.341220:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1120 00000100:00100000:2.0:1780340620.341233:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940393600:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340620.341327:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940393600:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 98us (12054us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340620.341335:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1120 00000100:00100000:2.0:1780340620.341354:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1112 00000100:00100000:2.0:1780340620.341359:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a205880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940393472:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:2.0:1780340620.341378:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340620.341413:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a205880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940393472:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 52us (11245us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340620.341419:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1112 00000100:00080000:3.0:1780340620.345729:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340620.682273:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340620.682279:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340620.682283:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340620.682290:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3395 00000100:00080000:2.0:1780340620.682295:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1780340620.682302:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340620.682323:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a125180 x1866818961042560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340620.682348:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340620.682351:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340620.682353:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340620.682357:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3395 00000100:00080000:2.0:1780340620.682359:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1780340620.682362:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340620.682374:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a124a80 x1866818961042816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340620.682410:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340620.682413:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340620.682415:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340620.682419:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3395 00000100:00100000:3.0:1780340620.682423:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961042432:0@lo:400:kworker.0 00000100:00080000:2.0:1780340620.682423:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1780340620.682428:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340620.682455:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a127100 x1866818961043072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340620.682481:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340620.682484:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340620.682486:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340620.682490:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3395 00000400:00000100:3.0:1780340620.682495:0:3661:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961042432 offset 0 length 224: 4 00000100:00080000:2.0:1780340620.682495:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1780340620.682500:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340620.682513:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0444224a80 x1866818961043456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340620.682540:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961042688:0@lo:400:kworker.0 00000100:00100000:3.0:1780340620.682558:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961043328:0@lo:400:kworker.0 00000100:00100000:2.0:1780340620.682583:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340620.682593:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340620.682626:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961042560:0@lo:38:kworker.0 00000100:00100000:3.0:1780340620.682638:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961043328 00000100:00100000:3.0:1780340620.682646:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961043328 00000100:00100000:2.0:1780340620.682655:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340620.682689:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961042816:0@lo:38:kworker.0 00000100:00100000:3.0:1780340620.682710:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2388 00000100:00100000:2.0:1780340620.682716:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340620.682723:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a205f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961043328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340620.682735:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961043072:0@lo:38:kworker.0 00000100:00100000:2.0:1780340620.682795:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340620.685269:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961042688 00000100:00100000:1.0:1780340620.685303:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961042688 00000100:00100000:1.0:1780340620.685359:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961042560 00000100:00100000:1.0:1780340620.685362:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961042560 00000100:00100000:1.0:1780340620.685376:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961042816 00000100:00100000:1.0:1780340620.685379:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961042816 00000100:00100000:1.0:1780340620.685739:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1780340620.685749:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961042688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340620.685984:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a205f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961043328:12345-0@lo:400:kworker.0 Request processed in 3262us (3388us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340620.685994:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2388 00000100:00080000:3.0:1780340620.686022:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780340620.686026:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340620.686063:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961043328:0@lo:400:kworker.0 00000100:00100000:1.0:1780340620.687158:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961042688:12345-0@lo:400:kworker.0 Request processed in 1407us (4572us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340620.687168:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1780340620.687193:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1780340620.687198:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961042560:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340620.687216:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340620.687250:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961042560:12345-0@lo:38:kworker.0 Request processed in 51us (4595us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340620.687256:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1780340620.687267:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:1.0:1780340620.687271:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961042816:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340620.687281:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340620.687303:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961042816:12345-0@lo:38:kworker.0 Request processed in 31us (4590us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340620.687309:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:1.0:1780340620.687339:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961043200:0@lo:400:kworker.0 00000100:00100000:1.0:1780340620.687374:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340620.687404:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780340620.687410:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961042944:0@lo:400:kworker.0 00000100:00100000:1.0:1780340620.687456:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340620.687497:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961043200 00000100:00100000:1.0:1780340620.687503:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961043200 00000100:00100000:1.0:1780340620.687543:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2389 00000100:00100000:1.0:1780340620.687550:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961043200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340620.687590:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961043200:12345-0@lo:400:kworker.0 Request processed in 42us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340620.687596:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2389 00000100:00100000:1.0:1780340620.687641:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961043200:0@lo:400:kworker.0 00000100:00100000:1.0:1780340620.687670:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961042944 00000100:00100000:1.0:1780340620.687674:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961042944 00000100:00100000:1.0:1780340620.687699:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:1.0:1780340620.687706:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961042944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340620.687738:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961042944:12345-0@lo:400:kworker.0 Request processed in 33us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340620.687744:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:1.0:1780340620.687785:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961042944:0@lo:400:kworker.0 00000100:00080000:3.0:1780340620.688639:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780340620.688646:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340620.688677:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961042688:0@lo:400:kworker.0 00000100:00100000:3.0:1780340620.688932:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961043072 00000100:00100000:3.0:1780340620.688938:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961043072 00000100:00100000:3.0:1780340620.688973:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3744 00000100:00100000:3.0:1780340620.688979:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961043072:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780340620.688996:0:8410:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340620.689043:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961043072:12345-0@lo:38:kworker.0 Request processed in 64us (6247us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340620.689061:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3744 00000100:00080000:2.0:1780340620.690907:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340620.690918:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340620.691124:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961043072:0@lo:38:kworker.0 00000100:00100000:2.0:1780340620.691138:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961043456:0@lo:38:kworker.0 00000100:00100000:2.0:1780340620.691188:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1780340620.691271:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340620.691277:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340620.691280:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961042560:0@lo:38:kworker.0 00000100:00080000:2.0:1780340620.691290:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340620.691293:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340620.691296:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961042816:0@lo:38:kworker.0 00000100:00100000:1.0:1780340620.692270:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961043456 00000100:00100000:1.0:1780340620.692279:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961043456 00000100:00100000:1.0:1780340620.692325:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:1.0:1780340620.692333:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961043456:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340620.692355:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340620.692579:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961043456:12345-0@lo:38:kworker.0 Request processed in 245us (1390us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340620.692587:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00080000:2.0:1780340620.692788:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340620.692794:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340620.692798:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961043456:0@lo:38:kworker.0 00010000:00010000:0.0:1780340621.201788:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1780340621.208385:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000020:00000080:2.0:1780340621.208394:0:9462:0:(genops.c:906:class_export_put()) final put ffff8c046b9af800/e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000001:00100000:0.0:1780340621.208480:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000020:00000080:0.0:1780340621.208484:0:8395:0:(genops.c:906:class_export_put()) final put ffff8c0475708000/e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000020:00000080:1.0:1780340621.210342:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b9af800/e06e5cf1-1986-4ba7-9630-fad7efb74eca for lustre-OST0001 00000020:00000080:1.0:1780340621.210399:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0475708000/e06e5cf1-1986-4ba7-9630-fad7efb74eca for lustre-OST0000 00000020:00000080:1.0:1780340621.210416:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c046b9a8000 for lustre-OST0001 00000020:00000080:1.0:1780340621.210420:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0475708800 for lustre-OST0000 00000400:00000100:2.0:1780340621.356257:0:3654:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940393728 offset 0 length 520: 4 00000100:00100000:2.0:1780340621.356290:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340621.356322:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340621.356366:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940393984 00000100:00100000:1.0:1780340621.356376:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940393984 00000100:00100000:1.0:1780340621.356422:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940393856 00000100:00100000:1.0:1780340621.356426:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940393856 00000100:00100000:1.0:1780340621.356467:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1123 00000100:00100000:1.0:1780340621.356594:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940393984:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340621.356676:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940393984:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 200us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340621.356683:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1123 00000100:00100000:1.0:1780340621.356701:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1116 00000100:00100000:1.0:1780340621.356732:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1866818940393856:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:1.0:1780340621.356801:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340621.356823:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1866818940393856:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 91us (500us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340621.356830:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1116 00000100:00000400:1.0:1780340621.706136:0:3659:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780340605/real 1780340605] req@ffff8c047a212680 x1866818961037696/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780340621 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340621.732852:0:3659:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8c047a212680 x1866818961037696/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780340621 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340621.732866:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1780340621.732870:0:3659:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1780340621.732884:0:3659:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.116@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1780340621.732886:0:3659:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1780340621.732890:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c047a212680 x1866818961037696/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780340621 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340621.732900:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c047207ea00 x1866818961039616/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340626 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340621.732908:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c047207df80 x1866818961041024/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340631 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340621.734323:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c047a124700 x1866818961042432/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340636 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1780340621.734336:0:3659:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1780340621.734339:0:3659:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1780340621.734341:0:3659:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1780340621.734343:0:3659:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1780340621.734359:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961041024:0@lo:400:kworker.0 00000100:00100000:0.0:1780340621.734388:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961042432:0@lo:400:kworker.0 00000100:00100000:0.0:1780340621.735744:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961039616:0@lo:400:kworker.0 00000100:00100000:0.0:1780340621.735751:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961037696:0@lo:400:kworker.0 00000100:00080000:3.0:1780340621.735867:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340621.735872:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1780340621.735875:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340621.735888:0:80497:0:(import.c:512:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 3343 00000100:00080000:3.0:1780340621.735895:0:80497:0:(import.c:626:import_select_connection()) MGC192.168.203.116@tcp: import ffff8c0475490800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340621.735922:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034a206300 x1866818961043584/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340621.736020:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a206300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961043584:0@lo:250:kworker.0 00000400:00000100:1.0:1780340621.736060:0:3658:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961043584 offset 0 length 520: 4 00000100:00080000:3.0:1780340621.736155:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340621.736159:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340621.736161:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340621.736165:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3400 00000100:00080000:3.0:1780340621.736167:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340621.736171:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340621.736189:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a124700 x1866818961043712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340621.736250:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961043712:0@lo:38:kworker.0 00000100:00100000:1.0:1780340621.736283:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340621.736368:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961043712 00000100:00100000:0.0:1780340621.736376:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961043712 00000100:00100000:0.0:1780340621.736417:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:0.0:1780340621.736424:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961043712:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340621.736455:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340621.736499:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961043712:12345-0@lo:38:kworker.0 Request processed in 74us (216us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340621.736516:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00080000:0.0:1780340621.736553:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340621.736557:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340621.736560:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961043712:0@lo:38:kworker.0 00000100:00100000:0.0:1780340621.736940:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961043840:0@lo:400:kworker.0 00000100:00100000:0.0:1780340621.736976:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340621.737020:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961043840 00000100:00100000:1.0:1780340621.737024:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961043840 00000100:00100000:1.0:1780340621.737056:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:1.0:1780340621.737062:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961043840:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1780340621.737111:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340621.737115:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340621.737117:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340621.737121:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3400 00000100:00080000:3.0:1780340621.737124:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340621.737127:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340621.737142:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a125180 x1866818961043968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340621.737165:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340621.737169:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340621.737170:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340621.737173:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3400 00000100:00080000:3.0:1780340621.737175:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340621.737184:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340621.737194:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a127800 x1866818961044224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340621.737309:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961043840:12345-0@lo:400:kworker.0 Request processed in 246us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340621.737325:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00080000:3.0:1780340621.737468:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340621.737472:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340621.737474:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340621.737478:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3400 00000100:00080000:3.0:1780340621.737480:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340621.737484:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340621.737499:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a125880 x1866818961044608/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340621.737525:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961044480:0@lo:400:kworker.0 00000100:00100000:3.0:1780340621.737557:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340621.737598:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961044352:0@lo:400:kworker.0 00000100:00100000:3.0:1780340621.737623:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340621.737653:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340621.737659:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961044096:0@lo:400:kworker.0 00000100:00100000:3.0:1780340621.737680:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340621.737707:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961044480 00000100:00100000:3.0:1780340621.737711:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961044480 00000100:00100000:3.0:1780340621.737736:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961044352 00000100:00100000:3.0:1780340621.737739:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961044352 00000100:00100000:3.0:1780340621.737754:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2390 00000100:00100000:3.0:1780340621.737788:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961044480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340621.737821:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a124700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961044480:12345-0@lo:400:kworker.0 Request processed in 35us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340621.737833:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2390 00000100:00100000:3.0:1780340621.737845:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2391 00000100:00100000:3.0:1780340621.737851:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961044352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340621.737878:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961044352:12345-0@lo:400:kworker.0 Request processed in 28us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340621.737883:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2391 00000100:00100000:3.0:1780340621.737897:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961044096 00000100:00100000:3.0:1780340621.737900:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961044096 00000100:00100000:3.0:1780340621.737920:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1780340621.737925:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961044096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340621.738108:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961044096:12345-0@lo:400:kworker.0 Request processed in 182us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340621.738114:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:3.0:1780340621.738152:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a126d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961044480:0@lo:400:kworker.0 00000100:00100000:3.0:1780340621.738190:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a127100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961044096:0@lo:400:kworker.0 00000100:00100000:3.0:1780340621.738198:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961044352:0@lo:400:kworker.0 00000100:00100000:3.0:1780340621.738216:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961043968:0@lo:38:kworker.0 00000100:00100000:3.0:1780340621.738239:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340621.738296:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961044224:0@lo:38:kworker.0 00000100:00100000:3.0:1780340621.738330:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340621.738358:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961044608:0@lo:38:kworker.0 00000100:00100000:3.0:1780340621.738378:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340621.738574:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961043840:0@lo:400:kworker.0 00000100:00100000:3.0:1780340621.738699:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961044224 00000100:00100000:3.0:1780340621.738709:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961044224 00000100:00100000:3.0:1780340621.738731:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3745 00000100:00100000:3.0:1780340621.738735:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961044224:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780340621.738751:0:26074:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340621.738801:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961044224:12345-0@lo:38:kworker.0 Request processed in 65us (470us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340621.738807:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3745 00000100:00080000:3.0:1780340621.738835:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340621.738839:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340621.738842:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a127800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961044224:0@lo:38:kworker.0 00000100:00100000:1.0:1780340621.739042:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961043968 00000100:00100000:1.0:1780340621.739047:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961043968 00000100:00100000:1.0:1780340621.739080:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961044608 00000100:00100000:1.0:1780340621.739083:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961044608 00000100:00100000:1.0:1780340621.739097:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1780340621.739102:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961043968:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340621.739113:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340621.739145:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a125f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961043968:12345-0@lo:38:kworker.0 Request processed in 41us (904us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340621.739151:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1780340621.739163:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1780340621.739167:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961044608:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340621.739175:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340621.739195:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a126d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961044608:12345-0@lo:38:kworker.0 Request processed in 27us (817us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340621.739201:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00080000:3.0:1780340621.739275:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340621.739280:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340621.739283:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961043968:0@lo:38:kworker.0 00000100:00080000:3.0:1780340621.739291:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340621.739294:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340621.739297:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961044608:0@lo:38:kworker.0 00010000:00010000:3.0:1780340622.220597:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340622.734271:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340622.734292:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961044736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340622.734369:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340622.734439:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961044736 00000100:00100000:3.0:1780340622.734447:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961044736 00000100:00100000:3.0:1780340622.734504:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1940 00000100:00100000:3.0:1780340622.734514:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961044736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340622.734540:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340622.734592:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961044736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340622.734600:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1940 00000100:00080000:3.0:1780340622.734620:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340622.734664:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961044736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340622.738276:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340622.738297:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961044864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340622.745115:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340622.749623:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961044864 00000100:00100000:0.0:1780340622.749636:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961044864 00000100:00100000:0.0:1780340622.749706:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1941 00000100:00100000:0.0:1780340622.749717:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961044864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340622.749748:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340622.749836:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a127800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961044864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (4728us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340622.749844:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1941 00000100:00100000:0.0:1780340622.752730:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961044864:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1780340622.752780:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1780340623.242407:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340624.266843:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340625.291270:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340626.332055:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340626.485896:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340626.485928:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340626.486052:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940394112 00000100:00100000:1.0:1780340626.486062:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940394112 00000100:00100000:1.0:1780340626.486113:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940394240 00000100:00100000:1.0:1780340626.486116:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940394240 00000100:00100000:1.0:1780340626.486156:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1126 00000100:00100000:1.0:1780340626.486167:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940394240:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340626.486234:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940394240:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 69us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340626.486242:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1126 00000100:00100000:1.0:1780340626.486259:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1120 00000100:00100000:1.0:1780340626.486264:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1866818940394112:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:1.0:1780340626.486300:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340626.486589:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1866818940394112:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 322us (701us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340626.486597:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1120 00000100:00080000:0.0:1780340626.486877:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340626.833740:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340626.833751:0:49688:0:(pinger.c:249:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1780340626.833754:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340626.833781:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340626.833786:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340626.833808:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3401 00000100:00080000:0.0:1780340626.833813:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340626.833828:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340626.833863:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c048527fb80 x1866818961044992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340626.833910:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340626.833913:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340626.833915:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340626.833919:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3401 00000100:00080000:0.0:1780340626.833921:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340626.833925:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340626.833938:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a212680 x1866818961045248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340626.833962:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340626.833965:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340626.833967:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340626.833970:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3401 00000100:00080000:0.0:1780340626.833973:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340626.833976:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340626.833988:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a210e00 x1866818961045504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340626.834009:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340626.834012:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340626.834014:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340626.834022:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3401 00000100:00080000:0.0:1780340626.834025:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340626.834028:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340626.834041:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a213100 x1866818961045888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340626.834068:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961045632:0@lo:400:kworker.0 00000100:00100000:3.0:1780340626.834221:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048527fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961044992:0@lo:38:kworker.0 00000100:00100000:3.0:1780340626.834276:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340626.834306:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961045248:0@lo:38:kworker.0 00000100:00100000:3.0:1780340626.834327:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340626.834340:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961045504:0@lo:38:kworker.0 00000100:00100000:3.0:1780340626.834362:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340626.834377:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961045888:0@lo:38:kworker.0 00000100:00100000:3.0:1780340626.834394:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340626.834437:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961045376:0@lo:400:kworker.0 00000100:00100000:3.0:1780340626.834472:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340626.834505:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961044992 00000100:00100000:3.0:1780340626.834513:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961044992 00000100:00100000:3.0:1780340626.834541:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961045248 00000100:00100000:3.0:1780340626.834544:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961045248 00000100:00100000:3.0:1780340626.834565:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961045888 00000100:00100000:3.0:1780340626.834568:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961045888 00000100:00100000:3.0:1780340626.834576:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961045376 00000100:00100000:3.0:1780340626.834578:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961045376 00000100:00100000:3.0:1780340626.834623:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1780340626.834631:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961045376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340626.834693:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961045376:12345-0@lo:400:kworker.0 Request processed in 62us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340626.834700:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1780340626.834714:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:3.0:1780340626.834719:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961044992:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780340626.834735:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340626.834783:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a125880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961044992:12345-0@lo:38:kworker.0 Request processed in 63us (507us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340626.834789:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:3.0:1780340626.834801:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1780340626.834805:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961045248:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780340626.834814:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340626.834847:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a124a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961045248:12345-0@lo:38:kworker.0 Request processed in 40us (519us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340626.834853:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1780340626.834865:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:3.0:1780340626.834869:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034872ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961045888:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780340626.834877:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340626.834900:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034872ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961045888:12345-0@lo:38:kworker.0 Request processed in 29us (505us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340626.834905:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:3.0:1780340626.834922:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961045504 00000100:00100000:3.0:1780340626.834926:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961045504 00000100:00100000:3.0:1780340626.834950:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3746 00000100:00100000:3.0:1780340626.834954:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961045504:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780340626.834963:0:8410:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340626.834989:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961045504:12345-0@lo:38:kworker.0 Request processed in 34us (626us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340626.834995:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3746 00000100:00080000:3.0:1780340626.835016:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340626.835040:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961045376:0@lo:400:kworker.0 00000100:00080000:3.0:1780340626.835069:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340626.835074:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340626.835077:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048527fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961044992:0@lo:38:kworker.0 00000100:00080000:3.0:1780340626.835085:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340626.835101:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340626.835104:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a212680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961045248:0@lo:38:kworker.0 00000100:00080000:3.0:1780340626.835112:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340626.835115:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340626.835118:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a210e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961045504:0@lo:38:kworker.0 00000100:00080000:3.0:1780340626.835125:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340626.835128:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340626.835131:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a213100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961045888:0@lo:38:kworker.0 00000100:00100000:1.0:1780340626.835431:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048527c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961045120:0@lo:400:kworker.0 00000100:00100000:1.0:1780340626.835461:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340626.835478:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780340626.835483:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961045760:0@lo:400:kworker.0 00000100:00100000:1.0:1780340626.835503:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340626.835534:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961045120 00000100:00100000:1.0:1780340626.835537:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961045120 00000100:00100000:1.0:1780340626.835580:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:1.0:1780340626.835586:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961045120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340626.835621:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961045120:12345-0@lo:400:kworker.0 Request processed in 35us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340626.835627:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:1.0:1780340626.835662:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961045760 00000100:00100000:1.0:1780340626.835666:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961045760 00000100:00100000:1.0:1780340626.835696:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2392 00000100:00100000:1.0:1780340626.835703:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961045760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340626.835732:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961045760:12345-0@lo:400:kworker.0 Request processed in 30us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340626.835738:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2392 00000100:00080000:1.0:1780340626.835772:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340626.835775:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340626.835793:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a213800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961045760:0@lo:400:kworker.0 00000100:00100000:1.0:1780340626.835823:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048527c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961045120:0@lo:400:kworker.0 00000100:00100000:0.0:1780340626.836055:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340626.836329:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961045632 00000100:00100000:1.0:1780340626.836333:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961045632 00000100:00100000:1.0:1780340626.836376:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2393 00000100:00100000:1.0:1780340626.836383:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961045632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340626.836431:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961045632:12345-0@lo:400:kworker.0 Request processed in 48us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340626.836437:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2393 00000100:00080000:3.0:1780340626.836513:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340626.837219:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a211880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961045632:0@lo:400:kworker.0 00000100:00100000:2.0:1780340626.989519:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340626.994659:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940394368 00000100:00100000:3.0:1780340626.994674:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940394368 00000100:00100000:3.0:1780340626.994746:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1124 00000100:00100000:3.0:1780340626.994776:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940394368:12345-192.168.203.16@tcp:17:kworker.0 00000100:00100000:3.0:1780340626.995232:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940394368:12345-192.168.203.16@tcp:17:kworker.0 Request processed in 475us (5722us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340626.995241:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1124 00010000:00010000:3.0:1780340627.344909:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340627.854291:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961046016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340627.854359:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340627.854421:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961046144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340627.854446:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340627.854478:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961046016 00000100:00100000:3.0:1780340627.854487:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961046016 00000100:00100000:3.0:1780340627.854529:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961046144 00000100:00100000:3.0:1780340627.854532:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961046144 00000100:00100000:3.0:1780340627.854553:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1942 00000100:00100000:3.0:1780340627.854560:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961046016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340627.854589:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340627.854632:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961046016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340627.854639:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1942 00000100:00100000:3.0:1780340627.854655:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1943 00000100:00100000:3.0:1780340627.854661:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961046144:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340627.854677:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340627.854706:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961046144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340627.854712:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1943 00000100:00100000:3.0:1780340627.854754:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961046016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340627.854836:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a210a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961046144:0@lo:13:osp-pre-0-1.0 00000020:01000004:0.0:1780340628.315418:0:83631:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1780340628.315424:0:83631:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1780340628.315426:0:83631:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1780340628.315536:0:83631:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8c04858fb800 00000020:01000004:0.0:1780340628.315552:0:83631:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1780340628.315567:0:83631:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1780340628.315579:0:83631:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8c0471d54d40) 00000020:00000080:0.0:1780340628.315595:0:83631:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1780340628.362121:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1780340628.463997:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1780340628.476922:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1780340628.493590:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1780340628.493905:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1780340628.494591:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1780340628.494862:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1780340628.495215:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1780340628.498062:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1780340628.499104:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1780340628.500098:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1780340628.500532:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1780340628.502687:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1780340628.503205:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1780340628.513072:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1780340628.513622:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1780340628.514165:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1780340628.515013:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1780340628.516437:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1780340628.516861:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1780340628.517203:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1780340628.517754:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1780340628.519554:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1780340628.520047:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1780340628.521088:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1780340628.522011:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1780340628.522253:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1780340628.523057:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1780340628.523468:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1780340628.524009:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1780340628.524562:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1780340628.525914:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1780340628.527071:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1780340628.527611:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1780340628.528051:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1780340628.541133:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1780340628.542028:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1780340628.542257:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1780340628.544571:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1780340628.545067:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1780340628.545517:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1780340628.545722:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1780340628.546159:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1780340628.546533:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1780340628.547447:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1780340628.547718:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1780340628.548745:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1780340628.549200:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1780340628.549725:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1780340628.550348:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1780340628.550605:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1780340628.551396:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1780340628.551733:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1780340628.552286:0:83631:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:3.0:1780340628.553356:0:83631:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1780340628.553585:0:83631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1780340628.553592:0:83631:0:(osd_handler.c:8933:osd_obd_connect()) connect #0 00000020:00000080:3.0:1780340628.553602:0:83631:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa246514327737a6 00000020:01000004:3.0:1780340628.553609:0:83631:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1780340628.553627:0:83631:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1780340628.553632:0:83631:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c04858fb800 from MGS 00000020:01000004:3.0:1780340628.553636:0:83631:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1780340628.553645:0:83631:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8c03482b4d40) 00000020:00000080:3.0:1780340628.553656:0:83631:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1780340628.553717:0:83631:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c04858fb800 from MGS, refs=2 00080000:01000000:3.0:1780340628.553721:0:83631:0:(osd_handler.c:8933:osd_obd_connect()) connect #1 00000020:00000080:3.0:1780340628.553726:0:83631:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa246514327737b4 00010000:00010000:3.0:1780340628.555830:0:83631:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1780340628.568061:0:83631:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1780340628.574151:0:83636:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1780340628.574199:0:83631:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1780340628.574247:0:83631:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1780340628.582859:0:83631:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1780340628.583108:0:83631:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1780340628.583293:0:83631:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1780340628.583307:0:83631:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1780340628.583957:0:83631:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1780340628.583964:0:83631:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1780340628.584284:0:83631:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1780340628.584291:0:83631:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1780340628.585232:0:83631:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1780340628.585256:0:83631:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1780340628.585257:0:83631:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.116@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1780340628.585261:0:83631:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.116@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1780340628.585331:0:83631:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8c0475490800 already not connected (conn 58, was 0): CONNECTING 00000100:00100000:2.0:1780340628.585338:0:83631:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00010000:00010000:2.0:1780340629.386099:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340630.411489:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340631.434255:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340631.594964:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340631.595014:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340631.595076:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340631.595268:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940394496 00000100:00100000:0.0:1780340631.595280:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940394496 00000100:00100000:1.0:1780340631.595322:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940394752 00000100:00100000:0.0:1780340631.595322:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:1.0:1780340631.595326:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940394752 00000100:00100000:0.0:1780340631.595329:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2406:x1866818940394496:12345-192.168.203.16@tcp:250:kworker.0 00010000:00080000:0.0:1780340631.595354:0:83638:0:(ldlm_lib.c:1430:target_handle_connect()) MGS: connection from ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4@192.168.203.16@tcp t0 exp 0000000000000000 cur 3411 last 0 00000100:00100000:1.0:1780340631.595379:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940394624 00000100:00100000:1.0:1780340631.595382:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940394624 00000020:00000080:0.0:1780340631.595391:0:83638:0:(genops.c:1406:class_connect()) connect: client ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4, cookie 0xa246514327737bb 00000100:00100000:1.0:1780340631.595396:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1129 00000100:00100000:1.0:1780340631.595427:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940394752:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340631.595486:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940394752:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 72us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340631.595492:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1129 00000100:00080000:0.0:1780340631.595503:0:83638:0:(import.c:65:import_set_state_nolock()) ffff8c0349152800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780340631.595508:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1125 00000100:00100000:1.0:1780340631.595511:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940394624:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:1.0:1780340631.595526:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340631.595528:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+4:2406:x1866818940394496:12345-192.168.203.16@tcp:250:kworker.0 Request processed in 199us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340631.595535:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:1.0:1780340631.595542:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940394624:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 29us (466us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340631.595547:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1125 00000100:00080000:3.0:1780340631.595715:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780340631.947470:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1780340631.947478:0:3658:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780340621/real 1780340621] req@ffff8c034a206300 x1866818961043584/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780340631 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780340631.947480:0:49688:0:(pinger.c:249:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1780340631.947485:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340631.947493:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340631.947499:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340631.947506:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3406 00000100:00080000:3.0:1780340631.947512:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340631.947521:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340631.947524:0:3658:0:(client.c:2511:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c034a206300 x1866818961043584/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780340631 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340631.947550:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1780340631.947576:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047ace6a00 x1866818961046272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340631.947576:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1780340631.947594:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a206300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961043584:0@lo:250:kworker.0 00000100:00080000:3.0:1780340631.947627:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340631.947631:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:0.0:1780340631.947633:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961046272:0@lo:38:kworker.0 00000100:00080000:3.0:1780340631.947634:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340631.947642:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3406 00000100:00080000:3.0:1780340631.947645:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340631.947671:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340631.947687:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047ace6680 x1866818961046528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340631.947718:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340631.947722:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340631.947724:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340631.947728:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3406 00000100:00080000:3.0:1780340631.947730:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:0.0:1780340631.947736:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1780340631.947738:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 10000000:01000000:2.0:1780340631.947747:0:83631:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00100000:3.0:1780340631.947754:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047ace5500 x1866818961046784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340631.947826:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340631.947829:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340631.947831:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00010000:2.0:1780340631.947833:0:83631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4400/0xa24651432773403 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa2465143277340a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340631.947848:0:83631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4400/0xa24651432773403 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa2465143277340a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340631.947854:0:83631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1780340631.947868:0:83631:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340631.947877:0:83631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4400/0xa24651432773403 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa2465143277340a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340631.947895:0:83631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa24651432773369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773370 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340631.947902:0:83631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa24651432773369 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773370 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340631.947907:0:83631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340631.947928:0:83631:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340631.947932:0:83631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa24651432773369 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773370 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340631.947941:0:83631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04754c6800/0xa24651432773385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xa2465143277338c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340631.947947:0:83631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c6800/0xa24651432773385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xa2465143277338c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340631.947952:0:83631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340631.947955:0:83631:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340631.947958:0:83631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04754c6800/0xa24651432773385 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xa2465143277338c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340631.947966:0:83631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04754c7a00/0xa246514327733af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xa246514327733b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340631.947971:0:83631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c7a00/0xa246514327733af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xa246514327733b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340631.947976:0:83631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340631.947980:0:83631:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340631.947983:0:83631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04754c7a00/0xa246514327733af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xa246514327733b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340631.948124:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961046528:0@lo:38:kworker.0 00010000:00010000:2.0:1780340631.948133:0:83631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04754c6c00/0xa246514327733bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xa246514327733c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340631.948143:0:83631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c6c00/0xa246514327733bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xa246514327733c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340631.948161:0:83631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340631.948166:0:83631:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340631.948171:0:83631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04754c6c00/0xa246514327733bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xa246514327733c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340631.948180:0:83631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa246514327733d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xa246514327733e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340631.948187:0:83631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa246514327733d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xa246514327733e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340631.948192:0:83631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340631.948195:0:83631:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340631.948198:0:83631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa246514327733d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xa246514327733e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340631.948206:0:83631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa246514327733e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xa246514327733ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340631.948212:0:83631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa246514327733e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xa246514327733ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340631.948217:0:83631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340631.948220:0:83631:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340631.948223:0:83631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa246514327733e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xa246514327733ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340631.948232:0:83631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773418 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340631.948248:0:83631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773418 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340631.948253:0:83631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340631.948256:0:83631:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340631.948260:0:83631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773411 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773418 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340631.948270:0:83631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0476762c00/0xa24651432773377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa2465143277337e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340631.948276:0:83631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0476762c00/0xa24651432773377 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa2465143277337e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340631.948280:0:83631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340631.948283:0:83631:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340631.948286:0:83631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0476762c00/0xa24651432773377 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa2465143277337e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340631.948298:0:83631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0440030200/0xa24651432773393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa2465143277339a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340631.948304:0:83631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0440030200/0xa24651432773393 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa2465143277339a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340631.948309:0:83631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340631.948312:0:83631:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340631.948315:0:83631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0440030200/0xa24651432773393 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa2465143277339a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340631.948338:0:83631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0440030e00/0xa246514327733a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xa246514327733a8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340631.948345:0:83631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0440030e00/0xa246514327733a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xa246514327733a8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340631.948349:0:83631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1780340631.948353:0:83631:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340631.948356:0:83631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0440030e00/0xa246514327733a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xa246514327733a8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340631.948373:0:83631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa246514327733cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xa246514327733d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340631.948379:0:83631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa246514327733cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xa246514327733d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340631.948384:0:83631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1780340631.948387:0:83631:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340631.948390:0:83631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa246514327733cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xa246514327733d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340631.948397:0:83631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa246514327733f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa246514327733fc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340631.948404:0:83631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa246514327733f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa246514327733fc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340631.948408:0:83631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1780340631.948417:0:83631:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340631.948420:0:83631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa246514327733f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa246514327733fc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1780340631.948437:0:83631:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8c0475490800 already not connected (conn 58, was 0): DISCONN 00000100:00080000:2.0:1780340631.948442:0:83631:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340631.950541:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3406 00000100:00080000:3.0:1780340631.951095:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340631.951108:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340631.951161:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c048527fb80 x1866818961047168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340631.956150:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961046400:0@lo:400:kworker.0 00000100:00100000:1.0:1780340631.957815:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961046656:0@lo:400:kworker.0 00000100:00080000:2.0:1780340631.958133:0:83631:0:(import.c:512:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 3401 00000100:00080000:2.0:1780340631.958143:0:83631:0:(import.c:591:import_select_connection()) MGC192.168.203.116@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780340631.958152:0:83631:0:(import.c:626:import_select_connection()) MGC192.168.203.116@tcp: import ffff8c0475490800 using connection 192.168.203.116@tcp/0@lo 00000100:00080000:3.0:1780340631.958163:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340631.958223:0:49688:0:(pinger.c:249:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1780340631.958230:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048527c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961047040:0@lo:400:kworker.0 00000100:00100000:1.0:1780340631.958270:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340631.958335:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961047040 00000100:00100000:1.0:1780340631.958346:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961047040 00000100:00100000:3.0:1780340631.958417:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961046912:0@lo:400:kworker.0 00000100:00100000:1.0:1780340631.958435:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2394 00000100:00100000:1.0:1780340631.958447:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961047040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340631.958469:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340631.958515:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961047040:12345-0@lo:400:kworker.0 Request processed in 70us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340631.958523:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2394 00000100:00100000:3.0:1780340631.959080:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961046272 00000100:00100000:3.0:1780340631.959105:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961046272 00000100:00100000:3.0:1780340631.959141:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:3.0:1780340631.959148:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961046272:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780340631.959182:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340631.959230:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a210a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961046272:12345-0@lo:38:kworker.0 Request processed in 81us (11496us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340631.959237:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:0.0:1780340631.959503:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340631.959548:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961046784:0@lo:38:kworker.0 00000100:00100000:0.0:1780340631.959690:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780340631.959733:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340631.959739:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340631.959743:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961046272:0@lo:38:kworker.0 00000100:00100000:0.0:1780340631.959783:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048527fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961047168:0@lo:38:kworker.0 00000100:00100000:0.0:1780340631.959808:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340631.959841:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961046784 00000100:00100000:0.0:1780340631.959845:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961046784 00000100:00100000:0.0:1780340631.959870:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3747 00000100:00100000:0.0:1780340631.959876:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961046784:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340631.959890:0:26074:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340631.959920:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961046784:12345-0@lo:38:kworker.0 Request processed in 44us (231us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340631.959939:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3747 00000100:00100000:0.0:1780340631.959964:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961046528 00000100:00100000:0.0:1780340631.959968:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961046528 00000100:00100000:0.0:1780340631.959985:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961047168 00000100:00100000:0.0:1780340631.959987:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961047168 00000100:00100000:0.0:1780340631.960001:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:0.0:1780340631.960006:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961046528:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340631.960015:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340631.960041:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a211880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961046528:12345-0@lo:38:kworker.0 Request processed in 34us (11881us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340631.960047:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:0.0:1780340631.960057:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:0.0:1780340631.960061:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961047168:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340631.960069:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340631.960086:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a213100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961047168:12345-0@lo:38:kworker.0 Request processed in 24us (278us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340631.960092:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:0.0:1780340631.960119:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340631.960158:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961046400 00000100:00100000:0.0:1780340631.960161:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961046400 00000100:00100000:0.0:1780340631.960192:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:0.0:1780340631.960198:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961046400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340631.960237:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a210e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961046400:12345-0@lo:400:kworker.0 Request processed in 39us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340631.960243:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:0.0:1780340631.960273:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961046400:0@lo:400:kworker.0 00000100:00100000:0.0:1780340631.960303:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340631.960330:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961046656 00000100:00100000:0.0:1780340631.960333:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961046656 00000100:00100000:0.0:1780340631.960354:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:0.0:1780340631.960374:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961046656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340631.960408:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a212680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961046656:12345-0@lo:400:kworker.0 Request processed in 49us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340631.960414:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:0.0:1780340631.960438:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961046656:0@lo:400:kworker.0 00000100:00080000:0.0:1780340631.960456:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340631.960460:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340631.960463:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048527fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961047168:0@lo:38:kworker.0 00000100:00080000:0.0:1780340631.960471:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340631.960474:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340631.960478:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961046528:0@lo:38:kworker.0 00000100:00080000:0.0:1780340631.960485:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340631.960488:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340631.960491:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961046784:0@lo:38:kworker.0 00000100:00100000:2.0:1780340631.966195:0:83631:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d876680 x1866818961047296/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340631.966487:0:83631:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:2.0:1780340631.966519:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961047296:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1780340631.966689:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340631.966982:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961046912 00000100:00100000:1.0:1780340631.966993:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961046912 00000100:00100000:1.0:1780340631.967066:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2395 00000100:00100000:1.0:1780340631.967103:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961046912:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1780340631.967132:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340631.967147:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340631.967151:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340631.967181:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961046912:12345-0@lo:400:kworker.0 Request processed in 83us (8713us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340631.967189:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2395 00000100:00100000:0.0:1780340631.967512:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048527c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961047040:0@lo:400:kworker.0 00000100:00100000:2.0:1780340631.967653:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961047296 00000100:00100000:2.0:1780340631.967659:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961047296 00000100:00100000:2.0:1780340631.967699:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1780340631.967705:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3658:x1866818961047296:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1780340631.967732:0:83640:0:(ldlm_lib.c:1430:target_handle_connect()) MGS: connection from f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo t0 exp 0000000000000000 cur 3411 last 0 00000020:00000080:2.0:1780340631.967792:0:83640:0:(genops.c:1406:class_connect()) connect: client f26f7947-2bb0-4491-8dd4-005fa8e64f3a, cookie 0xa246514327737c2 00000100:00080000:2.0:1780340631.968512:0:83640:0:(import.c:65:import_set_state_nolock()) ffff8c0475fad000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340631.968675:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:3658:x1866818961047296:12345-0@lo:250:mount.lustre.0 Request processed in 967us (1985us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340631.968684:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1780340631.968797:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961046912:0@lo:400:kworker.0 00000100:00100000:0.0:1780340631.968869:0:3658:0:(client.c:3102:ptlrpc_free_committed()) MGC192.168.203.116@tcp: committing for last_committed 0 gen 24 00000100:00080000:0.0:1780340631.968878:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.116@tcp: connect to target with instance 0 00000100:00080000:0.0:1780340631.968887:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1780340631.968905:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1780340631.968909:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1780340631.968911:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1780340631.969083:0:3658:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1780340631.969093:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961047296:0@lo:250:mount.lustre.0 00000020:01000000:2.0:1780340631.969622:0:49688:0:(tgt_mount.c:1581:tgt_import_update()) NID #0: 192.168.203.116@tcp 10000000:01000000:2.0:1780340631.969652:0:49688:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1780340631.969655:0:49688:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1780340631.969657:0:49688:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1780340631.969659:0:49688:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340631.969660:0:49688:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340631.969662:0:49688:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340631.969663:0:49688:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340631.969665:0:49688:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780340631.969667:0:49688:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340631.969668:0:49688:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1780340631.969753:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961047424:0@lo:253:kworker.0 00000100:00100000:0.0:1780340631.969825:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1780340631.969906:0:49688:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1780340631.969914:0:49688:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1780340631.969915:0:49688:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1780340631.969916:0:49688:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1780340631.969917:0:49688:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340631.969918:0:49688:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340631.969929:0:49688:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340631.969930:0:49688:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340631.969931:0:49688:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780340631.969932:0:49688:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340631.969933:0:49688:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1780340631.969945:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961047424 00000100:00100000:1.0:1780340631.969952:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961047424 00000100:00100000:1.0:1780340631.969997:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1780340631.970006:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:3662:x1866818961047424:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1780340631.970036:0:83639:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000020:01000000:2.0:1780340631.970131:0:49688:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1780340631.970136:0:49688:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000100:00080000:1.0:1780340631.970222:0:83631:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1780340631.970234:0:83631:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1780340631.970279:0:83631:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1780340631.970284:0:83631:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000020:01000004:2.0:1780340631.970418:0:49688:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1780340631.970420:0:49688:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1780340631.970421:0:49688:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340631.970422:0:49688:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340631.970423:0:49688:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340631.970424:0:49688:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340631.970425:0:49688:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780340631.970427:0:49688:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000040:01000000:1.0:1780340631.970427:0:83631:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1780340631.970428:0:49688:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1780340631.970450:0:49688:0:(tgt_mount.c:1592:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000020:01000004:1.0:1780340631.970458:0:83631:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.116@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1780340631.970462:0:83631:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1780340631.970463:0:83631:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780340631.970464:0:83631:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780340631.970465:0:83631:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780340631.970466:0:83631:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780340631.970467:0:83631:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780340631.970468:0:83631:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780340631.970470:0:83631:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780340631.970471:0:83631:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780340631.970472:0:83631:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000100:00100000:2.0:1780340631.970474:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961047680:0@lo:253:kworker.0 10000000:01000000:1.0:1780340631.970475:0:83631:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1780340631.970477:0:83631:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1780340631.970478:0:83631:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780340631.970479:0:83631:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780340631.970480:0:83631:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780340631.970481:0:83631:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780340631.970483:0:83631:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780340631.970484:0:83631:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780340631.970488:0:83631:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780340631.970489:0:83631:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780340631.970489:0:83631:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1780340631.970503:0:83631:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1780340631.970512:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340631.970513:0:83631:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446f20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961047808:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1780340631.970542:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780340631.970544:0:83631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340631.970553:0:83631:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047215b240 going to sleep for 11 seconds 00000100:00100000:1.0:1780340631.970570:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961047680 00000100:00100000:1.0:1780340631.970574:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961047680 00000100:00100000:1.0:1780340631.970593:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961047808 00000100:00100000:1.0:1780340631.970595:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961047808 00000100:00100000:1.0:1780340631.970607:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1780340631.970613:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:3660:x1866818961047680:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1780340631.970633:0:83638:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:1.0:1780340631.970682:0:83641:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1780340631.970756:0:83639:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 104 00000100:00100000:2.0:1780340631.973171:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961047552:0@lo:253:kworker.0 00000100:00100000:2.0:1780340631.974116:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340631.974911:0:83640:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1780340631.974929:0:83640:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1780340631.975119:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961047552 00000100:00100000:1.0:1780340631.975132:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961047552 00000100:00100000:2.0:1780340631.975845:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1780340631.975861:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:83631:x1866818961047808:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1780340631.991982:0:83643:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1780340631.991992:0:83643:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1780340631.991995:0:83643:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1780340631.991998:0:83643:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1780340631.992465:0:83643:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1780340631.994030:0:83639:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1780340631.994104:0:83638:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1780340631.994792:0:83642:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1780340631.994798:0:83642:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1780340631.994814:0:83642:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1780340631.994823:0:83642:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1780340631.999692:0:83638:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1780340631.999711:0:83638:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1780340631.999855:0:83641:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1780340631.999861:0:83641:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1780340631.999895:0:83641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0476762c00/0xa246514327737c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340631.999917:0:83641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0476762c00/0xa246514327737c9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1780340631.999963:0:83641:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000103092s 00010000:00010000:1.0:1780340631.999969:0:83641:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0476762c00/0xa246514327737c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340631.999977:0:83641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0476762c00/0xa246514327737c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340631.999984:0:83641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0476762c00/0xa246514327737c9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.000169:0:83641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0476762c00/0xa246514327737c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.000178:0:83641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340632.000183:0:83641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0476762c00/0xa246514327737c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.000193:0:83641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0476762c00/0xa246514327737c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.000211:0:83641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0476762c00/0xa246514327737c9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.000446:0:83641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0476762c00/0xa246514327737c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.000453:0:83641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0476762c00/0xa246514327737c9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340632.000593:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3660:x1866818961047680:12345-0@lo:253:kworker.0 Request processed in 29975us (30075us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340632.000616:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1780340632.000672:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1780340632.000688:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:3660:x1866818961047552:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1780340632.000724:0:83638:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1780340632.000741:0:83638:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1780340632.001189:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:83631:x1866818961047808:12345-0@lo:253:mount.lustre.0 Request processed in 25331us (30642us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340632.001198:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:2.0:1780340632.002205:0:3660:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1780340632.002210:0:3660:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1780340632.002211:0:3660:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340632.002221:0:3660:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340632.002223:0:3660:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340632.002226:0:3660:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340632.002228:0:3660:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780340632.002230:0:3660:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340632.002232:0:3660:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1780340632.002237:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961047680:0@lo:253:kworker.0 00000100:00100000:1.0:1780340632.003812:0:83631:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446f20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961047808:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1780340632.003833:0:83631:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1780340632.003836:0:83631:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1780340632.003838:0:83631:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780340632.003839:0:83631:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780340632.003840:0:83631:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780340632.003841:0:83631:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780340632.003842:0:83631:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780340632.003844:0:83631:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780340632.003845:0:83631:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780340632.003847:0:83631:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780340632.003848:0:83631:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1780340632.003887:0:83631:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c04858fb800 from lustre-MDT0000 10000000:01000000:1.0:1780340632.004891:0:83631:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1780340632.004897:0:83631:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1780340632.004910:0:83631:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c04858fb800 10000000:01000000:1.0:1780340632.004916:0:83631:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1780340632.004934:0:83631:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c04858fb800 10000000:01000000:1.0:1780340632.004938:0:83631:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1780340632.004942:0:83631:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8c04858fb800 from 1 10000000:01000000:1.0:1780340632.004946:0:83631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1780340632.005472:0:83631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa246514327737d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.005487:0:83631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa246514327737d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.005524:0:83631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa246514327737d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340632.005566:0:83631:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446f20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961047936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1780340632.005653:0:83631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340632.005705:0:83631:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047215bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1780340632.005816:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961047936 00000100:00100000:2.0:1780340632.005826:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961047936 00000100:00100000:2.0:1780340632.005885:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1780340632.005897:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:83631:x1866818961047936:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780340632.005914:0:83640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340632.005943:0:83640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a32be00/0xa246514327737d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327737d0 expref: -99 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340632.005972:0:83640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a32be00/0xa246514327737d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327737d0 expref: 7 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340632.006051:0:83640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a32be00/0xa246514327737d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327737d0 expref: 7 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340632.006063:0:83640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32be00, rc 0) 00000100:00100000:2.0:1780340632.006118:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:83631:x1866818961047936:12345-0@lo:101:mount.lustre.0 Request processed in 224us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340632.006127:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1780340632.007453:0:83631:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446f20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961047936:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780340632.007481:0:83631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa246514327737d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327737d7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.007494:0:83631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa246514327737d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327737d7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340632.007518:0:83631:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1780340632.007537:0:83631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa246514327737d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327737d7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.007556:0:83631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa246514327737d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327737d7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340632.007566:0:83631:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1780340632.007573:0:83631:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1780340632.007579:0:83631:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c04858fb800 10000000:01000000:1.0:1780340632.007582:0:83631:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1780340632.007587:0:83631:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1780340632.007590:0:83631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1780340632.007623:0:83631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763e00/0xa246514327737de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.007643:0:83631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0476763e00/0xa246514327737de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.007653:0:83631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0476763e00/0xa246514327737de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340632.007673:0:83631:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446f20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961048064:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1780340632.007725:0:83631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340632.007792:0:83631:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047215bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340632.008253:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961048064 00000100:00100000:0.0:1780340632.008262:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961048064 00000100:00100000:0.0:1780340632.008324:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1780340632.008334:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:83631:x1866818961048064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340632.008349:0:83640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340632.008380:0:83640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04441c4000/0xa246514327737e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327737de expref: -99 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.008402:0:83640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04441c4000/0xa246514327737e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327737de expref: 8 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.008413:0:83640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04441c4000/0xa246514327737e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327737de expref: 8 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.008422:0:83640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04441c4000, rc 0) 00000100:00100000:0.0:1780340632.008485:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:83631:x1866818961048064:12345-0@lo:101:mount.lustre.0 Request processed in 151us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340632.008492:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 20000000:01000000:2.0:1780340632.009096:0:83638:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1780340632.009108:0:83638:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1780340632.009634:0:83639:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1780340632.009897:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3660:x1866818961047552:12345-0@lo:253:kworker.0 Request processed in 9212us (35782us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340632.009907:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 20000000:01000000:1.0:1780340632.010092:0:83641:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1780340632.010099:0:83641:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1780340632.010120:0:83641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0476762e00/0xa246514327737ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.010136:0:83641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0476762e00/0xa246514327737ec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1780340632.010701:0:3660:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1780340632.010704:0:3660:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1780340632.010706:0:3660:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340632.010707:0:3660:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780340632.010708:0:3660:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340632.010710:0:3660:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340632.010711:0:3660:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1780340632.010713:0:3660:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780340632.010714:0:3660:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1780340632.010718:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961047552:0@lo:253:kworker.0 20000000:01000000:1.0:1780340632.010822:0:83641:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000725100s 00010000:00010000:1.0:1780340632.010829:0:83641:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0476762e00/0xa246514327737ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.010837:0:83641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0476762e00/0xa246514327737ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.010843:0:83641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0476762e00/0xa246514327737ec lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.010850:0:83641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0476762e00/0xa246514327737ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.010878:0:83641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340632.010884:0:83641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0476762e00/0xa246514327737ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.010893:0:83641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0476762e00/0xa246514327737ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.010910:0:83641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0476762e00/0xa246514327737ec lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.010917:0:83641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0476762e00/0xa246514327737ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.010934:0:83641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0476762e00/0xa246514327737ec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340632.010983:0:83631:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446f20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961048064:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780340632.011474:0:83631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0476763e00/0xa246514327737de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327737e5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.011485:0:83631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0476763e00/0xa246514327737de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327737e5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340632.011671:0:83631:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446f20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961048192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780340632.011732:0:83631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340632.011809:0:83631:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047215bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340632.011868:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961048192 00000100:00100000:0.0:1780340632.011875:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961048192 00000100:00100000:0.0:1780340632.011928:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1780340632.011938:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:83631:x1866818961048192:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780340632.012462:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:83631:x1866818961048192:12345-0@lo:501:mount.lustre.0 Request processed in 522us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340632.012471:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1780340632.012637:0:83631:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446f20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961048192:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780340632.012696:0:83631:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446f20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961048320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780340632.012741:0:83631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340632.012819:0:83631:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047215bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1780340632.012891:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961048320 00000100:00100000:2.0:1780340632.012896:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961048320 00000100:00100000:2.0:1780340632.012927:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1780340632.012935:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:83631:x1866818961048320:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780340632.017333:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:83631:x1866818961048320:12345-0@lo:503:mount.lustre.0 Request processed in 4386us (4578us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340632.017351:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1780340632.017584:0:83631:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446f20380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961048320:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780340632.020381:0:83644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446f20380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83644:1866818961048448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340632.020493:0:83644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340632.020547:0:83644:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047215b840 going to sleep for 11 seconds 00000100:00100000:0.0:1780340632.020645:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961048448 00000100:00100000:0.0:1780340632.020655:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961048448 00000100:00100000:0.0:1780340632.020716:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1780340632.020729:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:83644:x1866818961048448:12345-0@lo:502:llog_process_th.0 20000000:01000000:2.0:1780340632.020958:0:83639:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1780340632.020972:0:83639:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1780340632.022075:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:3662:x1866818961047424:12345-0@lo:253:kworker.0 Request processed in 52063us (52243us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340632.022088:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 20000000:01000000:3.0:1780340632.022465:0:83641:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1780340632.022472:0:83641:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1780340632.022508:0:83641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c046fb21400/0xa246514327737f3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340632.022530:0:83641:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c046fb21400/0xa246514327737f3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1780340632.022542:0:83641:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000725100s 00010000:00010000:3.0:1780340632.022548:0:83641:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c046fb21400/0xa246514327737f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340632.022556:0:83641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c046fb21400/0xa246514327737f3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340632.022564:0:83641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c046fb21400/0xa246514327737f3 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340632.022572:0:83641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c046fb21400/0xa246514327737f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340632.022580:0:83641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c046fb21400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340632.022585:0:83641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c046fb21400/0xa246514327737f3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340632.022612:0:83641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c046fb21400/0xa246514327737f3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340632.022630:0:83641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c046fb21400/0xa246514327737f3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340632.022639:0:83641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c046fb21400/0xa246514327737f3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340632.022646:0:83641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c046fb21400/0xa246514327737f3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1780340632.022938:0:3662:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1780340632.022941:0:3662:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1780340632.022943:0:3662:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340632.022945:0:3662:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780340632.022946:0:3662:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340632.022948:0:3662:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340632.022950:0:3662:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1780340632.022957:0:3662:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780340632.022959:0:3662:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1780340632.022963:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961047424:0@lo:253:kworker.0 00000100:00100000:1.0:1780340632.023605:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:83644:x1866818961048448:12345-0@lo:502:llog_process_th.0 Request processed in 2875us (3107us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340632.023616:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1780340632.023645:0:83644:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446f20380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83644:1866818961048448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780340632.023683:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780340632.023697:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340632.023700:0:83644:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1780340632.023705:0:83644:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1780340632.023708:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1780340632.023727:0:83644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8c03482b0000) 00000020:00000080:3.0:1780340632.023755:0:83644:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:3.0:1780340632.023800:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1780340632.023925:0:83644:0:(osd_handler.c:8933:osd_obd_connect()) connect #2 00000020:00000080:3.0:1780340632.023935:0:83644:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432773801 00000020:00000080:3.0:1780340632.024270:0:83644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1780340632.024275:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780340632.024280:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340632.024282:0:83644:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1780340632.024285:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780340632.024288:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340632.024290:0:83644:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1780340632.024302:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1780340632.024322:0:83644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8c03482b3380) 00000020:00000080:3.0:1780340632.024338:0:83644:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:3.0:1780340632.024343:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1780340632.024345:0:83644:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1780340632.024349:0:83644:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1780340632.024356:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1780340632.024422:0:83644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c04858fb800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1780340632.024439:0:83644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8c047658cd40) 00000020:00000080:3.0:1780340632.024449:0:83644:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:3.0:1780340632.024516:0:83644:0:(lod_dev.c:2290:lod_obd_connect()) connect #0 00000020:00000080:3.0:1780340632.024528:0:83644:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432773816 00000020:00000080:3.0:1780340632.024647:0:83644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1780340632.024654:0:83644:0:(mdd_device.c:1668:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1780340632.024659:0:83644:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa2465143277381d 00080000:01000000:3.0:1780340632.024665:0:83644:0:(osd_handler.c:8933:osd_obd_connect()) connect #3 00000020:00000080:3.0:1780340632.024669:0:83644:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432773824 00010000:00010000:2.0:1780340632.161556:0:83644:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1780340632.161730:0:83644:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: e06e5cf1-1986-4ba7-9630-fad7efb74eca idx: 0 lr: 94489280519 srv lr: 98784247808 lx: 0 gen 22 00000001:00080000:3.0:1780340632.162224:0:83644:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 98784247808 lx: 0 gen 21 00000001:00000004:3.0:1780340632.162322:0:83644:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 98784247808 00000001:00080000:3.0:1780340632.162462:0:83644:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1780340632.162534:0:83644:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8c047215b840: xid 1866818940387456, transno 98784247812, client gen 22, slot idx 0 00000001:00080000:3.0:1780340632.162543:0:83644:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8c047215b780: xid 1866818940387200, transno 98784247811, client gen 22, slot idx 1 00000020:00000080:3.0:1780340632.163645:0:83644:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8c0476588000) 00000020:00000080:3.0:1780340632.163672:0:83644:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:3.0:1780340632.163799:0:83644:0:(osd_handler.c:8933:osd_obd_connect()) connect #4 00000020:00000080:3.0:1780340632.163806:0:83644:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432773840 00000020:00000080:0.0:1780340632.164614:0:83644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1780340632.173517:0:83644:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa24651432773847 00000020:00000080:1.0:1780340632.182449:0:83644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1780340632.182471:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340632.182487:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340632.182490:0:83644:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1780340632.182493:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1780340632.182497:0:83644:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1780340632.182499:0:83644:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780340632.182501:0:83644:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780340632.182503:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1780340632.182505:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340632.182506:0:83644:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1780340632.182509:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780340632.182515:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340632.182517:0:83644:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1780340632.182523:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1780340632.182599:0:83644:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1780340632.182620:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340632.182623:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340632.182625:0:83644:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1780340632.182644:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780340632.182648:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340632.182649:0:83644:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1780340632.182652:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1780340632.182658:0:83644:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:00000080:1.0:1780340632.182690:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780340632.182711:0:83644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8c0445ba19c0) 00000020:00000080:1.0:1780340632.182742:0:83644:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1780340632.182748:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1780340632.182863:0:83644:0:(osp_dev.c:1197:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1780340632.182870:0:83644:0:(osd_handler.c:8933:osd_obd_connect()) connect #5 00000020:00000080:1.0:1780340632.182878:0:83644:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432773855 00010000:00080000:1.0:1780340632.182932:0:83644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c046b908800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:1.0:1780340632.184819:0:83644:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1780340632.188504:0:83644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340632.188522:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1780340632.188573:0:83644:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1780340632.188598:0:83644:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2465143277385c 00000100:00080000:0.0:1780340632.188611:0:83644:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1780340632.188619:0:83644:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c046b908800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340632.188664:0:83644:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a210380 x1866818961048576/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340632.188748:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961048576:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1780340632.188872:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340632.189097:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961048576 00000100:00100000:3.0:1780340632.189107:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961048576 00000100:00100000:3.0:1780340632.189139:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3748 00000100:00100000:3.0:1780340632.189148:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961048576:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1780340632.189180:0:8410:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3412 last 0 00000020:00000080:3.0:1780340632.189232:0:8410:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432773863 00000004:00100000:3.0:1780340632.189262:0:8410:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1780340632.189408:0:8410:0:(import.c:65:import_set_state_nolock()) ffff8c04754ec800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1780340632.189626:0:83644:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1780340632.189717:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780340632.189722:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340632.189725:0:83644:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1780340632.189728:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1780340632.189732:0:83644:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1780340632.189734:0:83644:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1780340632.189735:0:83644:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1780340632.189737:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1780340632.189740:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340632.189741:0:83644:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1780340632.189744:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1780340632.189750:0:83644:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1780340632.189753:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340632.189755:0:83644:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1780340632.189776:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1780340632.189781:0:83644:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:01000000:0.0:1780340632.189806:0:83644:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1780340632.189815:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1780340632.189844:0:83644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c0471d519c0) 00000020:00000080:0.0:1780340632.189867:0:83644:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1780340632.189873:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1780340632.189969:0:83644:0:(osp_dev.c:1197:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1780340632.189977:0:83644:0:(osd_handler.c:8933:osd_obd_connect()) connect #6 00000020:00000080:0.0:1780340632.189985:0:83644:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432773871 00010000:00080000:0.0:1780340632.190019:0:83644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c046b96f000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:0.0:1780340632.190451:0:83644:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00080000:2.0:1780340632.191114:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340632.191122:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340632.191126:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340632.191133:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3411 00000100:00080000:2.0:1780340632.191138:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340632.191152:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340632.191189:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d875c00 x1866818961048704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:01000000:0.0:1780340632.191753:0:83644:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1780340632.191797:0:83644:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1780340632.192131:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961048704:0@lo:38:kworker.0 00000100:00100000:1.0:1780340632.192211:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340632.192314:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961048704 00000100:00100000:0.0:1780340632.192325:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961048704 00000100:00100000:0.0:1780340632.192371:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:0.0:1780340632.192380:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961048704:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1780340632.192438:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961048704:12345-0@lo:38:kworker.0 Request processed in 58us (228us total) trans 0 rc -11/-11 00000100:00100000:0.0:1780340632.192445:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000040:00080000:0.0:1780340632.192533:0:83644:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:0.0:1780340632.193315:0:83644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1780340632.193344:0:83644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].24, 64 off9728 00000040:00080000:0.0:1780340632.193484:0:83644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x60:0x0].1, 64 off8256 00000100:00100000:3.0:1780340632.193742:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1866818961048576:12345-0@lo:38:llog_process_th.0 Request processed in 4589us (4866us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340632.193754:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3748 00000040:00080000:3.0:1780340632.194191:0:83650:0:(llog.c:800:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:3.0:1780340632.194196:0:83650:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1780340632.194330:0:83650:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:3.0:1780340632.194344:0:83650:0:(llog_cat.c:1250:llog_cat_cleanup()) cancel plain log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1780340632.194467:0:83650:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:3.0:1780340632.194470:0:83650:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000100:00080000:2.0:1780340632.194696:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340632.194702:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340632.194706:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340632.194713:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3411 00000100:00080000:2.0:1780340632.194717:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340632.194723:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340632.194746:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d874700 x1866818961048960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340632.194784:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340632.194787:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340632.194789:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340632.194792:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3411 00000100:00080000:2.0:1780340632.194795:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340632.194799:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340632.194809:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d874380 x1866818961049216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340632.194944:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961048832:0@lo:400:kworker.0 00000100:00100000:0.0:1780340632.195011:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340632.195043:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780340632.195049:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961049088:0@lo:400:kworker.0 00000100:00100000:0.0:1780340632.195068:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340632.195109:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961048832 00000100:00100000:0.0:1780340632.195116:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961048832 00000100:00100000:0.0:1780340632.195159:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961049088 00000100:00100000:0.0:1780340632.195172:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961049088 00000100:00100000:0.0:1780340632.195196:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:0.0:1780340632.195204:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961048832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340632.195383:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961048832:12345-0@lo:400:kworker.0 Request processed in 179us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340632.195391:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:0.0:1780340632.195407:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:0.0:1780340632.195414:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961049088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340632.195438:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961049088:12345-0@lo:400:kworker.0 Request processed in 26us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340632.195444:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:0.0:1780340632.195496:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961049088:0@lo:400:kworker.0 00000100:00100000:0.0:1780340632.195507:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961048832:0@lo:400:kworker.0 00000100:00080000:2.0:1780340632.195596:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340632.195600:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340632.195602:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340632.195606:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3411 00000100:00080000:2.0:1780340632.195609:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340632.195622:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340632.195638:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d876680 x1866818961049600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340632.195678:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961049472:0@lo:400:kworker.0 00000100:00100000:2.0:1780340632.195714:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340632.195736:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340632.195742:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961049344:0@lo:400:kworker.0 00000100:00100000:2.0:1780340632.195793:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340632.196304:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961049472 00000100:00100000:2.0:1780340632.196310:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961049472 00000100:00100000:2.0:1780340632.196346:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961049344 00000100:00100000:2.0:1780340632.196349:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961049344 00000100:00100000:2.0:1780340632.196378:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2396 00000100:00100000:2.0:1780340632.196385:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961049472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340632.196428:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961049472:12345-0@lo:400:kworker.0 Request processed in 45us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340632.196435:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2396 00000100:00100000:2.0:1780340632.196451:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2397 00000100:00100000:2.0:1780340632.196456:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961049344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340632.196479:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961049344:12345-0@lo:400:kworker.0 Request processed in 23us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340632.196484:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2397 00000100:00100000:2.0:1780340632.196518:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961049344:0@lo:400:kworker.0 00000100:00100000:2.0:1780340632.196527:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961049472:0@lo:400:kworker.0 00000100:00100000:1.0:1780340632.196790:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1780340632.196802:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:1.0:1780340632.196811:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1780340632.196817:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1780340632.196829:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c046b908800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1780340632.196838:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961048576:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1780340632.196857:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961048960:0@lo:38:kworker.0 00000100:00100000:1.0:1780340632.196890:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340632.196912:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961049216:0@lo:38:kworker.0 00000100:00100000:2.0:1780340632.197062:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961048960 00000100:00100000:2.0:1780340632.197073:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961048960 00000100:00100000:2.0:1780340632.197099:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1780340632.197104:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961048960:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1780340632.197151:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961048960:12345-0@lo:38:kworker.0 Request processed in 46us (260us total) trans 0 rc -11/-11 00000100:00100000:2.0:1780340632.197157:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:1.0:1780340632.197224:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340632.197313:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961049600:0@lo:38:kworker.0 00000100:00100000:1.0:1780340632.197340:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780340632.197381:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340632.197386:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1780340632.197389:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961048704:0@lo:38:kworker.0 00000100:00080000:1.0:1780340632.197405:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340632.197408:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1780340632.197411:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961048960:0@lo:38:kworker.0 00000100:00100000:1.0:1780340632.197437:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961049216 00000100:00100000:1.0:1780340632.197440:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961049216 00000100:00100000:1.0:1780340632.197465:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3749 00000100:00100000:1.0:1780340632.197468:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961049216:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1780340632.197503:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a210380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961049216:12345-0@lo:38:kworker.0 Request processed in 34us (279us total) trans 0 rc -11/-11 00000100:00100000:1.0:1780340632.197509:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3749 00000100:00080000:1.0:1780340632.197536:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340632.197540:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1780340632.197543:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961049216:0@lo:38:kworker.0 00000100:00100000:1.0:1780340632.197598:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340632.197606:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961049728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340632.197632:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340632.197659:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961049728 00000100:00100000:1.0:1780340632.197663:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961049728 00000100:00100000:1.0:1780340632.197686:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3750 00000100:00100000:1.0:1780340632.197692:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961049728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780340632.197729:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:1.0:1780340632.197797:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961049728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340632.197804:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3750 00000100:00100000:1.0:1780340632.197896:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961049728:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780340632.198092:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961049600 00000100:00100000:3.0:1780340632.198097:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961049600 00000100:00100000:3.0:1780340632.198120:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:3.0:1780340632.198126:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961049600:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1780340632.198174:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961049600:12345-0@lo:38:kworker.0 Request processed in 47us (832us total) trans 0 rc -11/-11 00000100:00100000:3.0:1780340632.198180:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00080000:2.0:1780340632.198233:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340632.198246:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1780340632.198251:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961049600:0@lo:38:kworker.0 00000020:00000080:2.0:1780340632.199174:0:83644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780340632.199192:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1780340632.199318:0:83644:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1780340632.199342:0:83644:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432773878 00000100:00080000:2.0:1780340632.199352:0:83644:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1780340632.199367:0:83644:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c046b96f000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340632.199402:0:83644:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d876680 x1866818961049856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340632.199469:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961049856:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1780340632.199526:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340632.199611:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961049856 00000100:00100000:0.0:1780340632.199618:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961049856 00000100:00100000:0.0:1780340632.199655:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5870 00000100:00100000:0.0:1780340632.199662:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3658:x1866818961049856:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1780340632.199689:0:8401:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3412 last 0 00000020:00000080:0.0:1780340632.199718:0:8401:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2465143277387f 00002000:00100000:0.0:1780340632.199735:0:8401:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c0485a54800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211351c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1780340632.199741:0:8401:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1780340632.199745:0:8401:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1780340632.199879:0:8401:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1780340632.199905:0:8401:0:(import.c:65:import_set_state_nolock()) ffff8c0485a50800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1780340632.200051:0:83644:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1780340632.200127:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340632.200131:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340632.200133:0:83644:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1780340632.200137:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1780340632.200140:0:83644:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1780340632.200142:0:83644:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1780340632.200144:0:83644:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1780340632.200145:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1780340632.200148:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340632.200150:0:83644:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1780340632.200153:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1780340632.200159:0:83644:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1780340632.200177:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340632.200179:0:83644:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1780340632.200182:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1780340632.200188:0:83644:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:01000000:2.0:1780340632.200212:0:83644:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1780340632.200214:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1780340632.200229:0:83644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c047ac74d40) 00000020:00000080:2.0:1780340632.200387:0:83644:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:2.0:1780340632.200396:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1780340632.200493:0:83644:0:(osp_dev.c:1197:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1780340632.200501:0:83644:0:(osd_handler.c:8933:osd_obd_connect()) connect #7 00000020:00000080:2.0:1780340632.200509:0:83644:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2465143277388d 00010000:00080000:2.0:1780340632.200543:0:83644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c045f0c6000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:2.0:1780340632.200818:0:83644:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1780340632.201118:0:83644:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1780340632.201136:0:83644:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1780340632.201638:0:83644:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000040:00080000:2.0:1780340632.202435:0:83644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1780340632.202466:0:83644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].24, 64 off9728 00000040:00080000:2.0:1780340632.202717:0:83644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x62:0x0].1, 64 off8256 00000040:00080000:2.0:1780340632.205583:0:83652:0:(llog.c:800:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:2.0:1780340632.205593:0:83652:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1780340632.206306:0:83652:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000040:00080000:2.0:1780340632.206342:0:83652:0:(llog_cat.c:1250:llog_cat_cleanup()) cancel plain log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1780340632.206519:0:83652:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:2.0:1780340632.206523:0:83652:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1780340632.206881:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3658:x1866818961049856:12345-0@lo:8:llog_process_th.0 Request processed in 7209us (7346us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340632.206914:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5870 00000100:00100000:1.0:1780340632.207558:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1780340632.207574:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1780340632.207585:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1780340632.207592:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1780340632.207596:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c046b96f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1780340632.207616:0:3658:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:1.0:1780340632.207625:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961049856:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1780340632.207716:0:83650:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1780340632.207818:0:83650:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3412197057855ns, next at 0ns, rc = 0 00080000:00080000:3.0:1780340632.207836:0:83650:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1780340632.208732:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780340632.208750:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961049984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340632.208872:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340632.209204:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961049984 00000100:00100000:3.0:1780340632.209214:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961049984 00000100:00100000:3.0:1780340632.209292:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:3.0:1780340632.209303:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961049984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780340632.209339:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340632.209401:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961049984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340632.209423:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00100000:0.0:1780340632.209556:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961049984:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1780340632.210389:0:83633:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00080000:1.0:1780340632.210482:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1780340632.211435:0:83644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340632.211455:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1780340632.211517:0:83644:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1780340632.211547:0:83644:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432773894 00000100:00080000:0.0:1780340632.211559:0:83644:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1780340632.211566:0:83644:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c045f0c6000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340632.211609:0:83644:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047ace5c00 x1866818961050112/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340632.211685:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961050112:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1780340632.212054:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340632.212143:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961050112 00000100:00100000:3.0:1780340632.212152:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961050112 00000100:00100000:3.0:1780340632.212197:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5871 00000100:00100000:3.0:1780340632.212206:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3658:x1866818961050112:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1780340632.212253:0:8830:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3412 last 0 00000020:00000080:3.0:1780340632.212291:0:8830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2465143277389b 00002000:00100000:3.0:1780340632.212308:0:8830:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c0475708000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211351c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1780340632.212314:0:8830:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1780340632.212317:0:8830:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1780340632.212418:0:8830:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1780340632.212444:0:8830:0:(import.c:65:import_set_state_nolock()) ffff8c0475708800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1780340632.213096:0:83644:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1780340632.213206:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780340632.213213:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340632.213216:0:83644:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1780340632.213220:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780340632.213225:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340632.213227:0:83644:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1780340632.213230:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1780340632.213232:0:83644:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1780340632.213235:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780340632.213366:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340632.213368:0:83644:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1780340632.213372:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780340632.213375:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340632.213376:0:83644:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1780340632.213396:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1780340632.213446:0:83644:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83644:1866818961050240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340632.213516:0:83644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340632.213556:0:83644:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9000 going to sleep for 11 seconds 00000100:00100000:2.0:1780340632.213626:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961050240 00000100:00100000:2.0:1780340632.213632:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961050240 00000100:00100000:2.0:1780340632.213683:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1780340632.213692:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:83644:x1866818961050240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340632.213859:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:83644:x1866818961050240:12345-0@lo:502:llog_process_th.0 Request processed in 168us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340632.213868:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1780340632.214086:0:83644:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83644:1866818961050240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1780340632.214112:0:83644:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780340632.214117:0:83644:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340632.214119:0:83644:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1780340632.214123:0:83644:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1780340632.214324:0:83631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1780340632.214351:0:83631:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1780340632.214380:0:83631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763e00/0xa246514327737de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327737e5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340632.214394:0:83631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0476763e00/0xa246514327737de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327737e5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340632.214403:0:83631:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c04858fb800 from 1 10000000:01000000:2.0:1780340632.214407:0:83631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1780340632.214441:0:83631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa246514327738a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340632.214449:0:83631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa246514327738a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340632.214458:0:83631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa246514327738a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340632.214475:0:83631:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961050368:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780340632.214508:0:83631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340632.214532:0:83631:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04515b2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1780340632.214556:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961050368 00000100:00100000:2.0:1780340632.214561:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961050368 00000100:00100000:2.0:1780340632.214590:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1780340632.214597:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:83631:x1866818961050368:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780340632.214618:0:83639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340632.214632:0:83639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a32a800/0xa246514327738a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327738a2 expref: -99 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340632.214659:0:83639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a32a800/0xa246514327738a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327738a2 expref: 8 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340632.214671:0:83639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a32a800/0xa246514327738a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327738a2 expref: 8 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340632.214681:0:83639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32a800, rc 0) 00000100:00100000:2.0:1780340632.214713:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:83631:x1866818961050368:12345-0@lo:101:mount.lustre.0 Request processed in 117us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340632.214720:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1780340632.214753:0:83631:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961050368:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780340632.214785:0:83631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa246514327738a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327738a9 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340632.214794:0:83631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa246514327738a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327738a9 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340632.215545:0:83631:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961050496:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1780340632.215591:0:83631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340632.215613:0:83631:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0447d0c840 going to sleep for 11 seconds 00000100:00100000:2.0:1780340632.215634:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961050496 00000100:00100000:2.0:1780340632.215639:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961050496 00000100:00100000:2.0:1780340632.215670:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1780340632.215677:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:83631:x1866818961050496:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1780340632.215700:0:83638:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1780340632.215722:0:83638:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1780340632.215726:0:83638:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1780340632.215730:0:83638:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1780340632.215732:0:83638:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 107 00000100:00100000:2.0:1780340632.216071:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:83631:x1866818961050496:12345-0@lo:256:mount.lustre.0 Request processed in 392us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340632.216080:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1780340632.216123:0:83631:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961050496:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1780340632.216409:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3658:x1866818961050112:12345-0@lo:8:llog_process_th.0 Request processed in 4202us (4354us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340632.216421:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5871 00000100:00100000:1.0:1780340632.217021:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1780340632.217032:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1780340632.217042:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1780340632.217048:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1780340632.217053:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c045f0c6000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1780340632.217108:0:3658:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:1.0:1780340632.217116:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961050112:0@lo:8:llog_process_th.0 10000000:01000000:2.0:1780340632.217418:0:83631:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1780340632.217435:0:83631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa246514327738a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327738a9 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340632.217447:0:83631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa246514327738a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327738a9 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780340632.217602:0:83652:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1780340632.217712:0:83652:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3412206952063ns, next at 0ns, rc = 0 00080000:00080000:0.0:1780340632.217719:0:83652:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 10000000:01000000:0.0:1780340632.218798:0:83631:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c04858fb800 from 1 10000000:01000000:0.0:1780340632.218807:0:83631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1780340632.218868:0:83631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c4e00/0xa246514327738b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.218881:0:83631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04441c4e00/0xa246514327738b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.218893:0:83631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04441c4e00/0xa246514327738b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340632.219042:0:83631:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961050624:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1780340632.219123:0:83631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340632.219169:0:83631:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9000 going to sleep for 11 seconds 00000004:00080000:1.0:1780340632.219411:0:83633:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1780340632.219553:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961050624 00000100:00100000:2.0:1780340632.219564:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961050624 00000100:00100000:2.0:1780340632.219621:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1780340632.219632:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:83631:x1866818961050624:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780340632.219649:0:83639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340632.219669:0:83639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a32b000/0xa246514327738b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327738b0 expref: -99 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340632.219699:0:83639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a32b000/0xa246514327738b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327738b0 expref: 9 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340632.219712:0:83639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a32b000/0xa246514327738b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327738b0 expref: 9 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340632.219729:0:83639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32b000, rc 0) 00000100:00100000:2.0:1780340632.219803:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:83631:x1866818961050624:12345-0@lo:101:mount.lustre.0 Request processed in 173us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340632.219811:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1780340632.220202:0:83631:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961050624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780340632.220220:0:83631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04441c4e00/0xa246514327738b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327738b7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340632.220231:0:83631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04441c4e00/0xa246514327738b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327738b7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340632.220402:0:83631:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961050752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780340632.220440:0:83631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340632.220477:0:83631:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0447d0c600 going to sleep for 11 seconds 00000100:00100000:1.0:1780340632.220705:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961050752 00000100:00100000:1.0:1780340632.220711:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961050752 00000100:00100000:1.0:1780340632.220748:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1780340632.220756:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03477f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:83631:x1866818961050752:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780340632.221144:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03477f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:83631:x1866818961050752:12345-0@lo:501:mount.lustre.0 Request processed in 388us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340632.221152:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1780340632.221376:0:83631:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961050752:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780340632.221418:0:83631:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961050880:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780340632.221476:0:83631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340632.221495:0:83631:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1780340632.221546:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961050880 00000100:00100000:1.0:1780340632.221551:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961050880 00000100:00100000:1.0:1780340632.221584:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1780340632.221592:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03477f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:83631:x1866818961050880:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780340632.221888:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03477f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:83631:x1866818961050880:12345-0@lo:503:mount.lustre.0 Request processed in 232us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340632.221895:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1780340632.222083:0:83631:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961050880:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780340632.222678:0:83654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83654:1866818961051008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340632.222728:0:83654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340632.222902:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961051008 00000100:00100000:1.0:1780340632.222908:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961051008 00000100:00100000:1.0:1780340632.223082:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1780340632.223090:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03477f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:83654:x1866818961051008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340632.223666:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961051136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340632.223719:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340632.223838:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961051136 00000100:00100000:3.0:1780340632.223843:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961051136 00000100:00100000:3.0:1780340632.223895:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:3.0:1780340632.223903:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961051136:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1780340632.224049:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1780340632.224086:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340632.224149:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961051136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 246us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340632.224157:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00000100:00100000:0.0:1780340632.224255:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961051136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340632.224509:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03477f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:83654:x1866818961051008:12345-0@lo:502:llog_process_th.0 Request processed in 1419us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340632.224518:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1780340632.224668:0:83654:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1780340632.224684:0:83654:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83654:1866818961051008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780340632.224718:0:83654:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340632.224731:0:83654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340632.224733:0:83654:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1780340632.224742:0:83654:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c04858fb800 00000020:00000080:2.0:1780340632.224745:0:83654:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1780340632.227353:0:83654:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780340632.227515:0:83654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340632.227520:0:83654:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1780340632.227528:0:83654:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780340632.227554:0:83654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340632.227556:0:83654:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1780340632.227562:0:83654:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c04858fb800 00000020:00000080:3.0:1780340632.227565:0:83654:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1780340632.227745:0:83654:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83654:1866818961051264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340632.227882:0:83654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340632.228120:0:83654:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034aa82c00 going to sleep for 11 seconds 00000100:00100000:1.0:1780340632.228183:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961051264 00000100:00100000:1.0:1780340632.228194:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961051264 00000100:00100000:1.0:1780340632.228269:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1780340632.228280:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03477f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:83654:x1866818961051264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340632.228447:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03477f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:83654:x1866818961051264:12345-0@lo:502:llog_process_th.0 Request processed in 168us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340632.228455:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1780340632.228546:0:83654:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f6d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83654:1866818961051264:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780340632.228590:0:83654:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340632.228596:0:83654:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340632.228598:0:83654:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1780340632.228603:0:83654:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1780340632.231867:0:83631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1780340632.231898:0:83631:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1780340632.231933:0:83631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c4e00/0xa246514327738b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327738b7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.231955:0:83631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04441c4e00/0xa246514327738b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327738b7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340632.232039:0:83631:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1780340632.232043:0:83631:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c04858fb800 10000000:01000000:0.0:1780340632.232046:0:83631:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c04858fb800 10000000:01000000:0.0:1780340632.232051:0:83631:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1780340632.232058:0:83631:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c04858fb800 from 1 10000000:01000000:0.0:1780340632.232061:0:83631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780340632.232105:0:83631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c4200/0xa246514327738be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.232129:0:83631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04441c4200/0xa246514327738be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.232141:0:83631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04441c4200/0xa246514327738be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340632.232170:0:83631:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961051392:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1780340632.232268:0:83631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340632.232311:0:83631:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9540 going to sleep for 11 seconds 00000100:00100000:1.0:1780340632.232724:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961051392 00000100:00100000:1.0:1780340632.232733:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961051392 00000100:00100000:1.0:1780340632.232814:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1780340632.232834:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03477f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:83631:x1866818961051392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780340632.232849:0:83640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340632.232864:0:83640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0476762e00/0xa246514327738c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327738be expref: -99 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.232892:0:83640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0476762e00/0xa246514327738c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327738be expref: 10 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.232905:0:83640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0476762e00/0xa246514327738c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327738be expref: 10 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.232922:0:83640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0476762e00, rc 0) 00000100:00100000:1.0:1780340632.232986:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03477f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:83631:x1866818961051392:12345-0@lo:101:mount.lustre.0 Request processed in 152us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340632.232994:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1780340632.233286:0:83631:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961051392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780340632.233303:0:83631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04441c4200/0xa246514327738be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327738c5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340632.233313:0:83631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04441c4200/0xa246514327738be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327738c5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340632.233402:0:83631:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961051520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780340632.233433:0:83631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340632.233458:0:83631:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a854c00 going to sleep for 11 seconds 00000100:00100000:1.0:1780340632.233611:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961051520 00000100:00100000:1.0:1780340632.233616:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961051520 00000100:00100000:1.0:1780340632.233650:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1780340632.233658:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03477f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:83631:x1866818961051520:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780340632.233814:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03477f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:83631:x1866818961051520:12345-0@lo:501:mount.lustre.0 Request processed in 156us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340632.233849:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1780340632.234058:0:83631:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961051520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780340632.234091:0:83631:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961051648:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780340632.234133:0:83631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340632.234152:0:83631:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a854c00 going to sleep for 11 seconds 00000100:00100000:0.0:1780340632.234215:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961051648 00000100:00100000:0.0:1780340632.234220:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961051648 00000100:00100000:0.0:1780340632.234317:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1780340632.234326:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:83631:x1866818961051648:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780340632.234424:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:83631:x1866818961051648:12345-0@lo:503:mount.lustre.0 Request processed in 99us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340632.234431:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1780340632.234491:0:83631:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961051648:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780340632.236438:0:83655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83655:1866818961051776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340632.236517:0:83655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340632.236561:0:83655:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0447d0cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1780340632.236613:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961051776 00000100:00100000:1.0:1780340632.236621:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961051776 00000100:00100000:1.0:1780340632.236668:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1780340632.236676:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:83655:x1866818961051776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340632.237084:0:83655:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83655:1866818961051776:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1780340632.237158:0:83655:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1780340632.237176:0:83655:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8c047ac70000) 00000020:00000080:2.0:1780340632.237208:0:83655:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000100:00100000:1.0:1780340632.238057:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:83655:x1866818961051776:12345-0@lo:502:llog_process_th.0 Request processed in 144us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340632.238076:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000020:01000004:2.0:1780340632.238515:0:83655:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c04858fb800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1780340632.238521:0:83655:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c04858fb800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1780340632.238524:0:83655:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c04858fb800 4 00010000:00080000:2.0:1780340632.238562:0:83655:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c034a948800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:2.0:1780340632.246345:0:83655:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:2.0:1780340632.247174:0:83655:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1780340632.247916:0:83655:0:(lwp_dev.c:494:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1780340632.248005:0:83655:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa246514327738d3 00000100:00080000:2.0:1780340632.248020:0:83655:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1780340632.248028:0:83655:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c034a948800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340632.248076:0:83655:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d877800 x1866818961051904/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340632.248137:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961051904:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1780340632.248235:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1780340632.249467:0:83655:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1780340632.249815:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961051904 00000100:00100000:0.0:1780340632.249899:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961051904 00000100:00100000:0.0:1780340632.250015:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:0.0:1780340632.250025:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961051904:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1780340632.250116:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961051904:12345-0@lo:38:llog_process_th.0 Request processed in 91us (1882us total) trans 0 rc -11/-11 00000100:00100000:0.0:1780340632.250124:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:2.0:1780340632.254511:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780340632.254528:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a948800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340632.254538:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1780340632.254544:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961051904:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1780340632.257526:0:83655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83655:1866818961052032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340632.257635:0:83655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340632.257686:0:83655:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0447d0cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1780340632.257696:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961052032 00000100:00100000:3.0:1780340632.257707:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961052032 00000100:00100000:3.0:1780340632.257810:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1780340632.257823:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:83655:x1866818961052032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340632.257981:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:83655:x1866818961052032:12345-0@lo:502:llog_process_th.0 Request processed in 160us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340632.257999:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1780340632.258039:0:83655:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83655:1866818961052032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340632.258094:0:83655:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83655:1866818961052160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340632.258128:0:83655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340632.258156:0:83655:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0447d0cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1780340632.258198:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961052160 00000100:00100000:0.0:1780340632.258204:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961052160 00000100:00100000:3.0:1780340632.258264:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1780340632.258274:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:83655:x1866818961052160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340632.258401:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:83655:x1866818961052160:12345-0@lo:502:llog_process_th.0 Request processed in 128us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340632.258401:0:83655:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83655:1866818961052160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340632.258409:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000040:00080000:2.0:1780340632.258424:0:83655:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1780340632.258503:0:83631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1780340632.258536:0:83631:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780340632.258556:0:83631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c4200/0xa246514327738be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327738c5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340632.258569:0:83631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04441c4200/0xa246514327738be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327738c5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1780340632.258671:0:83631:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1780340632.258673:0:83631:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1780340632.258674:0:83631:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780340632.258675:0:83631:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780340632.258676:0:83631:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780340632.258677:0:83631:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780340632.258678:0:83631:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780340632.258679:0:83631:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1780340632.258681:0:83631:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780340632.258681:0:83631:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1780340632.258685:0:83631:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1780340632.258687:0:83631:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1780340632.258688:0:83631:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1780340632.258689:0:83631:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780340632.258689:0:83631:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780340632.258690:0:83631:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780340632.258691:0:83631:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780340632.258691:0:83631:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780340632.258697:0:83631:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1780340632.258697:0:83631:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780340632.258698:0:83631:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1780340632.258712:0:83631:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1780340632.258720:0:83631:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961052288:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1780340632.258748:0:83631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340632.258796:0:83631:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b363a80 going to sleep for 11 seconds 00000100:00100000:2.0:1780340632.259234:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961052288 00000100:00100000:2.0:1780340632.259240:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961052288 00000100:00100000:2.0:1780340632.259269:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1780340632.259276:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:83631:x1866818961052288:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1780340632.259297:0:83642:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1780340632.259322:0:83642:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1780340632.270017:0:83642:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1780340632.270043:0:83642:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1780340632.270193:0:83641:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1780340632.270198:0:83641:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1780340632.270223:0:83641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c046fb21400/0xa246514327738da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340632.270250:0:83641:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c047a32a800/0xa246514327738a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327738a2 expref: 10 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340632.270260:0:83641:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c046fb21400/0xa246514327738da lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340632.270308:0:83641:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c047a32a800/0xa246514327738a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa246514327738a2 expref: 10 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340632.270326:0:83641:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c047a32a800/0xa246514327738a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa246514327738a2 expref: 10 pid: 83639 timeout: 3512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340632.270344:0:83641:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:83641:1866818961052416:0@lo:104: 00000100:00100000:3.0:1780340632.270436:0:83641:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340632.270479:0:83641:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b363900 going to sleep for 11 seconds 00000100:00100000:1.0:1780340632.270809:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1780340632.270903:0:6499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961052416 00000100:00100000:1.0:1780340632.270912:0:6499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961052416 00000100:00100000:1.0:1780340632.271018:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1780340632.271028:0:6499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:83641:x1866818961052416:12345-0@lo:104: 00010000:00010000:1.0:1780340632.271044:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa246514327738a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa246514327738a9 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.271105:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1780340632.271112:0:6499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:83641:x1866818961052416:12345-0@lo:104: Request processed in 85us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340632.271118:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00010000:00010000:1.0:1780340632.271212:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340632.271219:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa246514327738a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa246514327738a9 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.271228:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b400 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340632.271232:0:41205:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa246514327738a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa246514327738a9 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.272075:0:41205:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa246514327738a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa246514327738a9 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340632.272084:0:41205:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa246514327738a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa246514327738a9 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340632.272091:0:41205:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340632.272133:0:41205:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa246514327738a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327738a9 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.272138:0:41205:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340632.272163:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa246514327738a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327738a9 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.272171:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa246514327738a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327738a9 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.272190:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340632.272192:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340632.272194:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340632.272222:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961052544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340632.272990:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340632.273081:0:83641:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:83641:1866818961052416:0@lo:104: 00010000:00010000:1.0:1780340632.273104:0:83641:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c046fb21400/0xa246514327738da lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340632.273254:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:83631:x1866818961052288:12345-0@lo:253:mount.lustre.0 Request processed in 13976us (14502us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340632.273266:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1780340632.273460:0:19125:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961052544 00000100:00100000:0.0:1780340632.273467:0:19125:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961052544 00010000:00010000:0.0:1780340632.273497:0:19125:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c047a32a800/0xa246514327738a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa246514327738a2 expref: 10 pid: 83639 timeout: 3512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340632.273535:0:19125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2540 00000100:00100000:0.0:1780340632.273545:0:19125:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:3660:x1866818961052544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780340632.273560:0:19125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340632.273565:0:19125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c047a32a800/0xa246514327738a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa246514327738a2 expref: 10 pid: 83639 timeout: 3512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.273578:0:19125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c047a32a800/0xa246514327738a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa246514327738a2 expref: 10 pid: 83639 timeout: 3512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.273595:0:19125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a32a800/0xa246514327738a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa246514327738a2 expref: 10 pid: 83639 timeout: 3512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.273611:0:19125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c046fb21400/0xa246514327738da lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.273621:0:19125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c046fb21400/0xa246514327738da lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1780340632.273640:0:19125:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003442896s 00010000:00010000:0.0:1780340632.273645:0:19125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c046fb21400/0xa246514327738da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.273653:0:19125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c046fb21400/0xa246514327738da lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.273659:0:19125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c046fb21400/0xa246514327738da lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.273679:0:19125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c046fb21400/0xa246514327738da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.273685:0:19125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c046fb21400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340632.273690:0:19125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c046fb21400/0xa246514327738da lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.273697:0:19125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c046fb21400/0xa246514327738da lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.273709:0:19125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c046fb21400/0xa246514327738da lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.273719:0:19125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340632.273751:0:19125:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:3660:x1866818961052544:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340632.273783:0:19125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2540 00000100:00100000:1.0:1780340632.273859:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961052544:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340632.273880:0:83641:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c046fb21400/0xa246514327738da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.273894:0:83641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c046fb21400/0xa246514327738da lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.273900:0:83641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c046fb21400/0xa246514327738da lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340632.273957:0:83631:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:83631:1866818961052288:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1780340632.273968:0:83631:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1780340632.273971:0:83631:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1780340632.273973:0:83631:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780340632.273974:0:83631:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780340632.273975:0:83631:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780340632.273977:0:83631:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780340632.273978:0:83631:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780340632.273980:0:83631:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780340632.273982:0:83631:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780340632.273983:0:83631:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780340632.273985:0:83631:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1780340632.273999:0:83631:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:2.0:1780340632.282065:0:83631:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444069 00000040:01000000:1.0:1780340632.282658:0:83631:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1780340632.283733:0:83662:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444069 00000020:00080000:2.0:1780340632.283742:0:83662:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444069 00000040:01000000:0.0:1780340632.284113:0:83663:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1780340632.284462:0:83631:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1780340632.285521:0:83663:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1780340632.285980:0:83664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:83664:1866818961052672:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780340632.286078:0:83664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340632.286115:0:83664:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1780340632.286807:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961052672 00000100:00100000:1.0:1780340632.286817:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961052672 00000100:00100000:1.0:1780340632.286888:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3751 00000100:00100000:1.0:1780340632.286899:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:83664:x1866818961052672:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780340632.287142:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:83664:x1866818961052672:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 243us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340632.287151:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3751 00000100:00100000:0.0:1780340632.287550:0:83664:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:83664:1866818961052672:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1780340632.287603:0:83664:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1780340632.287654:0:83664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:83664:1866818961052800:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780340632.287699:0:83664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340632.287722:0:83664:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9c00 going to sleep for 11 seconds 00000040:00080000:2.0:1780340632.289528:0:83663:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1780340632.289711:0:83663:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1780340632.290479:0:83631:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1780340632.290525:0:83631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1780340632.291073:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961052800 00000100:00100000:0.0:1780340632.291097:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961052800 00000100:00100000:0.0:1780340632.291168:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3752 00000100:00100000:0.0:1780340632.291181:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:83664:x1866818961052800:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780340632.291422:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:83664:x1866818961052800:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 244us (3722us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340632.291431:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3752 00000004:00000080:1.0:1780340632.291571:0:83631:0:(mdd_device.c:556:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1780340632.291580:0:83631:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1780340632.291638:0:83631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1780340632.292264:0:83664:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:83664:1866818961052800:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780340632.292404:0:83664:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:83664:1866818961052928:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780340632.292483:0:83664:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340632.292512:0:83664:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b363a80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340632.293350:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961052928 00000100:00100000:3.0:1780340632.293372:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961052928 00000100:00100000:3.0:1780340632.293431:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3753 00000100:00100000:3.0:1780340632.293441:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:83664:x1866818961052928:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780340632.293543:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:83664:x1866818961052928:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 104us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340632.293552:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3753 00000100:00100000:3.0:1780340632.293594:0:83664:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f6a00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:83664:1866818961052928:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1780340632.293665:0:83664:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1780340632.295816:0:83631:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1780340632.299504:0:83631:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1780340632.299596:0:83631:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1780340632.299740:0:83631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1780340632.300076:0:83664:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1780340632.300154:0:83664:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1780340632.300159:0:83664:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:1.0:1780340632.300746:0:83631:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4b:0x0] (8/32) registered 00010000:00080000:1.0:1780340632.305387:0:83631:0:(ldlm_lib.c:3035:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 98784247812 00010000:00080000:2.0:1780340632.306466:0:83665:0:(ldlm_lib.c:2838:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 83665 00010000:02000000:2.0:1780340632.306481:0:83665:0:(ldlm_lib.c:2320:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1780340632.306485:0:83665:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1780340632.306489:0:83665:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1780340632.306647:0:83631:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1780340632.306671:0:83631:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.116@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1780340632.306700:0:83631:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=47 00000080:00000004:1.0:1780340632.306727:0:83631:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1780340632.332151:0:83631:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1780340632.333053:0:83631:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1780340632.457928:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340632.748404:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340632.748502:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940394880 00000100:00100000:1.0:1780340632.748513:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940394880 00000100:00100000:1.0:1780340632.748570:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 26 00000100:00100000:1.0:1780340632.748579:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+4:41995:x1866818940394880:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340632.748596:0:83640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340632.748617:0:83640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0476762800/0xa246514327738e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced228e expref: -99 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.748666:0:83640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0476762800/0xa246514327738e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced228e expref: 5 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.748678:0:83640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0476762800/0xa246514327738e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced228e expref: 5 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.748688:0:83640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0476762800, rc 0) 00000100:00100000:1.0:1780340632.748743:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+5:41995:x1866818940394880:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 165us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340632.748797:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 26 00000100:00100000:2.0:1780340632.752843:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340632.754216:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940395008 00000100:00100000:0.0:1780340632.754229:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940395008 00000100:00100000:1.0:1780340632.755077:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:1.0:1780340632.755089:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+5:41995:x1866818940395008:12345-192.168.203.16@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1780340632.755116:0:83638:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1780340632.755137:0:83638:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1780340632.755141:0:83638:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1780340632.755144:0:83638:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1780340632.755146:0:83638:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1780340632.755148:0:83638:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 108 00000100:00100000:1.0:1780340632.758153:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+5:41995:x1866818940395008:12345-192.168.203.16@tcp:256:ll_cfg_requeue.0 Request processed in 3052us (5303us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340632.758165:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 27 00000100:00100000:3.0:1780340632.760013:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340632.760060:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340632.760123:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940395136 00000100:00100000:0.0:1780340632.760132:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940395136 00000100:00100000:0.0:1780340632.760177:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1133 00000100:00100000:0.0:1780340632.760184:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940395136:12345-192.168.203.16@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1780340632.760211:0:63711:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'e06e5cf1-1986-4ba7-9630-fad7efb74eca' at ffff8c0475faa800, cookie 0xa2465143277382b 00010000:00080000:0.0:1780340632.760216:0:63711:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp recovering/t98784247813 exp ffff8c0475faa800 cur 3412 last 1780340632 00010000:02000400:0.0:1780340632.760224:0:63711:0:(ldlm_lib.c:2021:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1780340632.760229:0:63711:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1780340632.760257:0:63711:0:(mdt_handler.c:7301:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1780340632.760393:0:63711:0:(import.c:65:import_set_state_nolock()) ffff8c047651b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340632.760458:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940395136:12345-192.168.203.16@tcp:38:ll_cfg_requeue.0 Request processed in 273us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340632.760470:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1133 00000100:00100000:1.0:1780340632.760612:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940395264 00000100:00100000:1.0:1780340632.760617:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940395264 00000100:00100000:1.0:1780340632.760652:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 28 00000100:00100000:1.0:1780340632.760659:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+5:41995:x1866818940395264:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340632.760668:0:83639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340632.760684:0:83639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0476762400/0xa246514327738e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2295 expref: -99 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.760708:0:83639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0476762400/0xa246514327738e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2295 expref: 6 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.760738:0:83639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0476762400/0xa246514327738e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2295 expref: 6 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340632.760747:0:83639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0476762400, rc 0) 00000100:00100000:1.0:1780340632.760802:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+6:41995:x1866818940395264:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 144us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340632.760809:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 28 00000100:00100000:2.0:1780340632.768267:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340632.768345:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340632.768442:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940388224 00000100:00100000:1.0:1780340632.768452:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940388224 00000100:00100000:1.0:1780340632.768513:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1134 00000100:00100000:1.0:1780340632.768523:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940388224:12345-192.168.203.16@tcp:36:mcreate.0 00010000:00080000:1.0:1780340632.768543:0:63710:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 98784247813, current: 98784247813, replaying 00000100:00100000:1.0:1780340632.768561:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940388224:12345-192.168.203.16@tcp:36:mcreate.0 Request processed in 40us (304us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780340632.768567:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1134 00000100:00100000:3.0:1780340632.768666:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940395392 00000100:00100000:3.0:1780340632.768671:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940395392 00000100:00100000:3.0:1780340632.768707:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 29 00000100:00100000:3.0:1780340632.768715:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+6:41995:x1866818940395392:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340632.768902:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+7:41995:x1866818940395392:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 188us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340632.768909:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 29 00010000:00080000:2.0:1780340632.769630:0:83665:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:2.0:1780340632.777271:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340632.778245:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940395520 00000100:00100000:1.0:1780340632.778256:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940395520 00000100:00100000:1.0:1780340632.778309:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 30 00000100:00100000:1.0:1780340632.778320:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+7:41995:x1866818940395520:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340632.778466:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+7:41995:x1866818940395520:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 147us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340632.778474:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 30 00000100:00100000:0.0:1780340632.794127:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340632.794814:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940395648 00000100:00100000:3.0:1780340632.794825:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940395648 00000100:00100000:3.0:1780340632.795064:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 31 00000100:00100000:3.0:1780340632.795075:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+7:41995:x1866818940395648:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340632.795092:0:83642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340632.795111:0:83642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c046fb20a00/0xa246514327738ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced229c expref: -99 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340632.795140:0:83642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c046fb20a00/0xa246514327738ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced229c expref: 8 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340632.795154:0:83642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c046fb20a00/0xa246514327738ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced229c expref: 8 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340632.795217:0:83642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c046fb20a00, rc 0) 00000100:00100000:3.0:1780340632.795275:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940395648:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 202us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340632.795283:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 31 00000100:00100000:2.0:1780340632.801449:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340632.801530:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940395776 00000100:00100000:1.0:1780340632.801540:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940395776 00000100:00100000:1.0:1780340632.801621:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 32 00000100:00100000:1.0:1780340632.801632:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940395776:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340632.801806:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940395776:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 174us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340632.801815:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 32 00000100:00100000:0.0:1780340632.806687:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340632.806871:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940395904 00000100:00100000:2.0:1780340632.806882:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940395904 00000100:00100000:2.0:1780340632.807056:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 33 00000100:00100000:2.0:1780340632.807067:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940395904:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340632.807248:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940395904:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 182us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340632.807256:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 33 00000100:00100000:3.0:1780340632.815183:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340632.817078:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940396032 00000100:00100000:0.0:1780340632.817092:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940396032 00000100:00100000:0.0:1780340632.817144:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 34 00000100:00100000:0.0:1780340632.817154:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940396032:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340632.817178:0:83640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340632.817195:0:83640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04441c4c00/0xa246514327738f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced22a3 expref: -99 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.817222:0:83640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04441c4c00/0xa246514327738f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22a3 expref: 9 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.817233:0:83640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04441c4c00/0xa246514327738f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22a3 expref: 9 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340632.817242:0:83640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04441c4c00, rc 0) 00000100:00100000:0.0:1780340632.817311:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:41995:x1866818940396032:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 159us (2139us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340632.817318:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 34 00000100:00100000:0.0:1780340632.833007:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340632.833100:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940396160 00000100:00100000:3.0:1780340632.833110:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940396160 00000100:00100000:3.0:1780340632.833160:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 35 00000100:00100000:3.0:1780340632.833170:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:41995:x1866818940396160:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340632.833278:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:41995:x1866818940396160:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 109us (280us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780340632.833286:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 35 00000100:00100000:1.0:1780340632.970754:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961053056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340632.970963:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340632.971464:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961053056 00000100:00100000:3.0:1780340632.971473:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961053056 00000100:00100000:3.0:1780340632.971526:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1946 00000100:00100000:3.0:1780340632.971537:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961053056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340632.971569:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340632.971616:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961053056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340632.971624:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1946 00000100:00100000:1.0:1780340632.971813:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961053056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340632.971835:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340632.971842:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961053184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340632.971870:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340632.972658:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961053184 00000100:00100000:3.0:1780340632.972666:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961053184 00000100:00100000:3.0:1780340632.972698:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1947 00000100:00100000:3.0:1780340632.972705:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961053184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340632.972720:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340632.972777:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961053184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340632.972784:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1947 00000100:00100000:3.0:1780340632.972916:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961053184:0@lo:13:osp-pre-0-1.0 10000000:01000000:1.0:1780340633.289833:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1780340633.289840:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c04858fb800 from 108 10000000:01000000:1.0:1780340633.289846:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1780340633.289899:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763a00/0xa246514327738fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340633.289911:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0476763a00/0xa246514327738fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340633.289921:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0476763a00/0xa246514327738fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340633.289958:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961053312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340633.290021:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340633.290062:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034992b840 going to sleep for 11 seconds 00000100:00100000:3.0:1780340633.290080:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961053312 00000100:00100000:3.0:1780340633.290088:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961053312 00000100:00100000:3.0:1780340633.290493:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1780340633.290505:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:6514:x1866818961053312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340633.290518:0:83640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340633.290537:0:83640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c046fb20600/0xa24651432773904 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327738fd expref: -99 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.290561:0:83640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c046fb20600/0xa24651432773904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327738fd expref: 10 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.290571:0:83640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c046fb20600/0xa24651432773904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327738fd expref: 10 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.290590:0:83640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c046fb20600, rc 0) 00000100:00100000:3.0:1780340633.290648:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961053312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340633.290655:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1780340633.290696:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961053312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340633.290711:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0476763a00/0xa246514327738fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773904 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340633.290719:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0476763a00/0xa246514327738fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773904 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340633.291135:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961053440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1780340633.291179:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340633.291209:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034992b840 going to sleep for 11 seconds 00000100:00100000:3.0:1780340633.291293:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961053440 00000100:00100000:3.0:1780340633.291298:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961053440 00000100:00100000:3.0:1780340633.291333:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1780340633.291341:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961053440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1780340633.291370:0:83642:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1780340633.291385:0:83642:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1780340633.291388:0:83642:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 108 00000100:00100000:3.0:1780340633.291470:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961053440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340633.291478:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1780340633.291558:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961053440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1780340633.291601:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1780340633.291608:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763a00/0xa246514327738fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773904 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340633.291617:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0476763a00/0xa246514327738fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773904 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340633.291626:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1780340633.291627:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c045f0c4800 from 52 10000000:01000000:1.0:1780340633.291630:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780340633.291645:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763000/0xa2465143277390b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340633.291653:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0476763000/0xa2465143277390b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340633.291661:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0476763000/0xa2465143277390b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340633.291673:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961053568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340633.291703:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340633.291725:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034992b840 going to sleep for 11 seconds 00000100:00100000:3.0:1780340633.291815:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961053568 00000100:00100000:3.0:1780340633.291820:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961053568 00000100:00100000:3.0:1780340633.291853:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1780340633.291870:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961053568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340633.291878:0:83638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340633.291887:0:83638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c046fb21200/0xa24651432773912 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277390b expref: -99 pid: 83638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.291903:0:83638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c046fb21200/0xa24651432773912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277390b expref: 11 pid: 83638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.291911:0:83638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c046fb21200/0xa24651432773912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277390b expref: 11 pid: 83638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.294329:0:83638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c046fb21200, rc 0) 00000100:00100000:3.0:1780340633.294479:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961053568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2557us (2713us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340633.294488:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1780340633.295952:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961053568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340633.296082:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0476763000/0xa2465143277390b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773912 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340633.296095:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0476763000/0xa2465143277390b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773912 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340633.296176:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961053696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.296318:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340633.296375:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034992b840 going to sleep for 11 seconds 00000100:00100000:2.0:1780340633.296407:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961053696 00000100:00100000:2.0:1780340633.296414:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961053696 00000100:00100000:2.0:1780340633.296505:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1780340633.296515:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961053696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340633.296656:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961053696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340633.296665:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1780340633.297727:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961053696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.297814:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961053824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.298124:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340633.298191:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340633.298227:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961053824 00000100:00100000:1.0:1780340633.298293:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961053824 00000100:00100000:1.0:1780340633.298377:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1780340633.298386:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961053824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340633.298670:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961053824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 284us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340633.298678:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1780340633.298751:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961053824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340633.300177:0:83722:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1780340633.300361:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1780340633.300385:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780340633.300396:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763000/0xa2465143277390b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773912 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.300418:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0476763000/0xa2465143277390b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773912 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340633.300552:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1780340633.300555:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c045f0c4800 from 105 10000000:01000000:0.0:1780340633.300558:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1780340633.300588:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c4600/0xa24651432773919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.300595:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04441c4600/0xa24651432773919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.300603:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04441c4600/0xa24651432773919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340633.300623:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961053952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.300670:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340633.300706:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340633.300874:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961053952 00000100:00100000:1.0:1780340633.300880:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961053952 00000100:00100000:1.0:1780340633.301167:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1780340633.301178:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03493e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961053952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340633.301190:0:83639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340633.301202:0:83639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0476762a00/0xa24651432773920 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773919 expref: -99 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340633.301223:0:83639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0476762a00/0xa24651432773920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773919 expref: 12 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340633.301243:0:83639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0476762a00/0xa24651432773920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773919 expref: 12 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340633.301263:0:83639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0476762a00, rc 0) 00000100:00100000:1.0:1780340633.301308:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03493e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961053952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340633.301315:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1780340633.301382:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961053952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340633.301394:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04441c4600/0xa24651432773919 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773920 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.301402:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04441c4600/0xa24651432773919 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773920 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340633.301472:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961054080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.301503:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340633.301779:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340633.301844:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961054080 00000100:00100000:2.0:1780340633.301849:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961054080 00000100:00100000:2.0:1780340633.301892:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1780340633.301900:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03493e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961054080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1780340633.301915:0:83642:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1780340633.301931:0:83642:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1780340633.301935:0:83642:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1780340633.301943:0:83642:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1780340633.301945:0:83642:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1780340633.302013:0:83642:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 108 00000100:00100000:2.0:1780340633.302094:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03493e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961054080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 194us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340633.302101:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1780340633.302332:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961054080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1780340633.302413:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1780340633.302537:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c4600/0xa24651432773919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773920 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.302547:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04441c4600/0xa24651432773919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773920 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340633.302555:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1780340633.302557:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1780340633.302560:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1780340633.302580:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c5800/0xa24651432773927 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.302586:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04441c5800/0xa24651432773927 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.302593:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04441c5800/0xa24651432773927 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340633.302606:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961054208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.302633:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340633.302697:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340633.302729:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961054208 00000100:00100000:2.0:1780340633.302734:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961054208 00000100:00100000:2.0:1780340633.302864:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1780340633.302873:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03493e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961054208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340633.302882:0:83642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340633.302891:0:83642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a32b400/0xa2465143277392e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773927 expref: -99 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.302907:0:83642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a32b400/0xa2465143277392e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773927 expref: 13 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.302914:0:83642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a32b400/0xa2465143277392e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773927 expref: 13 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.302921:0:83642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32b400, rc 0) 00000100:00100000:2.0:1780340633.303025:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03493e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961054208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340633.303032:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1780340633.303135:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961054208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340633.303145:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04441c5800/0xa24651432773927 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277392e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.303153:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04441c5800/0xa24651432773927 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277392e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340633.303213:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961054336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.303250:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340633.303379:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340633.303406:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961054336 00000100:00100000:1.0:1780340633.303410:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961054336 00000100:00100000:1.0:1780340633.303602:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1780340633.303611:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961054336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340633.303735:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961054336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340633.303742:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1780340633.303867:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961054336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.303898:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961054464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.303936:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340633.304032:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340633.304045:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961054464 00000100:00100000:0.0:1780340633.304049:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961054464 00000100:00100000:0.0:1780340633.304069:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1780340633.304076:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961054464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340633.310384:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961054464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6300us (6439us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340633.310397:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1780340633.310962:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961054464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340633.313226:0:83723:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1780340633.313372:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1780340633.313442:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1780340633.313452:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c5800/0xa24651432773927 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277392e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340633.313465:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04441c5800/0xa24651432773927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277392e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340633.313476:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1780340633.313479:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8c045f0c4800 from 1 10000000:01000000:1.0:1780340633.313482:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1780340633.313518:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763400/0xa24651432773935 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340633.313536:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0476763400/0xa24651432773935 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340633.313547:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0476763400/0xa24651432773935 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340633.313571:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961054592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340633.313628:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340633.313673:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c044963d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340633.315364:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961054592 00000100:00100000:2.0:1780340633.315375:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961054592 00000100:00100000:2.0:1780340633.315500:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1780340633.315527:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961054592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340633.315545:0:83639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340633.315574:0:83639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a32a800/0xa2465143277393c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773935 expref: -99 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.315600:0:83639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a32a800/0xa2465143277393c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773935 expref: 14 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.315612:0:83639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a32a800/0xa2465143277393c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773935 expref: 14 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.315620:0:83639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32a800, rc 0) 00000100:00100000:2.0:1780340633.315698:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:6514:x1866818961054592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340633.315705:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1780340633.315805:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961054592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340633.315822:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0476763400/0xa24651432773935 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277393c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.315831:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0476763400/0xa24651432773935 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277393c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340633.315850:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1780340633.315855:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763400/0xa24651432773935 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277393c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.315862:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0476763400/0xa24651432773935 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277393c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340633.315869:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1780340633.315872:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c045f0c4800 from 7 10000000:01000000:3.0:1780340633.315874:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1780340633.315895:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c046fb21600/0xa24651432773943 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.315901:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c046fb21600/0xa24651432773943 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.315908:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c046fb21600/0xa24651432773943 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340633.315932:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961054720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340633.315965:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340633.315994:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04455f0180 going to sleep for 11 seconds 00000100:00100000:2.0:1780340633.316046:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961054720 00000100:00100000:2.0:1780340633.316050:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961054720 00000100:00100000:2.0:1780340633.316077:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1780340633.316084:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:6514:x1866818961054720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340633.316091:0:83642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340633.316098:0:83642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a32ba00/0xa2465143277394a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773943 expref: -99 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.316111:0:83642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a32ba00/0xa2465143277394a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773943 expref: 15 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.316118:0:83642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a32ba00/0xa2465143277394a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773943 expref: 15 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.316135:0:83642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32ba00, rc 0) 00000100:00100000:2.0:1780340633.316163:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961054720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340633.316169:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1780340633.316304:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961054720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340633.316314:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c046fb21600/0xa24651432773943 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277394a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.316321:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c046fb21600/0xa24651432773943 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277394a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340633.316385:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961054848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340633.316409:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340633.316518:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04455f0180 going to sleep for 11 seconds 00000100:00100000:2.0:1780340633.316549:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961054848 00000100:00100000:2.0:1780340633.316553:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961054848 00000100:00100000:2.0:1780340633.316613:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1780340633.316622:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961054848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340633.316728:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961054848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340633.316735:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1780340633.316795:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961054848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340633.316822:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961054976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340633.316859:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340633.316873:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04455f0180 going to sleep for 11 seconds 00000100:00100000:2.0:1780340633.316921:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961054976 00000100:00100000:2.0:1780340633.316925:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961054976 00000100:00100000:2.0:1780340633.316946:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1780340633.316953:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961054976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340633.317021:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961054976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340633.317027:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1780340633.317161:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961054976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780340633.318384:0:83725:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1780340633.318566:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1780340633.318586:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1780340633.318595:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c046fb21600/0xa24651432773943 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277394a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.318606:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c046fb21600/0xa24651432773943 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277394a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340633.318625:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1780340633.318627:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c04773ad000 from 52 10000000:01000000:2.0:1780340633.318630:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780340633.318657:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32ae00/0xa24651432773951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.318665:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a32ae00/0xa24651432773951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.318673:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a32ae00/0xa24651432773951 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340633.318692:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961055104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340633.318735:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340633.318819:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034accf900 going to sleep for 11 seconds 00000100:00100000:3.0:1780340633.318905:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961055104 00000100:00100000:3.0:1780340633.318911:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961055104 00000100:00100000:3.0:1780340633.318947:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1780340633.318955:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961055104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340633.318966:0:83639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340633.318983:0:83639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c046fb20400/0xa24651432773958 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773951 expref: -99 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.319003:0:83639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c046fb20400/0xa24651432773958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773951 expref: 16 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.319012:0:83639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c046fb20400/0xa24651432773958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773951 expref: 16 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.319020:0:83639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c046fb20400, rc 0) 00000100:00100000:3.0:1780340633.319058:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961055104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340633.319065:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1780340633.319107:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961055104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340633.319119:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c047a32ae00/0xa24651432773951 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773958 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.319127:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c047a32ae00/0xa24651432773951 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773958 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340633.319173:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961055232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340633.319196:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340633.319210:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04455f0000 going to sleep for 11 seconds 00000100:00100000:3.0:1780340633.319223:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961055232 00000100:00100000:3.0:1780340633.319226:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961055232 00000100:00100000:3.0:1780340633.319392:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1780340633.319399:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961055232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340633.319503:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479ddcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961055232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340633.319516:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1780340633.319646:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961055232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340633.319673:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961055360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340633.319707:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340633.319777:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04455f0000 going to sleep for 11 seconds 00000100:00100000:2.0:1780340633.319818:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961055360 00000100:00100000:2.0:1780340633.319823:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961055360 00000100:00100000:2.0:1780340633.319884:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1780340633.319890:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961055360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340633.319967:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479ddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961055360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340633.319973:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1780340633.320048:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961055360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780340633.322179:0:83726:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1780340633.322363:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1780340633.322388:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1780340633.322398:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32ae00/0xa24651432773951 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773958 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.322418:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c047a32ae00/0xa24651432773951 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773958 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340633.322434:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1780340633.322437:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1780340633.322440:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1780340633.322470:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa2465143277395f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.322478:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa2465143277395f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.322487:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa2465143277395f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340633.322510:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961055488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340633.322562:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340633.322603:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034accfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340633.322790:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961055488 00000100:00100000:3.0:1780340633.322796:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961055488 00000100:00100000:3.0:1780340633.322836:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1780340633.322847:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961055488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340633.322859:0:83642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340633.322871:0:83642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c046fb20200/0xa24651432773966 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277395f expref: -99 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.322887:0:83642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c046fb20200/0xa24651432773966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277395f expref: 17 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.322894:0:83642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c046fb20200/0xa24651432773966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277395f expref: 17 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.322900:0:83642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c046fb20200, rc 0) 00000100:00100000:3.0:1780340633.322937:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961055488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340633.322944:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1780340633.323076:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961055488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340633.323089:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa2465143277395f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773966 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340633.323097:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa2465143277395f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773966 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340633.323158:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961055616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340633.323182:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340633.323203:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c044963d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340633.324728:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961055616 00000100:00100000:3.0:1780340633.324738:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961055616 00000100:00100000:3.0:1780340633.324810:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1780340633.324833:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961055616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340633.325001:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961055616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (1817us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340633.325008:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1780340633.326366:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961055616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.326619:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961055744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.326675:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340633.326710:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340633.326996:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961055744 00000100:00100000:3.0:1780340633.327002:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961055744 00000100:00100000:3.0:1780340633.327045:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1780340633.327054:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961055744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340633.328026:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961055744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 970us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340633.328035:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1780340633.328098:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961055744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340633.329515:0:83728:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1780340633.329714:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1780340633.329741:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1780340633.329752:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa2465143277395f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773966 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.329926:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa2465143277395f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773966 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340633.329954:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1780340633.329957:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c04773ad000 from 7 10000000:01000000:0.0:1780340633.329960:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1780340633.329994:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c5a00/0xa2465143277396d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.330003:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04441c5a00/0xa2465143277396d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.330012:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04441c5a00/0xa2465143277396d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340633.330034:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961055872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.330082:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340633.330156:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340633.330228:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961055872 00000100:00100000:3.0:1780340633.330293:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961055872 00000100:00100000:3.0:1780340633.330368:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1780340633.330376:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961055872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340633.330387:0:83640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340633.330398:0:83640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c046fb20800/0xa24651432773974 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277396d expref: -99 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.330419:0:83640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c046fb20800/0xa24651432773974 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277396d expref: 18 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.330486:0:83640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c046fb20800/0xa24651432773974 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277396d expref: 18 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.330496:0:83640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c046fb20800, rc 0) 00000100:00100000:3.0:1780340633.330540:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479ddf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961055872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340633.330555:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1780340633.330623:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961055872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340633.330635:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04441c5a00/0xa2465143277396d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773974 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.330644:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04441c5a00/0xa2465143277396d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773974 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340633.330697:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961056000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.330722:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340633.330855:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340633.331054:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961056000 00000100:00100000:2.0:1780340633.331059:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961056000 00000100:00100000:2.0:1780340633.331095:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1780340633.331104:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961056000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340633.331211:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479dddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961056000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340633.331217:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1780340633.331574:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961056000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.331608:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961056128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.331668:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340633.331837:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340633.331927:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961056128 00000100:00100000:2.0:1780340633.331940:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961056128 00000100:00100000:2.0:1780340633.332004:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1780340633.332014:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961056128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340633.332157:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479dde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961056128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340633.332164:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1780340633.332342:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961056128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780340633.333347:0:83729:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1780340633.333568:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1780340633.333588:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1780340633.333598:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c5a00/0xa2465143277396d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773974 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.333611:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04441c5a00/0xa2465143277396d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773974 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340633.333620:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780340633.333622:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c047b065000 from 52 10000000:01000000:0.0:1780340633.333625:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780340633.333652:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c5200/0xa2465143277397b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.333660:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04441c5200/0xa2465143277397b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.333669:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04441c5200/0xa2465143277397b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340633.333687:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961056256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.333733:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340633.333785:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340633.333896:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961056256 00000100:00100000:3.0:1780340633.333901:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961056256 00000100:00100000:3.0:1780340633.333931:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1780340633.333939:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961056256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340633.333950:0:83642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340633.333962:0:83642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c046fb21e00/0xa24651432773982 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277397b expref: -99 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.333981:0:83642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c046fb21e00/0xa24651432773982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277397b expref: 19 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.333991:0:83642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c046fb21e00/0xa24651432773982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277397b expref: 19 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.334000:0:83642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c046fb21e00, rc 0) 00000100:00100000:3.0:1780340633.334035:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479dde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961056256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340633.334041:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1780340633.334167:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961056256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340633.334179:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04441c5200/0xa2465143277397b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773982 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.334199:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04441c5200/0xa2465143277397b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773982 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340633.334391:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961056384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.334417:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340633.334525:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340633.334562:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961056384 00000100:00100000:3.0:1780340633.334567:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961056384 00000100:00100000:3.0:1780340633.334628:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1780340633.334635:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961056384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340633.334810:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479ddc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961056384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340633.334817:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1780340633.334952:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961056384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340633.334986:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961056512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340633.335027:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340633.335098:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034accf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340633.335129:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961056512 00000100:00100000:3.0:1780340633.335134:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961056512 00000100:00100000:3.0:1780340633.335165:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1780340633.335171:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961056512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340633.335537:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961056512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 366us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340633.335545:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1780340633.335662:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961056512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780340633.336919:0:83730:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1780340633.337174:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1780340633.337201:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1780340633.337209:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c5200/0xa2465143277397b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773982 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.337220:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04441c5200/0xa2465143277397b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773982 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340633.337229:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1780340633.337743:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1780340633.337746:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1780340633.337880:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432773989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.337889:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432773989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.337914:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432773989 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340633.338055:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961056640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340633.338181:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340633.338329:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034accf780 going to sleep for 11 seconds 00000100:00100000:0.0:1780340633.338945:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961056640 00000100:00100000:0.0:1780340633.338953:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961056640 00000100:00100000:0.0:1780340633.339001:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1780340633.339011:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961056640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340633.339024:0:83642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340633.339037:0:83642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04441c5c00/0xa24651432773990 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773989 expref: -99 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.339059:0:83642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04441c5c00/0xa24651432773990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773989 expref: 20 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.339069:0:83642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04441c5c00/0xa24651432773990 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773989 expref: 20 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.339077:0:83642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04441c5c00, rc 0) 00000100:00100000:0.0:1780340633.339129:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479ddd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961056640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340633.339136:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1780340633.339656:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961056640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340633.339672:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432773989 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773990 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.339680:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432773989 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773990 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340633.339745:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961056768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340633.339806:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340633.339831:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034accf780 going to sleep for 11 seconds 00000100:00100000:3.0:1780340633.339936:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961056768 00000100:00100000:3.0:1780340633.339941:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961056768 00000100:00100000:3.0:1780340633.340196:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1780340633.340204:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961056768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340633.340341:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961056768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340633.340358:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1780340633.340683:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961056768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340633.340714:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961056896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340633.340847:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340633.341030:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961056896 00000100:00100000:3.0:1780340633.341035:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961056896 00000100:00100000:2.0:1780340633.341041:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034accf780 going to sleep for 11 seconds 00000100:00100000:3.0:1780340633.341059:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1780340633.341066:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961056896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340633.342361:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961056896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1283us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340633.342370:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1780340633.342503:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961056896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340633.343750:0:83731:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1780340633.344383:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1780340633.344573:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1780340633.344584:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432773989 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773990 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.344608:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432773989 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773990 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340633.344617:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1780340633.344620:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c047b065000 from 7 10000000:01000000:0.0:1780340633.344623:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1780340633.344654:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c5400/0xa24651432773997 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.344662:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04441c5400/0xa24651432773997 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.344672:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04441c5400/0xa24651432773997 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340633.344692:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961057024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.344742:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340633.345048:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9300 going to sleep for 11 seconds 00000100:00100000:3.0:1780340633.345094:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961057024 00000100:00100000:3.0:1780340633.345101:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961057024 00000100:00100000:3.0:1780340633.345185:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1780340633.345196:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961057024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340633.345209:0:83640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340633.345228:0:83640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c046fb21a00/0xa2465143277399e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773997 expref: -99 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.345312:0:83640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c046fb21a00/0xa2465143277399e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773997 expref: 21 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.345324:0:83640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c046fb21a00/0xa2465143277399e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773997 expref: 21 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340633.345333:0:83640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c046fb21a00, rc 0) 00000100:00100000:3.0:1780340633.345388:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961057024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340633.345395:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1780340633.345473:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961057024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340633.345488:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04441c5400/0xa24651432773997 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277399e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.345504:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04441c5400/0xa24651432773997 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277399e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340633.345561:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961057152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340633.345589:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340633.345757:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034accf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340633.346008:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961057152 00000100:00100000:0.0:1780340633.346014:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961057152 00000100:00100000:0.0:1780340633.346052:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1780340633.346059:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961057152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.346158:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961057152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340633.346165:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1780340633.346251:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961057152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340633.346278:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961057280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340633.346316:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340633.346344:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034accf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340633.346446:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961057280 00000100:00100000:0.0:1780340633.346450:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961057280 00000100:00100000:0.0:1780340633.346477:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1780340633.346490:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961057280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.346562:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961057280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340633.346568:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1780340633.346701:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961057280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340633.348152:0:83732:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1780340633.348517:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1780340633.348546:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1780340633.348556:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c5400/0xa24651432773997 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277399e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.348568:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04441c5400/0xa24651432773997 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277399e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340633.348578:0:6514:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1780340633.348581:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8c0471e119c0 from 1 10000000:01000000:0.0:1780340633.348584:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1780340633.348617:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c5e00/0xa246514327739a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.348625:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04441c5e00/0xa246514327739a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.348635:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04441c5e00/0xa246514327739a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340633.348657:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961057408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.348712:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340633.348754:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1780340633.349049:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961057408 00000100:00100000:2.0:1780340633.349056:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961057408 00000100:00100000:2.0:1780340633.349092:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1780340633.349100:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961057408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340633.349112:0:83638:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340633.349125:0:83638:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a32a600/0xa246514327739ac lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327739a5 expref: -99 pid: 83638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.349145:0:83638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a32a600/0xa246514327739ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327739a5 expref: 22 pid: 83638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.349154:0:83638:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a32a600/0xa246514327739ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327739a5 expref: 22 pid: 83638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.349177:0:83638:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32a600, rc 0) 00000100:00100000:2.0:1780340633.349213:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961057408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340633.349219:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1780340633.349612:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961057408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340633.349624:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04441c5e00/0xa246514327739a5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327739ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.349639:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04441c5e00/0xa246514327739a5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327739ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340633.349656:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1780340633.349660:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c5e00/0xa246514327739a5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327739ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.349667:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04441c5e00/0xa246514327739a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327739ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340633.349673:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1780340633.349675:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8c0471e119c0 from 1 10000000:01000000:0.0:1780340633.349677:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1780340633.349691:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c5600/0xa246514327739b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.349698:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04441c5600/0xa246514327739b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.349705:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04441c5600/0xa246514327739b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340633.349718:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961057536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.349744:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340633.349792:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1780340633.349862:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961057536 00000100:00100000:2.0:1780340633.349867:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961057536 00000100:00100000:2.0:1780340633.349899:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1780340633.349905:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961057536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340633.349913:0:83639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340633.349920:0:83639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a32ac00/0xa246514327739ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327739b3 expref: -99 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.349944:0:83639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a32ac00/0xa246514327739ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327739b3 expref: 23 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.349953:0:83639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a32ac00/0xa246514327739ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327739b3 expref: 23 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.349960:0:83639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32ac00, rc 0) 00000100:00100000:2.0:1780340633.349995:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961057536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340633.350004:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1780340633.350143:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961057536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340633.350154:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04441c5600/0xa246514327739b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327739ba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.350173:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04441c5600/0xa246514327739b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327739ba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340633.350225:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961057664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340633.350268:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340633.350293:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047adc9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340633.350537:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961057664 00000100:00100000:3.0:1780340633.350542:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961057664 00000100:00100000:3.0:1780340633.350570:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1780340633.350577:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961057664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340633.350643:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961057664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (374us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780340633.350650:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1780340633.350751:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961057664:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1780340633.350806:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1780340633.350814:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c5600/0xa246514327739b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327739ba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340633.350821:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04441c5600/0xa246514327739b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327739ba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340633.482184:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340634.506023:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340635.530989:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340636.555002:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1780340636.696314:0:83900:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1780340636.714019:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340636.714113:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340636.714216:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940396288 00000100:00100000:0.0:1780340636.714227:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940396288 00000100:00100000:0.0:1780340636.714296:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 71 00000100:00100000:0.0:1780340636.714307:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940396288:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340636.714384:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940396288:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 79us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340636.714391:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 71 00000100:00100000:1.0:1780340636.714496:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940396416 00000100:00100000:1.0:1780340636.714501:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940396416 00000100:00100000:1.0:1780340636.714552:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1134 00000100:00100000:1.0:1780340636.714559:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940396416:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340636.714597:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940396416:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 39us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340636.714604:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1134 00000100:00080000:1.0:1780340636.714647:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340637.577932:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340637.577944:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340637.577948:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340637.577959:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340637.577991:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d874380 x1866818961057920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340637.578020:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340637.578024:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340637.578025:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340637.578030:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340637.578039:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046ba2ed80 x1866818961058176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340637.578062:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340637.578065:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340637.578067:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340637.578071:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340637.578082:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046ba2ea00 x1866818961058432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340637.578101:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340637.578104:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340637.578105:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340637.578109:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340637.578117:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0471572d80 x1866818961058816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340637.578154:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1780340637.578162:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340637.578164:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c034a948800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340637.578168:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c034a948800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340637.578179:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0471573100 x1866818961059328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340637.578205:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961057920:0@lo:38:kworker.0 00000100:00100000:2.0:1780340637.578261:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340637.578289:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961058176:0@lo:38:kworker.0 00000100:00100000:2.0:1780340637.578309:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340637.578334:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961058432:0@lo:38:kworker.0 00000100:00100000:2.0:1780340637.578396:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340637.578413:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961058816:0@lo:38:kworker.0 00000100:00100000:1.0:1780340637.578669:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961057792:0@lo:400:kworker.0 00000100:00100000:1.0:1780340637.578704:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340637.578734:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961058688:0@lo:400:kworker.0 00000100:00100000:1.0:1780340637.578757:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340637.578810:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1780340637.578816:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961058048:0@lo:400:kworker.0 00000100:00100000:1.0:1780340637.578857:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340637.578871:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961058944:0@lo:400:kworker.0 00000100:00100000:1.0:1780340637.578890:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340637.578920:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961057920 00000100:00100000:1.0:1780340637.578927:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961057920 00000100:00100000:1.0:1780340637.578955:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961058176 00000100:00100000:1.0:1780340637.578958:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961058176 00000100:00100000:1.0:1780340637.578970:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961058048 00000100:00100000:1.0:1780340637.578973:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961058048 00000100:00100000:1.0:1780340637.579014:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:1.0:1780340637.579022:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961058048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340637.579072:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a213b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961058048:12345-0@lo:400:kworker.0 Request processed in 51us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340637.579078:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:1.0:1780340637.579094:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:1.0:1780340637.579098:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961057920:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780340637.579118:0:63710:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3417 last 0 00000020:00000080:1.0:1780340637.579164:0:63710:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa246514327739c1 00000004:00100000:1.0:1780340637.579178:0:63710:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780340637.579301:0:63710:0:(import.c:65:import_set_state_nolock()) ffff8c0345f19000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780340637.579358:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1866818961057920:12345-0@lo:38:kworker.0 Request processed in 258us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340637.579365:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:1.0:1780340637.579378:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:1.0:1780340637.579382:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961058176:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780340637.579395:0:63710:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3417 last 0 00000020:00000080:1.0:1780340637.579413:0:63710:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa246514327739c8 00000004:00100000:1.0:1780340637.579689:0:63710:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780340637.579712:0:63710:0:(import.c:65:import_set_state_nolock()) ffff8c0345f1b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780340637.579743:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1866818961058176:12345-0@lo:38:kworker.0 Request processed in 359us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340637.579750:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:1.0:1780340637.579923:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961058688 00000100:00100000:1.0:1780340637.579926:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961058688 00000100:00100000:1.0:1780340637.579962:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398 00000100:00100000:1.0:1780340637.579970:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961058688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340637.580004:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961058688:12345-0@lo:400:kworker.0 Request processed in 35us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340637.580010:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398 00000100:00100000:1.0:1780340637.580028:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961058432 00000100:00100000:1.0:1780340637.580032:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961058432 00000100:00100000:1.0:1780340637.580046:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961058944 00000100:00100000:1.0:1780340637.580049:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961058944 00000100:00100000:1.0:1780340637.580069:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3754 00000100:00100000:1.0:1780340637.580074:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961058432:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780340637.580088:0:8411:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8c04480ab800, cookie 0xa24651432773832 00010000:00080000:1.0:1780340637.580091:0:8411:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff8c04480ab800 cur 3417 last 1780340632 00000004:00100000:1.0:1780340637.580108:0:8411:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780340637.580123:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8c0345f1b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340637.580579:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340637.580606:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961059328:0@lo:38:kworker.0 00000100:00100000:2.0:1780340637.580628:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1780340637.580658:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c034d874380 x1866818961057920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340637.580672:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 24 00000100:00100000:0.0:1780340637.580961:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340637.580972:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961059456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340637.581011:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340637.581035:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961059456 00000100:00100000:0.0:1780340637.581039:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961059456 00000100:00100000:0.0:1780340637.581077:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3755 00000100:00100000:0.0:1780340637.581084:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3659:x1866818961058944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340637.581121:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3659:x1866818961058944:12345-0@lo:400:kworker.0 Request processed in 37us (2230us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340637.581128:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3755 00000100:00100000:0.0:1780340637.581377:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3756 00000100:00100000:0.0:1780340637.581384:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961059456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780340637.581407:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:1.0:1780340637.581567:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818961058432:12345-0@lo:38:kworker.0 Request processed in 1490us (3168us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340637.581575:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3754 00000100:00100000:1.0:1780340637.581596:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961058816 00000100:00100000:1.0:1780340637.581600:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961058816 00000100:00100000:1.0:1780340637.581613:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961059328 00000100:00100000:1.0:1780340637.581616:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961059328 00000100:00100000:1.0:1780340637.581626:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:1.0:1780340637.581631:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961058816:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780340637.581647:0:64454:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3417 last 0 00000020:00000080:1.0:1780340637.581677:0:64454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa246514327739cf 00000004:00100000:1.0:1780340637.581689:0:64454:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780340637.581713:0:64454:0:(import.c:65:import_set_state_nolock()) ffff8c0458280800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780340637.581740:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1866818961058816:12345-0@lo:38:kworker.0 Request processed in 108us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340637.581747:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:1.0:1780340637.581773:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:1.0:1780340637.581778:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961059328:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780340637.581789:0:64454:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3417 last 0 00000020:00000080:1.0:1780340637.581810:0:64454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa246514327739d6 00000004:00100000:1.0:1780340637.581816:0:64454:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1780340637.582252:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961059456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 867us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340637.582259:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3756 00000100:00100000:0.0:1780340637.582313:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961059456:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1780340637.582380:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1780340637.583681:0:64454:0:(import.c:65:import_set_state_nolock()) ffff8c0458287000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780340637.583749:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1866818961059328:12345-0@lo:38:kworker.0 Request processed in 1967us (3118us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340637.583789:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00080000:1.0:1780340637.583822:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340637.584980:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961057792 00000100:00100000:3.0:1780340637.584991:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961057792 00000100:00100000:3.0:1780340637.585049:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1780340637.585058:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961057792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340637.585118:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961057792:12345-0@lo:400:kworker.0 Request processed in 62us (6413us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340637.585124:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1780340637.585652:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340637.585699:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961058048:0@lo:400:kworker.0 00000100:00100000:1.0:1780340637.585713:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961058944:0@lo:400:kworker.0 00000100:00100000:1.0:1780340637.585721:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961057792:0@lo:400:kworker.0 00000100:00100000:1.0:1780340637.585734:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961058688:0@lo:400:kworker.0 00010000:00080000:1.0:1780340637.586963:0:83665:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1780340637.586970:0:83665:0:(ldlm_lib.c:2668:replay_request_or_update()) Waiting for transno 98784247813 00000020:00080000:1.0:1780340637.586978:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340637.586981:0:83665:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 98784247813, next_transno: 98784247813 00010000:00080000:1.0:1780340637.586985:0:83665:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (98784247813) 00000020:00080000:1.0:1780340637.586988:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340637.587001:0:83665:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940388224 t98784247813 from 192.168.203.16@tcp req@ffff8c034d877800 x1866818940388224/t0(98784247813) o36->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:58/0 lens 528/0 e 0 to 0 dl 1780340643 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340637.587217:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961058560:0@lo:400:kworker.0 00000100:00100000:3.0:1780340637.587270:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340637.587297:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961059200:0@lo:400:kworker.0 00000100:00100000:3.0:1780340637.587332:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340637.587352:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1780340637.587359:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961058304:0@lo:400:kworker.0 00000100:00100000:3.0:1780340637.587383:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340637.587409:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961059072:0@lo:400:kworker.0 00000100:00100000:1.0:1780340637.589031:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961058560 00000100:00100000:1.0:1780340637.589043:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961058560 00000100:00100000:1.0:1780340637.589095:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961059200 00000100:00100000:1.0:1780340637.589099:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961059200 00000100:00100000:1.0:1780340637.589139:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2399 00000100:00100000:1.0:1780340637.589150:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961058560:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1780340637.589393:0:3658:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8c034d874380 x1866818961057920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340662 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340637.589404:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1780340637.589410:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1780340637.589415:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1780340637.589532:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961058304 00000100:00100000:0.0:1780340637.589537:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961058304 00000100:00100000:0.0:1780340637.589573:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1780340637.589580:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961058304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340637.589645:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961058304:12345-0@lo:400:kworker.0 Request processed in 65us (2260us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340637.589651:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1780340637.590695:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340637.590773:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961058304:0@lo:400:kworker.0 00000100:00100000:1.0:1780340637.590893:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961058560:12345-0@lo:400:kworker.0 Request processed in 1744us (3621us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340637.590901:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2399 00000100:00100000:1.0:1780340637.590931:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961059072 00000100:00100000:1.0:1780340637.590936:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961059072 00000100:00100000:1.0:1780340637.590968:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2400 00000100:00100000:1.0:1780340637.590975:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961059200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340637.591013:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961059200:12345-0@lo:400:kworker.0 Request processed in 39us (3680us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340637.591019:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2400 00000100:00100000:1.0:1780340637.591030:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2401 00000100:00100000:1.0:1780340637.591036:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961059072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340637.591109:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961059072:12345-0@lo:400:kworker.0 Request processed in 73us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340637.591115:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2401 00000100:00080000:1.0:1780340637.591148:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780340637.591153:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340637.591156:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340637.592656:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471571f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961059072:0@lo:400:kworker.0 00000100:00100000:3.0:1780340637.592671:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961058560:0@lo:400:kworker.0 00000100:00100000:3.0:1780340637.592683:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961059200:0@lo:400:kworker.0 00000004:00080000:1.0:1780340637.596383:0:83665:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 9317us 00000100:00100000:2.0:1780340637.607718:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961057920:0@lo:38:kworker.0 00010000:00080000:2.0:1780340637.607785:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c046ba2ed80 x1866818961058176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340637.607801:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 24 00000100:00080000:2.0:1780340637.621955:0:3658:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8c046ba2ed80 x1866818961058176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340662 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340637.621968:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1780340637.621973:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1780340637.621977:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1780340637.621984:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961058176:0@lo:38:kworker.0 00000100:00080000:2.0:1780340637.622023:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 24 00000100:00080000:2.0:1780340637.622034:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1780340637.622038:0:3658:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1780340637.622040:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:2.0:1780340637.622044:0:3658:0:(recover.c:53:ptlrpc_replay_next()) import ffff8c034a39c800 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:2.0:1780340637.622047:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1780340637.622630:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961058432:0@lo:38:kworker.0 00010000:00080000:2.0:1780340637.622652:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c0471572d80 x1866818961058816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340637.622662:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 24 00010000:00080000:1.0:1780340637.622832:0:83942:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1780340637.622837:0:83942:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1780340637.622842:0:83942:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1780340637.623390:0:83942:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00080000:2.0:1780340637.624510:0:3658:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8c0471572d80 x1866818961058816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340662 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340637.624521:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1780340637.624526:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1780340637.624530:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1780340637.624546:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471572d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961058816:0@lo:38:kworker.0 00010000:00080000:2.0:1780340637.624600:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c0471573100 x1866818961059328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340647 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340637.624613:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 24 00000100:00080000:2.0:1780340637.624619:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1780340637.624623:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1780340637.624625:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a948800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1780340637.624629:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961059328:0@lo:38:kworker.0 00000100:00100000:2.0:1780340637.624671:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961059584:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1780340637.624728:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340637.625284:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961059584 00000100:00100000:0.0:1780340637.625292:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961059584 00000100:00100000:0.0:1780340637.625369:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3757 00000100:00100000:0.0:1780340637.625385:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818961059584:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1780340637.625405:0:8411:0:(ldlm_lib.c:3119:target_queue_recovery_request()) @@@ queue final req req@ffff8c0471573100 x1866818961059584/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:63/0 lens 224/0 e 0 to 0 dl 1780340648 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340637.625416:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471573100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818961059584:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 34us (688us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340637.625423:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3757 00010000:00010000:1.0:1780340637.631902:0:83665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa246514327739dd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.631925:0:83665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa246514327739dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.631941:0:83665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa246514327739dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.631982:0:83665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa246514327739e4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.631990:0:83665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa246514327739e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.631998:0:83665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa246514327739e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.633956:0:83665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa246514327739dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.633971:0:83665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa246514327739dd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.633979:0:83665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa246514327739dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.633986:0:83665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340637.633991:0:83665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa246514327739dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.633999:0:83665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa246514327739dd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.634015:0:83665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c044412b000) 00010000:00010000:1.0:1780340637.634018:0:83665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340637.634023:0:83665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa246514327739dd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.634030:0:83665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762600/0xa246514327739dd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340637.634058:0:83665:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003562fcf2 reply state 000000003fb4a686 transno 98784247813 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa246514327739e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.634086:0:83665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa246514327739e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.634094:0:83665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c044412bb00) 00010000:00010000:1.0:1780340637.634096:0:83665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340637.634100:0:83665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1780340637.634225:0:83665:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:1.0:1780340637.634243:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340637.634246:0:83665:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000020:00080000:1.0:1780340637.634250:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340637.634252:0:83665:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000001:00080000:1.0:1780340637.644650:0:83633:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247813 is committed 00010000:00010000:0.0:1780340637.644782:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa246514327739e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.644796:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa246514327739e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.644804:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa246514327739e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.644811:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340637.644816:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa246514327739e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.644825:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa246514327739e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.644843:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c044412bb00) 00010000:00010000:0.0:1780340637.644847:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340637.644851:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa246514327739e4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.644858:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0476762000/0xa246514327739e4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340637.648927:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340637.649868:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940388736 00000100:00100000:2.0:1780340637.649879:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940388736 00000100:00100000:2.0:1780340637.649940:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1139 00000100:00100000:2.0:1780340637.649954:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940388736:12345-192.168.203.16@tcp:36:rm.0 00010000:00080000:2.0:1780340637.649975:0:63711:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 98784247814, current: 98784247814, replaying 00000100:00100000:2.0:1780340637.649990:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940388736:12345-192.168.203.16@tcp:36:rm.0 Request processed in 43us (1072us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340637.649997:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1139 00000020:00080000:2.0:1780340637.650014:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340637.650019:0:83665:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247814, next_transno: 98784247814 00010000:00080000:2.0:1780340637.650023:0:83665:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (98784247814) 00000020:00080000:2.0:1780340637.650026:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340637.650035:0:83665:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940388736 t98784247814 from 192.168.203.16@tcp req@ffff8c047ace6a00 x1866818940388736/t0(98784247814) o36->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:63/0 lens 512/0 e 0 to 0 dl 1780340648 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1780340637.650135:0:83665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa246514327739eb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650152:0:83665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa246514327739eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650166:0:83665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa246514327739eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650178:0:83665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327739f2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650186:0:83665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327739f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650192:0:83665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327739f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650273:0:83665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa246514327739f9 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650282:0:83665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa246514327739f9 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650289:0:83665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa246514327739f9 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650535:0:83665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa246514327739f9 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650542:0:83665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa246514327739f9 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650555:0:83665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa246514327739f9 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650561:0:83665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32bc00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340637.650565:0:83665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa246514327739f9 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650572:0:83665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa246514327739f9 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650584:0:83665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff8c0455c3bf00) 00010000:00010000:2.0:1780340637.650587:0:83665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1780340637.650591:0:83665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa246514327739f9 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650597:0:83665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa246514327739f9 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650615:0:83665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa246514327739eb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650621:0:83665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa246514327739eb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650627:0:83665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa246514327739eb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650633:0:83665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340637.650636:0:83665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa246514327739eb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650653:0:83665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa246514327739eb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650661:0:83665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455c3bc00) 00010000:00010000:2.0:1780340637.650663:0:83665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340637.650665:0:83665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa246514327739eb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650670:0:83665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa246514327739eb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340637.650683:0:83665:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000361e20b0 reply state 00000000cfc0cdec transno 98784247814 ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327739f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650692:0:83665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327739f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.650698:0:83665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c0455c3b400) 00010000:00010000:2.0:1780340637.650700:0:83665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340637.650703:0:83665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1780340637.650791:0:83665:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1780340637.650810:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340637.650813:0:83665:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000020:00080000:2.0:1780340637.650817:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340637.650819:0:83665:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000100:00100000:1.0:1780340637.653377:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340637.653538:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940390528 00000100:00100000:0.0:1780340637.653548:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940390528 00000100:00100000:0.0:1780340637.653604:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1140 00000100:00100000:0.0:1780340637.653615:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2406:x1866818940390528:12345-192.168.203.16@tcp:101:touch.0 00010000:00080000:0.0:1780340637.653636:0:63712:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 98784247815, current: 98784247815, replaying 00000100:00100000:0.0:1780340637.653651:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2406:x1866818940390528:12345-192.168.203.16@tcp:101:touch.0 Request processed in 40us (294us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340637.653659:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1140 00000020:00080000:0.0:1780340637.653677:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780340637.653681:0:83665:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247815, next_transno: 98784247815 00010000:00080000:0.0:1780340637.653685:0:83665:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (98784247815) 00000020:00080000:0.0:1780340637.653689:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780340637.653699:0:83665:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940390528 t98784247815 from 192.168.203.16@tcp req@ffff8c034d874380 x1866818940390528/t0(98784247815) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:63/0 lens 752/0 e 0 to 0 dl 1780340648 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1780340637.653719:0:83665:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340637.653741:0:83665:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4800/0xa24651432773a00 lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2287 expref: -99 pid: 83665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.654019:0:83665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa24651432773a07 lrc: 3/0,1 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.654034:0:83665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa24651432773a07 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.654045:0:83665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa24651432773a07 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.654108:0:83665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432773a0e lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.654117:0:83665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432773a0e lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.654124:0:83665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432773a0e lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780340637.657102:0:83665:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x5:0x0], cookie = 0xa24651432773791 00000004:00080000:1.0:1780340637.657110:0:83665:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0xa24651432773791 in new mfd 00010000:00010000:1.0:1780340637.657126:0:83665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa24651432773a07 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.657137:0:83665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa24651432773a07 lrc: 2/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.657144:0:83665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa24651432773a07 lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.657150:0:83665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c4a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340637.657155:0:83665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa24651432773a07 lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.657172:0:83665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa24651432773a07 lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.657188:0:83665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff8c0443bb9c00) 00010000:00010000:1.0:1780340637.657190:0:83665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340637.657194:0:83665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa24651432773a07 lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.661539:0:83665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4a00/0xa24651432773a07 lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340637.661563:0:83665:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005f1b9216 reply state 00000000c3ffbc90 transno 98784247815 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432773a0e lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.661580:0:83665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432773a0e lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.661589:0:83665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff8c0443bb9b00) 00010000:00010000:1.0:1780340637.661592:0:83665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340637.661596:0:83665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780340637.661648:0:83665:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4800/0xa24651432773a00 lrc: 1/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2287 expref: 10 pid: 83665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.661660:0:83665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff8c0443bb9c00) 00010000:00010000:1.0:1780340637.661662:0:83665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340637.661666:0:83665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04441c4800/0xa24651432773a00 lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2287 expref: 10 pid: 83665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.661681:0:83665:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04441c4800, rc 0) 00010000:00080000:1.0:1780340637.661775:0:83665:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1780340637.661802:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340637.661806:0:83665:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000020:00080000:1.0:1780340637.661810:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340637.661812:0:83665:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000100:00100000:0.0:1780340637.713279:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340637.713403:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940390784 00000100:00100000:2.0:1780340637.713412:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940390784 00000100:00100000:2.0:1780340637.713474:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1141 00000100:00100000:2.0:1780340637.713483:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2406:x1866818940390784:12345-192.168.203.16@tcp:36:touch.0 00010000:00080000:2.0:1780340637.713509:0:64454:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 98784247816, current: 98784247816, replaying 00000100:00100000:2.0:1780340637.713523:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2406:x1866818940390784:12345-192.168.203.16@tcp:36:touch.0 Request processed in 42us (252us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340637.713530:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1141 00000020:00080000:2.0:1780340637.713547:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340637.713551:0:83665:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247816, next_transno: 98784247816 00010000:00080000:2.0:1780340637.713554:0:83665:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (98784247816) 00000020:00080000:2.0:1780340637.713557:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340637.713565:0:83665:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940390784 t98784247816 from 192.168.203.16@tcp req@ffff8c034a206300 x1866818940390784/t0(98784247816) o36->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:63/0 lens 488/0 e 0 to 0 dl 1780340648 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1780340637.713663:0:83665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa24651432773a1c lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.713679:0:83665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa24651432773a1c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.713689:0:83665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa24651432773a1c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340637.713802:0:83665:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c1ab8e61 reply state 0000000019a5bdad transno 98784247816 ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa24651432773a1c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.713814:0:83665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa24651432773a1c lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.713821:0:83665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff8c0455c3bc00) 00010000:00010000:2.0:1780340637.713824:0:83665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340637.713837:0:83665:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1780340637.713910:0:83665:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1780340637.713927:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340637.713929:0:83665:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247817 00000020:00080000:2.0:1780340637.713932:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340637.713934:0:83665:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247817 00000100:00100000:0.0:1780340637.716165:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340637.717185:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940391168 00000100:00100000:2.0:1780340637.717206:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940391168 00000100:00100000:2.0:1780340637.717266:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 221 00000100:00100000:2.0:1780340637.717276:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:2406:x1866818940391168:12345-192.168.203.16@tcp:35:touch.0 00010000:00080000:2.0:1780340637.717295:0:77826:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 98784247817, current: 98784247817, replaying 00000100:00100000:2.0:1780340637.717314:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:2406:x1866818940391168:12345-192.168.203.16@tcp:35:touch.0 Request processed in 41us (1156us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340637.717330:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 221 00000020:00080000:1.0:1780340637.718308:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340637.718315:0:83665:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247817, next_transno: 98784247817 00010000:00080000:1.0:1780340637.718328:0:83665:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (98784247817) 00000020:00080000:1.0:1780340637.718332:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340637.718341:0:83665:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940391168 t98784247817 from 192.168.203.16@tcp req@ffff8c0346f50000 x1866818940391168/t0(98784247817) o35->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:63/0 lens 392/0 e 0 to 0 dl 1780340648 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780340637.720017:0:83665:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1780340637.720041:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340637.720045:0:83665:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247818 00000020:00080000:1.0:1780340637.720049:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340637.720052:0:83665:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247818 00000100:00100000:2.0:1780340637.731983:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340637.741834:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340637.742303:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340637.743938:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940396544 00000100:00100000:1.0:1780340637.743952:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940396544 00000100:00100000:1.0:1780340637.744049:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940396800 00000100:00100000:1.0:1780340637.744053:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940396800 00000100:00100000:1.0:1780340637.744082:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1137 00000100:00100000:1.0:1780340637.744091:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:2406:x1866818940396544:12345-192.168.203.16@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1780340637.744115:0:63710:0:(ldlm_lib.c:3119:target_queue_recovery_request()) @@@ queue final req req@ffff8c0471572d80 x1866818940396544/t0(0) o400->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:63/0 lens 224/0 e 0 to 0 dl 1780340648 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340637.744144:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471572d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:2406:x1866818940396544:12345-192.168.203.16@tcp:400:ldlm_lock_repla.0 Request processed in 54us (12169us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780340637.744151:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1137 00000100:00100000:1.0:1780340637.744170:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1138 00000100:00100000:1.0:1780340637.744178:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940396800:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340637.744256:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471573b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940396800:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 79us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340637.744263:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1138 00000020:00080000:1.0:1780340637.744413:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340637.745529:0:83665:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 98784247818 00010000:00080000:1.0:1780340637.745533:0:83665:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1780340637.745536:0:83665:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340637.745543:0:83665:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1780340637.745546:0:83665:0:(ldlm_lib.c:2270:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1780340637.745648:0:83665:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 103079215104 00000100:00100000:0.0:1780340637.751150:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940396672 00000100:00100000:0.0:1780340637.751165:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940396672 00000100:00100000:0.0:1780340637.751235:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 73 00000100:00100000:0.0:1780340637.751245:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2410:x1866818940396672:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340637.751331:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2410:x1866818940396672:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 87us (9514us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340637.751339:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 73 00000020:00000004:0.0:1780340637.758152:0:83954:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000001:00100000:2.0:1780340637.760018:0:83633:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000001:00100000:2.0:1780340637.760027:0:83633:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1780340637.760052:0:83633:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247817 is committed 00010000:00010000:1.0:1780340637.760301:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327739f2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760314:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327739f2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760331:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327739f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760337:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340637.760341:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327739f2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760349:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327739f2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760365:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327739f2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760386:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327739f2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760423:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432773a0e lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760429:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432773a0e lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760435:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432773a0e lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760440:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340637.760442:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432773a0e lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760448:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432773a0e lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760457:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432773a0e lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760463:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432773a0e lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760478:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa24651432773a1c lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760483:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa24651432773a1c lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760498:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa24651432773a1c lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760502:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340637.760505:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa24651432773a1c lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760510:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa24651432773a1c lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760517:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa24651432773a1c lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.760523:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa24651432773a1c lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83665 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1780340637.760561:0:83665:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1780340637.760596:0:83665:0:(ldlm_lib.c:1981:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1780340637.760610:0:83665:0:(ldlm_lib.c:2922:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8c0471573100 x1866818961059584/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:63/0 lens 224/0 e 0 to 0 dl 1780340648 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1780340637.760722:0:83665:0:(ldlm_lib.c:2922:target_recovery_thread()) @@@ processing final ping from 192.168.203.16@tcp: req@ffff8c0471572d80 x1866818940396544/t0(0) o400->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:63/0 lens 224/0 e 0 to 0 dl 1780340648 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1780340637.760802:0:83665:0:(ldlm_lib.c:1853:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:2.0:1780340637.765934:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1780340637.765953:0:3658:0:(client.c:3224:ptlrpc_resend_req()) @@@ going to resend req@ffff8c04587b6680 x1866818961059584/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340653 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340637.765964:0:3658:0:(client.c:3233:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8c04587b6680 x1866818961059584/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340653 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340637.765970:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1780340637.765993:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1780340637.765998:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961059584:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1780340637.766115:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961059712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340637.766189:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340637.766292:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961059712 00000100:00100000:2.0:1780340637.766299:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961059712 00000100:00100000:2.0:1780340637.766361:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3758 00000100:00100000:2.0:1780340637.766371:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818961059712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780340637.766418:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:2.0:1780340637.766463:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818961059712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340637.766471:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3758 00000100:00100000:2.0:1780340637.766505:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961059712:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1780340637.768900:0:83954:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000004:00000080:1.0:1780340637.807029:0:83665:0:(mdd_device.c:2374:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff992747eebe10 00100000:10000000:1.0:1780340637.807040:0:83665:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1780340637.811551:0:83651:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x282:0x0] 00000100:00100000:2.0:1780340637.811601:0:83651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471570000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83651:1866818961059840:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1780340637.811671:0:83651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340637.811705:0:83651:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0347591d80 going to sleep for 11 seconds 00000100:00100000:1.0:1780340637.811784:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961059840 00000100:00100000:1.0:1780340637.811792:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961059840 00000100:00100000:1.0:1780340637.811850:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5872 00000100:00100000:1.0:1780340637.811870:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:83651:x1866818961059840:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1780340637.811895:0:8399:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 737 -> diff = -95 00002000:02000040:1.0:1780340637.811899:0:8399:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:643 to 0x280000401:737) 00000004:00080000:3.0:1780340637.811960:0:83653:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x90:0x0] 00000100:00100000:3.0:1780340637.811981:0:83653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83653:1866818961059968:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1780340637.812013:0:83653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340637.812456:0:83653:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0447b5f600 going to sleep for 11 seconds 00000100:00100000:2.0:1780340637.820876:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961059968 00000100:00100000:2.0:1780340637.820889:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961059968 00000100:00100000:2.0:1780340637.823367:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5873 00000100:00100000:2.0:1780340637.823395:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:83653:x1866818961059968:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1780340637.823441:0:25491:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 737 -> diff = -593 00002000:02000040:2.0:1780340637.823447:0:25491:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:145 to 0x2c0000401:737) 00002000:00010000:1.0:1780340637.831976:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.831989:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba25263/0xa24651432773a23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832004:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832006:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832011:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fba25263/0xa24651432773a23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832025:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fba25263/0xa24651432773a23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832034:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fba25263/0xa24651432773a23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832041:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fba25263/0xa24651432773a23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832063:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780340637.832148:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.832153:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7b51ba2/0xa24651432773a2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832160:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832169:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832172:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7b51ba2/0xa24651432773a2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832181:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7b51ba2/0xa24651432773a2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832188:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7b51ba2/0xa24651432773a2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832204:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7b51ba2/0xa24651432773a2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832216:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780340637.832250:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.832255:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000793b8cb5/0xa24651432773a31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832263:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832264:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832267:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000793b8cb5/0xa24651432773a31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832275:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000793b8cb5/0xa24651432773a31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832282:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000793b8cb5/0xa24651432773a31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832298:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000793b8cb5/0xa24651432773a31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832324:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1780340637.832363:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.832368:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000950a2f33/0xa24651432773a38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832375:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832376:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832378:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000950a2f33/0xa24651432773a38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832386:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000950a2f33/0xa24651432773a38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832393:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000950a2f33/0xa24651432773a38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832401:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000950a2f33/0xa24651432773a38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832419:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1780340637.832492:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.832497:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a41d7374/0xa24651432773a3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832514:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832515:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832518:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a41d7374/0xa24651432773a3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832527:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a41d7374/0xa24651432773a3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832535:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a41d7374/0xa24651432773a3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832541:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a41d7374/0xa24651432773a3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832552:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1780340637.832587:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.832592:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc7fccf4/0xa24651432773a46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832598:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832600:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832602:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc7fccf4/0xa24651432773a46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832610:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc7fccf4/0xa24651432773a46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832627:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc7fccf4/0xa24651432773a46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832634:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc7fccf4/0xa24651432773a46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832643:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1780340637.832678:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.832683:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa24651432773a4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832690:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832692:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832694:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa24651432773a4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832703:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa24651432773a4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832710:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa24651432773a4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832715:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa24651432773a4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832722:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1780340637.832786:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.832790:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019524e20/0xa24651432773a54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832797:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832798:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832801:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019524e20/0xa24651432773a54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832808:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019524e20/0xa24651432773a54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832814:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019524e20/0xa24651432773a54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832819:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019524e20/0xa24651432773a54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832826:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1780340637.832852:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.832856:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb5f163a/0xa24651432773a5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832862:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832863:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832866:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb5f163a/0xa24651432773a5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832873:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb5f163a/0xa24651432773a5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832885:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb5f163a/0xa24651432773a5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832891:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb5f163a/0xa24651432773a5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832898:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:1.0:1780340637.832928:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.832932:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa24651432773a62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832938:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832939:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.832941:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa24651432773a62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832949:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa24651432773a62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832955:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa24651432773a62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832962:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa24651432773a62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.832969:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:1.0:1780340637.833007:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.833012:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa24651432773a69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833018:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.833019:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.833022:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa24651432773a69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833030:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa24651432773a69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833037:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa24651432773a69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833044:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa24651432773a69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833052:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:1.0:1780340637.833088:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.833092:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa24651432773a70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833099:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.833100:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.833103:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa24651432773a70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833110:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa24651432773a70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833123:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa24651432773a70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833130:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa24651432773a70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833139:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:1.0:1780340637.833172:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.833176:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa24651432773a77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833183:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.833184:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.833187:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa24651432773a77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833194:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa24651432773a77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833200:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa24651432773a77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833206:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa24651432773a77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833214:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:1.0:1780340637.833253:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.833257:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa24651432773a7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833264:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.833266:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.833268:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa24651432773a7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833276:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa24651432773a7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833284:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa24651432773a7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833290:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa24651432773a7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833298:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:1.0:1780340637.833341:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.833346:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa24651432773a85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833353:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.833354:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.833357:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa24651432773a85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833365:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa24651432773a85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833378:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa24651432773a85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833386:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa24651432773a85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833394:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00010000:00010000:3.0:1780340637.833429:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00002000:00010000:1.0:1780340637.833429:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.833433:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa24651432773a8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833436:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fba25263/0xa24651432773a23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833441:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.833442:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.833444:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476763200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340637.833445:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa24651432773a8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833449:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba25263/0xa24651432773a23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833454:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa24651432773a8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833461:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa24651432773a8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833468:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fba25263/0xa24651432773a23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833468:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa24651432773a8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833475:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00010000:00010000:3.0:1780340637.833492:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fba25263/0xa24651432773a23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833499:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fba25263/0xa24651432773a23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340637.833511:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.833515:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa24651432773a93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833518:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:3.0:1780340637.833522:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7b51ba2/0xa24651432773a2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833522:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.833523:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.833526:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa24651432773a93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833529:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.833532:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7b51ba2/0xa24651432773a2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833535:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa24651432773a93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833539:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7b51ba2/0xa24651432773a2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833542:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa24651432773a93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833549:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7b51ba2/0xa24651432773a2a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833549:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa24651432773a93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833556:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7b51ba2/0xa24651432773a2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833558:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00010000:00010000:3.0:1780340637.833580:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:3.0:1780340637.833583:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000793b8cb5/0xa24651432773a31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340637.833584:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.833588:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008883ffc8/0xa24651432773a9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833591:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476763600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.833594:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000793b8cb5/0xa24651432773a31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833601:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000793b8cb5/0xa24651432773a31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833610:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.833611:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000793b8cb5/0xa24651432773a31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833611:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.833614:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008883ffc8/0xa24651432773a9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833619:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000793b8cb5/0xa24651432773a31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833622:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008883ffc8/0xa24651432773a9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833630:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:3.0:1780340637.833633:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000950a2f33/0xa24651432773a38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833636:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008883ffc8/0xa24651432773a9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833640:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476763c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.833643:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000950a2f33/0xa24651432773a38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833643:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008883ffc8/0xa24651432773a9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833652:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00010000:00010000:3.0:1780340637.833659:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000950a2f33/0xa24651432773a38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833668:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000950a2f33/0xa24651432773a38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833675:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000950a2f33/0xa24651432773a38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340637.833683:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.833686:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:1.0:1780340637.833687:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000926158d6/0xa24651432773aa1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833689:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a41d7374/0xa24651432773a3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833694:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.833696:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340637.833696:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.833699:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a41d7374/0xa24651432773a3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833699:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000926158d6/0xa24651432773aa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833707:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a41d7374/0xa24651432773a3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833708:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000926158d6/0xa24651432773aa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833716:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a41d7374/0xa24651432773a3f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833716:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000926158d6/0xa24651432773aa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833724:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a41d7374/0xa24651432773a3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833724:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000926158d6/0xa24651432773aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833732:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00010000:00010000:3.0:1780340637.833744:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:3.0:1780340637.833747:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc7fccf4/0xa24651432773a46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833753:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.833756:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc7fccf4/0xa24651432773a46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833781:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc7fccf4/0xa24651432773a46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340637.833783:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.833787:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab6d03ad/0xa24651432773aa8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833792:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc7fccf4/0xa24651432773a46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833794:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.833795:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.833798:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab6d03ad/0xa24651432773aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833799:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc7fccf4/0xa24651432773a46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833807:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab6d03ad/0xa24651432773aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833811:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:3.0:1780340637.833814:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa24651432773a4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833815:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab6d03ad/0xa24651432773aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833821:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476762200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340637.833823:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab6d03ad/0xa24651432773aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833824:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa24651432773a4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833831:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00010000:00010000:3.0:1780340637.833841:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa24651432773a4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833851:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa24651432773a4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833858:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000beeed813/0xa24651432773a4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340637.833859:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.833863:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001663f8f0/0xa24651432773aaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833869:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.833870:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:1.0:1780340637.833871:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.833873:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001663f8f0/0xa24651432773aaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833874:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019524e20/0xa24651432773a54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833880:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c4800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340637.833882:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001663f8f0/0xa24651432773aaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833883:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019524e20/0xa24651432773a54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833890:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019524e20/0xa24651432773a54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833894:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001663f8f0/0xa24651432773aaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833898:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019524e20/0xa24651432773a54 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833902:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001663f8f0/0xa24651432773aaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833905:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019524e20/0xa24651432773a54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833910:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00010000:00010000:3.0:1780340637.833925:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:3.0:1780340637.833928:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb5f163a/0xa24651432773a5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833935:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c4a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.833937:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb5f163a/0xa24651432773a5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340637.833941:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.833945:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb5f163a/0xa24651432773a5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833945:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ae9a216/0xa24651432773ab6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833952:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.833953:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.833954:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb5f163a/0xa24651432773a5b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833956:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ae9a216/0xa24651432773ab6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833962:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb5f163a/0xa24651432773a5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833965:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ae9a216/0xa24651432773ab6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833972:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:1.0:1780340637.833972:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ae9a216/0xa24651432773ab6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833975:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa24651432773a62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833979:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ae9a216/0xa24651432773ab6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.833982:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440030e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.833985:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa24651432773a62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.833987:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00010000:00010000:3.0:1780340637.833999:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa24651432773a62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834008:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa24651432773a62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834015:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa24651432773a62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340637.834019:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.834023:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a1b957/0xa24651432773abd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834027:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1780340637.834029:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa24651432773a69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834030:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.834031:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.834034:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a1b957/0xa24651432773abd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834036:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440030200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.834039:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa24651432773a69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834042:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4a1b957/0xa24651432773abd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834046:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa24651432773a69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834050:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4a1b957/0xa24651432773abd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834055:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa24651432773a69 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834057:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4a1b957/0xa24651432773abd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834063:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa24651432773a69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834065:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00010000:00010000:3.0:1780340637.834083:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:3.0:1780340637.834087:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa24651432773a70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340637.834090:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.834093:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440030800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340637.834094:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086665915/0xa24651432773ac4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834096:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa24651432773a70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834102:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.834103:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.834104:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa24651432773a70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834106:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086665915/0xa24651432773ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834113:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa24651432773a70 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834114:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086665915/0xa24651432773ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834120:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa24651432773a70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834126:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086665915/0xa24651432773ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834130:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1780340637.834133:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa24651432773a77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834134:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086665915/0xa24651432773ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834139:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.834142:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa24651432773a77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834142:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00010000:00010000:3.0:1780340637.834159:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa24651432773a77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834168:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa24651432773a77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340637.834173:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.834176:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa24651432773a77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834177:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e567eece/0xa24651432773acb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834184:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.834186:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.834188:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1780340637.834188:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e567eece/0xa24651432773acb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834192:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa24651432773a7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834196:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e567eece/0xa24651432773acb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834198:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.834201:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa24651432773a7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834204:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e567eece/0xa24651432773acb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834209:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa24651432773a7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834211:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e567eece/0xa24651432773acb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834217:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa24651432773a7e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834218:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00010000:00010000:3.0:1780340637.834223:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa24651432773a7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834241:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:3.0:1780340637.834244:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa24651432773a85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834250:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031800 already unused, calling callback (ffffffffc0cb36f0) 00002000:00010000:1.0:1780340637.834252:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.834253:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa24651432773a85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834256:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003842f191/0xa24651432773ad2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834261:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa24651432773a85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834263:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.834264:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.834267:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003842f191/0xa24651432773ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834270:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa24651432773a85 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834275:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003842f191/0xa24651432773ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834277:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa24651432773a85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834283:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003842f191/0xa24651432773ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834287:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1780340637.834290:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa24651432773a8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834291:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003842f191/0xa24651432773ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834297:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340637.834299:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:3.0:1780340637.834300:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa24651432773a8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834327:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa24651432773a8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834338:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa24651432773a8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340637.834338:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.834343:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000865bfea/0xa24651432773ad9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834345:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa24651432773a8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834350:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.834351:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.834354:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000865bfea/0xa24651432773ad9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834358:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1780340637.834361:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa24651432773a93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834361:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000865bfea/0xa24651432773ad9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834367:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.834370:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa24651432773a93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834373:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000865bfea/0xa24651432773ad9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834377:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa24651432773a93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834381:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000865bfea/0xa24651432773ad9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834386:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa24651432773a93 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834389:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00010000:00010000:3.0:1780340637.834392:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa24651432773a93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834412:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:3.0:1780340637.834415:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008883ffc8/0xa24651432773a9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834421:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122a00 already unused, calling callback (ffffffffc0cb36f0) 00002000:00010000:1.0:1780340637.834421:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.834424:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008883ffc8/0xa24651432773a9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834425:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008281118c/0xa24651432773ae0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834432:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008883ffc8/0xa24651432773a9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834432:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.834434:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.834436:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008281118c/0xa24651432773ae0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834441:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008883ffc8/0xa24651432773a9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834444:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008281118c/0xa24651432773ae0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834448:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008883ffc8/0xa24651432773a9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834452:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008281118c/0xa24651432773ae0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834459:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1780340637.834459:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008281118c/0xa24651432773ae0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834462:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000926158d6/0xa24651432773aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834467:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:3.0:1780340637.834468:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.834471:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000926158d6/0xa24651432773aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834486:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000926158d6/0xa24651432773aa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834496:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000926158d6/0xa24651432773aa1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340637.834500:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.834503:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000926158d6/0xa24651432773aa1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834504:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000538e7f63/0xa24651432773ae7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834511:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.834513:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.834515:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1780340637.834515:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000538e7f63/0xa24651432773ae7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834519:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab6d03ad/0xa24651432773aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834524:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000538e7f63/0xa24651432773ae7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834525:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.834528:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab6d03ad/0xa24651432773aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834532:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000538e7f63/0xa24651432773ae7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834535:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab6d03ad/0xa24651432773aa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834539:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000538e7f63/0xa24651432773ae7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834544:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab6d03ad/0xa24651432773aa8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834546:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00010000:00010000:3.0:1780340637.834550:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab6d03ad/0xa24651432773aa8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834570:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00002000:00010000:1.0:1780340637.834572:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.834573:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001663f8f0/0xa24651432773aaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834576:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e40ce22/0xa24651432773aee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834580:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.834583:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001663f8f0/0xa24651432773aaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834583:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.834584:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.834587:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e40ce22/0xa24651432773aee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834591:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001663f8f0/0xa24651432773aaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834595:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e40ce22/0xa24651432773aee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834600:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001663f8f0/0xa24651432773aaf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834607:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001663f8f0/0xa24651432773aaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834608:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e40ce22/0xa24651432773aee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834616:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e40ce22/0xa24651432773aee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834618:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1780340637.834620:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ae9a216/0xa24651432773ab6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834623:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1780340637.834626:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.834629:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ae9a216/0xa24651432773ab6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834644:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ae9a216/0xa24651432773ab6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340637.834652:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.834653:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ae9a216/0xa24651432773ab6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834656:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e79de54/0xa24651432773af5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834660:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ae9a216/0xa24651432773ab6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834663:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.834665:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.834667:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e79de54/0xa24651432773af5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834671:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1780340637.834674:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4a1b957/0xa24651432773abd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834675:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e79de54/0xa24651432773af5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834681:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340637.834683:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e79de54/0xa24651432773af5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834684:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a1b957/0xa24651432773abd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834690:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e79de54/0xa24651432773af5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834691:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4a1b957/0xa24651432773abd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834698:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:3.0:1780340637.834699:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4a1b957/0xa24651432773abd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834705:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4a1b957/0xa24651432773abd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834725:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1780340637.834728:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086665915/0xa24651432773ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340637.834731:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.834734:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340637.834735:0:8399:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037d1ee22/0xa24651432773afc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834737:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086665915/0xa24651432773ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834743:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340637.834744:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.834745:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086665915/0xa24651432773ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834747:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037d1ee22/0xa24651432773afc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834755:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086665915/0xa24651432773ac4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.834755:0:8399:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037d1ee22/0xa24651432773afc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834787:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086665915/0xa24651432773ac4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834798:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1780340637.834801:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e567eece/0xa24651432773acb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834806:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.834809:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e567eece/0xa24651432773acb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834826:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e567eece/0xa24651432773acb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834835:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e567eece/0xa24651432773acb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834843:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e567eece/0xa24651432773acb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834855:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1780340637.834858:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003842f191/0xa24651432773ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834864:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.834866:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003842f191/0xa24651432773ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834873:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003842f191/0xa24651432773ad2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834882:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003842f191/0xa24651432773ad2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834888:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003842f191/0xa24651432773ad2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834908:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1780340637.834911:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000865bfea/0xa24651432773ad9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834917:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.834920:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000865bfea/0xa24651432773ad9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834926:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000865bfea/0xa24651432773ad9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834935:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000865bfea/0xa24651432773ad9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834940:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000865bfea/0xa24651432773ad9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834950:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780340637.834952:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008281118c/0xa24651432773ae0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834957:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.834959:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008281118c/0xa24651432773ae0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834975:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008281118c/0xa24651432773ae0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834983:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008281118c/0xa24651432773ae0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.834990:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008281118c/0xa24651432773ae0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.835001:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780340637.835003:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000538e7f63/0xa24651432773ae7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.835008:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.835010:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000538e7f63/0xa24651432773ae7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.835016:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000538e7f63/0xa24651432773ae7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.835023:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000538e7f63/0xa24651432773ae7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.835028:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000538e7f63/0xa24651432773ae7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.835047:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340637.835050:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e40ce22/0xa24651432773aee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.835055:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.835058:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e40ce22/0xa24651432773aee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.835064:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e40ce22/0xa24651432773aee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.835071:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e40ce22/0xa24651432773aee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.835077:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e40ce22/0xa24651432773aee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.835085:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340637.835087:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e79de54/0xa24651432773af5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.835092:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.835095:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e79de54/0xa24651432773af5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.835111:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e79de54/0xa24651432773af5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.835120:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e79de54/0xa24651432773af5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.835126:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e79de54/0xa24651432773af5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.835138:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.835140:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.835142:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.835153:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340637.835953:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340637.835961:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340637.839120:0:8399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037d1ee22/0xa24651432773afc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.839131:0:8399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037d1ee22/0xa24651432773afc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.839156:0:8399:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340637.840941:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340637.840951:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037d1ee22/0xa24651432773afc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.840964:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.840969:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037d1ee22/0xa24651432773afc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.840979:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037d1ee22/0xa24651432773afc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.840998:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037d1ee22/0xa24651432773afc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.841025:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037d1ee22/0xa24651432773afc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.841049:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.841051:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.841053:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.841875:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1780340637.842219:0:8399:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:642 00000100:00100000:1.0:1780340637.842310:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471571c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:83651:x1866818961059840:12345-0@lo:5:osp-pre-0-0.0 Request processed in 30438us (30635us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340637.842922:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5872 00000100:00100000:1.0:1780340637.842983:0:83651:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471570000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83651:1866818961059840:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1780340637.842998:0:83651:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x2e1:0x0] from OST, last_created [0x280000401:0x2e1:0x0]last_used is [0x280000401:0x282:0x0] 00000100:00100000:1.0:1780340637.843063:0:83651:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83651:1866818961060224:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1780340637.843115:0:83651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340637.843523:0:83651:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345302600 going to sleep for 11 seconds 00000100:00100000:1.0:1780340637.843549:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961060224 00000100:00100000:1.0:1780340637.843556:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961060224 00000100:00100000:1.0:1780340637.843591:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5874 00000100:00100000:1.0:1780340637.843599:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:83651:x1866818961060224:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1780340637.843638:0:25486:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 738 00000100:00100000:3.0:1780340637.843866:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961060096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340637.843908:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340637.843959:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961060096 00000100:00100000:3.0:1780340637.843963:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961060096 00000100:00100000:3.0:1780340637.843990:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:3.0:1780340637.843997:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1866818961060096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780340637.844008:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 896 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340637.844047:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1866818961060096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340637.844052:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00100000:3.0:1780340637.844085:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961060096:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1780340637.854586:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1780340637.857552:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340637.857567:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773b03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.857598:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340637.857600:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340637.857606:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.857623:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.857634:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.857642:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773b03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.857667:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340637.857959:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340637.857965:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432773b0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.857972:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340637.857974:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340637.857977:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432773b0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.857984:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432773b0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.858000:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432773b0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.858006:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432773b0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.858022:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780340637.858031:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340637.858036:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773b03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.858042:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340637.858047:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773b03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.858055:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773b03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.858069:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773b03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.858075:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432773b03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.858092:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340637.858100:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432773b0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.858105:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340637.858108:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432773b0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.858115:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432773b0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.858122:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432773b0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.858625:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340637.860718:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.860725:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000563baee/0xa24651432773b11 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.860738:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.860740:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.860750:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000563baee/0xa24651432773b11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.860791:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000563baee/0xa24651432773b11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.860802:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000563baee/0xa24651432773b11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.860808:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000563baee/0xa24651432773b11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.860824:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780340637.860872:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.860877:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085c61623/0xa24651432773b18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.860884:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.860885:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.860888:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085c61623/0xa24651432773b18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.860897:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085c61623/0xa24651432773b18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.860905:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085c61623/0xa24651432773b18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.860923:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085c61623/0xa24651432773b18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.860937:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780340637.860948:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340637.860952:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000563baee/0xa24651432773b11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.860960:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c046fb21800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.860964:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000563baee/0xa24651432773b11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.860973:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000563baee/0xa24651432773b11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.860987:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000563baee/0xa24651432773b11 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.860993:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000563baee/0xa24651432773b11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861008:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340637.861011:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085c61623/0xa24651432773b18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861027:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c046fb20000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.861029:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085c61623/0xa24651432773b18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861036:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085c61623/0xa24651432773b18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861045:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085c61623/0xa24651432773b18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861051:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085c61623/0xa24651432773b18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861060:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.861062:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.861063:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340637.861103:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.861108:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004206e8dc/0xa24651432773b1f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861115:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.861116:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.861118:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004206e8dc/0xa24651432773b1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861125:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004206e8dc/0xa24651432773b1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861152:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004206e8dc/0xa24651432773b1f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861159:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004206e8dc/0xa24651432773b1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861171:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340637.861180:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340637.861183:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004206e8dc/0xa24651432773b1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861189:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c046fb20e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.861192:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004206e8dc/0xa24651432773b1f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861544:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004206e8dc/0xa24651432773b1f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861557:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004206e8dc/0xa24651432773b1f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861563:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004206e8dc/0xa24651432773b1f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861577:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.861584:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.861586:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340637.861633:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.861638:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011808953/0xa24651432773b26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861645:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.861646:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.861649:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011808953/0xa24651432773b26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861658:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011808953/0xa24651432773b26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861666:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011808953/0xa24651432773b26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861673:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011808953/0xa24651432773b26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861686:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340637.861693:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340637.861697:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011808953/0xa24651432773b26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861704:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c046fb20c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.861707:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011808953/0xa24651432773b26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861727:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011808953/0xa24651432773b26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861737:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011808953/0xa24651432773b26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861744:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011808953/0xa24651432773b26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861781:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.861784:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.861785:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340637.861830:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.861835:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa7f1b7c/0xa24651432773b2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861842:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.861844:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.861846:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa7f1b7c/0xa24651432773b2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861854:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa7f1b7c/0xa24651432773b2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861861:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa7f1b7c/0xa24651432773b2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861879:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa7f1b7c/0xa24651432773b2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861891:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340637.861899:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340637.861902:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa7f1b7c/0xa24651432773b2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861908:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c046fb21000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.861910:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa7f1b7c/0xa24651432773b2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861917:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa7f1b7c/0xa24651432773b2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861927:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa7f1b7c/0xa24651432773b2d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861935:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa7f1b7c/0xa24651432773b2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.861947:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.861949:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.861950:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340637.861991:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.862004:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014e944ca/0xa24651432773b34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.862012:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.862013:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.862016:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014e944ca/0xa24651432773b34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.862024:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014e944ca/0xa24651432773b34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.862032:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014e944ca/0xa24651432773b34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.862039:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014e944ca/0xa24651432773b34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.862051:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340637.862057:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340637.862059:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014e944ca/0xa24651432773b34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.862065:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c046fb21400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.862068:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e944ca/0xa24651432773b34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.862076:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e944ca/0xa24651432773b34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.862097:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014e944ca/0xa24651432773b34 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.862103:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014e944ca/0xa24651432773b34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.862115:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.862117:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.862119:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340637.862559:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432773b0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.862580:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340637.862581:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340637.862583:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340637.862804:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1780340637.864279:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1780340637.865548:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969450 is committed 00000100:00100000:0.0:1780340637.865819:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:83651:x1866818961060224:12345-0@lo:5:osp-pre-0-0.0 Request processed in 22215us (22698us total) trans 4294969450 rc 0/0 00000100:00100000:0.0:1780340637.865831:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5874 00002000:00010000:3.0:1780340637.865996:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.866004:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7fbdce4/0xa24651432773b3b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.866018:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.866020:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.866026:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7fbdce4/0xa24651432773b3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.866038:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7fbdce4/0xa24651432773b3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.866049:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7fbdce4/0xa24651432773b3b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.866056:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7fbdce4/0xa24651432773b3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340637.866178:0:83651:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 2 00000100:00100000:2.0:1780340637.866187:0:83651:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83651:1866818961060224:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1780340637.866332:0:83651:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2e1:0x0]-[0x280000401:0x301:0x0] 00010000:00010000:3.0:1780340637.866403:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780340637.866449:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.866454:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773b42 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.866462:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.866464:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.866466:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773b42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.866486:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773b42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.866494:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773b42 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.866500:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773b42 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.866974:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780340637.866981:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7fbdce4/0xa24651432773b3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.866990:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c046fb21c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340637.866994:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7fbdce4/0xa24651432773b3b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.867004:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7fbdce4/0xa24651432773b3b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.867019:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7fbdce4/0xa24651432773b3b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.867027:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7fbdce4/0xa24651432773b3b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.867044:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340637.867047:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773b42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.867052:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340637.867055:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773b42 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.867061:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773b42 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.867082:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773b42 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.867090:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340637.867091:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340637.867093:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.867286:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1780340637.867291:0:25491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432773b42 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780340637.867604:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340637.867610:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773b49 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.867624:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.867626:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340637.867630:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773b49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.867640:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773b49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.867648:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773b49 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.867655:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773b49 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.867722:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340637.867728:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773b49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.867747:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340637.867750:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773b49 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.867784:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773b49 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.867797:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773b49 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.867805:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340637.867806:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340637.867808:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.867942:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1780340637.867946:0:25491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432773b49 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340637.868063:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.868069:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a78c14df/0xa24651432773b50 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.868077:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.868079:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.868081:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a78c14df/0xa24651432773b50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.868090:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a78c14df/0xa24651432773b50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.868097:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a78c14df/0xa24651432773b50 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.868103:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a78c14df/0xa24651432773b50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.868188:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340637.868193:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a78c14df/0xa24651432773b50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.868264:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340637.868267:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a78c14df/0xa24651432773b50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.868275:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a78c14df/0xa24651432773b50 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.868635:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a78c14df/0xa24651432773b50 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.868652:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340637.868654:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340637.868656:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340637.868719:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1780340637.868724:0:25491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a78c14df/0xa24651432773b50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340637.868819:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.868824:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4c5182b/0xa24651432773b57 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.868833:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.868834:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.868837:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4c5182b/0xa24651432773b57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.868845:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4c5182b/0xa24651432773b57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.868852:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4c5182b/0xa24651432773b57 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.868860:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4c5182b/0xa24651432773b57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.869005:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340637.869010:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4c5182b/0xa24651432773b57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.869019:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340637.869022:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4c5182b/0xa24651432773b57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.869030:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4c5182b/0xa24651432773b57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.869041:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4c5182b/0xa24651432773b57 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.869123:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1780340637.869268:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340637.869294:0:25491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4c5182b/0xa24651432773b57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340637.869358:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.869363:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030cb18f5/0xa24651432773b5e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.869381:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.869382:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.869386:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030cb18f5/0xa24651432773b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.869554:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030cb18f5/0xa24651432773b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.869562:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030cb18f5/0xa24651432773b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.869569:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030cb18f5/0xa24651432773b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.869590:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340637.869636:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.869641:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3f7ed44/0xa24651432773b65 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.869648:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.869649:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.869653:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3f7ed44/0xa24651432773b65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.869661:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3f7ed44/0xa24651432773b65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.869681:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3f7ed44/0xa24651432773b65 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.869688:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3f7ed44/0xa24651432773b65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.869749:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780340637.870068:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340637.870074:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030cb18f5/0xa24651432773b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.870083:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.870086:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030cb18f5/0xa24651432773b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.870105:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030cb18f5/0xa24651432773b5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.870118:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030cb18f5/0xa24651432773b5e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.870125:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030cb18f5/0xa24651432773b5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.870150:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340637.870153:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3f7ed44/0xa24651432773b65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.870160:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.870162:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3f7ed44/0xa24651432773b65 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.870170:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3f7ed44/0xa24651432773b65 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.870179:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3f7ed44/0xa24651432773b65 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.870185:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3f7ed44/0xa24651432773b65 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.870220:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.870222:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340637.870925:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340637.871062:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.871069:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1172e0f/0xa24651432773b6c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.871079:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.871081:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.871084:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1172e0f/0xa24651432773b6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.871095:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1172e0f/0xa24651432773b6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.871102:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1172e0f/0xa24651432773b6c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.871109:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1172e0f/0xa24651432773b6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.871255:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340637.871310:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.871314:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2f83c7a/0xa24651432773b73 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.874994:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.874997:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.875003:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f83c7a/0xa24651432773b73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.875021:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2f83c7a/0xa24651432773b73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.875032:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2f83c7a/0xa24651432773b73 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.875040:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2f83c7a/0xa24651432773b73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.875066:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780340637.875304:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340637.875313:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1172e0f/0xa24651432773b6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.875330:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340637.875335:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1172e0f/0xa24651432773b6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.875360:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1172e0f/0xa24651432773b6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.875378:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1172e0f/0xa24651432773b6c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.875386:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1172e0f/0xa24651432773b6c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.875424:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340637.875428:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2f83c7a/0xa24651432773b73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.875434:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340637.875437:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2f83c7a/0xa24651432773b73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.875444:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2f83c7a/0xa24651432773b73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.875453:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2f83c7a/0xa24651432773b73 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.875459:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2f83c7a/0xa24651432773b73 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340637.875650:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340637.875652:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340637.875655:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340637.875665:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340637.875902:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.875908:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005419894f/0xa24651432773b7a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.875915:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.875917:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.875920:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005419894f/0xa24651432773b7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.875929:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005419894f/0xa24651432773b7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.875944:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005419894f/0xa24651432773b7a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.875951:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005419894f/0xa24651432773b7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.875963:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340637.876011:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.876016:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000172af6a9/0xa24651432773b81 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.876023:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.876025:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.876028:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000172af6a9/0xa24651432773b81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.876036:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000172af6a9/0xa24651432773b81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.876043:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000172af6a9/0xa24651432773b81 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.876050:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000172af6a9/0xa24651432773b81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.876061:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1780340637.876105:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.876109:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086e6f877/0xa24651432773b88 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.876117:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.876118:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.876121:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086e6f877/0xa24651432773b88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.876326:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340637.876333:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005419894f/0xa24651432773b7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.876340:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.876344:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005419894f/0xa24651432773b7a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.876351:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005419894f/0xa24651432773b7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.876361:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005419894f/0xa24651432773b7a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.876369:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005419894f/0xa24651432773b7a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.876385:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340637.876388:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000172af6a9/0xa24651432773b81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.876552:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.876555:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000172af6a9/0xa24651432773b81 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.876575:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000172af6a9/0xa24651432773b81 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.876585:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000172af6a9/0xa24651432773b81 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.876591:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000172af6a9/0xa24651432773b81 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.876606:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.876608:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.876609:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340637.877171:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086e6f877/0xa24651432773b88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877181:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086e6f877/0xa24651432773b88 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877189:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086e6f877/0xa24651432773b88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877270:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340637.877340:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.877346:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003f77e1d/0xa24651432773b8f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877354:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.877356:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.877358:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000003f77e1d/0xa24651432773b8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.877366:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340637.877367:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000003f77e1d/0xa24651432773b8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.877381:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086e6f877/0xa24651432773b88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877381:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000003f77e1d/0xa24651432773b8f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877388:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000003f77e1d/0xa24651432773b8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.877396:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340637.877407:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340637.877445:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.877449:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeca5bf1/0xa24651432773b96 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877456:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.877457:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.877459:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aeca5bf1/0xa24651432773b96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877467:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aeca5bf1/0xa24651432773b96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877607:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aeca5bf1/0xa24651432773b96 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877614:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aeca5bf1/0xa24651432773b96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877624:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1780340637.877667:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.877672:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088340e03/0xa24651432773b9d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877680:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.877681:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.877684:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088340e03/0xa24651432773b9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877692:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088340e03/0xa24651432773b9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877699:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088340e03/0xa24651432773b9d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877707:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088340e03/0xa24651432773b9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877714:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1780340637.877747:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.877752:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b6e5d20/0xa24651432773ba4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877782:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.877783:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.877785:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b6e5d20/0xa24651432773ba4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877793:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b6e5d20/0xa24651432773ba4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877807:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b6e5d20/0xa24651432773ba4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877814:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b6e5d20/0xa24651432773ba4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877822:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1780340637.877859:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.877864:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006b3c6ea/0xa24651432773bab lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877871:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.877873:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.877875:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006b3c6ea/0xa24651432773bab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877883:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006b3c6ea/0xa24651432773bab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877889:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006b3c6ea/0xa24651432773bab lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877896:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006b3c6ea/0xa24651432773bab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877904:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1780340637.877945:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.877949:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044129825/0xa24651432773bb2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877957:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.877958:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.877961:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044129825/0xa24651432773bb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877969:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044129825/0xa24651432773bb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.877971:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086e6f877/0xa24651432773b88 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877977:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044129825/0xa24651432773bb2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.877981:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086e6f877/0xa24651432773b88 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877984:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044129825/0xa24651432773bb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.877992:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1780340637.877994:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086e6f877/0xa24651432773b88 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878001:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086e6f877/0xa24651432773b88 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878020:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00002000:00010000:0.0:1780340637.878021:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.878023:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000003f77e1d/0xa24651432773b8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.878025:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000039009ef/0xa24651432773bb9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.878032:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.878033:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.878036:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000039009ef/0xa24651432773bb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878041:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340637.878045:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000003f77e1d/0xa24651432773b8f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.878045:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000039009ef/0xa24651432773bb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878053:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000003f77e1d/0xa24651432773b8f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.878056:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000039009ef/0xa24651432773bb9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.878062:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000039009ef/0xa24651432773bb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878063:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000003f77e1d/0xa24651432773b8f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878070:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000003f77e1d/0xa24651432773b8f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.878071:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1780340637.878082:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1780340637.878085:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aeca5bf1/0xa24651432773b96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878091:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340637.878094:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeca5bf1/0xa24651432773b96 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878100:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aeca5bf1/0xa24651432773b96 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340637.878105:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340637.878109:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aeca5bf1/0xa24651432773b96 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.878109:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa24651432773bc0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.878115:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.878117:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.878120:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa24651432773bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878123:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aeca5bf1/0xa24651432773b96 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878135:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1780340637.878138:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088340e03/0xa24651432773b9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878144:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340637.878147:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088340e03/0xa24651432773b9d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878153:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088340e03/0xa24651432773b9d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878163:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088340e03/0xa24651432773b9d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878170:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088340e03/0xa24651432773b9d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878193:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1780340637.878196:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b6e5d20/0xa24651432773ba4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878204:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340637.878213:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b6e5d20/0xa24651432773ba4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878220:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b6e5d20/0xa24651432773ba4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878230:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b6e5d20/0xa24651432773ba4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.878233:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780340637.878237:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006b3c6ea/0xa24651432773bab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878237:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b6e5d20/0xa24651432773ba4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.878245:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.878248:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006b3c6ea/0xa24651432773bab lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878250:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780340637.878253:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044129825/0xa24651432773bb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.878256:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006b3c6ea/0xa24651432773bab lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878259:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340637.878262:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044129825/0xa24651432773bb2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.878266:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006b3c6ea/0xa24651432773bab lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878269:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044129825/0xa24651432773bb2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878277:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044129825/0xa24651432773bb2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.878285:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006b3c6ea/0xa24651432773bab lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878285:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044129825/0xa24651432773bb2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.878297:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340637.878299:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000039009ef/0xa24651432773bb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.878299:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340637.878300:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340637.878302:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.878306:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340637.878308:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000039009ef/0xa24651432773bb9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.878324:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000039009ef/0xa24651432773bb9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.878334:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000039009ef/0xa24651432773bb9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.878341:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000039009ef/0xa24651432773bb9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340637.878352:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.878354:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.878356:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.878380:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340637.878579:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa24651432773bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.878588:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa24651432773bc0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.878594:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa24651432773bc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.880514:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340637.880627:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.880634:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa24651432773bc7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.880646:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.880648:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.880652:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa24651432773bc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.880663:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa24651432773bc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.880671:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa24651432773bc7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.880678:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa24651432773bc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.880695:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1780340637.880730:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.880735:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432773bce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.880742:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.880743:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.880746:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432773bce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.880754:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432773bce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.880783:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432773bce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.880791:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432773bce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.880802:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1780340637.880910:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1780340637.880917:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa24651432773bc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.880926:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340637.880930:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa24651432773bc0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.880939:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa24651432773bc0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.880952:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa24651432773bc0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.880959:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa24651432773bc0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.880982:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780340637.880985:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa24651432773bc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.880991:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340637.881001:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa24651432773bc7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.881008:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa24651432773bc7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.881018:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa24651432773bc7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.881024:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa24651432773bc7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.881037:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340637.881039:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432773bce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.881045:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340637.881047:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432773bce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.881053:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432773bce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.881060:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432773bce lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.881065:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432773bce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.881082:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340637.881084:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340637.881085:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340637.881129:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340637.881136:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340637.881970:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.881977:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa24651432773bd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.881987:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.881989:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.881993:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa24651432773bd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.882002:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa24651432773bd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.882010:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa24651432773bd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.882017:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa24651432773bd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.882039:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340637.882092:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340637.882097:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773bdc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.882104:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.882105:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340637.882108:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773bdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.882117:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773bdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.882124:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773bdc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.882130:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773bdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340637.882141:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780340637.882937:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780340637.882945:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa24651432773bd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.882956:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340637.882960:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa24651432773bd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.882968:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa24651432773bd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.882982:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa24651432773bd5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.882989:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa24651432773bd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.883010:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340637.883014:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773bdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.883020:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340637.883030:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773bdc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.883039:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773bdc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.883049:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773bdc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.883055:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773bdc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340637.883069:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340637.883070:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340637.883072:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340637.883081:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.885387:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340637.885395:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1780340637.895526:0:25491:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:144 00000100:00100000:0.0:1780340637.895629:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:83653:x1866818961059968:12345-0@lo:5:osp-pre-1-0.0 Request processed in 72244us (83610us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340637.895639:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5873 00000100:00100000:3.0:1780340637.895701:0:83653:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83653:1866818961059968:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1780340637.895717:0:83653:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2e1:0x0] from OST, last_created [0x2c0000401:0x2e1:0x0]last_used is [0x2c0000401:0x90:0x0] 00000100:00100000:3.0:1780340637.895819:0:83653:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83653:1866818961060480:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1780340637.895849:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340637.895865:0:83653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340637.895865:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961060352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340637.895893:0:83653:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0447b5f600 going to sleep for 11 seconds 00000100:00100000:2.0:1780340637.895910:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340637.895924:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961060480 00000100:00100000:3.0:1780340637.895931:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961060480 00000100:00100000:3.0:1780340637.895972:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5875 00000100:00100000:3.0:1780340637.895979:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:83653:x1866818961060480:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1780340637.896013:0:25487:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 738 00000100:00100000:3.0:1780340637.899816:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:83653:x1866818961060480:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3829us (3955us total) trans 4294969450 rc 0/0 00000100:00100000:3.0:1780340637.899831:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5875 00000100:00100000:3.0:1780340637.899885:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961060352 00000100:00100000:3.0:1780340637.899893:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961060352 00000100:00100000:3.0:1780340637.899934:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949 00000100:00100000:3.0:1780340637.899942:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961060352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340637.899967:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340637.899985:0:83653:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83653:1866818961060480:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1780340637.900000:0:83653:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2e1:0x0]-[0x2c0000401:0x301:0x0] 00000100:00100000:3.0:1780340637.900021:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961060352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (4110us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340637.900028:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949 00000100:00100000:3.0:1780340637.900079:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961060352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340638.091751:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780340638.091820:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03474c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961060608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340638.091896:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340638.091940:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961060608 00000100:00100000:1.0:1780340638.091948:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961060608 00000100:00100000:1.0:1780340638.091994:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950 00000100:00100000:1.0:1780340638.092003:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961060608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780340638.092027:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340638.092070:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961060608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340638.092077:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950 00000100:00100000:1.0:1780340638.092131:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03474c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961060608:0@lo:13:osp-pre-0-1.0 00000001:00100000:3.0:1780340638.093289:0:72681:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1780340638.093498:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961060736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340638.093550:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340638.093609:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961060736 00000100:00100000:3.0:1780340638.093614:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961060736 00000100:00100000:3.0:1780340638.093652:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951 00000100:00100000:3.0:1780340638.093669:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961060736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340638.093689:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340638.094810:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961060736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1136us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340638.094830:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951 00000100:00100000:1.0:1780340638.095072:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961060736:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1780340638.611114:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1780340638.902663:0:84005:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1780340638.903134:0:84005:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1780340639.626124:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340640.650047:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340641.156874:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340641.157037:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940396928 00000100:00100000:0.0:1780340641.157046:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940396928 00000100:00100000:0.0:1780340641.157141:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1142 00000100:00100000:0.0:1780340641.157154:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:66105:x1866818940396928:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1780340641.157174:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340641.157196:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773be3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced22aa expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340641.157259:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa24651432773bea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340641.157274:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa24651432773bea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340641.157286:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa24651432773bea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340641.157342:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780340641.157346:0:63711:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780340641.157381:0:63711:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa24651432773bea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340641.157404:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4600/0xa24651432773be3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22aa expref: 8 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340641.157422:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa24651432773bea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22aa expref: 7 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340641.157431:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c034b343100) 00010000:00010000:0.0:1780340641.157433:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780340641.157437:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4e00, rc 0) 00000100:00100000:0.0:1780340641.157505:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471571f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:66105:x1866818940396928:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 355us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340641.157519:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1142 00000100:00080000:1.0:1780340641.157633:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780340641.167486:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340641.169947:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940397056 00000100:00100000:1.0:1780340641.169963:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940397056 00000100:00100000:1.0:1780340641.170093:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1143 00000100:00100000:1.0:1780340641.170104:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:66105:x1866818940397056:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:1.0:1780340641.170143:0:70100:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:1.0:1780340641.170233:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:66105:x1866818940397056:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 131us (2756us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340641.170241:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1143 00000100:00100000:3.0:1780340641.172924:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340641.180959:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940397184 00000100:00100000:2.0:1780340641.180974:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940397184 00000100:00100000:2.0:1780340641.181050:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1144 00000100:00100000:2.0:1780340641.181062:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:66105:x1866818940397184:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:2.0:1780340641.181099:0:64454:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:2.0:1780340641.181169:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:66105:x1866818940397184:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 110us (8253us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340641.181175:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1144 00000100:00080000:3.0:1780340641.186009:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340641.208120:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340641.208342:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940397312 00000100:00100000:2.0:1780340641.208352:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940397312 00000100:00100000:2.0:1780340641.208419:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5876 00000100:00100000:2.0:1780340641.208428:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2406:x1866818940397312:12345-192.168.203.16@tcp:8:lfs.0 00010000:00080000:2.0:1780340641.208466:0:25493:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0000: connection from e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp t0 exp 0000000000000000 cur 3421 last 0 00000020:00000080:2.0:1780340641.208510:0:25493:0:(genops.c:1406:class_connect()) connect: client e06e5cf1-1986-4ba7-9630-fad7efb74eca, cookie 0xa24651432773bf1 00002000:00100000:2.0:1780340641.208522:0:25493:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e06e5cf1-1986-4ba7-9630-fad7efb74eca/ffff8c044d43f000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211351c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1780340641.208540:0:25493:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1780340641.208611:0:25493:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1780340641.208641:0:25493:0:(import.c:65:import_set_state_nolock()) ffff8c044d43c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340641.208715:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940397312:12345-192.168.203.16@tcp:8:lfs.0 Request processed in 286us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340641.208723:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5876 00000100:00100000:2.0:1780340641.224427:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340641.224554:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940397440 00000100:00100000:1.0:1780340641.224565:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940397440 00000100:00100000:1.0:1780340641.224640:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1952 00000100:00100000:1.0:1780340641.224650:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:66105:x1866818940397440:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:1.0:1780340641.224677:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340641.224755:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471573800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:66105:x1866818940397440:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 106us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340641.224807:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1952 00000100:00080000:3.0:1780340641.225398:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340641.230692:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340641.230962:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940397568 00000100:00100000:3.0:1780340641.230971:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940397568 00000100:00100000:3.0:1780340641.231054:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5877 00000100:00100000:3.0:1780340641.231062:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:2406:x1866818940397568:12345-192.168.203.16@tcp:8:lfs.0 00010000:00080000:3.0:1780340641.231098:0:25490:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0001: connection from e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp t0 exp 0000000000000000 cur 3421 last 0 00000020:00000080:3.0:1780340641.231127:0:25490:0:(genops.c:1406:class_connect()) connect: client e06e5cf1-1986-4ba7-9630-fad7efb74eca, cookie 0xa24651432773bf8 00002000:00100000:3.0:1780340641.231139:0:25490:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e06e5cf1-1986-4ba7-9630-fad7efb74eca/ffff8c047570a000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211351c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1780340641.231156:0:25490:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1780340641.231230:0:25490:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1780340641.231258:0:25490:0:(import.c:65:import_set_state_nolock()) ffff8c0475709800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340641.231336:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940397568:12345-192.168.203.16@tcp:8:lfs.0 Request processed in 273us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340641.231343:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5877 00000100:00100000:0.0:1780340641.237648:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340641.238004:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940397696 00000100:00100000:3.0:1780340641.238014:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940397696 00000100:00100000:3.0:1780340641.238085:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1953 00000100:00100000:3.0:1780340641.238095:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:66105:x1866818940397696:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:3.0:1780340641.238134:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340641.238213:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:66105:x1866818940397696:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 119us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340641.238221:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1953 00000100:00080000:1.0:1780340641.240948:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1780340641.677671:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340642.697993:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961060864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780340642.698094:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1780340642.698145:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340642.698205:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961060864 00000100:00100000:0.0:1780340642.698214:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961060864 00000100:00100000:0.0:1780340642.698300:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3759 00000100:00100000:0.0:1780340642.698309:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961060864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780340642.698358:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:0.0:1780340642.698409:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961060864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340642.698416:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3759 00000100:00100000:1.0:1780340642.701048:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961061120:0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.701111:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340642.701137:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961061632:0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.701157:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340642.701307:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961060992:0@lo:400:kworker.0 00000100:00100000:2.0:1780340642.701339:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340642.701362:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961061504:0@lo:400:kworker.0 00000100:00100000:2.0:1780340642.701381:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340642.701396:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961062016:0@lo:400:kworker.0 00000100:00100000:2.0:1780340642.701413:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340642.701432:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1780340642.701437:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961061376:0@lo:400:kworker.0 00000100:00100000:2.0:1780340642.701458:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340642.701474:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961061888:0@lo:400:kworker.0 00000100:00100000:2.0:1780340642.701494:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340642.701510:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961062400:0@lo:400:kworker.0 00000100:00100000:2.0:1780340642.701529:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340642.701561:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961061120 00000100:00100000:2.0:1780340642.701568:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961061120 00000100:00100000:2.0:1780340642.701609:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961061504 00000100:00100000:2.0:1780340642.701618:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961061504 00000100:00100000:2.0:1780340642.701634:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961062016 00000100:00100000:2.0:1780340642.701637:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961062016 00000100:00100000:2.0:1780340642.701650:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961061376 00000100:00100000:2.0:1780340642.701652:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961061376 00000100:00100000:2.0:1780340642.701663:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961062400 00000100:00100000:2.0:1780340642.701665:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961062400 00000100:00100000:2.0:1780340642.701678:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:2.0:1780340642.701686:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961061120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340642.701729:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961061120:12345-0@lo:400:kworker.0 Request processed in 44us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340642.701736:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:2.0:1780340642.701752:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:2.0:1780340642.702164:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961061504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340642.702201:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961061504:12345-0@lo:400:kworker.0 Request processed in 444us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340642.702208:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:2.0:1780340642.702221:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:2.0:1780340642.702227:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818961062016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340642.702251:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818961062016:12345-0@lo:400:kworker.0 Request processed in 25us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340642.702256:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:2.0:1780340642.702265:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:2.0:1780340642.702270:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961061376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340642.702307:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961061376:12345-0@lo:400:kworker.0 Request processed in 37us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340642.702314:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:2.0:1780340642.702333:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:2.0:1780340642.702340:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961062400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340642.702365:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961062400:12345-0@lo:400:kworker.0 Request processed in 27us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340642.702370:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:2.0:1780340642.702407:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961061376:0@lo:400:kworker.0 00000100:00100000:2.0:1780340642.702420:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961062400:0@lo:400:kworker.0 00000100:00100000:2.0:1780340642.702428:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961061504:0@lo:400:kworker.0 00000100:00100000:2.0:1780340642.702437:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961062016:0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.702655:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961062144:0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.702683:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340642.702713:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961061120:0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.702721:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1780340642.702727:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961061248:0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.702748:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340642.702791:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03474c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961061760:0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.702812:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340642.702829:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961062272:0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.702849:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340642.702877:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961061248 00000100:00100000:1.0:1780340642.702882:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961061248 00000100:00100000:1.0:1780340642.702927:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:1.0:1780340642.702934:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961061248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.702967:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961061248:12345-0@lo:400:kworker.0 Request processed in 34us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340642.702973:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:1.0:1780340642.702991:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961060992 00000100:00100000:1.0:1780340642.702994:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961060992 00000100:00100000:1.0:1780340642.703018:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1780340642.703024:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961060992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.703058:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961060992:12345-0@lo:400:kworker.0 Request processed in 34us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340642.703072:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1780340642.703101:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961061888 00000100:00100000:1.0:1780340642.703105:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961061888 00000100:00100000:1.0:1780340642.703126:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961062144 00000100:00100000:1.0:1780340642.703129:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961062144 00000100:00100000:1.0:1780340642.703143:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961061760 00000100:00100000:1.0:1780340642.703146:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961061760 00000100:00100000:1.0:1780340642.703163:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961062272 00000100:00100000:1.0:1780340642.703166:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961062272 00000100:00100000:1.0:1780340642.703182:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2402 00000100:00100000:1.0:1780340642.703187:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961061888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.703217:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961061888:12345-0@lo:400:kworker.0 Request processed in 30us (1722us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340642.703223:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2402 00000100:00100000:1.0:1780340642.703233:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2403 00000100:00100000:1.0:1780340642.703238:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961062144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.703261:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961062144:12345-0@lo:400:kworker.0 Request processed in 24us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340642.703266:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2403 00000100:00100000:1.0:1780340642.703276:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2404 00000100:00100000:1.0:1780340642.703293:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961061760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.703318:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961061760:12345-0@lo:400:kworker.0 Request processed in 37us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340642.703323:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2404 00000100:00100000:1.0:1780340642.703333:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2405 00000100:00100000:1.0:1780340642.703339:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961062272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.703377:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961062272:12345-0@lo:400:kworker.0 Request processed in 38us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340642.703383:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2405 00000100:00080000:1.0:1780340642.703398:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780340642.703401:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340642.703404:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780340642.703406:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340642.703524:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961061888:0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.703534:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961060992:0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.703568:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961061248:0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.703576:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03474c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961061760:0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.703585:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961062272:0@lo:400:kworker.0 00000100:00100000:1.0:1780340642.703594:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961062144:0@lo:400:kworker.0 00000100:00100000:3.0:1780340642.704017:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961061632 00000100:00100000:3.0:1780340642.704023:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961061632 00000100:00100000:3.0:1780340642.704059:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3760 00000100:00100000:3.0:1780340642.704066:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961061632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340642.704109:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961061632:12345-0@lo:400:kworker.0 Request processed in 43us (2950us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340642.704114:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3760 00000100:00100000:3.0:1780340642.704161:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961060864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340642.707168:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961061632:0@lo:400:kworker.0 00000100:00100000:3.0:1780340642.864084:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340642.864129:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340642.864153:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340642.864236:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340642.864258:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340642.864292:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940398080 00000100:00100000:3.0:1780340642.864300:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940398080 00000100:00100000:3.0:1780340642.864344:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940397952 00000100:00100000:3.0:1780340642.864347:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940397952 00000100:00100000:3.0:1780340642.864367:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1145 00000100:00100000:3.0:1780340642.864377:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940398080:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340642.864465:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940398080:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 90us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340642.864473:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1145 00000100:00100000:3.0:1780340642.864562:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1146 00000100:00100000:3.0:1780340642.864570:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2408:x1866818940397952:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340642.864598:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2408:x1866818940397952:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 29us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340642.864603:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1146 00000100:00100000:3.0:1780340642.864623:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940398336 00000100:00100000:3.0:1780340642.864627:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940398336 00000100:00100000:3.0:1780340642.864649:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940398208 00000100:00100000:3.0:1780340642.864651:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940398208 00000100:00100000:3.0:1780340642.864671:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2406 00000100:00100000:3.0:1780340642.864677:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940398336:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340642.864703:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940398336:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 27us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340642.864709:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2406 00000100:00100000:3.0:1780340642.864720:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2407 00000100:00100000:3.0:1780340642.864726:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940398208:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340642.864752:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940398208:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 26us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340642.864784:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2407 00000100:00100000:1.0:1780340642.864853:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940397824 00000100:00100000:1.0:1780340642.864858:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940397824 00000100:00100000:1.0:1780340642.864893:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 75 00000100:00100000:1.0:1780340642.864901:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940397824:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340642.864927:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940397824:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 28us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340642.864933:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 75 00000100:00100000:0.0:1780340643.209932:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961062784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340643.209942:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961062656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340643.210692:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a07f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961063040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340643.213057:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340643.213139:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340643.213171:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961062912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340643.213174:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961062528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340643.213212:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961062656 00000100:00100000:3.0:1780340643.213220:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961062656 00000100:00100000:1.0:1780340643.213250:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961062784 00000100:00100000:1.0:1780340643.213255:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961062784 00000100:00100000:3.0:1780340643.213287:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1954 00000100:00100000:3.0:1780340643.213299:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961062656:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340643.213306:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1955 00000100:00100000:1.0:1780340643.213314:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961062784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780340643.213333:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1780340643.213336:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340643.213385:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961062784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340643.213394:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1955 00000100:00100000:3.0:1780340643.213401:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961062656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340643.213409:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1954 00000100:00100000:0.0:1780340643.213437:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340643.213466:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961062528 00000100:00100000:3.0:1780340643.213470:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961062528 00000100:00100000:3.0:1780340643.213496:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956 00000100:00100000:3.0:1780340643.213502:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961062528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340643.213513:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340643.213678:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961062656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340643.213809:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961062784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340643.213836:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340643.213877:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961062912 00000100:00100000:0.0:1780340643.213881:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961062912 00000100:00100000:0.0:1780340643.213906:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957 00000100:00100000:0.0:1780340643.213912:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961062912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340643.213923:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340643.213955:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961062912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340643.213960:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957 00000100:00100000:1.0:1780340643.213972:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961062912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340643.216379:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961062528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2869us (2935us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340643.216392:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956 00000100:00100000:0.0:1780340643.216831:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961062528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340643.219137:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340643.221116:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961063040 00000100:00100000:3.0:1780340643.221131:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961063040 00000100:00100000:3.0:1780340643.221213:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3761 00000100:00100000:3.0:1780340643.221223:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961063040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340643.221265:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:3.0:1780340643.221365:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961063040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340643.221373:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3761 00000100:00100000:2.0:1780340643.221441:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a07f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961063040:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1780340643.721935:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1780340643.723780:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000001:00100000:1.0:1780340643.727063:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000001:00080000:1.0:1780340643.727080:0:9462:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969450 is committed 00010000:00010000:0.0:1780340644.745951:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1780340645.588114:0:84102:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:1.0:1780340645.770189:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340646.795820:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1780340647.316995:0:84150:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1780340647.818103:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340647.821355:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961063168:0@lo:400:kworker.0 00000100:00100000:1.0:1780340647.821429:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340647.821520:0:83642:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961063168 00000100:00100000:2.0:1780340647.821528:0:83642:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961063168 00000100:00100000:2.0:1780340647.821579:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1780340647.821588:0:83642:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961063168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340647.825096:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961063680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340647.825186:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340647.825568:0:83642:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961063168:12345-0@lo:400:kworker.0 Request processed in 3979us (4136us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340647.825580:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1780340647.825623:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961063680 00000100:00100000:2.0:1780340647.825630:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961063680 00000100:00100000:2.0:1780340647.825685:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3762 00000100:00100000:2.0:1780340647.825693:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961063680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340647.825740:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:2.0:1780340647.825796:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961063680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340647.825802:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3762 00000100:00100000:2.0:1780340647.825829:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961063552:0@lo:400:kworker.0 00000100:00100000:2.0:1780340647.825858:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340647.826106:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961063552 00000100:00100000:2.0:1780340647.826111:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961063552 00000100:00100000:2.0:1780340647.826160:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1780340647.826167:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961063552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340647.826203:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961063552:12345-0@lo:400:kworker.0 Request processed in 36us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340647.826209:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1780340647.826228:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961063296:0@lo:400:kworker.0 00000100:00100000:2.0:1780340647.826270:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340647.826289:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780340647.826505:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961063424:0@lo:400:kworker.0 00000100:00100000:2.0:1780340647.826530:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340647.826573:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961063552:0@lo:400:kworker.0 00000100:00100000:2.0:1780340647.826608:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961063296 00000100:00100000:2.0:1780340647.826611:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961063296 00000100:00100000:2.0:1780340647.826637:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961063424 00000100:00100000:2.0:1780340647.826651:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961063424 00000100:00100000:2.0:1780340647.826671:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1780340647.826677:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961063296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340647.826713:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961063296:12345-0@lo:400:kworker.0 Request processed in 37us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340647.826728:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1780340647.826739:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1780340647.826744:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961063424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340647.826799:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961063424:12345-0@lo:400:kworker.0 Request processed in 54us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340647.826804:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1780340647.826832:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961063424:0@lo:400:kworker.0 00000100:00100000:2.0:1780340647.826841:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961063296:0@lo:400:kworker.0 00000100:00100000:1.0:1780340647.827480:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961063168:0@lo:400:kworker.0 00000100:00100000:1.0:1780340647.827507:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961063680:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1780340647.827526:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780340647.827538:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780340647.827884:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961063936:0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.827924:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340647.827964:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04441b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961064448:0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.827987:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340647.828007:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1780340647.828012:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961063808:0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.828032:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340647.828049:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04441b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961064320:0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.828068:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340647.828221:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961064064:0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.828263:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340647.828279:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04441b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961064576:0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.828309:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340647.828326:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1780340647.828331:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04441b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961064192:0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.828350:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340647.828365:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04441b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961064704:0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.828387:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340647.828429:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961063936 00000100:00100000:3.0:1780340647.828435:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961063936 00000100:00100000:3.0:1780340647.828472:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3763 00000100:00100000:3.0:1780340647.828480:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818961063936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.828523:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818961063936:12345-0@lo:400:kworker.0 Request processed in 44us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340647.828530:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3763 00000100:00100000:3.0:1780340647.828550:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961064448 00000100:00100000:3.0:1780340647.828554:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961064448 00000100:00100000:3.0:1780340647.828579:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961064064 00000100:00100000:3.0:1780340647.828587:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961064064 00000100:00100000:3.0:1780340647.828609:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961064576 00000100:00100000:3.0:1780340647.828612:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961064576 00000100:00100000:3.0:1780340647.828626:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961064192 00000100:00100000:3.0:1780340647.828629:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961064192 00000100:00100000:3.0:1780340647.828644:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2408 00000100:00100000:3.0:1780340647.828650:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961064448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.828682:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961064448:12345-0@lo:400:kworker.0 Request processed in 32us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340647.828688:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2408 00000100:00100000:3.0:1780340647.828699:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2409 00000100:00100000:3.0:1780340647.828704:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961064064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.828732:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961064064:12345-0@lo:400:kworker.0 Request processed in 28us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340647.828737:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2409 00000100:00100000:3.0:1780340647.828748:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2410 00000100:00100000:3.0:1780340647.828753:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961064576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.828806:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961064576:12345-0@lo:400:kworker.0 Request processed in 53us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340647.828811:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2410 00000100:00100000:3.0:1780340647.828821:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2411 00000100:00100000:3.0:1780340647.828826:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961064192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.828849:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961064192:12345-0@lo:400:kworker.0 Request processed in 24us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340647.828854:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2411 00000100:00100000:3.0:1780340647.828871:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961063808 00000100:00100000:3.0:1780340647.828874:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961063808 00000100:00100000:3.0:1780340647.828907:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961064320 00000100:00100000:3.0:1780340647.828910:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961064320 00000100:00100000:3.0:1780340647.828923:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961064704 00000100:00100000:3.0:1780340647.828926:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961064704 00000100:00100000:3.0:1780340647.828937:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:3.0:1780340647.829359:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961063808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.829396:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961063808:12345-0@lo:400:kworker.0 Request processed in 43us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340647.829401:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:3.0:1780340647.829414:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:3.0:1780340647.829420:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961064320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.829443:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961064320:12345-0@lo:400:kworker.0 Request processed in 24us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340647.829448:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:3.0:1780340647.829458:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1780340647.829464:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961064704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.829488:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961064704:12345-0@lo:400:kworker.0 Request processed in 25us (1100us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340647.829493:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1780340647.829542:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961063808:0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.829553:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04441b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961064320:0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.829561:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961063936:0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.829569:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04441b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961064448:0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.829607:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04441b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961064192:0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.829629:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04441b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961064704:0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.829639:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961064064:0@lo:400:kworker.0 00000100:00100000:3.0:1780340647.829646:0:3661:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 2 00000100:00100000:3.0:1780340647.829657:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04441b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961064576:0@lo:400:kworker.0 00000100:00080000:1.0:1780340647.829779:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780340647.829784:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340647.829786:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340647.980217:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340647.980265:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340647.980541:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940398592 00000100:00100000:3.0:1780340647.980552:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940398592 00000100:00100000:3.0:1780340647.980628:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1153 00000100:00100000:3.0:1780340647.980637:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2409:x1866818940398592:12345-192.168.203.16@tcp:400:kworker.0 00000100:00080000:0.0:1780340647.980713:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340647.981106:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940398848 00000100:00100000:1.0:1780340647.981111:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940398848 00000100:00100000:1.0:1780340647.981156:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2412 00000100:00100000:1.0:1780340647.981163:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940398848:12345-192.168.203.16@tcp:400:kworker.0 00000100:00080000:0.0:1780340647.981216:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340647.988527:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2409:x1866818940398592:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 7880us (8308us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340647.988542:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1153 00000100:00100000:2.0:1780340647.994632:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340647.994789:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340647.994824:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340647.994867:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940398720 00000100:00100000:2.0:1780340647.994877:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940398720 00000100:00100000:2.0:1780340647.994969:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1154 00000100:00100000:2.0:1780340647.994979:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940398720:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340647.995053:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940398720:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 76us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340647.995060:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1154 00000100:00080000:2.0:1780340647.995188:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340647.995208:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940398976 00000100:00100000:2.0:1780340647.995212:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940398976 00000100:00100000:2.0:1780340647.995253:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2413 00000100:00100000:2.0:1780340647.995261:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940398976:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340647.995319:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940398976:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 59us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340647.995326:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2413 00000100:00080000:2.0:1780340647.995343:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340647.996167:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940398848:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 15000us (15897us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340647.996177:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2412 00000100:00100000:3.0:1780340648.001646:0:83638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940398464 00000100:00100000:3.0:1780340648.001660:0:83638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940398464 00000100:00100000:3.0:1780340648.001793:0:83638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:3.0:1780340648.001804:0:83638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2409:x1866818940398464:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340648.001893:0:83638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2409:x1866818940398464:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 91us (7269us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340648.001908:0:83638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:3.0:1780340648.330279:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340648.330302:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961064832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340648.330388:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340648.330632:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961064832 00000100:00100000:2.0:1780340648.330639:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961064832 00000100:00100000:2.0:1780340648.330691:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3764 00000100:00100000:2.0:1780340648.330701:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818961064832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780340648.330732:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:2.0:1780340648.330796:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818961064832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340648.330803:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3764 00000100:00100000:1.0:1780340648.331273:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340648.331284:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961065088:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340648.331326:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340648.331367:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961065088 00000100:00100000:1.0:1780340648.331371:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961065088 00000100:00100000:1.0:1780340648.331399:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:1.0:1780340648.331405:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961065088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780340648.331425:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340648.331456:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961065088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340648.331463:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00100000:1.0:1780340648.331501:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961065088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340648.331715:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340648.331725:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961064960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340648.331754:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340648.332259:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961065216:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340648.332286:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340648.332547:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961064832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340648.332562:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340648.332568:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04441b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961065344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340648.332606:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340648.332636:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961064960 00000100:00100000:3.0:1780340648.332641:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961064960 00000100:00100000:3.0:1780340648.332667:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961065216 00000100:00100000:3.0:1780340648.332670:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961065216 00000100:00100000:3.0:1780340648.332680:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961065344 00000100:00100000:3.0:1780340648.332683:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961065344 00000100:00100000:3.0:1780340648.332695:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959 00000100:00100000:3.0:1780340648.332701:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961064960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340648.332720:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340648.332749:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961064960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340648.332755:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959 00000100:00100000:3.0:1780340648.332798:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960 00000100:00100000:3.0:1780340648.332805:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961065216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340648.332815:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340648.332859:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961065216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340648.332864:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960 00000100:00100000:3.0:1780340648.332876:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1961 00000100:00100000:3.0:1780340648.332882:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961065344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340648.332892:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340648.332919:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961065344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340648.332924:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1961 00000100:00100000:3.0:1780340648.332951:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04441b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961065344:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340648.333259:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961064960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340648.333290:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961065216:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1780340648.846809:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340649.139613:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340649.139686:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940399104 00000100:00100000:3.0:1780340649.139696:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940399104 00000100:00100000:3.0:1780340649.139796:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1145 00000100:00100000:3.0:1780340649.139807:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:66551:x1866818940399104:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:3.0:1780340649.139852:0:63710:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:3.0:1780340649.139934:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349956300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:66551:x1866818940399104:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 129us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340649.139942:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1145 00000100:00080000:2.0:1780340649.140195:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780340649.145411:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340649.145543:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940399232 00000100:00100000:3.0:1780340649.145554:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940399232 00000100:00100000:3.0:1780340649.145634:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1146 00000100:00100000:3.0:1780340649.145645:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:66551:x1866818940399232:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:3.0:1780340649.145682:0:70100:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:3.0:1780340649.145742:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:66551:x1866818940399232:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 100us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340649.145750:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1146 00000100:00080000:2.0:1780340649.145848:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340649.159453:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340649.159606:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940399360 00000100:00100000:3.0:1780340649.159617:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940399360 00000100:00100000:3.0:1780340649.159688:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1962 00000100:00100000:3.0:1780340649.159699:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:66551:x1866818940399360:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:3.0:1780340649.159724:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340649.159819:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:66551:x1866818940399360:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 122us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340649.159827:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1962 00000100:00080000:2.0:1780340649.160051:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340649.162264:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340649.162350:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940399488 00000100:00100000:1.0:1780340649.162359:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940399488 00000100:00100000:1.0:1780340649.162627:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1963 00000100:00100000:1.0:1780340649.162637:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:66551:x1866818940399488:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:1.0:1780340649.162674:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340649.162823:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:66551:x1866818940399488:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 104us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340649.162945:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1963 00000100:00080000:2.0:1780340649.163303:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340649.210547:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340649.210643:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940399616 00000100:00100000:2.0:1780340649.210653:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940399616 00000100:00100000:2.0:1780340649.211092:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1147 00000100:00100000:2.0:1780340649.211105:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:66567:x1866818940399616:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1780340649.211133:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340649.211152:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa24651432773bff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced22b1 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211216:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32aa00/0xa24651432773c06 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211253:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32aa00/0xa24651432773c06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211265:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32aa00/0xa24651432773c06 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211279:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa24651432773c0d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211284:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa24651432773c0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211290:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa24651432773c0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211362:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa24651432773c14 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211369:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa24651432773c14 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211375:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa24651432773c14 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340649.211408:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1780340649.211412:0:64454:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780340649.211433:0:64454:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa24651432773c14 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211443:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32aa00/0xa24651432773c06 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211459:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32aa00/0xa24651432773c06 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211465:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32aa00/0xa24651432773c06 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211470:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32aa00/0xa24651432773c06 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211475:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32aa00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340649.211479:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32aa00/0xa24651432773c06 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211486:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32aa00/0xa24651432773c06 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211498:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c034b343100) 00010000:00010000:2.0:1780340649.211500:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340649.211505:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32aa00/0xa24651432773c06 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211512:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32aa00/0xa24651432773c06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211524:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa24651432773c0d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211530:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa24651432773c0d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211536:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa24651432773c0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211547:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340649.211550:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa24651432773c0d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211555:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa24651432773c0d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211563:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff8c0455e5c500) 00010000:00010000:2.0:1780340649.211565:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340649.211567:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa24651432773c0d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211573:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa24651432773c0d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211600:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa24651432773bff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22b1 expref: 9 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211612:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa24651432773c14 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22b1 expref: 8 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.211619:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff8c0455e5cd00) 00010000:00010000:2.0:1780340649.211621:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780340649.211624:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32a400, rc 0) 00000100:00100000:2.0:1780340649.211699:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:66567:x1866818940399616:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 598us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340649.211706:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1147 00000100:00100000:0.0:1780340649.217320:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340649.218282:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940399872 00000100:00100000:2.0:1780340649.218310:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940399872 00000100:00100000:2.0:1780340649.218377:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1148 00000100:00100000:2.0:1780340649.218974:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:66567:x1866818940399872:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1780340649.218994:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340649.219013:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa24651432773c1b lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced22b8 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.219518:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432773c22 lrc: 3/1,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.219532:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432773c22 lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.219542:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432773c22 lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.219557:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773c29 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.219564:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773c29 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.219570:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773c29 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.219634:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432773c22 lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.219640:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432773c22 lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.219647:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432773c22 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.219662:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432773c22 lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.219668:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32bc00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340649.219672:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432773c22 lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.219679:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432773c22 lrc: 5/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.219690:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff8c0455e5cd00) 00010000:00010000:2.0:1780340649.219693:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340649.219698:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432773c22 lrc: 3/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.219704:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432773c22 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.219715:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773c29 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.219721:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773c29 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.219726:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773c29 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.219732:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722aec00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340649.220894:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773c29 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.220920:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773c29 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.220932:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff8c0455e5c100) 00010000:00010000:2.0:1780340649.220935:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340649.220939:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773c29 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.220944:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773c29 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.220996:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa24651432773c1b lrc: 1/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22b8 expref: 9 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.221006:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff8c0455e5cd00) 00010000:00010000:2.0:1780340649.221008:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780340649.221012:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa24651432773c1b lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22b8 expref: 9 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340649.221460:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32a000, rc 0) 00000100:00100000:2.0:1780340649.221544:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:66567:x1866818940399872:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 2575us (4234us total) trans 0 rc 301/301 00000100:00100000:2.0:1780340649.221554:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1148 00000100:00100000:0.0:1780340649.223825:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340649.224461:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940400128 00000100:00100000:1.0:1780340649.224471:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940400128 00000100:00100000:1.0:1780340649.224533:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1149 00000100:00100000:1.0:1780340649.224544:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:66567:x1866818940400128:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1780340649.224562:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340649.224582:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122c00/0xa24651432773c30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced22bf expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340649.224693:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1780340649.224899:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122c00/0xa24651432773c30 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22bf expref: 10 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340649.224915:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c034b343100) 00010000:00010000:1.0:1780340649.224918:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1780340649.224923:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122c00/0xa24651432773c30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22bf expref: 10 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340649.224937:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122c00, rc 0) 00000100:00100000:1.0:1780340649.224994:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:66567:x1866818940400128:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 453us (1175us total) trans 103079215105 rc 301/301 00000100:00100000:1.0:1780340649.225001:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1149 00000100:00100000:1.0:1780340649.235207:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340649.235565:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940400256 00000100:00100000:3.0:1780340649.235595:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940400256 00000100:00100000:3.0:1780340649.235650:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1150 00000100:00100000:3.0:1780340649.235659:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:66567:x1866818940400256:12345-192.168.203.16@tcp:34:lfs.0 00010000:00010000:3.0:1780340649.235735:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c3e lrc: 3/1,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.235751:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c3e lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.235813:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c3e lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236174:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c45 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236186:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c45 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236195:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c45 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236278:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773c4c lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236286:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773c4c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236293:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773c4c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340649.236331:0:70100:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780340649.236342:0:70100:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773c4c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236362:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c3e lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236369:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c3e lrc: 2/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236376:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c3e lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236383:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340649.236387:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c3e lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236395:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c3e lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236405:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff8c0455e5cd00) 00010000:00010000:3.0:1780340649.236408:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340649.236412:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c3e lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236418:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c3e lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236432:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c45 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236437:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c45 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236575:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c45 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236586:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340649.236589:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c45 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236596:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c45 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236605:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff8c0444f27600) 00010000:00010000:3.0:1780340649.236608:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340649.236610:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c45 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236616:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c45 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236631:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773c4c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236637:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773c4c lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236644:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773c4c lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236648:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340649.236651:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773c4c lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236656:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773c4c lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236675:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff8c0444f27400) 00010000:00010000:3.0:1780340649.236678:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340649.236681:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773c4c lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340649.236687:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773c4c lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340649.236805:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:66567:x1866818940400256:12345-192.168.203.16@tcp:34:lfs.0 Request processed in 1145us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340649.236814:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1150 00000100:00100000:0.0:1780340649.245069:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340649.248212:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940400512 00000100:00100000:2.0:1780340649.248225:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940400512 00000100:00100000:2.0:1780340649.248334:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 222 00000100:00100000:2.0:1780340649.248345:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:66567:x1866818940400512:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1780340649.248574:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:66567:x1866818940400512:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 231us (3517us total) trans 103079215106 rc 0/0 00000100:00100000:2.0:1780340649.248591:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 222 00010000:00010000:1.0:1780340649.867144:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340650.903924:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340651.914501:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340652.938200:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340652.938995:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961065472:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.939064:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340652.939114:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961065984:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.939140:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340652.939160:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961066496:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.943278:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340652.943367:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1866818961067008:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.943391:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340652.943435:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1780340652.943443:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961065856:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.943465:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340652.943483:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961066368:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.943505:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340652.943536:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961066880:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.943568:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340652.943606:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961065600:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.943629:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340652.943645:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961066112:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.943666:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340652.943691:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961066624:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.944183:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340652.944220:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1780340652.944228:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961065728:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.944254:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340652.944265:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961066240:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.944283:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340652.944301:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961066752:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.944321:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340652.944356:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961065472 00000100:00100000:2.0:1780340652.944363:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961065472 00000100:00100000:2.0:1780340652.944430:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1780340652.944438:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961065472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.944489:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961065472:12345-0@lo:400:kworker.0 Request processed in 51us (5425us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340652.944497:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1780340652.944528:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961065984 00000100:00100000:2.0:1780340652.944531:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961065984 00000100:00100000:2.0:1780340652.944558:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961066496 00000100:00100000:2.0:1780340652.944561:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961066496 00000100:00100000:2.0:1780340652.944571:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961067008 00000100:00100000:2.0:1780340652.944573:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961067008 00000100:00100000:2.0:1780340652.944582:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961065856 00000100:00100000:2.0:1780340652.944584:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961065856 00000100:00100000:2.0:1780340652.944595:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961065600 00000100:00100000:2.0:1780340652.944597:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961065600 00000100:00100000:2.0:1780340652.944607:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961065728 00000100:00100000:2.0:1780340652.944609:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961065728 00000100:00100000:2.0:1780340652.944622:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:2.0:1780340652.944636:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961065984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.944668:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961065984:12345-0@lo:400:kworker.0 Request processed in 33us (5527us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340652.944674:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:2.0:1780340652.944686:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:2.0:1780340652.944692:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961066496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.944897:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349861880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961066496:12345-0@lo:400:kworker.0 Request processed in 204us (1621us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340652.944905:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:2.0:1780340652.944918:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:2.0:1780340652.944925:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1866818961067008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.944952:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349863100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1866818961067008:12345-0@lo:400:kworker.0 Request processed in 29us (1561us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340652.944958:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:2.0:1780340652.944968:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:2.0:1780340652.944974:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961065856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.944997:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961065856:12345-0@lo:400:kworker.0 Request processed in 24us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340652.945002:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:2.0:1780340652.945013:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:2.0:1780340652.945018:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961065600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.945044:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961065600:12345-0@lo:400:kworker.0 Request processed in 26us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340652.945050:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:2.0:1780340652.945059:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:2.0:1780340652.945073:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961065728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.945835:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961065728:12345-0@lo:400:kworker.0 Request processed in 760us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340652.945844:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:2.0:1780340652.945885:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961066368 00000100:00100000:2.0:1780340652.945890:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961066368 00000100:00100000:2.0:1780340652.945932:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961066880 00000100:00100000:2.0:1780340652.945936:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961066880 00000100:00100000:2.0:1780340652.945954:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961066240 00000100:00100000:2.0:1780340652.945956:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961066240 00000100:00100000:2.0:1780340652.945978:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961066752 00000100:00100000:2.0:1780340652.945980:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961066752 00000100:00100000:2.0:1780340652.946000:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2414 00000100:00100000:2.0:1780340652.946006:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961066368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.946040:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961066368:12345-0@lo:400:kworker.0 Request processed in 35us (2534us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340652.946047:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2414 00000100:00100000:2.0:1780340652.946058:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2415 00000100:00100000:2.0:1780340652.946064:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349862680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961066880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.948344:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349862680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961066880:12345-0@lo:400:kworker.0 Request processed in 2272us (4767us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340652.948357:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2415 00000100:00100000:2.0:1780340652.948392:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2416 00000100:00100000:2.0:1780340652.948408:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349860e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961066240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.948476:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349860e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961066240:12345-0@lo:400:kworker.0 Request processed in 77us (4192us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340652.948482:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2416 00000100:00100000:2.0:1780340652.948509:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2417 00000100:00100000:2.0:1780340652.948516:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961066752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.948546:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961066752:12345-0@lo:400:kworker.0 Request processed in 31us (4223us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340652.948551:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2417 00000100:00100000:2.0:1780340652.948589:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961066112 00000100:00100000:2.0:1780340652.948596:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961066112 00000100:00100000:2.0:1780340652.948637:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961066624 00000100:00100000:2.0:1780340652.948641:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961066624 00000100:00100000:2.0:1780340652.948664:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3765 00000100:00100000:2.0:1780340652.948670:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349860700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961066112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.948701:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349860700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961066112:12345-0@lo:400:kworker.0 Request processed in 32us (5035us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340652.948707:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3765 00000100:00100000:0.0:1780340652.950930:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340652.950951:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961067136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340652.951011:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340652.951839:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961067136 00000100:00100000:2.0:1780340652.951849:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961067136 00000100:00100000:2.0:1780340652.951878:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3766 00000100:00100000:2.0:1780340652.951887:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961066624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.951944:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961066624:12345-0@lo:400:kworker.0 Request processed in 58us (7760us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340652.951952:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3766 00000100:00100000:2.0:1780340652.951964:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3767 00000100:00100000:2.0:1780340652.951970:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961067136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340652.951994:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:2.0:1780340652.952027:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961067136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340652.952033:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3767 00000100:00080000:2.0:1780340652.952073:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340652.952077:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340652.952081:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780340652.952934:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961067136:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1780340652.953815:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340652.953859:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961065728:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.953873:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961066240:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.953884:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349861500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961066752:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.953895:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961065600:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.953905:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961066112:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.953915:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961066624:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.953971:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961065856:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.953982:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961066368:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.953993:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961066880:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.954003:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961065472:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.954013:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961065984:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.954022:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961066496:0@lo:400:kworker.0 00000100:00100000:2.0:1780340652.954032:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349863800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1866818961067008:0@lo:400:kworker.0 00000100:00100000:0.0:1780340653.096503:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340653.096545:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340653.096613:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340653.096638:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340653.096669:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340653.096695:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940400768 00000100:00100000:0.0:1780340653.096720:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940400768 00000100:00100000:0.0:1780340653.096799:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940400896 00000100:00100000:0.0:1780340653.096802:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940400896 00000100:00100000:0.0:1780340653.096836:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1161 00000100:00100000:0.0:1780340653.096847:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2410:x1866818940400768:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340653.096925:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2410:x1866818940400768:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 81us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340653.096933:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1161 00000100:00100000:0.0:1780340653.096951:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1162 00000100:00100000:0.0:1780340653.096958:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940400896:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340653.096982:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940400896:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340653.096989:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1162 00000100:00100000:0.0:1780340653.097006:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940401024 00000100:00100000:0.0:1780340653.097010:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940401024 00000100:00100000:0.0:1780340653.097035:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940401152 00000100:00100000:0.0:1780340653.097038:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940401152 00000100:00100000:0.0:1780340653.097058:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2418 00000100:00100000:0.0:1780340653.097065:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2410:x1866818940401024:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340653.097102:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2410:x1866818940401024:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 38us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340653.097108:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2418 00000100:00100000:0.0:1780340653.097120:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2419 00000100:00100000:0.0:1780340653.097126:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2410:x1866818940401152:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340653.097147:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2410:x1866818940401152:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 21us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340653.097160:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2419 00000100:00080000:0.0:1780340653.097185:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340653.097189:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340653.097192:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340653.097194:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780340653.097968:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940400640 00000100:00100000:3.0:1780340653.097975:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940400640 00000100:00100000:3.0:1780340653.098019:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 79 00000100:00100000:3.0:1780340653.098026:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03477f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2410:x1866818940400640:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340653.098073:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03477f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2410:x1866818940400640:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 48us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340653.098091:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 79 00000100:00100000:2.0:1780340653.449998:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961067520:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340653.450063:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340653.450131:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961067520 00000100:00100000:2.0:1780340653.450138:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961067520 00000100:00100000:2.0:1780340653.450227:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1964 00000100:00100000:2.0:1780340653.450236:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961067520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340653.450265:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340653.450315:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961067520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340653.450322:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1964 00000100:00100000:2.0:1780340653.450367:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961067520:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340653.450580:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340653.450589:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961067648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340653.450617:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340653.450640:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961067648 00000100:00100000:1.0:1780340653.450644:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961067648 00000100:00100000:1.0:1780340653.450668:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1965 00000100:00100000:1.0:1780340653.450673:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03474c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961067648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780340653.450689:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340653.450718:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03474c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961067648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340653.450724:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1965 00000100:00100000:1.0:1780340653.450752:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961067648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340653.453714:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1780340653.455682:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04441b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961067392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340653.455786:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340653.455831:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961067264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340653.455855:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340653.455976:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961067264 00000100:00100000:1.0:1780340653.455985:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961067264 00000100:00100000:1.0:1780340653.456036:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3768 00000100:00100000:1.0:1780340653.456045:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961067264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780340653.456078:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:0.0:1780340653.456087:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340653.456098:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961067776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340653.456125:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340653.456136:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961067264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340653.456142:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3768 00000100:00100000:0.0:1780340653.456150:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961067392 00000100:00100000:0.0:1780340653.456153:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961067392 00000100:00100000:1.0:1780340653.456187:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961067776 00000100:00100000:1.0:1780340653.456191:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961067776 00000100:00100000:0.0:1780340653.456191:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966 00000100:00100000:0.0:1780340653.456197:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961067392:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340653.456219:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1967 00002000:00000024:0.0:1780340653.456220:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340653.456224:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961067776:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340653.456247:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961067392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (462us total) trans 0 rc 0/0 00002000:00000024:1.0:1780340653.456248:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340653.456253:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966 00000100:00100000:1.0:1780340653.456277:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961067776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340653.456282:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1967 00000100:00100000:0.0:1780340653.456299:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04441b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961067392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340653.456304:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961067776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340653.456311:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961067264:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1780340653.962051:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340654.985872:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1780340655.007044:0:83633:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215106 is committed 00010000:00010000:1.0:1780340656.011259:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340657.035920:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1780340657.572168:0:84346:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 131a: DoM file write lock replay === 15:04:16 (1780340656) 00000100:00100000:0.0:1780340657.715120:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340657.715215:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940401280 00000100:00100000:3.0:1780340657.715236:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940401280 00000100:00080000:0.0:1780340657.715399:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780340657.715572:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1151 00000100:00100000:3.0:1780340657.715590:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:67157:x1866818940401280:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1780340657.715619:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340657.715653:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773c53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced22c6 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.715871:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.715894:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.715909:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.715930:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.715937:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.715946:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.716012:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.716020:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.716026:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.716033:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340657.716038:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.716059:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.716074:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c034b343100) 00010000:00010000:3.0:1780340657.716077:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340657.716082:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.716182:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432773c5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.716201:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.716207:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.716212:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.716218:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340657.716221:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.716227:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.716235:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff8c0444f27600) 00010000:00010000:3.0:1780340657.716238:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340657.716240:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.716257:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432773c61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.716301:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773c53 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22c6 expref: 9 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.716313:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c034b343100) 00010000:00010000:3.0:1780340657.716315:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340657.716319:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773c53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22c6 expref: 9 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340657.716328:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440031800, rc 0) 00000100:00100000:3.0:1780340657.716470:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:67157:x1866818940401280:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 885us (1357us total) trans 0 rc 301/301 00000100:00100000:3.0:1780340657.716480:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1151 00000100:00100000:1.0:1780340657.722239:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340657.722336:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940401536 00000100:00100000:2.0:1780340657.722347:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940401536 00000100:00100000:2.0:1780340657.722465:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1152 00000100:00100000:2.0:1780340657.722477:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:67157:x1866818940401536:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1780340657.722509:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340657.722512:0:63710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1780340657.722542:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa24651432773bea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22aa expref: 8 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.722559:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c034b343100) 00010000:00010000:2.0:1780340657.722569:0:63710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340657.722583:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432773c68 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced22cd expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.722692:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c6f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.722706:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.722716:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c6f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.722745:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432773c76 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.722753:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432773c76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.722781:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432773c76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.723156:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432773c7d lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.723165:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432773c7d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.723183:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432773c7d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340657.723193:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x6:0x0]: returning size 0 00010000:00010000:2.0:1780340657.723216:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c6f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.723223:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c6f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.723235:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c6f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.723242:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c6f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.723248:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340657.723252:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c6f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.723259:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c6f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.723268:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455e5c500) 00010000:00010000:2.0:1780340657.723271:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340657.723274:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c6f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.723280:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c6f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340657.723292:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003433cfb6 reply state 0000000050b004f3 transno 103079215107 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432773c76 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.723302:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432773c76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.723307:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff8c0455e5c400) 00010000:00010000:2.0:1780340657.723309:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340657.723312:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1780340657.723337:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432773c68 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22cd expref: 10 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.723360:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432773c7d lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22cd expref: 9 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.723367:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff8c0455e5c000) 00010000:00010000:2.0:1780340657.723369:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340657.723371:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722ae000, rc 0) 00000100:00100000:2.0:1780340657.723460:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:67157:x1866818940401536:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 986us (1228us total) trans 103079215107 rc 0/0 00000100:00100000:2.0:1780340657.723467:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1152 00000100:00100000:0.0:1780340657.732042:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340657.732390:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940401792 00000100:00100000:2.0:1780340657.732400:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940401792 00000100:00100000:2.0:1780340657.732493:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1153 00000100:00100000:2.0:1780340657.732505:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:67157:x1866818940401792:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1780340657.732531:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340657.732557:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432773c8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced22d4 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.732660:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c92 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.732675:0:64454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432773c7d lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22cd expref: 11 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.732684:0:64454:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c92 lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.732715:0:64454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432773c7d lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22cd expref: 11 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.732741:0:64454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432773c7d lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22cd expref: 11 pid: 63710 timeout: 3537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340657.732788:0:64454:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349863800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:64454:1866818961067904:192.168.203.16@tcp:104: 00000100:00100000:2.0:1780340657.732878:0:64454:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0477400240 going to sleep for 11 seconds 00000100:00100000:1.0:1780340657.738925:0:64454:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349863800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:64454:1866818961067904:192.168.203.16@tcp:104: 00010000:00010000:1.0:1780340657.739436:0:64454:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c92 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340657.744262:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340657.744612:0:25499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940401920 00000100:00100000:0.0:1780340657.744623:0:25499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940401920 00010000:00010000:0.0:1780340657.744663:0:25499:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432773c7d lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22cd expref: 12 pid: 63710 timeout: 3537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340657.744717:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2541 00000100:00100000:0.0:1780340657.744727:0:25499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:2407:x1866818940401920:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780340657.744743:0:25499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340657.744750:0:25499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432773c7d lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22cd expref: 12 pid: 63710 timeout: 3537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340657.744792:0:25499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432773c7d lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22cd expref: 12 pid: 63710 timeout: 3537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340657.744816:0:25499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432773c7d lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22cd expref: 12 pid: 63710 timeout: 3537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340657.744831:0:25499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff8c0455e5c000) 00010000:00010000:0.0:1780340657.744836:0:25499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c92 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340657.744845:0:25499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c92 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340657.744852:0:25499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c92 lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340657.744883:0:25499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340657.744939:0:25499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:2407:x1866818940401920:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 214us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340657.744957:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2541 00010000:00010000:2.0:1780340657.745297:0:64454:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c92 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.745307:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c92 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340657.745326:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x6:0x0]: returning size 0 00010000:00010000:2.0:1780340657.745585:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c92 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.745593:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c92 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.745600:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c92 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.745605:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340657.745609:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c92 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.745616:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c92 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.745625:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff8c0455e5c000) 00010000:00010000:2.0:1780340657.745634:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1780340657.745639:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c92 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.745645:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432773c92 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.745694:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432773c8b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22d4 expref: 11 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.745703:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455e5c500) 00010000:00010000:2.0:1780340657.745705:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780340657.745709:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432773c8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22d4 expref: 11 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340657.745721:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722afe00, rc 0) 00000100:00100000:2.0:1780340657.745829:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:67157:x1866818940401792:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 13326us (13794us total) trans 103079215108 rc 301/301 00000100:00100000:2.0:1780340657.745836:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1153 00000100:00100000:1.0:1780340657.764930:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340657.765422:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940402176 00000100:00100000:2.0:1780340657.765434:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940402176 00000100:00100000:2.0:1780340657.765504:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 223 00000100:00100000:2.0:1780340657.765518:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034af38850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:67157:x1866818940402176:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1780340657.765738:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034af38850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:67157:x1866818940402176:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 226us (818us total) trans 103079215109 rc 0/0 00000100:00100000:2.0:1780340657.765746:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 223 00000100:00100000:2.0:1780340657.775117:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340657.776622:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940402432 00000100:00100000:1.0:1780340657.776636:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940402432 00000100:00100000:1.0:1780340657.776696:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 224 00000100:00100000:1.0:1780340657.776707:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:67157:x1866818940402432:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:1.0:1780340657.782467:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:67157:x1866818940402432:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 243us (1839us total) trans 103079215110 rc 0/0 00000100:00100000:1.0:1780340657.782558:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 224 00000100:00100000:0.0:1780340658.058633:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961068032:0@lo:400:kworker.0 00000100:00100000:1.0:1780340658.058658:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961068160:0@lo:400:kworker.0 00000100:00100000:3.0:1780340658.058730:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961068416:0@lo:400:kworker.0 00000100:00100000:1.0:1780340658.063564:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340658.063589:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340658.063627:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961068672:0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.063638:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961068544:0@lo:400:kworker.0 00000100:00100000:1.0:1780340658.063687:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340658.063692:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340658.063713:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961069184:0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.063721:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961069056:0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.063755:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340658.063801:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961069568:0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.063829:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340658.063932:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961068032 00000100:00100000:0.0:1780340658.063939:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961068032 00000100:00100000:0.0:1780340658.063984:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1780340658.063992:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03477f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961068032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.064046:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03477f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961068032:12345-0@lo:400:kworker.0 Request processed in 55us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340658.064053:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1780340658.064083:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961068160 00000100:00100000:0.0:1780340658.064087:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961068160 00000100:00100000:0.0:1780340658.064252:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961068544 00000100:00100000:0.0:1780340658.064256:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961068544 00000100:00100000:0.0:1780340658.064412:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961069056 00000100:00100000:0.0:1780340658.064416:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961069056 00000100:00100000:0.0:1780340658.064430:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961069568 00000100:00100000:0.0:1780340658.064432:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961069568 00000100:00100000:0.0:1780340658.064444:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:0.0:1780340658.064450:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961068160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.064485:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961068160:12345-0@lo:400:kworker.0 Request processed in 35us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340658.064491:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:0.0:1780340658.064512:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1780340658.064518:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961068544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.064559:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961068544:12345-0@lo:400:kworker.0 Request processed in 41us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340658.064565:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1780340658.064578:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:0.0:1780340658.064584:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818961069056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.064612:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818961069056:12345-0@lo:400:kworker.0 Request processed in 29us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340658.064618:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:0.0:1780340658.064630:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:0.0:1780340658.064635:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961069568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.064659:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961069568:12345-0@lo:400:kworker.0 Request processed in 25us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340658.064664:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00010000:00010000:0.0:1780340658.064686:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1780340658.064696:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340658.064699:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780340658.064730:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961069568:0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.064740:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961068032:0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.064749:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961068544:0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.064776:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961069056:0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.065222:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961068288:0@lo:400:kworker.0 00000100:00100000:1.0:1780340658.065240:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340658.065634:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340658.065670:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961068800:0@lo:400:kworker.0 00000100:00100000:3.0:1780340658.065692:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961068288 00000100:00100000:3.0:1780340658.065699:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961068288 00000100:00100000:0.0:1780340658.065715:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340658.065738:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961069312:0@lo:400:kworker.0 00000100:00100000:3.0:1780340658.065756:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:0.0:1780340658.065785:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340658.065801:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961068288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.065808:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340658.065816:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961069696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340658.065852:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340658.065859:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961068288:12345-0@lo:400:kworker.0 Request processed in 73us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340658.065868:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:0.0:1780340658.065892:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961068288:0@lo:400:kworker.0 00000100:00100000:3.0:1780340658.065910:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340658.065928:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961068416 00000100:00100000:0.0:1780340658.065932:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961068416 00000100:00100000:3.0:1780340658.065934:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961068928:0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.065965:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:0.0:1780340658.065971:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961068416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.066018:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961068416:12345-0@lo:400:kworker.0 Request processed in 32us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340658.066024:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00080000:0.0:1780340658.066040:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780340658.066043:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340658.066665:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340658.066706:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961069440:0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.067479:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961068800 00000100:00100000:0.0:1780340658.067486:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961068800 00000100:00100000:0.0:1780340658.067532:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961069312 00000100:00100000:0.0:1780340658.067535:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961069312 00000100:00100000:0.0:1780340658.067556:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961068928 00000100:00100000:0.0:1780340658.067559:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961068928 00000100:00100000:0.0:1780340658.067579:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420 00000100:00100000:0.0:1780340658.067586:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961068800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340658.071250:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961068160:0@lo:400:kworker.0 00000100:00100000:1.0:1780340658.071448:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961068672 00000100:00100000:1.0:1780340658.071456:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961068672 00000100:00100000:1.0:1780340658.071510:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961069184 00000100:00100000:1.0:1780340658.071514:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961069184 00000100:00100000:1.0:1780340658.071526:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961069696 00000100:00100000:1.0:1780340658.071528:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961069696 00000100:00100000:1.0:1780340658.071541:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3769 00000100:00100000:1.0:1780340658.071549:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961068672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340658.071634:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961068672:12345-0@lo:400:kworker.0 Request processed in 80us (7943us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340658.071641:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3769 00000100:00100000:1.0:1780340658.071657:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3770 00000100:00100000:1.0:1780340658.071663:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961069184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340658.071692:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961069184:12345-0@lo:400:kworker.0 Request processed in 29us (6453us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340658.071698:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3770 00000100:00100000:1.0:1780340658.071708:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3771 00000100:00100000:1.0:1780340658.071714:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961069696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780340658.071735:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:1.0:1780340658.074918:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961069696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3193us (9056us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340658.074932:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3771 00000100:00100000:1.0:1780340658.075056:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2421 00000100:00100000:1.0:1780340658.075070:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961069312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340658.075714:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961069312:12345-0@lo:400:kworker.0 Request processed in 647us (9927us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340658.075723:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2421 00000100:00100000:1.0:1780340658.075743:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2422 00000100:00100000:1.0:1780340658.075751:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961068928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340658.077348:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961068928:12345-0@lo:400:kworker.0 Request processed in 1473us (10558us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340658.077361:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2422 00000100:00100000:1.0:1780340658.077466:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961069696:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340658.077482:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961069312:0@lo:400:kworker.0 00000100:00100000:1.0:1780340658.077521:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961068672:0@lo:400:kworker.0 00000100:00100000:1.0:1780340658.077531:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961069184:0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.077706:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961068800:12345-0@lo:400:kworker.0 Request processed in 10119us (11991us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340658.077728:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420 00000100:00080000:0.0:1780340658.077756:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340658.077798:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340658.080808:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340658.080864:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961069440 00000100:00100000:0.0:1780340658.080873:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961069440 00000100:00100000:0.0:1780340658.080932:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2423 00000100:00100000:0.0:1780340658.080941:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961069440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.080999:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961069440:12345-0@lo:400:kworker.0 Request processed in 60us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340658.081006:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2423 00000100:00080000:0.0:1780340658.081029:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340658.081061:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961069440:0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.081089:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961068416:0@lo:400:kworker.0 00000100:00100000:0.0:1780340658.081100:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961068928:0@lo:400:kworker.0 00000100:00100000:1.0:1780340658.086986:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961068800:0@lo:400:kworker.0 00000100:00100000:2.0:1780340658.221128:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340658.221205:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340658.225328:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340658.225370:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340658.225435:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340658.225553:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940402688 00000100:00100000:3.0:1780340658.225566:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940402688 00000100:00100000:3.0:1780340658.225633:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940402816 00000100:00100000:3.0:1780340658.225637:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940402816 00000100:00100000:3.0:1780340658.225679:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1169 00000100:00100000:3.0:1780340658.225688:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:2407:x1866818940402688:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340658.225805:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:2407:x1866818940402688:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 118us (4692us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340658.225814:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1169 00000100:00100000:3.0:1780340658.225833:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1170 00000100:00100000:3.0:1780340658.225840:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940402816:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340658.225867:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940402816:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 28us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340658.225873:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1170 00000100:00100000:3.0:1780340658.225895:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940402560 00000100:00100000:3.0:1780340658.225898:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940402560 00000100:00100000:3.0:1780340658.225927:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 81 00000100:00100000:3.0:1780340658.225934:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03477f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940402560:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340658.225958:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03477f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940402560:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 25us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340658.225964:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 81 00000100:00080000:3.0:1780340658.225998:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340658.236261:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940402944 00000100:00100000:0.0:1780340658.236284:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940402944 00000100:00100000:0.0:1780340658.236403:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940403072 00000100:00100000:0.0:1780340658.236408:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940403072 00000100:00100000:0.0:1780340658.236450:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2424 00000100:00100000:0.0:1780340658.236462:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940402944:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340658.236564:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349861500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940402944:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 104us (15358us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340658.236572:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2424 00000100:00100000:0.0:1780340658.236591:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2425 00000100:00100000:0.0:1780340658.236614:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04777c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940403072:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340658.236641:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04777c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2407:x1866818940403072:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 28us (11207us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340658.236646:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2425 00000100:00080000:2.0:1780340658.250677:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340658.250693:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340658.570262:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340658.570294:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961069824:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340658.570361:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340658.570516:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961069824 00000100:00100000:1.0:1780340658.570524:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961069824 00000100:00100000:1.0:1780340658.570577:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1968 00000100:00100000:1.0:1780340658.570587:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961069824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780340658.570615:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340658.570660:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961069824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340658.570667:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1968 00000100:00100000:1.0:1780340658.570711:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961069824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340658.570938:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961069952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340658.570983:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340658.571002:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340658.571008:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961070080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340658.571029:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340658.571056:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961069952 00000100:00100000:1.0:1780340658.571059:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961069952 00000100:00100000:1.0:1780340658.571079:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961070080 00000100:00100000:1.0:1780340658.571081:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961070080 00000100:00100000:1.0:1780340658.571094:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969 00000100:00100000:1.0:1780340658.571100:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961069952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780340658.571110:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340658.571140:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961069952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340658.571146:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969 00000100:00100000:1.0:1780340658.571157:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970 00000100:00100000:1.0:1780340658.571176:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961070080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780340658.571193:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340658.571219:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961070080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340658.571225:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970 00000100:00100000:1.0:1780340658.571255:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961070080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340658.571446:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961069952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340658.580607:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340658.580627:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349860000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961070208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340658.580701:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340658.580746:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961070208 00000100:00100000:2.0:1780340658.580754:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961070208 00000100:00100000:2.0:1780340658.580818:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3772 00000100:00100000:2.0:1780340658.580826:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349862680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818961070208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780340658.580858:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:2.0:1780340658.580900:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349862680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818961070208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340658.580907:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3772 00000100:00100000:2.0:1780340658.580960:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349860000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961070208:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340658.581453:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340658.581466:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04441b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961070336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340658.581498:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340658.581578:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961070336 00000100:00100000:3.0:1780340658.581582:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961070336 00000100:00100000:3.0:1780340658.581618:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971 00000100:00100000:3.0:1780340658.581625:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961070336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340658.581639:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340658.581673:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961070336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340658.581679:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971 00000100:00100000:1.0:1780340658.581821:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04441b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961070336:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1780340658.924393:0:83633:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215110 is committed 00010000:00010000:0.0:1780340658.924466:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432773c76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340658.924479:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432773c76 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340658.924487:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432773c76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340658.924493:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340658.924497:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432773c76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340658.924504:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432773c76 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340658.924520:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff8c0455e5c400) 00010000:00010000:0.0:1780340658.924523:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340658.924528:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432773c76 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340658.924534:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432773c76 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340658.973338:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340658.973425:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940403200 00000100:00100000:1.0:1780340658.973435:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940403200 00000100:00100000:1.0:1780340658.973492:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1154 00000100:00100000:1.0:1780340658.973502:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:67167:x1866818940403200:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1780340658.973521:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340658.973542:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432773ca0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced22db expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340658.973643:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123400/0xa24651432773ca7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340658.973658:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123400/0xa24651432773ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340658.973679:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123400/0xa24651432773ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340658.973724:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1780340658.973728:0:64454:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780340658.973747:0:64454:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123400/0xa24651432773ca7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340658.973803:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432773ca0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22db expref: 9 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340658.973820:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123400/0xa24651432773ca7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22db expref: 8 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340658.973844:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045a87ab00) 00010000:00010000:1.0:1780340658.973847:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1780340658.973851:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123400, rc 0) 00000100:00100000:1.0:1780340658.973902:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:67167:x1866818940403200:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 401us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340658.973909:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1154 00000100:00100000:0.0:1780340658.985981:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340658.986019:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940403328 00000100:00100000:0.0:1780340658.986033:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940403328 00000100:00100000:0.0:1780340658.986156:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1155 00000100:00100000:0.0:1780340658.986177:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:67167:x1866818940403328:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:0.0:1780340658.986210:0:63710:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:0.0:1780340658.986277:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:67167:x1866818940403328:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 102us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340658.986284:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1155 00000100:00100000:2.0:1780340658.992920:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340658.993031:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940403456 00000100:00100000:0.0:1780340658.993041:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940403456 00000100:00100000:1.0:1780340658.993155:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1156 00000100:00100000:1.0:1780340658.993180:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:67167:x1866818940403456:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:1.0:1780340658.993212:0:64454:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:1.0:1780340658.993287:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:67167:x1866818940403456:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 110us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340658.993294:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1156 00000100:00100000:1.0:1780340659.005868:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340659.007152:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940403584 00000100:00100000:0.0:1780340659.007176:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940403584 00000100:00100000:0.0:1780340659.007233:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1972 00000100:00100000:0.0:1780340659.007244:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:67167:x1866818940403584:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:0.0:1780340659.007268:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340659.007335:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:67167:x1866818940403584:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 94us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340659.007343:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1972 00000100:00100000:0.0:1780340659.010469:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340659.010610:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940403712 00000100:00100000:3.0:1780340659.010619:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940403712 00000100:00100000:3.0:1780340659.010678:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1973 00000100:00100000:3.0:1780340659.010687:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:67167:x1866818940403712:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:3.0:1780340659.010710:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340659.010791:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:67167:x1866818940403712:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 104us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340659.010798:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1973 00010000:00010000:0.0:1780340659.081911:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340659.098123:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340659.098431:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940403968 00000100:00100000:3.0:1780340659.098441:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940403968 00000100:00100000:3.0:1780340659.098515:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1157 00000100:00100000:3.0:1780340659.098526:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:67174:x1866818940403968:12345-192.168.203.16@tcp:36:mcreate.0 00010000:00010000:3.0:1780340659.098580:0:70100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340659.098607:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123400/0xa24651432773ca7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22db expref: 8 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1780340659.098929:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1780340659.099156:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045a87ab00) 00010000:00010000:3.0:1780340659.099184:0:70100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340659.099246:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432773cae lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340659.099261:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432773cae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340659.099272:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432773cae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340659.099284:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773cb5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340659.099291:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773cb5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340659.099297:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773cb5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340659.099780:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432773cae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340659.099789:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432773cae lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340659.099796:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432773cae lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340659.099802:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340659.099808:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432773cae lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340659.099817:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432773cae lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340659.099838:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04506cf600) 00010000:00010000:3.0:1780340659.099841:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340659.099845:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432773cae lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340659.099850:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432773cae lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340659.100421:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000090e6b288 reply state 000000009055ffde transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773cb5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340659.100437:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773cb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340659.100444:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04506cfd00) 00010000:00010000:3.0:1780340659.100446:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340659.100449:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780340659.100541:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:67174:x1866818940403968:12345-192.168.203.16@tcp:36:mcreate.0 Request processed in 2015us (2424us total) trans 103079215111 rc 0/0 00000100:00100000:3.0:1780340659.100550:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1157 00000100:00100000:3.0:1780340659.123690:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340659.123921:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940404096 00000100:00100000:0.0:1780340659.123932:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940404096 00000100:00100000:0.0:1780340659.123991:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1158 00000100:00100000:0.0:1780340659.124001:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:67177:x1866818940404096:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:0.0:1780340659.124024:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340659.124046:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432773cbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced22e2 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.124115:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa24651432773cc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.124130:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa24651432773cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.124141:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa24651432773cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340659.124193:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780340659.124197:0:63712:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780340659.124219:0:63712:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa24651432773cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.124242:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432773cbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22e2 expref: 11 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.124258:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa24651432773cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22e2 expref: 10 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.124265:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c034b343a00) 00010000:00010000:0.0:1780340659.124268:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780340659.124271:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4e00, rc 0) 00000100:00100000:0.0:1780340659.124327:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:67177:x1866818940404096:12345-192.168.203.16@tcp:101:rm.0 Request processed in 327us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340659.124334:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1158 00000100:00100000:0.0:1780340659.128406:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340659.128667:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940404224 00000100:00100000:2.0:1780340659.128677:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940404224 00000100:00100000:2.0:1780340659.128744:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1159 00000100:00100000:2.0:1780340659.128756:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:67177:x1866818940404224:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:2.0:1780340659.128802:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340659.128824:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432773cca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced22e9 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.128898:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432773cd1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.128912:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432773cd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.128924:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432773cd1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.128934:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432773cd8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.128941:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432773cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.128948:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432773cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129019:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773cdf lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129027:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773cdf lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129034:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773cdf lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340659.129071:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x7:0x0]: returning size 0 00000004:00200000:2.0:1780340659.129075:0:63711:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780340659.129091:0:63711:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773cdf lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129111:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773cdf lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129120:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432773cd1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129127:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432773cd1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129133:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432773cd1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129140:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432773cd1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129146:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340659.129150:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432773cd1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129201:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432773cd1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129214:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c034b343a00) 00010000:00010000:2.0:1780340659.129217:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340659.129222:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432773cd1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129228:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432773cd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129239:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432773cd8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129251:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432773cd8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129258:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432773cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129263:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340659.129266:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432773cd8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129273:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432773cd8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129281:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04506cfd00) 00010000:00010000:2.0:1780340659.129283:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340659.129286:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432773cd8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129293:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432773cd8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129316:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432773cca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22e9 expref: 12 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129329:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773cdf lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22e9 expref: 11 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.129337:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff8c0455e5c500) 00010000:00010000:2.0:1780340659.129340:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340659.129349:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722aec00, rc 0) 00000100:00100000:2.0:1780340659.129417:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:67177:x1866818940404224:12345-192.168.203.16@tcp:101:rm.0 Request processed in 664us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340659.129424:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1159 00000100:00100000:3.0:1780340659.132370:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340659.132452:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940404480 00000100:00100000:0.0:1780340659.132470:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940404480 00000100:00100000:0.0:1780340659.132735:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1160 00000100:00100000:0.0:1780340659.132746:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:67177:x1866818940404480:12345-192.168.203.16@tcp:36:rm.0 00010000:00010000:0.0:1780340659.132833:0:70100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1780340659.132861:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773cdf lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22e9 expref: 11 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.132881:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff8c0455e5c500) 00010000:00010000:0.0:1780340659.132899:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4e00/0xa24651432773cc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22e2 expref: 10 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.132909:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c034b343a00) 00010000:00010000:0.0:1780340659.132915:0:70100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780340659.132939:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432773ce6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.132952:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432773ce6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.132961:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432773ce6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.132972:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa24651432773ced lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.132979:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa24651432773ced lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.132984:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa24651432773ced lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.133281:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773cf4 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.133290:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773cf4 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.133297:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773cf4 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.134133:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4200/0xa24651432773cfb lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.134395:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4200/0xa24651432773cfb lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.134405:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4200/0xa24651432773cfb lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.134412:0:70100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4200/0xa24651432773cfb lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.134419:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4200/0xa24651432773cfb lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.134425:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4200/0xa24651432773cfb lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.134449:0:70100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340659.134471:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340659.134472:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773cf4 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.134480:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4200/0xa24651432773cfb lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.134480:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773cf4 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.134912:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773cf4 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.134930:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340659.134936:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4200/0xa24651432773cfb lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.134945:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4200/0xa24651432773cfb lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.134958:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff8c034b343100) 00010000:00010000:2.0:1780340659.134961:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1780340659.134965:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4200/0xa24651432773cfb lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.134971:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4200/0xa24651432773cfb lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340659.134983:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340659.134985:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340659.134987:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340659.138452:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340659.138462:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773cf4 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.138475:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773cf4 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.138492:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff8c034b343100) 00010000:00010000:0.0:1780340659.138495:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1780340659.138500:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773cf4 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.138507:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432773cf4 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.138541:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432773ce6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.138547:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432773ce6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.138553:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432773ce6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.138559:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340659.138561:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432773ce6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.138586:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432773ce6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.138593:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c034b343c00) 00010000:00010000:0.0:1780340659.138595:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340659.138598:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432773ce6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.138604:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432773ce6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340659.138615:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000602379b7 reply state 0000000072974354 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa24651432773ced lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.138627:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa24651432773ced lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340659.138634:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04506cfd00) 00010000:00010000:0.0:1780340659.138636:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340659.138639:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780340659.138733:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:67177:x1866818940404480:12345-192.168.203.16@tcp:36:rm.0 Request processed in 5986us (6368us total) trans 103079215112 rc 0/0 00000100:00100000:0.0:1780340659.138742:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1160 00010000:00010000:1.0:1780340660.107506:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340661.131411:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340662.155734:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340663.178326:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961070720:0@lo:400:kworker.0 00000100:00100000:1.0:1780340663.178394:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340663.178427:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961071232:0@lo:400:kworker.0 00000100:00100000:1.0:1780340663.178453:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340663.178472:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961071744:0@lo:400:kworker.0 00000100:00100000:1.0:1780340663.178491:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340663.178514:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1780340663.178520:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961070848:0@lo:400:kworker.0 00000100:00100000:1.0:1780340663.178539:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340663.178571:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961071360:0@lo:400:kworker.0 00000100:00100000:1.0:1780340663.178630:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340663.178652:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961071872:0@lo:400:kworker.0 00000100:00100000:2.0:1780340663.178656:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961070464:0@lo:400:kworker.0 00000100:00100000:1.0:1780340663.178686:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340663.178688:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340663.178713:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961070976:0@lo:400:kworker.0 00000100:00100000:2.0:1780340663.178734:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340663.178757:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961071488:0@lo:400:kworker.0 00000100:00100000:2.0:1780340663.178792:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340663.178795:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961070464 00000100:00100000:0.0:1780340663.178803:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961070464 00000100:00100000:2.0:1780340663.178808:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961072000:0@lo:400:kworker.0 00000100:00100000:2.0:1780340663.178825:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340663.178842:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1780340663.178845:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1780340663.178847:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961070592:0@lo:400:kworker.0 00000100:00100000:0.0:1780340663.178853:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03477f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961070464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340663.178864:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340663.178873:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961071104:0@lo:400:kworker.0 00000100:00100000:0.0:1780340663.178898:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03477f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961070464:12345-0@lo:400:kworker.0 Request processed in 46us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340663.178909:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340663.178913:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1780340663.178937:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961071616:0@lo:400:kworker.0 00000100:00100000:0.0:1780340663.178946:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961070720 00000100:00100000:0.0:1780340663.178949:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961070720 00000100:00100000:2.0:1780340663.178958:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340663.178973:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961072128:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340663.178976:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961070848 00000100:00100000:0.0:1780340663.178979:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961070848 00000100:00100000:0.0:1780340663.178991:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961070976 00000100:00100000:0.0:1780340663.178993:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961070976 00000100:00100000:0.0:1780340663.179004:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961071488 00000100:00100000:0.0:1780340663.179006:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961071488 00000100:00100000:0.0:1780340663.179029:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961072000 00000100:00100000:0.0:1780340663.179031:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961072000 00000100:00100000:0.0:1780340663.179043:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961070592 00000100:00100000:0.0:1780340663.179046:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961070592 00000100:00100000:0.0:1780340663.179058:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:2.0:1780340663.179059:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340663.179064:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961070720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340663.179389:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:1.0:1780340663.179398:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961070848:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780340663.179414:0:64454:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046b992a00 x1866818961070848/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:89/0 lens 224/224 e 0 to 0 dl 1780340674 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340663.179530:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961070464:0@lo:400:kworker.0 00000100:00100000:2.0:1780340663.179561:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:0.0:1780340663.179563:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961070720:12345-0@lo:400:kworker.0 Request processed in 499us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340663.179568:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961070976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340663.179570:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:0.0:1780340663.179583:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:0.0:1780340663.179589:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961071488:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1780340663.179599:0:70100:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0349861500 x1866818961071488/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:89/0 lens 224/224 e 0 to 0 dl 1780340674 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340663.179602:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961070976:12345-0@lo:400:kworker.0 Request processed in 36us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340663.179608:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:2.0:1780340663.179621:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:0.0:1780340663.179622:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961071488:12345-0@lo:400:kworker.0 Request processed in 35us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340663.179626:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961072000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340663.179628:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00010000:00000080:2.0:1780340663.179637:0:63711:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047207f100 x1866818961072000/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:89/0 lens 224/224 e 0 to 0 dl 1780340674 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340663.179650:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1780340663.179656:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961070592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340663.179659:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961072000:12345-0@lo:400:kworker.0 Request processed in 34us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340663.179670:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00010000:00000080:0.0:1780340663.179675:0:70100:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047207d500 x1866818961070592/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:89/0 lens 224/224 e 0 to 0 dl 1780340674 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340663.179690:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961071104 00000100:00100000:2.0:1780340663.179694:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961071104 00000100:00100000:0.0:1780340663.179699:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961070592:12345-0@lo:400:kworker.0 Request processed in 45us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340663.179705:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:2.0:1780340663.179717:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961071616 00000100:00100000:2.0:1780340663.179720:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961071616 00000100:00080000:0.0:1780340663.179723:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780340663.179727:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340663.179729:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961072128 00000100:00100000:2.0:1780340663.179732:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961072128 00000100:00100000:2.0:1780340663.179742:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3773 00000100:00100000:2.0:1780340663.179746:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961071104:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340663.179773:0:8410:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047207f480 x1866818961071104/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:89/0 lens 224/224 e 0 to 0 dl 1780340674 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1780340663.179779:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340663.179799:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961071104:12345-0@lo:400:kworker.0 Request processed in 52us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340663.179805:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3773 00000100:00100000:2.0:1780340663.179816:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3774 00000100:00100000:2.0:1780340663.179821:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961071616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340663.179847:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961071616:12345-0@lo:400:kworker.0 Request processed in 26us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340663.179852:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3774 00000100:00100000:2.0:1780340663.179862:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3775 00000100:00100000:2.0:1780340663.179867:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961072128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340663.179892:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:2.0:1780340663.179918:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961072128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340663.179923:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3775 00000100:00100000:2.0:1780340663.179953:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961070592:0@lo:400:kworker.0 00000100:00100000:2.0:1780340663.179974:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961071104:0@lo:400:kworker.0 00000100:00100000:2.0:1780340663.179981:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961071616:0@lo:400:kworker.0 00000100:00100000:2.0:1780340663.180014:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961072128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340663.180024:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961070976:0@lo:400:kworker.0 00000100:00100000:2.0:1780340663.180032:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961071488:0@lo:400:kworker.0 00000100:00100000:2.0:1780340663.180040:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961072000:0@lo:400:kworker.0 00000100:00100000:3.0:1780340663.180192:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961070720:0@lo:400:kworker.0 00000100:00100000:0.0:1780340663.181866:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961071232 00000100:00100000:0.0:1780340663.181877:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961071232 00000100:00100000:1.0:1780340663.182352:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961070848:12345-0@lo:400:kworker.0 Request processed in 2952us (3807us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340663.182364:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:0.0:1780340663.182415:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961071744 00000100:00100000:0.0:1780340663.182419:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961071744 00000100:00100000:3.0:1780340663.182747:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961071360 00000100:00100000:3.0:1780340663.182752:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961071360 00000100:00100000:3.0:1780340663.182799:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961071872 00000100:00100000:3.0:1780340663.182803:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961071872 00000100:00100000:3.0:1780340663.182822:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2426 00000100:00100000:3.0:1780340663.182843:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961071232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340663.182896:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b990000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961071232:12345-0@lo:400:kworker.0 Request processed in 55us (4441us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340663.182902:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2426 00000100:00100000:3.0:1780340663.182914:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2427 00000100:00100000:3.0:1780340663.182920:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961071744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340663.182945:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b990380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961071744:12345-0@lo:400:kworker.0 Request processed in 26us (4454us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340663.182951:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2427 00000100:00100000:3.0:1780340663.182961:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2428 00000100:00100000:3.0:1780340663.182967:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b991880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961071360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340663.182990:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b991880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961071360:12345-0@lo:400:kworker.0 Request processed in 24us (4359us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340663.182995:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2428 00000100:00100000:3.0:1780340663.183005:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2429 00000100:00100000:3.0:1780340663.183023:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b990700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961071872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340663.183046:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b990700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961071872:12345-0@lo:400:kworker.0 Request processed in 36us (4360us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340663.183051:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2429 00000100:00080000:2.0:1780340663.183299:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340663.183303:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340663.186560:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961070848:0@lo:400:kworker.0 00000100:00100000:1.0:1780340663.186578:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961071360:0@lo:400:kworker.0 00000100:00100000:1.0:1780340663.186591:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961071872:0@lo:400:kworker.0 00000100:00100000:1.0:1780340663.186602:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961071232:0@lo:400:kworker.0 00000100:00100000:1.0:1780340663.186612:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961071744:0@lo:400:kworker.0 00000100:00100000:3.0:1780340663.340702:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340663.340813:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340663.340878:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340663.340918:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940404992 00000100:00100000:0.0:1780340663.340927:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940404992 00000100:00100000:3.0:1780340663.340933:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340663.340982:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2430 00000100:00100000:0.0:1780340663.340991:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940404992:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340663.341028:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340663.341099:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940404736 00000100:00100000:2.0:1780340663.341103:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940404736 00000100:00100000:2.0:1780340663.341157:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940404864 00000100:00100000:2.0:1780340663.341171:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940404864 00000100:00100000:2.0:1780340663.341193:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1177 00000100:00100000:2.0:1780340663.341199:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:2409:x1866818940404736:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000080:2.0:1780340663.341219:0:63711:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04441b5f80 x1866818940404736/t0(0) o400->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:89/0 lens 224/224 e 0 to 0 dl 1780340674 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340663.341401:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940404992:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 410us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340663.341409:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2430 00000100:00100000:0.0:1780340663.341424:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940405120 00000100:00100000:0.0:1780340663.341427:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940405120 00000100:00100000:0.0:1780340663.341450:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2431 00000100:00100000:0.0:1780340663.341456:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940405120:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340663.342282:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940404608 00000100:00100000:3.0:1780340663.342300:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940404608 00000100:00100000:3.0:1780340663.342356:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 83 00000100:00100000:3.0:1780340663.342379:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03477f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2409:x1866818940404608:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340663.342584:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03477f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2409:x1866818940404608:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 205us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340663.342592:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 83 00000100:00100000:2.0:1780340663.345822:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:2409:x1866818940404736:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 4613us (5147us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340663.345835:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1177 00000100:00100000:2.0:1780340663.345868:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1178 00000100:00100000:2.0:1780340663.345880:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940404864:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340663.345944:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940404864:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 68us (5010us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340663.345962:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1178 00000100:00080000:2.0:1780340663.345997:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340663.346002:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340663.347806:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780340663.347815:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340663.348347:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940405120:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 6881us (7309us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340663.348361:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2431 00000100:00100000:3.0:1780340663.690227:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961072768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340663.690292:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340663.690353:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961072768 00000100:00100000:3.0:1780340663.690361:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961072768 00000100:00100000:3.0:1780340663.690446:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974 00000100:00100000:3.0:1780340663.690455:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961072768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340663.690483:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340663.690532:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961072768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340663.690539:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974 00000100:00100000:3.0:1780340663.690602:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b991f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961072768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340663.690748:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961072256:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340663.690807:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340663.690824:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961072384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340663.690844:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340663.690898:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961072256 00000100:00100000:3.0:1780340663.690902:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961072256 00000100:00100000:3.0:1780340663.690931:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3776 00000100:00100000:3.0:1780340663.690937:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961072256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340663.690960:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00010000:00000080:3.0:1780340663.690972:0:8410:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046b993800 x1866818961072256/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:89/0 lens 224/368 e 0 to 0 dl 1780340674 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340663.691151:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961072384 00000100:00100000:2.0:1780340663.691155:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961072384 00000100:00100000:2.0:1780340663.691182:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1975 00000100:00100000:2.0:1780340663.691189:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b993b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961072384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780340663.691201:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340663.697292:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961072512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340663.698831:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340663.698884:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961072640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340663.701390:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340663.701522:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961072512 00000100:00100000:0.0:1780340663.701532:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961072512 00000100:00100000:0.0:1780340663.701570:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961072640 00000100:00100000:0.0:1780340663.701573:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961072640 00000100:00100000:0.0:1780340663.701588:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976 00000100:00100000:0.0:1780340663.701597:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961072512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780340663.701641:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340663.701698:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961072512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (2872us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340663.701705:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976 00000100:00100000:0.0:1780340663.701720:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1977 00000100:00100000:0.0:1780340663.701726:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961072640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340663.701739:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340663.701778:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961072640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340663.701785:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1977 00000100:00100000:0.0:1780340663.701829:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961072512:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340663.701843:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961072640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340663.703046:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961072256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 12103us (12232us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340663.703135:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3776 00000100:00100000:1.0:1780340663.704822:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961072256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340663.706702:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b993b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961072384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 15505us (15848us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340663.706714:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1975 00000100:00100000:1.0:1780340663.712832:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961072384:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1780340664.208211:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1780340664.931203:0:83633:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215112 is committed 00010000:00010000:2.0:1780340664.932125:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773cb5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340664.932140:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773cb5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340664.932148:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773cb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340664.932156:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340664.932160:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773cb5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340664.932168:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773cb5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340664.932184:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04506cfd00) 00010000:00010000:2.0:1780340664.932194:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340664.932199:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773cb5 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340664.932205:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031800/0xa24651432773cb5 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340664.932233:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa24651432773ced lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340664.932239:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa24651432773ced lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340664.932244:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa24651432773ced lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340664.932249:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340664.932252:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa24651432773ced lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340664.932257:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa24651432773ced lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340664.932264:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04506cfd00) 00010000:00010000:2.0:1780340664.932266:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340664.932269:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa24651432773ced lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340664.932274:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa24651432773ced lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340665.226161:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1780340666.144063:0:84741:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:0.0:1780340666.245570:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340666.245689:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940405248 00000100:00100000:2.0:1780340666.245710:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940405248 00000100:00100000:2.0:1780340666.245810:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1161 00000100:00100000:2.0:1780340666.245821:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:67245:x1866818940405248:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340666.245841:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340666.245863:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432773d02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced22f0 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.246104:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432773d09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.246129:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432773d09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.246141:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432773d09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340666.246193:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1780340666.246197:0:63710:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780340666.246301:0:63710:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432773d09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.246327:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432773d02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f0 expref: 9 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.246344:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432773d09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f0 expref: 8 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.246352:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0345328d00) 00010000:00010000:2.0:1780340666.246355:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780340666.246359:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722af200, rc 0) 00010000:00000080:2.0:1780340666.246372:0:63710:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0485a18700 x1866818940405248/t0(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:92/0 lens 576/688 e 0 to 0 dl 1780340677 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340666.246470:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:67245:x1866818940405248:12345-192.168.203.16@tcp:101:dd.0 Request processed in 651us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340666.246477:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1161 00000100:00080000:3.0:1780340666.246559:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1780340666.253925:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340666.257438:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340666.257509:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940405504 00000100:00100000:2.0:1780340666.257519:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940405504 00000100:00100000:2.0:1780340666.257578:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1162 00000100:00100000:2.0:1780340666.257588:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:67245:x1866818940405504:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340666.257608:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340666.257611:0:63712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1780340666.257634:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432773d09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f0 expref: 8 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258150:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0345328d00) 00010000:00010000:2.0:1780340666.258163:0:63712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340666.258179:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432773d10 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced22f7 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258379:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432773d17 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258393:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432773d17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258404:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432773d17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258416:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773d1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258439:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773d1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258445:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773d1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258529:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aea00/0xa24651432773d25 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258537:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aea00/0xa24651432773d25 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258543:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aea00/0xa24651432773d25 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340666.258656:0:63712:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1780340666.258659:0:63712:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 0 -> 1780340658 00000004:00010000:2.0:1780340666.258661:0:63712:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 0 -> 1780340658 00000004:00010000:2.0:1780340666.258663:0:63712:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 0 -> 1780340658 00000004:00010000:2.0:1780340666.258666:0:63712:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:2.0:1780340666.258669:0:63712:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:2.0:1780340666.258674:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432773d17 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258682:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432773d17 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258688:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432773d17 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258694:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432773d17 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258705:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340666.258709:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432773d17 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258715:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432773d17 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258726:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0345328c00) 00010000:00010000:2.0:1780340666.258729:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340666.258732:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432773d17 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258738:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432773d17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258748:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773d1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258754:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773d1e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258788:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773d1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258794:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722aec00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340666.258796:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773d1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258802:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773d1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258821:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff8c0345328a00) 00010000:00010000:2.0:1780340666.258824:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340666.258827:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773d1e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258832:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432773d1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258871:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432773d10 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 10 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258898:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aea00/0xa24651432773d25 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 9 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.258907:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff8c0345328100) 00010000:00010000:2.0:1780340666.258909:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1780340666.258912:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722aea00, rc 0) 00010000:00000080:2.0:1780340666.259087:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c034d875c00 x1866818940405504/t103079215113(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:92/0 lens 752/824 e 0 to 0 dl 1780340677 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340666.259170:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:67245:x1866818940405504:12345-192.168.203.16@tcp:101:dd.0 Request processed in 1584us (1741us total) trans 103079215113 rc 0/0 00000100:00100000:2.0:1780340666.259179:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1162 00000100:00100000:1.0:1780340666.261750:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340666.263507:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940405632 00000100:00100000:2.0:1780340666.263521:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940405632 00000100:00100000:2.0:1780340666.263590:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1163 00000100:00100000:2.0:1780340666.263600:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:67245:x1866818940405632:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340666.263623:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340666.263651:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afc00/0xa24651432773d33 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced22fe expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.263684:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432773d3a lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.263697:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432773d3a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.263708:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432773d3a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.263824:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afc00/0xa24651432773d33 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22fe expref: 11 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.263842:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432773d3a lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22fe expref: 10 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340666.263850:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff8c0345328100) 00010000:00010000:2.0:1780340666.263853:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780340666.263856:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722af600, rc 0) 00010000:00000080:2.0:1780340666.263864:0:64454:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046b990e00 x1866818940405632/t0(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:92/0 lens 568/1272 e 0 to 0 dl 1780340677 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340666.263987:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:67245:x1866818940405632:12345-192.168.203.16@tcp:101:dd.0 Request processed in 388us (2244us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340666.263995:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1163 00000100:00100000:0.0:1780340666.269614:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340666.270552:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940405888 00000100:00100000:1.0:1780340666.270563:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940405888 00000100:00100000:1.0:1780340666.270620:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1164 00000100:00100000:1.0:1780340666.270630:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:67245:x1866818940405888:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:1.0:1780340666.270747:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432773d41 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340666.270786:0:63710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aea00/0xa24651432773d25 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 10 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340666.270797:0:63710:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432773d41 lrc: 4/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340666.270830:0:63710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aea00/0xa24651432773d25 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 10 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340666.270842:0:63710:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aea00/0xa24651432773d25 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 10 pid: 63712 timeout: 3546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340666.270855:0:63710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b991f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:63710:1866818961072896:192.168.203.16@tcp:104: 00000100:00100000:1.0:1780340666.271060:0:63710:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047215b840 going to sleep for 11 seconds 00000100:00100000:3.0:1780340666.284353:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340666.284423:0:63710:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b991f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:63710:1866818961072896:192.168.203.16@tcp:104: 00010000:00010000:1.0:1780340666.284453:0:63710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432773d41 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340666.289158:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940406016 00000100:00100000:0.0:1780340666.289170:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940406016 00010000:00010000:0.0:1780340666.289222:0:25498:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aea00/0xa24651432773d25 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 11 pid: 63712 timeout: 3546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340666.289267:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2542 00000100:00100000:0.0:1780340666.289276:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:2408:x1866818940406016:12345-192.168.203.16@tcp:102:ldlm_bl.0 00010000:00010000:0.0:1780340666.289292:0:25498:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aea00/0xa24651432773d25 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 11 pid: 63712 timeout: 3546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340666.289303:0:25498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aea00/0xa24651432773d25 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 11 pid: 63712 timeout: 3546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340666.289315:0:25498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aea00/0xa24651432773d25 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 11 pid: 63712 timeout: 3546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340666.289324:0:25498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff8c0345328100) 00010000:00010000:0.0:1780340666.289327:0:25498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:0.0:1780340666.289331:0:25498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432773d41 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340666.289341:0:25498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432773d41 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340666.289347:0:25498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432773d41 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340666.289380:0:25498:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aea00/0xa24651432773d25 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 11 pid: 63712 timeout: 3546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340666.289451:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:2408:x1866818940406016:12345-192.168.203.16@tcp:102:ldlm_bl.0 Request processed in 176us (5106us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340666.289464:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2542 00010000:00010000:1.0:1780340666.290163:0:63710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432773d41 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340666.290173:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432773d41 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340666.290318:0:63710:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1780340666.290322:0:63710:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1780340658 -> 1780340666 00000004:00010000:1.0:1780340666.290324:0:63710:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1780340658 -> 1780340658 00000004:00010000:1.0:1780340666.290326:0:63710:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1780340658 -> 1780340666 00000004:00010000:1.0:1780340666.290328:0:63710:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:1.0:1780340666.290335:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b3544766 reply state 0000000000119e2d transno 103079215114 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432773d41 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340666.290347:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432773d41 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340666.290354:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff8c0345328100) 00010000:00010000:1.0:1780340666.290357:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340666.290359:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:1.0:1780340666.290412:0:63710:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04587b4000 x1866818940405888/t103079215114(0) o36->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:92/0 lens 488/456 e 0 to 0 dl 1780340677 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340666.290458:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:67245:x1866818940405888:12345-192.168.203.16@tcp:36:dd.0 Request processed in 19830us (20862us total) trans 103079215114 rc 0/0 00000100:00100000:1.0:1780340666.290466:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1164 00000100:00100000:0.0:1780340666.299146:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340666.299315:0:63723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940406144 00000100:00100000:1.0:1780340666.299326:0:63723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940406144 00002000:00010000:1.0:1780340666.299360:0:63723:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000a811:0x6:0x0] 00002000:00100000:1.0:1780340666.299380:0:63723:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8c04587b5880 with x1866818940406144 00000100:00100000:1.0:1780340666.299443:0:63723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:1.0:1780340666.299452:0:63723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:2409:x1866818940406144:12345-192.168.203.16@tcp:10:dd.0 00000004:00010000:1.0:1780340666.299593:0:63723:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1780340666.299597:0:63723:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1780340666 -> 1780340666 00000004:00010000:1.0:1780340666.299600:0:63723:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1780340658 -> 1780340658 00000004:00010000:1.0:1780340666.299602:0:63723:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1780340666 -> 1780340666 00000004:00010000:1.0:1780340666.299605:0:63723:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1780340666.299630:0:63723:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04587b5880 x1866818940406144/t103079215115(0) o10->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:92/0 lens 440/432 e 0 to 0 dl 1780340677 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340666.299686:0:63723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:2409:x1866818940406144:12345-192.168.203.16@tcp:10:dd.0 Request processed in 235us (550us total) trans 103079215115 rc 0/0 00000100:00100000:1.0:1780340666.299693:0:63723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00002000:00010000:1.0:1780340666.299696:0:63723:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000a811:0x6:0x0] 00002000:00100000:1.0:1780340666.299698:0:63723:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8c04587b5880 with x1866818940406144 00000100:00100000:0.0:1780340666.305844:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340666.305878:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940406400 00000100:00100000:0.0:1780340666.305887:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940406400 00000100:00100000:0.0:1780340666.305935:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 225 00000100:00100000:0.0:1780340666.305945:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:67245:x1866818940406400:12345-192.168.203.16@tcp:35:dd.0 00010000:00000080:0.0:1780340666.306146:0:77826:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04529d5f80 x1866818940406400/t103079215116(0) o35->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:92/0 lens 392/456 e 0 to 0 dl 1780340677 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340666.306202:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+14:67245:x1866818940406400:12345-192.168.203.16@tcp:35:dd.0 Request processed in 258us (365us total) trans 103079215116 rc 0/0 00000100:00100000:0.0:1780340666.306210:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 225 00010000:00010000:2.0:1780340667.289294:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340668.306197:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961073024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340668.306306:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340668.306364:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961073024 00000100:00100000:0.0:1780340668.306372:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961073024 00000100:00100000:0.0:1780340668.306417:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3777 00000100:00100000:0.0:1780340668.306425:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961073024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780340668.306458:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:0.0:1780340668.306499:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961073024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340668.306507:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3777 00000100:00100000:0.0:1780340668.306551:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961073024:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1780340668.318559:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340668.320744:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961073152:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.320827:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340668.320873:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961073664:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.320902:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340668.320909:0:83639:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961073152 00000100:00100000:2.0:1780340668.320917:0:83639:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961073152 00000100:00100000:1.0:1780340668.320921:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961074176:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.320942:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340668.320972:0:83639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1780340668.320981:0:83639:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03477f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961073152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.321005:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1780340668.321012:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961073280:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.321037:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340668.321042:0:83639:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03477f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961073152:12345-0@lo:400:kworker.0 Request processed in 62us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340668.321049:0:83639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1780340668.321062:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961073792:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.321087:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340668.321122:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ac7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961074304:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.321144:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340668.321174:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961073152:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.321202:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961073664 00000100:00100000:1.0:1780340668.321205:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961073664 00000100:00100000:1.0:1780340668.321247:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961074176 00000100:00100000:1.0:1780340668.321250:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961074176 00000100:00100000:1.0:1780340668.321266:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961073280 00000100:00100000:1.0:1780340668.321269:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961073280 00000100:00100000:1.0:1780340668.321284:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:1.0:1780340668.321291:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961073664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.321327:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961073664:12345-0@lo:400:kworker.0 Request processed in 36us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340668.321333:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:1.0:1780340668.321345:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:1.0:1780340668.321350:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961074176:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780340668.321363:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046b993480 x1866818961074176/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:94/0 lens 224/224 e 0 to 0 dl 1780340679 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340668.321388:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961074176:12345-0@lo:400:kworker.0 Request processed in 39us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340668.321394:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:1.0:1780340668.321405:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:1.0:1780340668.321411:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961073280:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780340668.321421:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c03498ef480 x1866818961073280/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:94/0 lens 224/224 e 0 to 0 dl 1780340679 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340668.321454:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961073280:12345-0@lo:400:kworker.0 Request processed in 44us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340668.321461:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:2.0:1780340668.321483:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961073792 00000100:00100000:1.0:1780340668.321486:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961074304 00000100:00100000:2.0:1780340668.321487:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961073792 00000100:00100000:1.0:1780340668.321488:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961074304 00000100:00100000:2.0:1780340668.321516:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3778 00000100:00100000:2.0:1780340668.321522:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961073792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.321527:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2432 00000100:00100000:1.0:1780340668.321532:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961074304:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340668.321536:0:8410:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c03498ef100 x1866818961073792/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:94/0 lens 224/224 e 0 to 0 dl 1780340679 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340668.321560:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961073792:12345-0@lo:400:kworker.0 Request processed in 39us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340668.321560:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961074304:12345-0@lo:400:kworker.0 Request processed in 27us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340668.321567:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3778 00000100:00100000:1.0:1780340668.321567:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2432 00000100:00100000:1.0:1780340668.321727:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961073280:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.321744:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961073792:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.321754:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ac7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961074304:0@lo:400:kworker.0 00000100:00080000:2.0:1780340668.321808:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340668.321813:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780340668.321815:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340668.321839:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961073664:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.321848:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961074176:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.324200:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048527e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961073408:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.324263:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340668.324303:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a206a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961073920:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.324330:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340668.324362:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961074432:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.324385:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340668.324414:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1780340668.324430:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048527ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961073536:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.324453:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340668.324472:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961074048:0@lo:400:kworker.0 00000100:00100000:3.0:1780340668.324748:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961073920 00000100:00100000:3.0:1780340668.324778:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961073920 00000100:00100000:3.0:1780340668.324831:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961074432 00000100:00100000:3.0:1780340668.324834:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961074432 00000100:00100000:3.0:1780340668.324855:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2433 00000100:00100000:3.0:1780340668.324863:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961073920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340668.324912:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961073920:12345-0@lo:400:kworker.0 Request processed in 50us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340668.324919:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2433 00000100:00100000:3.0:1780340668.324933:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2434 00000100:00100000:3.0:1780340668.324939:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961074432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340668.324963:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961074432:12345-0@lo:400:kworker.0 Request processed in 24us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340668.324968:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2434 00000100:00080000:3.0:1780340668.324995:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340668.324999:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340668.325146:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340668.325173:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961074560:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.325198:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340668.325228:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a206a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961073920:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.325238:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961074432:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.325270:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961074048 00000100:00100000:1.0:1780340668.325274:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961074048 00000100:00100000:1.0:1780340668.325299:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2435 00000100:00100000:1.0:1780340668.325304:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961074048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.325335:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961074048:12345-0@lo:400:kworker.0 Request processed in 30us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340668.325340:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2435 00000100:00100000:1.0:1780340668.325356:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961073408 00000100:00100000:1.0:1780340668.325359:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961073408 00000100:00100000:1.0:1780340668.325380:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961073536 00000100:00100000:1.0:1780340668.325382:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961073536 00000100:00100000:1.0:1780340668.325399:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961074560 00000100:00100000:1.0:1780340668.325401:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961074560 00000100:00100000:1.0:1780340668.325413:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:1.0:1780340668.325419:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961073408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.325449:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961073408:12345-0@lo:400:kworker.0 Request processed in 30us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340668.325454:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:1.0:1780340668.325476:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:1.0:1780340668.325482:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961073536:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780340668.325494:0:64454:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c03498ee300 x1866818961073536/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:94/0 lens 224/224 e 0 to 0 dl 1780340679 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340668.325678:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961073536:12345-0@lo:400:kworker.0 Request processed in 196us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340668.325685:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:1.0:1780340668.325697:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:1.0:1780340668.325704:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961074560:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780340668.325715:0:64454:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c03498ed500 x1866818961074560/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:94/0 lens 224/224 e 0 to 0 dl 1780340679 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340668.325740:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961074560:12345-0@lo:400:kworker.0 Request processed in 37us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340668.325745:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:1.0:1780340668.325794:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048527ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961073536:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.325804:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961074048:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.325812:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961074560:0@lo:400:kworker.0 00000100:00100000:1.0:1780340668.325821:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048527e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961073408:0@lo:400:kworker.0 00000100:00080000:3.0:1780340668.326832:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780340668.326839:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780340668.326842:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:01000004:1.0:1780340668.425732:0:84838:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1780340668.425804:0:84838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c4200/0xa246514327738be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327738c5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.425819:0:84838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c4200/0xa246514327738be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327738c5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.425844:0:84838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c4200/0xa246514327738be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa246514327738c5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.425850:0:84838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c04441c4200/0xa246514327738be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa246514327738c5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.425870:0:84838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1780340668.425877:0:84838:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1780340668.425904:0:84838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1780340668.425908:0:84838:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1780340668.425914:0:84838:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1780340668.425938:0:84838:0:(import.c:65:import_set_state_nolock()) ffff8c034a948800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1780340668.426817:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340668.426827:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04441c4200/0xa246514327738be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa246514327738c5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340668.426837:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c4200 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:2.0:1780340668.426840:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04441c4200/0xa246514327738be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa246514327738c5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340668.426849:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04441c4200/0xa246514327738be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xa246514327738c5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340668.426856:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04441c4200/0xa246514327738be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xa246514327738c5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340668.426873:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1780340668.426875:0:7442:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1780340668.426878:0:7442:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1780340668.426907:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c04441c4200/0xa246514327738be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327738c5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340668.426913:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780340668.426940:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04441c4200/0xa246514327738be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327738c5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340668.426947:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04441c4200/0xa246514327738be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327738c5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340668.426959:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340668.426961:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340668.426963:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340668.426992:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961074688:0@lo:39:umount.0 00000100:00100000:2.0:1780340668.427061:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340668.427116:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340668.427123:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961074816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340668.427149:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340668.427182:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961074688 00000100:00100000:2.0:1780340668.427188:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961074688 00000100:00100000:2.0:1780340668.427226:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:2.0:1780340668.427234:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1866818961074688:12345-0@lo:39:umount.0 00000020:00000080:2.0:1780340668.427256:0:63712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327739d6 00000100:00080000:2.0:1780340668.427269:0:63712:0:(import.c:65:import_set_state_nolock()) ffff8c0458287000 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1780340668.427292:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0349084a80 x1866818961074688/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:94/0 lens 224/224 e 0 to 0 dl 1780340679 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340668.427334:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3658:x1866818961074688:12345-0@lo:39:umount.0 Request processed in 101us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340668.427340:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000020:00000080:2.0:1780340668.427349:0:63712:0:(genops.c:906:class_export_put()) final put ffff8c0458285800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:2.0:1780340668.427376:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961074816 00000100:00100000:2.0:1780340668.427379:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961074816 00000100:00100000:2.0:1780340668.427409:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:2.0:1780340668.427416:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961074816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340668.427426:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340668.427440:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0476762e00/0xa246514327738c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327738be expref: 23 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340668.427454:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340668.427480:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349084380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3660:x1866818961074816:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340668.427487:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00010000:00010000:2.0:1780340668.427547:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780340668.427572:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a948800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1780340668.427582:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961074688:0@lo:39:umount.0 00000100:00100000:2.0:1780340668.432776:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961074816:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1780340668.432910:0:84838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1780340668.432914:0:84838:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1780340668.432920:0:84838:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1780340668.433921:0:84838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763e00/0xa246514327737de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327737e5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.433936:0:84838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763e00/0xa246514327737de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327737e5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.433943:0:84838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763e00/0xa246514327737de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa246514327737e5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.433949:0:84838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c0476763e00/0xa246514327737de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa246514327737e5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.433970:0:84838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780340668.433988:0:84838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763a00/0xa246514327738fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773904 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.433994:0:84838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763a00/0xa246514327738fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773904 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434000:0:84838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763a00/0xa246514327738fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773904 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434006:0:84838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c0476763a00/0xa246514327738fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773904 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434016:0:84838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780340668.434021:0:84838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c4e00/0xa246514327738b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327738b7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434026:0:84838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c4e00/0xa246514327738b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327738b7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434032:0:84838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04441c4e00/0xa246514327738b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa246514327738b7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434037:0:84838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c04441c4e00/0xa246514327738b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa246514327738b7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434048:0:84838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1780340668.434061:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1780340668.434066:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0476763e00/0xa246514327737de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa246514327737e5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434073:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476763e00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340668.434081:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0476763e00/0xa246514327737de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa246514327737e5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434104:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0476763e00/0xa246514327737de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xa246514327737e5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340668.434112:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0476763e00/0xa246514327737de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xa246514327737e5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340668.434118:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1780340668.434121:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1780340668.434148:0:6505:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0476763e00/0xa246514327737de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327737e5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434154:0:6505:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340668.434172:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0476763e00/0xa246514327737de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327737e5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434178:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0476763e00/0xa246514327737de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327737e5 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434190:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780340668.434192:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0476763a00/0xa246514327738fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773904 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434197:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476763a00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340668.434200:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0476763a00/0xa246514327738fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773904 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434205:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0476763a00/0xa246514327738fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432773904 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340668.434220:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0476763a00/0xa246514327738fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432773904 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340668.434225:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1780340668.434227:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1780340668.434229:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1780340668.434244:0:6505:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0476763a00/0xa246514327738fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773904 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434249:0:6505:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340668.434262:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0476763a00/0xa246514327738fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773904 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434268:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0476763a00/0xa246514327738fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773904 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434277:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340668.434280:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04441c4e00/0xa246514327738b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa246514327738b7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434285:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04441c4e00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340668.434288:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04441c4e00/0xa246514327738b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa246514327738b7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434294:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04441c4e00/0xa246514327738b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa246514327738b7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340668.434300:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04441c4e00/0xa246514327738b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa246514327738b7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340668.434314:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1780340668.434316:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1780340668.434317:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1780340668.434331:0:6505:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c04441c4e00/0xa246514327738b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327738b7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434336:0:6505:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340668.434342:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04441c4e00/0xa246514327738b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327738b7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434347:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04441c4e00/0xa246514327738b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327738b7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434356:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340668.434358:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340668.434359:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340668.434366:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340668.434379:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961074944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340668.434437:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340668.434485:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961075072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340668.434509:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340668.434525:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340668.434530:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961075200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340668.434550:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340668.434579:0:7443:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961074944 00000100:00100000:1.0:1780340668.434585:0:7443:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961074944 00000100:00100000:1.0:1780340668.434622:0:7443:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961075072 00000100:00100000:1.0:1780340668.434625:0:7443:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961075072 00000100:00100000:1.0:1780340668.434664:0:7443:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961075200 00000100:00100000:1.0:1780340668.434667:0:7443:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961075200 00000100:00100000:1.0:1780340668.434688:0:7443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1780340668.434696:0:7443:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+24:3659:x1866818961074944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340668.434707:0:7443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340668.434719:0:7443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04441c4000/0xa246514327737e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327737de expref: 24 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434730:0:7443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340668.434786:0:7443:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961074944:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340668.434794:0:7443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1780340668.434810:0:7443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1780340668.434816:0:7443:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04757d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3661:x1866818961075072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340668.434824:0:7443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340668.434832:0:7443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c046fb20600/0xa24651432773904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327738fd expref: 22 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434841:0:7443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340668.434866:0:7443:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04757d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:3661:x1866818961075072:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340668.434871:0:7443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1780340668.434907:0:7443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1780340668.434913:0:7443:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3661:x1866818961075200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340668.434920:0:7443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340668.434928:0:7443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a32b000/0xa246514327738b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327738b0 expref: 20 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.434946:0:7443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340668.434966:0:7443:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:3661:x1866818961075200:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340668.434972:0:7443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1780340668.435006:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961074944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340668.435029:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961075200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340668.435036:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961075072:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340668.435055:0:84838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa246514327737d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327737d7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.435064:0:84838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa246514327737d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327737d7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.435071:0:84838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa246514327737d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa246514327737d7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.435076:0:84838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa246514327737d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa246514327737d7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340668.435088:0:84838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1780340668.435104:0:84838:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1780340668.435108:0:84838:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1780340668.435141:0:84838:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1780340668.435146:0:84838:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1780340668.435150:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1780340668.435156:0:84838:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000020:00000080:0.0:1780340668.436042:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0458285800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1780340668.436116:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0458287000 for lustre-MDT0000 00010000:00010000:0.0:1780340668.436128:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340668.436134:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa246514327737d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa246514327737d7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.436142:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0476763800 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:0.0:1780340668.436145:0:41205:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa246514327737d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa246514327737d7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.436152:0:41205:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa246514327737d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa246514327737d7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340668.436159:0:41205:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa246514327737d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa246514327737d7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340668.436164:0:41205:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1780340668.436166:0:41205:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1780340668.436169:0:41205:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1780340668.436192:0:41205:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa246514327737d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327737d7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.436198:0:41205:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780340668.436213:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa246514327737d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327737d7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.436220:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0476763800/0xa246514327737d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327737d7 expref: -99 pid: 83631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.436230:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340668.436232:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340668.436233:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340668.436277:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961075328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780340668.436322:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340668.436368:0:6502:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961075328 00000100:00100000:0.0:1780340668.436373:0:6502:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961075328 00000100:00100000:0.0:1780340668.436409:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:0.0:1780340668.436418:0:6502:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:3659:x1866818961075328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780340668.436428:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340668.436438:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a32be00/0xa246514327737d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327737d0 expref: 19 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.436448:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340668.436477:0:6502:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:3659:x1866818961075328:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340668.436483:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:0.0:1780340668.436514:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961075328:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340668.436755:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340668.436792:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:1.0:1780340668.442052:0:84838:0:(mdt_handler.c:8186:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:0.0:1780340668.448086:0:83633:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215116 is committed 00010000:00010000:3.0:1780340668.448275:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432773d41 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340668.448288:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432773d41 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340668.448310:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432773d41 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340668.448317:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340668.448322:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432773d41 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340668.448330:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432773d41 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340668.448347:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff8c0345328100) 00010000:00010000:3.0:1780340668.448350:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340668.448355:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432773d41 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340668.448362:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432773d41 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1780340668.452398:0:84838:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1780340668.452412:0:84838:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c0345f1d000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780340668.452418:0:84838:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c0345f1f000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780340668.452422:0:84838:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c0345f1c000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780340668.452426:0:84838:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c04480ab800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780340668.452432:0:84838:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c0475faa800 e06e5cf1-1986-4ba7-9630-fad7efb74eca 192.168.203.16@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 103079215116 stale:0 00000020:00080000:1.0:1780340668.452436:0:84838:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff8c03482b3380) has exports, disconnecting them 00000020:00080000:1.0:1780340668.452441:0:84838:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c0345f1d000), last request at 1780340637 00000020:00000080:1.0:1780340668.452448:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327739cf 00000100:00080000:1.0:1780340668.452458:0:84838:0:(import.c:65:import_set_state_nolock()) ffff8c0458280800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780340668.452487:0:84838:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0345f1d000): rc 0 00000020:00000080:1.0:1780340668.452489:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c0345f1d000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1780340668.452500:0:84838:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c0345f1f000), last request at 1780340668 00000020:00000080:1.0:1780340668.452503:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327739c8 00000100:00080000:1.0:1780340668.452507:0:84838:0:(import.c:65:import_set_state_nolock()) ffff8c0345f1b000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780340668.452525:0:84838:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0345f1f000): rc 0 00000020:00000080:1.0:1780340668.452527:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c0345f1f000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1780340668.452531:0:84838:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c0345f1c000), last request at 1780340668 00000020:00000080:1.0:1780340668.452534:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327739c1 00000100:00080000:1.0:1780340668.452538:0:84838:0:(import.c:65:import_set_state_nolock()) ffff8c0345f19000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780340668.452547:0:84838:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0345f1c000): rc 0 00000020:00000080:1.0:1780340668.452549:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c0345f1c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1780340668.452552:0:84838:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c04480ab800), last request at 1780340632 00000020:00000080:1.0:1780340668.452562:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773832 00000100:00080000:1.0:1780340668.452574:0:84838:0:(import.c:65:import_set_state_nolock()) ffff8c0345f1b800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780340668.452636:0:84838:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c04480ab800): rc 0 00000020:00000080:1.0:1780340668.452652:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c04480ab800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:1.0:1780340668.452658:0:84838:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.16@tcp (ffff8c0475faa800), last request at 1780340666 00000020:00000080:1.0:1780340668.452662:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277382b 00000020:00010000:1.0:1780340668.452668:0:84838:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c0475faa800: total 4 00000100:00080000:1.0:1780340668.452672:0:84838:0:(import.c:65:import_set_state_nolock()) ffff8c047651b800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780340668.452682:0:84838:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.16@tcp (ffff8c0475faa800): rc 0 00000004:00000080:1.0:1780340668.452689:0:84838:0:(mdd_device.c:2374:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff99274169bae0 00000100:00080000:1.0:1780340668.452709:0:84838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1780340668.452713:0:84838:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:3.0:1780340668.453131:0:6505:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c0475faa800: total 4 00010000:00010000:3.0:1780340668.453184:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c0475faa800, canceled 0 locks, left on hash table 3. 00010000:00010000:3.0:1780340668.453219:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aea00/0xa24651432773d25 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 4 pid: 63712 timeout: 3546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340668.453240:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa24651432773c14 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22b1 expref: 3 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340668.453260:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432773d3a lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22fe expref: 2 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340668.453288:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c0475faa800, canceled 3 locks, left on hash table 0. 00000020:00000080:0.0:1780340668.457104:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0345f1d000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1780340668.457159:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0345f1f000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1780340668.457177:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0345f1c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1780340668.457191:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04480ab800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1780340668.457211:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0458280800 for lustre-MDT0000 00000020:00000080:0.0:1780340668.457214:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0345f1b000 for lustre-MDT0000 00000020:00000080:0.0:1780340668.457218:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0345f19000 for lustre-MDT0000 00000020:00000080:0.0:1780340668.457220:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0345f1b800 for lustre-MDT0000 00010000:00010000:0.0:1780340668.457232:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1780340668.457514:0:84838:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1780340668.457542:0:84838:0:(import.c:65:import_set_state_nolock()) ffff8c046b908800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1780340668.457594:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961075456:0@lo:39:umount.0 00010000:00010000:2.0:1780340668.458993:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340668.459004:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340668.459009:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340668.459592:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780340668.459861:0:84838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1780340668.459867:0:84838:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 3 00000004:00080000:1.0:1780340668.459880:0:84838:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:1.0:1780340668.459939:0:84838:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1780340668.459961:0:84838:0:(import.c:65:import_set_state_nolock()) ffff8c046b96f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1780340668.460192:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961075456 00000100:00100000:0.0:1780340668.460201:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961075456 00000100:00100000:0.0:1780340668.460257:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3779 00000100:00100000:0.0:1780340668.460266:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818961075456:12345-0@lo:39:umount.0 00000020:00000080:0.0:1780340668.460293:0:22660:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773863 00000100:00080000:0.0:1780340668.460312:0:22660:0:(import.c:65:import_set_state_nolock()) ffff8c04754ec800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1780340668.460330:0:22660:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378732 00000100:00100000:0.0:1780340668.460469:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3658:x1866818961075456:12345-0@lo:39:umount.0 Request processed in 203us (1169us total) trans 81604378733 rc 0/0 00000100:00100000:0.0:1780340668.460476:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3779 00010000:00010000:0.0:1780340668.460497:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1780340668.460523:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c046b908800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1780340668.460531:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961075456:0@lo:39:umount.0 00000100:00080000:1.0:1780340668.460693:0:84838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1780340668.460696:0:84838:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 3 00000004:00080000:1.0:1780340668.460704:0:84838:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:1.0:1780340668.460784:0:84838:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1780340668.460795:0:84838:0:(import.c:65:import_set_state_nolock()) ffff8c045f0c6000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1780340668.460835:0:84838:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8c03482b3380) has no exports 00000100:00100000:0.0:1780340668.461277:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961075584:0@lo:9:umount.0 00000100:00100000:0.0:1780340668.461329:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340668.461356:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961075712:0@lo:9:umount.0 00000100:00100000:0.0:1780340668.461376:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340668.461413:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961075584 00000100:00100000:0.0:1780340668.461417:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961075584 00000100:00100000:0.0:1780340668.461447:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961075712 00000100:00100000:0.0:1780340668.461450:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961075712 00000100:00100000:0.0:1780340668.461470:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5878 00000100:00100000:0.0:1780340668.461478:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818961075584:12345-0@lo:9:umount.0 00000020:00000080:0.0:1780340668.461496:0:25496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277387f 00000100:00080000:0.0:1780340668.461502:0:25496:0:(import.c:65:import_set_state_nolock()) ffff8c0485a50800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1780340668.461535:0:25496:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:0.0:1780340668.461652:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+2:3658:x1866818961075584:12345-0@lo:9:umount.0 Request processed in 174us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340668.461659:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5878 00000100:00100000:0.0:1780340668.461682:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5879 00000100:00100000:0.0:1780340668.461688:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818961075712:12345-0@lo:9:umount.0 00000020:00000080:0.0:1780340668.461700:0:25496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277389b 00000100:00080000:0.0:1780340668.461705:0:25496:0:(import.c:65:import_set_state_nolock()) ffff8c0475708800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1780340668.461727:0:25496:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:0.0:1780340668.461824:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+2:3658:x1866818961075712:12345-0@lo:9:umount.0 Request processed in 136us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340668.461830:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5879 00000100:00080000:0.0:1780340668.461865:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c046b96f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1780340668.461876:0:3658:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:0.0:1780340668.461877:0:3658:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:0.0:1780340668.461881:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961075584:0@lo:9:umount.0 00000100:00080000:0.0:1780340668.461889:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c045f0c6000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1780340668.461895:0:3658:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:0.0:1780340668.461896:0:3658:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:0.0:1780340668.461898:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961075712:0@lo:9:umount.0 00010000:00010000:0.0:1780340668.461922:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340668.461927:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340668.464556:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340668.464610:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340668.464643:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340668.464671:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340668.464694:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340668.464723:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940406912 00000100:00100000:0.0:1780340668.464733:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940406912 00000100:00100000:0.0:1780340668.464805:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940407040 00000100:00100000:0.0:1780340668.464808:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940407040 00000100:00100000:0.0:1780340668.464835:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2436 00000100:00100000:0.0:1780340668.464845:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940406912:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340668.464925:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940406912:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 82us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340668.464933:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2436 00000100:00100000:0.0:1780340668.464950:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2437 00000100:00100000:0.0:1780340668.464956:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940407040:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340668.465118:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940406656 00000100:00100000:1.0:1780340668.465123:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940406656 00000100:00100000:1.0:1780340668.465146:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940406784 00000100:00100000:1.0:1780340668.465149:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940406784 00000100:00100000:1.0:1780340668.465176:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1185 00000100:00100000:1.0:1780340668.465187:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940406784:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340668.465216:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940406784:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 29us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340668.465222:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1185 00000100:00100000:1.0:1780340668.465233:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1166 00000100:00100000:1.0:1780340668.465237:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2409:x1866818940406656:12345-192.168.203.16@tcp:400:kworker.0 00000020:00080000:1.0:1780340668.465243:0:63711:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.16@tcp 00000100:00100000:1.0:1780340668.465259:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2409:x1866818940406656:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 21us (715us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780340668.465265:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1166 00000100:00100000:0.0:1780340668.465393:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940407040:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 437us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340668.465400:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2437 00000020:00080000:1.0:1780340668.467740:0:84838:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8c03482b3380) has no exports 00000100:00080000:2.0:1780340668.472916:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340668.472938:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340668.472941:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340668.472959:0:83640:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940406528 00000100:00100000:2.0:1780340668.472969:0:83640:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940406528 00000100:00100000:2.0:1780340668.473035:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 85 00000100:00100000:2.0:1780340668.473044:0:83640:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2409:x1866818940406528:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340668.473126:0:83640:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2409:x1866818940406528:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 83us (8481us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340668.473133:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 85 00000100:00100000:0.0:1780340668.474807:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340668.474872:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940407168 00000100:00100000:2.0:1780340668.474879:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940407168 00000100:00100000:2.0:1780340668.474919:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1167 00000100:00100000:2.0:1780340668.474926:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1866818940407168:12345-192.168.203.16@tcp:38:ptlrpcd_01_00.0 00010000:02000000:2.0:1780340668.474944:0:64454:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.203.16@tcp (stopping) 00000100:00100000:2.0:1780340668.492108:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1866818940407168:12345-192.168.203.16@tcp:38:ptlrpcd_01_00.0 Request processed in 17160us (17285us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340668.492122:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1167 00000020:00000080:3.0:1780340668.510285:0:6505:0:(genops.c:906:class_export_put()) final put ffff8c0475faa800/e06e5cf1-1986-4ba7-9630-fad7efb74eca 00010000:00010000:2.0:1780340668.511285:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340668.511290:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340668.511293:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1780340668.515346:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0475faa800/e06e5cf1-1986-4ba7-9630-fad7efb74eca for lustre-MDT0000 00000020:00000080:3.0:1780340668.520745:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047651b800 for lustre-MDT0000 00000020:00000080:1.0:1780340668.543419:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773847 00000020:00000080:1.0:1780340668.543434:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c0447db6800/lustre-QMT0000_UUID 00000020:01000000:1.0:1780340668.543493:0:84838:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1780340668.546906:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340668.546922:0:84838:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1780340668.546928:0:84838:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff8c0476588000) has no exports 00000020:00000080:0.0:1780340668.547286:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0447db6800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1780340668.547737:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773840 00000020:00000080:1.0:1780340668.547747:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c04530a7800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780340668.547826:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340668.547836:0:84838:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1780340668.547839:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c0345c80000/lustre-QMT0000_UUID 00000020:00000080:1.0:1780340668.547841:0:84838:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0345c80000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1780340668.547849:0:84838:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1780340668.548476:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04530a7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1780340668.552654:0:84838:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c04441a7600 - data ffff8c04719dd798/ffff8c0476ed4800 00000020:01000000:0.0:1780340668.552848:0:84838:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c047a94d660 - data ffff8c0471b6baf8/ffff8c044d6adc00 00000100:00080000:2.0:1780340668.631558:0:84838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1780340668.631566:0:84838:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1780340668.631580:0:84838:0:(client.c:3140:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8c03498ee680 x1866818961075456/t81604378733(81604378733) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340678 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340668.631605:0:84838:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1780340668.632862:0:84838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1780340668.632867:0:84838:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 4 00000004:00080000:1.0:1780340668.632884:0:84838:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:1.0:1780340668.632886:0:84838:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1780340668.634374:0:83650:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1780340668.634379:0:83650:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x60:0x0] index 1 count 1 00000040:00080000:0.0:1780340668.634389:0:83650:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 24 count 2 00000100:00080000:1.0:1780340668.634901:0:84838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1780340668.634918:0:84838:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 4 00000004:00080000:1.0:1780340668.634932:0:84838:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:1.0:1780340668.634934:0:84838:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1780340668.635329:0:83652:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1780340668.635333:0:83652:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x62:0x0] index 1 count 1 00000040:00080000:0.0:1780340668.635340:0:83652:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 24 count 2 00000020:00000080:1.0:1780340668.636632:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773801 00000020:00000080:1.0:1780340668.636641:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c0346eee000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780340668.637254:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773816 00000020:00000080:1.0:1780340668.637261:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c04480ad000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1780340668.637267:0:84838:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1780340668.637272:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340668.637281:0:84838:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1780340668.637285:0:84838:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8c03482b0000) has no exports 00000004:01000000:1.0:1780340668.637437:0:84838:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1780340668.637445:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773894 00000020:00000080:1.0:1780340668.637449:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c047651f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1780340668.637453:0:84838:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1780340668.637456:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340668.637461:0:84838:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1780340668.637464:0:84838:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8c047ac74d40) has no exports 00000020:00000080:1.0:1780340668.637469:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277388d 00000020:00000080:1.0:1780340668.637473:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c045f0c3000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1780340668.637868:0:84838:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1780340668.637873:0:84838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1780340668.637876:0:84838:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969450 gen 5 00000004:00080000:1.0:1780340668.637882:0:84838:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:1.0:1780340668.637884:0:84838:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1780340668.637919:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340668.637925:0:84838:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780340668.637930:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773878 00000020:00000080:1.0:1780340668.637934:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c046b9ab800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1780340668.637938:0:84838:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1780340668.637942:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340668.637945:0:84838:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1780340668.637947:0:84838:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8c0471d519c0) has no exports 00000020:00000080:1.0:1780340668.637962:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773871 00000020:00000080:1.0:1780340668.637965:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c04506d1000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1780340668.638279:0:84838:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1780340668.638282:0:84838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1780340668.638285:0:84838:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 5 00000004:00080000:1.0:1780340668.638288:0:84838:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:1.0:1780340668.638290:0:84838:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1780340668.638314:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340668.638319:0:84838:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1780340668.638328:0:84838:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1780340668.638332:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277385c 00000020:00000080:1.0:1780340668.638337:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c04480af000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1780340668.638340:0:84838:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1780340668.638344:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340668.638348:0:84838:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1780340668.638350:0:84838:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8c0445ba19c0) has no exports 00000020:00000080:1.0:1780340668.638354:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773855 00000020:00000080:1.0:1780340668.638356:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c046b90d000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1780340668.639302:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0346eee000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780340668.639314:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04480ad000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1780340668.639324:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047651f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1780340668.639328:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045f0c3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780340668.639333:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c045f0c6000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1780340668.639347:0:71335:0:(genops.c:906:class_export_put()) final put ffff8c0349151800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340668.639349:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0349151800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1780340668.639352:0:71335:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340668.639433:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b9ab800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1780340668.639438:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04506d1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780340668.639442:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c046b96f000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1780340668.639446:0:71335:0:(genops.c:906:class_export_put()) final put ffff8c046b9ab000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340668.639448:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b9ab000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1780340668.639451:0:71335:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340668.639480:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04480af000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1780340668.639487:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b90d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1780340668.640269:0:84838:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1780340668.640275:0:84838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1780340668.640279:0:84838:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1780340668.640285:0:84838:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1780340668.640308:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c046b908800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1780340668.640347:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340668.640357:0:84838:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340668.640361:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c0346fd7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340668.640363:0:84838:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0346fd7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1780340668.640368:0:84838:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340668.640430:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340668.640433:0:84838:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340668.640435:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c0346fd2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340668.640437:0:84838:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0346fd2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1780340668.640440:0:84838:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340668.640498:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277381d 00000020:00000080:0.0:1780340668.640510:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c04480af800/lustre-MDD0000_UUID 00000020:01000000:0.0:1780340668.640519:0:84838:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1780340668.640527:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04480af800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1780340668.640536:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780340668.640541:0:84838:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1780340668.640545:0:84838:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8c047658cd40) has no exports 00000020:00000080:0.0:1780340668.640566:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340668.640570:0:84838:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1780340668.640572:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c04480ac000/lustre-MDD0000_UUID 00000020:00000080:0.0:1780340668.640574:0:84838:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04480ac000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1780340668.640577:0:84838:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1780340668.640607:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773824 00000020:00000080:0.0:1780340668.640621:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c04480a9000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1780340668.640635:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04480a9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1780340668.640648:0:84838:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c04858fb800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1780340668.640651:0:84838:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c04858fb800 3 00000020:01000004:0.0:1780340668.640654:0:84838:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c04858fb800 from lustre-MDT0000 00000020:00000080:0.0:1780340668.640670:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340668.640674:0:84838:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1780340668.640676:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c0452441800/lustre-MDT0000_UUID 00000020:00000080:0.0:1780340668.640678:0:84838:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0452441800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1780340668.640684:0:84838:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1780340668.640717:0:84838:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1780340668.640720:0:84838:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1780340668.640723:0:84838:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1780340668.640726:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780340668.640728:0:84838:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1780340668.640734:0:84838:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8c0470f6d800 f26f7947-2bb0-4491-8dd4-005fa8e64f3a 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1780340668.640742:0:84838:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8c0349150000 ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4 192.168.203.16@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1780340668.640746:0:84838:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8c03482b4d40) has exports, disconnecting them 00000020:00080000:0.0:1780340668.640749:0:84838:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8c0470f6d800), last request at 1780340631 00000020:00000080:0.0:1780340668.640788:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327737c2 00000020:00010000:0.0:1780340668.640792:0:84838:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c0470f6d800: total 0 00000100:00080000:0.0:1780340668.640796:0:84838:0:(import.c:65:import_set_state_nolock()) ffff8c0475fad000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1780340668.640805:0:84838:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0470f6d800): rc 0 00000020:00080000:0.0:1780340668.640808:0:84838:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.16@tcp (ffff8c0349150000), last request at 1780340631 00000020:00000080:0.0:1780340668.640843:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327737bb 00000020:00010000:0.0:1780340668.640847:0:84838:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c0349150000: total 0 00000100:00080000:0.0:1780340668.640849:0:84838:0:(import.c:65:import_set_state_nolock()) ffff8c0349152800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1780340668.640857:0:84838:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.16@tcp (ffff8c0349150000): rc 0 00000020:00080000:0.0:1780340668.640861:0:84838:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8c03482b4d40) has no exports 00000020:00010000:0.0:1780340668.640869:0:41205:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c0470f6d800: total 0 00010000:00010000:0.0:1780340668.640872:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340668.640895:0:41205:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c0470f6d800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1780340668.640922:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a32b400/0xa2465143277392e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773927 expref: 14 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.640936:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04441c5c00/0xa24651432773990 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773989 expref: 13 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.640946:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0476762a00/0xa24651432773920 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773919 expref: 12 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.640957:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c046fb21a00/0xa2465143277399e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773997 expref: 11 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.640967:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a32a600/0xa246514327739ac lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327739a5 expref: 10 pid: 83638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.640979:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a32a800/0xa2465143277393c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773935 expref: 9 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.641002:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a32ac00/0xa246514327739ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327739b3 expref: 8 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.641011:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a32ba00/0xa2465143277394a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773943 expref: 7 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.641021:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c046fb20400/0xa24651432773958 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773951 expref: 6 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.641031:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c046fb20200/0xa24651432773966 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2465143277395f expref: 5 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.641042:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c046fb21e00/0xa24651432773982 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2465143277397b expref: 4 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.641053:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c046fb21200/0xa24651432773912 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2465143277390b expref: 3 pid: 83638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.641062:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c046fb20800/0xa24651432773974 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2465143277396d expref: 2 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.641072:0:41205:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c0470f6d800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1780340668.641099:0:41205:0:(genops.c:906:class_export_put()) final put ffff8c0470f6d800/f26f7947-2bb0-4491-8dd4-005fa8e64f3a 00000020:00010000:0.0:1780340668.641108:0:41205:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c0349150000: total 1 00010000:00010000:0.0:1780340668.641127:0:41205:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c0349150000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1780340668.641142:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0476762400/0xa246514327738e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2295 expref: 5 pid: 83639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.641154:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04441c4c00/0xa246514327738f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22a3 expref: 4 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.641189:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0476762800/0xa246514327738e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced228e expref: 3 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.641202:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c046fb20a00/0xa246514327738ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced229c expref: 2 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340668.641213:0:41205:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c0349150000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1780340668.641226:0:41205:0:(genops.c:906:class_export_put()) final put ffff8c0349150000/ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4 00010000:00010000:0.0:1780340668.641230:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340668.641232:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340668.641233:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1780340668.641240:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0470f6d800/f26f7947-2bb0-4491-8dd4-005fa8e64f3a for MGS 00000020:00000080:0.0:1780340668.641260:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0349150000/ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4 for MGS 00000020:00000080:0.0:1780340668.641273:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0475fad000 for MGS 00000020:00000080:0.0:1780340668.641277:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0349152800 for MGS 00010000:00010000:2.0:1780340668.641434:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340668.641467:0:83639:0:(service.c:3186:ptlrpc_main()) ll_mgs_0001: service thread [ffff8c046ba0e600:83639] 1 exiting: rc = 0 00000100:00100000:2.0:1780340668.641551:0:83642:0:(service.c:3186:ptlrpc_main()) ll_mgs_0003: service thread [ffff8c0471ecf400:83642] 3 exiting: rc = 0 00000100:00100000:2.0:1780340668.641869:0:83640:0:(service.c:3186:ptlrpc_main()) ll_mgs_0002: service thread [ffff8c03452fe800:83640] 2 exiting: rc = 0 00000100:00100000:2.0:1780340668.641931:0:83638:0:(service.c:3186:ptlrpc_main()) ll_mgs_0000: service thread [ffff8c046ba0ee00:83638] 0 exiting: rc = 1 00000100:00100000:0.0:1780340668.642045:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642052:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642058:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642064:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642070:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642076:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642082:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642087:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642101:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642107:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642113:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642118:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642123:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642128:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642133:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642148:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642153:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642206:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642213:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642218:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642224:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642229:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642234:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642239:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642245:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642250:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642256:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642260:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642266:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642272:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642277:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642282:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642288:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642293:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642298:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642304:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642309:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642314:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642319:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642325:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642331:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642336:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642341:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642346:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642351:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642357:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642362:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642368:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642373:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642378:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642391:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642396:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642401:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642407:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642413:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642418:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642422:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642427:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642431:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642436:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642442:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642448:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642453:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340668.642458:0:84838:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1780340668.649705:0:84838:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c034776f720 - data ffff8c044d0e5288/ffff8c0448376000 00000020:01000000:0.0:1780340668.649879:0:84838:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c047a94dc60 - data ffff8c0345664438/ffff8c034aa60c00 00000020:00000080:0.0:1780340668.650301:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327737b4 00000020:00000080:0.0:1780340668.650309:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c0346fd3800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1780340668.650322:0:84838:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c04858fb800 from MGS, refs=2 00000020:01000004:0.0:1780340668.650326:0:84838:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c04858fb800 2 00000020:01000004:0.0:1780340668.650328:0:84838:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c04858fb800 from MGS 00000020:00000080:0.0:1780340668.650348:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340668.650355:0:84838:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1780340668.650357:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c0346fd0800/MGS 00000020:00000080:0.0:1780340668.650359:0:84838:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0346fd0800/MGS for MGS 00000020:01000000:0.0:1780340668.650365:0:84838:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1780340668.650432:0:84838:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1780340668.650437:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780340668.650443:0:84838:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1780340668.650449:0:84838:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8c034a94e000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1780340668.650455:0:84838:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff8c047ac70000) has exports, disconnecting them 00000020:00080000:0.0:1780340668.650460:0:84838:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8c034a94e000), last request at 1780340632 00000020:00000080:0.0:1780340668.650464:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327738d3 00000020:00080000:0.0:1780340668.650486:0:84838:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c034a94e000): rc 0 00000020:00000080:0.0:1780340668.650491:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c034a94e000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1780340668.651374:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0346fd3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1780340668.651385:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c034a94e000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1780340668.684870:0:84838:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1780340668.684879:0:84838:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1780340668.684883:0:84838:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1780340668.684891:0:84838:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780340668.684923:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c034a948800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1780340668.685054:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780340668.685064:0:84838:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1780340668.685069:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c046ba23800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1780340668.685074:0:84838:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046ba23800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1780340668.685082:0:84838:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1780340668.685169:0:84838:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c04858fb800 1 00000020:00000080:2.0:1780340668.685176:0:84838:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327737a6 00000020:00000080:2.0:1780340668.685182:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c0346fd1800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1780340668.685190:0:84838:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1780340668.685196:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0346fd1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1780340668.685204:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780340668.685208:0:84838:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1780340668.685211:0:84838:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8c0471d54d40) has no exports 00000100:00100000:2.0:1780340668.811691:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961075840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340668.811783:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340668.811838:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961075840 00000100:00100000:2.0:1780340668.811846:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961075840 00000100:00100000:2.0:1780340668.811885:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3780 00000100:00100000:2.0:1780340668.811892:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3660:x1866818961075840:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1780340668.811900:0:8410:0:(tgt_handler.c:804:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1780340668.811967:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3660:x1866818961075840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (183us total) trans 0 rc -107/-107 00000100:00100000:2.0:1780340668.811974:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3780 00000100:02020000:2.0:1780340668.812013:0:3660:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1780340668.812018:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1780340668.812023:0:3660:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1780340668.812027:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1780340668.816949:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961075968:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340668.818475:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340668.818523:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340668.818534:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961076096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340668.818560:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340668.818598:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961075968 00000100:00100000:3.0:1780340668.818605:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961075968 00000100:00100000:3.0:1780340668.818645:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961076096 00000100:00100000:3.0:1780340668.818648:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961076096 00000100:00100000:3.0:1780340668.818670:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978 00000100:00100000:3.0:1780340668.818678:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961075968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340668.818708:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340668.818749:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961075968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340668.818757:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978 00000100:00100000:3.0:1780340668.818792:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979 00000100:00100000:3.0:1780340668.818799:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961076096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340668.818815:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340668.818840:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961076096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340668.818846:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979 00000100:00100000:3.0:1780340668.818890:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961076096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340668.818919:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961075968:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1780340668.837833:0:3660:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340668.837845:0:3660:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3417 00000100:00080000:2.0:1780340668.837855:0:3660:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340668.840020:0:3660:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a212a00 x1866818961076224/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340668.840070:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961076224:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1780340668.840249:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340668.840300:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961076224 00000100:00100000:2.0:1780340668.840308:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961076224 00000100:00100000:2.0:1780340668.840340:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3781 00000100:00100000:2.0:1780340668.840347:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961076224:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1780340668.840366:0:22660:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340668.840408:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961076224:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 60us (249us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340668.840415:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3781 00000100:00080000:2.0:1780340668.840455:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340668.840460:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340668.840463:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a212a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961076224:0@lo:38:ptlrpcd_00_01.0 00000020:00000080:0.0:1780340669.256887:0:84838:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340669.256898:0:84838:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1780340669.256903:0:84838:0:(genops.c:906:class_export_put()) final put ffff8c04858fd800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1780340669.256908:0:84838:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04858fd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1780340669.256920:0:84838:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1780340669.257022:0:84838:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8c04858f8800 00000020:02000400:0.0:1780340669.257080:0:84838:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1780340669.322842:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340670.345898:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340671.371875:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340672.393911:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340673.418991:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340673.421504:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961076608:0@lo:400:kworker.0 00000100:00100000:1.0:1780340673.421592:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340673.421664:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961076352:0@lo:400:kworker.0 00000400:00000100:2.0:1780340673.421688:0:3659:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961076352 offset 0 length 224: 4 00000100:00100000:2.0:1780340673.421718:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780340673.421724:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961076480:0@lo:400:kworker.0 00000100:00100000:2.0:1780340673.421746:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340673.421930:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961076608 00000100:00100000:0.0:1780340673.421959:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961076608 00000100:00100000:0.0:1780340673.422019:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961076480 00000100:00100000:0.0:1780340673.422022:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961076480 00000100:00100000:0.0:1780340673.422039:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:0.0:1780340673.422048:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961076608:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1780340673.422142:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340673.422168:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:2.0:1780340673.422174:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1866818961076480:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1780340673.422180:0:63712:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1780340673.422216:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1866818961076480:12345-0@lo:400:kworker.0 Request processed in 40us (468us total) trans 0 rc -107/-107 00000100:00100000:2.0:1780340673.422223:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000100:00080000:2.0:1780340673.422259:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1780340673.422264:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1780340673.422267:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1780340673.422273:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340673.422276:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3417 00000100:00080000:2.0:1780340673.422282:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340673.422303:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034933a680 x1866818961076736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340673.422322:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961076480:0@lo:400:kworker.0 00000100:00100000:2.0:1780340673.422344:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961076736:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1780340673.422368:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340673.422410:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961076736 00000100:00100000:2.0:1780340673.422414:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961076736 00000100:00100000:2.0:1780340673.422433:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:2.0:1780340673.422437:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961076736:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1780340673.422453:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340673.422482:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961076736:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 44us (113us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340673.422487:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00080000:2.0:1780340673.422510:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340673.422515:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340673.422518:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961076736:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1780340673.429193:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961076864:0@lo:400:kworker.0 00000100:00100000:3.0:1780340673.429256:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340673.429329:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961076864 00000100:00100000:3.0:1780340673.429336:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961076864 00000100:00100000:3.0:1780340673.429370:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1780340673.429377:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3662:x1866818961076864:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1780340673.429384:0:64454:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1780340673.429422:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3662:x1866818961076864:12345-0@lo:400:kworker.0 Request processed in 44us (165us total) trans 0 rc -107/-107 00000100:00100000:3.0:1780340673.429428:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00080000:3.0:1780340673.429462:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1780340673.429467:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1780340673.429470:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1780340673.429474:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340673.429477:0:3662:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3417 00000100:00080000:3.0:1780340673.429483:0:3662:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340673.429502:0:3662:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c04468f5500 x1866818961076992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340673.429532:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961076864:0@lo:400:kworker.0 00000100:00100000:3.0:1780340673.429564:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961076992:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1780340673.429597:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340673.429627:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961076992 00000100:00100000:3.0:1780340673.429630:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961076992 00000100:00100000:3.0:1780340673.429659:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:3.0:1780340673.429663:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961076992:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:3.0:1780340673.429681:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340673.429708:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961076992:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 44us (110us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340673.429714:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00080000:3.0:1780340673.429736:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340673.429740:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340673.429743:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961076992:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1780340673.436118:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961076608:12345-0@lo:400:kworker.0 Request processed in 14064us (14527us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340673.436139:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00080000:2.0:1780340673.441870:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340673.441877:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340673.441881:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340673.441889:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3448 00000100:00080000:2.0:1780340673.441894:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780340673.441901:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340673.441935:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0349338a80 x1866818961077248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340673.441974:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961077248:0@lo:38:kworker.0 00000100:00100000:3.0:1780340673.442011:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961077120:0@lo:400:kworker.0 00000100:00100000:2.0:1780340673.442066:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340673.442067:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340673.442158:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961077248 00000100:00100000:0.0:1780340673.442165:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961077248 00000100:00100000:0.0:1780340673.442199:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3782 00000100:00100000:0.0:1780340673.442206:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961077248:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340673.442233:0:8410:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340673.442701:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961076608:0@lo:400:kworker.0 00000100:00100000:1.0:1780340673.444580:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961077504:0@lo:400:kworker.0 00000100:00100000:3.0:1780340673.449018:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340673.449036:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961077376:0@lo:400:kworker.0 00000100:00100000:2.0:1780340673.449062:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961077632:0@lo:400:kworker.0 00000100:00100000:2.0:1780340673.449116:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340673.449117:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340673.449158:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961077120 00000100:00100000:2.0:1780340673.449166:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961077120 00000100:00100000:2.0:1780340673.449232:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961077632 00000100:00100000:2.0:1780340673.449235:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961077632 00000100:00100000:2.0:1780340673.449250:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1780340673.449258:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961077120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340673.449302:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961077120:12345-0@lo:400:kworker.0 Request processed in 46us (7249us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340673.449310:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1780340673.449325:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:2.0:1780340673.449328:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3662:x1866818961077632:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1780340673.449334:0:64454:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1780340673.449356:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3662:x1866818961077632:12345-0@lo:400:kworker.0 Request processed in 26us (245us total) trans 0 rc -107/-107 00000100:00100000:2.0:1780340673.449362:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00080000:2.0:1780340673.449375:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340673.449396:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1780340673.449401:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1780340673.449404:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1780340673.449409:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340673.449413:0:3662:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3417 00000100:00080000:2.0:1780340673.449418:0:3662:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340673.449443:0:3662:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034933a680 x1866818961077760/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340673.449462:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961077632:0@lo:400:kworker.0 00000100:00100000:2.0:1780340673.449495:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961077760:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1780340673.449681:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340673.449722:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961077760 00000100:00100000:2.0:1780340673.449726:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961077760 00000100:00100000:2.0:1780340673.449746:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:3.0:1780340673.449750:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961077120:0@lo:400:kworker.0 00000100:00100000:2.0:1780340673.449753:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961077760:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1780340673.449793:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340673.449831:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a212a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961077760:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 78us (150us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340673.449838:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00080000:2.0:1780340673.449863:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340673.449868:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340673.449871:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961077760:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1780340673.450803:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961077248:12345-0@lo:38:kworker.0 Request processed in 8592us (8748us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340673.450813:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3782 00000100:00100000:0.0:1780340673.450848:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961077376 00000100:00100000:0.0:1780340673.450853:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961077376 00000100:00100000:0.0:1780340673.450894:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2438 00000100:00100000:0.0:1780340673.450901:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961077376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340673.450968:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961077376:12345-0@lo:400:kworker.0 Request processed in 67us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340673.450975:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2438 00000100:00100000:0.0:1780340673.451022:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961077376:0@lo:400:kworker.0 00000100:00080000:3.0:1780340673.451463:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340673.451635:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340673.451641:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340673.451645:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961077248:0@lo:38:kworker.0 00000100:00100000:1.0:1780340673.451732:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340673.451829:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961077504 00000100:00100000:0.0:1780340673.451833:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961077504 00000100:00100000:0.0:1780340673.451966:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2439 00000100:00100000:0.0:1780340673.451974:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961077504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340673.452026:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961077504:12345-0@lo:400:kworker.0 Request processed in 53us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340673.452032:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2439 00000100:00100000:2.0:1780340673.452240:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961077504:0@lo:400:kworker.0 00000100:00080000:3.0:1780340673.460434:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340673.593044:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340673.593109:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000400:00000100:0.0:1780340673.593154:0:3652:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940407552 offset 0 length 224: 4 00000100:00100000:1.0:1780340673.593308:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940407808 00000100:00100000:1.0:1780340673.593330:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940407808 00000100:00100000:1.0:1780340673.593417:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940407680 00000100:00100000:1.0:1780340673.593421:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940407680 00000100:00100000:1.0:1780340673.593448:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1188 00000100:00100000:1.0:1780340673.593460:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940407808:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340673.593587:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940407808:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 129us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340673.593596:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1188 00000100:00100000:1.0:1780340673.593848:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1174 00000100:00100000:1.0:1780340673.593858:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940407680:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:1.0:1780340673.593884:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340673.593916:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940407680:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 58us (806us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340673.593923:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1174 00000100:00100000:0.0:1780340673.594069:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340673.594098:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940407936 00000100:00100000:0.0:1780340673.594102:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940407936 00000100:00100000:0.0:1780340673.594140:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2440 00000100:00100000:0.0:1780340673.594147:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940407936:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340673.595461:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2409:x1866818940407936:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 1304us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340673.595475:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2440 00000100:00080000:2.0:1780340673.597208:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340673.597219:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340673.607438:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340673.608453:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940408064 00000100:00100000:3.0:1780340673.608469:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940408064 00000100:00100000:3.0:1780340673.608572:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2441 00000100:00100000:3.0:1780340673.608584:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2410:x1866818940408064:12345-192.168.203.16@tcp:400:kworker.0 00000100:00080000:2.0:1780340673.608833:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340673.609517:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2410:x1866818940408064:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 930us (2089us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340673.609530:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2441 00000100:00100000:2.0:1780340673.931365:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961078016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340673.931450:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340673.931504:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340673.931512:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961077888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340673.931534:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340673.931572:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961078016 00000100:00100000:2.0:1780340673.931580:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961078016 00000100:00100000:2.0:1780340673.931633:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961077888 00000100:00100000:2.0:1780340673.931636:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961077888 00000100:00100000:2.0:1780340673.931944:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980 00000100:00100000:2.0:1780340673.931954:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961078016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340673.931988:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340673.932035:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961078016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340673.932043:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980 00000100:00100000:2.0:1780340673.932122:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981 00000100:00100000:2.0:1780340673.932130:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961077888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340673.932146:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340673.932174:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961077888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340673.932179:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981 00000100:00100000:2.0:1780340673.932223:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961077888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340673.932363:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961078016:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1780340673.933582:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780340673.933588:0:8395:0:(genops.c:906:class_export_put()) final put ffff8c0485a54800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780340673.933616:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0485a54800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1780340673.933722:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0485a50800 for lustre-OST0000 00000001:00100000:3.0:1780340673.941605:0:72681:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1780340673.941629:0:72681:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378733 is committed 00000020:00000080:3.0:1780340673.941634:0:72681:0:(genops.c:906:class_export_put()) final put ffff8c0450117800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780340673.941948:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0450117800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1780340673.942007:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c04754ec800 for lustre-MDT0001 00000001:00100000:1.0:1780340673.947186:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780340673.947195:0:9462:0:(genops.c:906:class_export_put()) final put ffff8c0475708000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780340673.949376:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0475708000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1780340673.949449:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0475708800 for lustre-OST0001 00010000:00010000:0.0:1780340674.442327:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340675.466125:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340676.490809:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340677.513948:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1780340678.538181:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340678.538186:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340678.538190:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340678.538198:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3453 00000100:00080000:1.0:1780340678.538205:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1780340678.538211:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340678.538219:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340678.538238:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961078144:0@lo:400:kworker.0 00000400:00000100:1.0:1780340678.538290:0:3662:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961078144 offset 0 length 224: 4 00000100:00100000:1.0:1780340678.538352:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03498ed880 x1866818961078272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340678.538382:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340678.538400:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340678.538402:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340678.538406:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3453 00000100:00080000:1.0:1780340678.538409:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1780340678.538412:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340678.538428:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03498c9f80 x1866818961078528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340678.538455:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340678.538458:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340678.538459:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340678.538463:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3453 00000100:00080000:1.0:1780340678.538466:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1780340678.538469:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340678.538483:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048527e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961078656:0@lo:400:kworker.0 00000100:00100000:1.0:1780340678.538523:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340678.538564:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961078400:0@lo:400:kworker.0 00000100:00100000:1.0:1780340678.538586:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340678.538978:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961078656 00000100:00100000:1.0:1780340678.538988:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961078656 00000100:00100000:1.0:1780340678.539049:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961078400 00000100:00100000:1.0:1780340678.539053:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961078400 00000100:00100000:1.0:1780340678.539134:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:1.0:1780340678.539143:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961078656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340678.539203:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961078656:12345-0@lo:400:kworker.0 Request processed in 61us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340678.539221:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:1.0:1780340678.539238:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1780340678.539244:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961078400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340678.539278:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961078400:12345-0@lo:400:kworker.0 Request processed in 34us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340678.539283:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1780340678.539325:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048527e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961078656:0@lo:400:kworker.0 00000100:00100000:1.0:1780340678.539360:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961078400:0@lo:400:kworker.0 00000100:00100000:1.0:1780340678.539395:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034a206a00 x1866818961078784/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340678.539431:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961078912:0@lo:400:kworker.0 00000100:00100000:1.0:1780340678.539464:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780340678.539510:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340678.539513:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340678.539516:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340678.539520:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3453 00000100:00080000:1.0:1780340678.539523:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1780340678.539528:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340678.539542:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047ac7e300 x1866818961079168/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340678.539566:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340678.539573:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961079040:0@lo:400:kworker.0 00000100:00100000:0.0:1780340678.539599:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961078272:0@lo:38:kworker.0 00000100:00100000:0.0:1780340678.539637:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340678.539654:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961078528:0@lo:38:kworker.0 00000100:00100000:0.0:1780340678.539673:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340678.539686:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a206a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961078784:0@lo:38:kworker.0 00000100:00100000:0.0:1780340678.539716:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340678.539733:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ac7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961079168:0@lo:38:kworker.0 00000100:00100000:0.0:1780340678.539754:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340678.540138:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961078272 00000100:00100000:0.0:1780340678.540143:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961078272 00000100:00100000:0.0:1780340678.540166:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961078528 00000100:00100000:0.0:1780340678.540169:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961078528 00000100:00100000:0.0:1780340678.540176:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961079168 00000100:00100000:0.0:1780340678.540179:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961079168 00000100:00100000:0.0:1780340678.540190:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:0.0:1780340678.540196:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961078272:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340678.540214:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340678.540248:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961078272:12345-0@lo:38:kworker.0 Request processed in 52us (611us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340678.540255:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:0.0:1780340678.540270:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1780340678.540274:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961078528:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340678.540283:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340678.540319:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961078528:12345-0@lo:38:kworker.0 Request processed in 43us (645us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340678.540325:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:0.0:1780340678.540337:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:0.0:1780340678.540341:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961079168:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340678.540350:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340678.540371:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961079168:12345-0@lo:38:kworker.0 Request processed in 29us (617us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340678.540376:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00080000:0.0:1780340678.540403:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340678.540409:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340678.540412:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961078272:0@lo:38:kworker.0 00000100:00080000:0.0:1780340678.540433:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340678.540437:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340678.540440:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961078528:0@lo:38:kworker.0 00000100:00080000:0.0:1780340678.540449:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340678.540452:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340678.540454:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ac7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961079168:0@lo:38:kworker.0 00000100:00080000:0.0:1780340678.540496:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340678.540863:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961078912 00000100:00100000:3.0:1780340678.540868:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961078912 00000100:00100000:3.0:1780340678.540906:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2442 00000100:00100000:3.0:1780340678.540913:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961078912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340678.540958:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961078912:12345-0@lo:400:kworker.0 Request processed in 47us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340678.540965:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2442 00000100:00100000:3.0:1780340678.541114:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961078784 00000100:00100000:3.0:1780340678.541119:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961078784 00000100:00100000:3.0:1780340678.541142:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3783 00000100:00100000:3.0:1780340678.541148:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961078784:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780340678.541160:0:8411:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340678.541190:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961078784:12345-0@lo:38:kworker.0 Request processed in 42us (1473us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340678.541196:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3783 00000100:00100000:3.0:1780340678.541227:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961078912:0@lo:400:kworker.0 00000100:00080000:0.0:1780340678.541471:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340678.541493:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780340678.541499:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340678.541506:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340678.541510:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a206a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961078784:0@lo:38:kworker.0 00000100:00100000:3.0:1780340678.542317:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961079040 00000100:00100000:3.0:1780340678.542323:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961079040 00000100:00100000:3.0:1780340678.542375:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2443 00000100:00100000:3.0:1780340678.542382:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961079040:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1780340678.542482:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340678.542659:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961079040:12345-0@lo:400:kworker.0 Request processed in 276us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340678.542666:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2443 00010000:00010000:2.0:1780340678.542736:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340678.542752:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961079040:0@lo:400:kworker.0 00000100:00100000:0.0:1780340678.697167:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340678.697329:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940408448 00000100:00100000:1.0:1780340678.697341:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940408448 00000100:00100000:1.0:1780340678.697424:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1191 00000100:00100000:1.0:1780340678.697435:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940408448:12345-192.168.203.16@tcp:400:kworker.0 00000400:00000100:0.0:1780340678.697604:0:3652:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940408192 offset 0 length 224: 4 00000100:00080000:2.0:1780340678.697638:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340678.700012:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940408448:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 2569us (2844us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340678.700034:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1191 00000100:00100000:0.0:1780340678.701704:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340678.701877:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340678.701992:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340678.702049:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940408320 00000100:00100000:1.0:1780340678.702059:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940408320 00000100:00100000:1.0:1780340678.702100:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1178 00000100:00100000:1.0:1780340678.702107:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940408320:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:1.0:1780340678.702131:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340678.703688:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940408576 00000100:00100000:3.0:1780340678.703724:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940408576 00000100:00100000:3.0:1780340678.703896:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940408704 00000100:00100000:3.0:1780340678.703901:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940408704 00000100:00100000:3.0:1780340678.703931:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5880 00000100:00100000:3.0:1780340678.703941:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2406:x1866818940408576:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:3.0:1780340678.703970:0:25487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773bf1 00000100:00080000:3.0:1780340678.703977:0:25487:0:(import.c:65:import_set_state_nolock()) ffff8c044d43c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780340678.706436:0:25487:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:1.0:1780340678.709200:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940408320:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 7078us (7491us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340678.709214:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1178 00000100:00100000:1.0:1780340678.709282:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5881 00000100:00100000:1.0:1780340678.709298:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2406:x1866818940408704:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:1.0:1780340678.709328:0:25490:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773bf8 00000100:00080000:1.0:1780340678.709336:0:25490:0:(import.c:65:import_set_state_nolock()) ffff8c0475709800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1780340678.709384:0:25490:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969450 00000100:00080000:2.0:1780340678.711334:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340678.711342:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1780340678.711365:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340678.711379:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340678.722285:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e06e5cf1-1986-4ba7-9630-fad7efb74eca+2:2406:x1866818940408576:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 18334us (20396us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340678.722299:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5880 00000100:00100000:1.0:1780340678.724694:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e06e5cf1-1986-4ba7-9630-fad7efb74eca+2:2406:x1866818940408704:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 15393us (22691us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340678.724707:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5881 00000100:00100000:0.0:1780340679.050236:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780340679.050256:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961079296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340679.050325:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340679.050420:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961079296 00000100:00100000:1.0:1780340679.050427:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961079296 00000100:00100000:1.0:1780340679.050477:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982 00000100:00100000:1.0:1780340679.050487:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961079296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780340679.050514:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340679.050636:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961079296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 150us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340679.050644:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982 00000100:00100000:1.0:1780340679.050689:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961079296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340679.055645:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340679.055671:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961079424:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340679.055833:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340679.056019:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961079424 00000100:00100000:3.0:1780340679.056027:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961079424 00000100:00100000:3.0:1780340679.056080:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983 00000100:00100000:3.0:1780340679.056088:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961079424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340679.056118:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340679.056169:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961079424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340679.056177:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983 00000100:00100000:2.0:1780340679.056423:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961079424:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1780340679.563664:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340680.586333:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340681.610818:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340682.637521:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1780340683.657961:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340683.657966:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340683.657970:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340683.657987:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3458 00000100:00080000:1.0:1780340683.657993:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1780340683.657999:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340683.658022:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0444225f80 x1866818961079680/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340683.658067:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340683.658071:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340683.658072:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340683.658075:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3458 00000100:00080000:1.0:1780340683.658078:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1780340683.658081:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340683.658092:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0445594e00 x1866818961079936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340683.658123:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340683.658126:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340683.658127:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340683.658131:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3458 00000100:00080000:1.0:1780340683.658133:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1780340683.658137:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340683.658151:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a846300 x1866818961080192/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340683.658170:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340683.658172:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340683.658174:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340683.658177:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3458 00000100:00080000:1.0:1780340683.658179:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1780340683.658182:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340683.658191:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a845880 x1866818961080576/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340683.658218:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961079680:0@lo:38:kworker.0 00000100:00100000:1.0:1780340683.658279:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340683.658315:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961079936:0@lo:38:kworker.0 00000100:00100000:1.0:1780340683.658336:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340683.658347:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961080320:0@lo:400:kworker.0 00000100:00100000:1.0:1780340683.658363:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961080192:0@lo:38:kworker.0 00000100:00100000:1.0:1780340683.658397:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340683.658414:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961080576:0@lo:38:kworker.0 00000100:00100000:3.0:1780340683.658442:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961079552:0@lo:400:kworker.0 00000100:00100000:1.0:1780340683.658442:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:3.0:1780340683.658465:0:3660:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961079552 offset 0 length 224: 4 00000100:00100000:1.0:1780340683.658473:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961079808:0@lo:400:kworker.0 00000100:00100000:3.0:1780340683.658485:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961080448:0@lo:400:kworker.0 00000100:00100000:1.0:1780340683.658493:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340683.658502:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340683.658509:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340683.658515:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961080064:0@lo:400:kworker.0 00000100:00100000:3.0:1780340683.658531:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961080448 00000100:00100000:1.0:1780340683.658532:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340683.658537:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961080448 00000100:00100000:1.0:1780340683.658559:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961079680 00000100:00100000:1.0:1780340683.658562:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961079680 00000100:00100000:1.0:1780340683.658576:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961079936 00000100:00100000:1.0:1780340683.658578:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961079936 00000100:00100000:3.0:1780340683.658582:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444 00000100:00100000:1.0:1780340683.658586:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961080576 00000100:00100000:1.0:1780340683.658588:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961080576 00000100:00100000:3.0:1780340683.658590:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961080448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340683.658594:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961079808 00000100:00100000:1.0:1780340683.658596:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961079808 00000100:00100000:1.0:1780340683.658610:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961080064 00000100:00100000:1.0:1780340683.658613:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961080064 00000100:00100000:1.0:1780340683.658625:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:1.0:1780340683.658630:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961079808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340683.658654:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961080448:12345-0@lo:400:kworker.0 Request processed in 66us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340683.658656:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961079808:12345-0@lo:400:kworker.0 Request processed in 27us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340683.658661:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444 00000100:00100000:1.0:1780340683.658662:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:1.0:1780340683.658675:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:1.0:1780340683.658681:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961080064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340683.658698:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961080448:0@lo:400:kworker.0 00000100:00100000:1.0:1780340683.658703:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961080064:12345-0@lo:400:kworker.0 Request processed in 24us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340683.658708:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:1.0:1780340683.658718:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:1.0:1780340683.658722:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961079680:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340683.658745:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340683.658796:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961079680:12345-0@lo:38:kworker.0 Request processed in 72us (516us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340683.658803:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:1.0:1780340683.658815:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:1.0:1780340683.658819:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961079936:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340683.658829:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340683.658849:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961079936:12345-0@lo:38:kworker.0 Request processed in 29us (513us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340683.658855:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:1.0:1780340683.658865:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:1.0:1780340683.658869:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961080576:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340683.658877:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340683.658897:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961080576:12345-0@lo:38:kworker.0 Request processed in 27us (453us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340683.658902:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:1.0:1780340683.658921:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961080192 00000100:00100000:1.0:1780340683.658924:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961080192 00000100:00100000:1.0:1780340683.658943:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3784 00000100:00100000:1.0:1780340683.658947:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961080192:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340683.658956:0:8410:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340683.658989:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961080192:12345-0@lo:38:kworker.0 Request processed in 28us (579us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340683.658994:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3784 00000100:00100000:1.0:1780340683.659030:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961080064:0@lo:400:kworker.0 00000100:00100000:1.0:1780340683.659046:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961079808:0@lo:400:kworker.0 00000100:00080000:0.0:1780340683.661220:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340683.661227:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1780340683.662496:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1780340683.663336:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340683.663345:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340683.663350:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961079680:0@lo:38:kworker.0 00000100:00080000:3.0:1780340683.663363:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340683.663367:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340683.663370:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961079936:0@lo:38:kworker.0 00000100:00080000:3.0:1780340683.663380:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340683.663383:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340683.663386:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961080192:0@lo:38:kworker.0 00000100:00080000:3.0:1780340683.663395:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340683.663399:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340683.663401:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961080576:0@lo:38:kworker.0 00000100:00100000:2.0:1780340683.668791:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340683.668830:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961080320 00000100:00100000:0.0:1780340683.668839:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961080320 00000100:00100000:0.0:1780340683.668902:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2445 00000100:00100000:0.0:1780340683.668911:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961080320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340683.668993:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961080320:12345-0@lo:400:kworker.0 Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340683.669001:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2445 00000100:00080000:1.0:1780340683.669267:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340683.669336:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961080320:0@lo:400:kworker.0 00000400:00000100:0.0:1780340683.817644:0:3652:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940408832 offset 0 length 224: 4 00000100:00100000:0.0:1780340683.817680:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340683.817818:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940409088 00000100:00100000:3.0:1780340683.817827:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940409088 00000100:00100000:3.0:1780340683.817897:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1194 00000100:00100000:3.0:1780340683.817906:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940409088:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340683.817968:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940409088:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 64us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340683.817995:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1194 00000100:00080000:0.0:1780340683.818705:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340683.835300:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340683.836414:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940408960 00000100:00100000:1.0:1780340683.836824:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940408960 00000100:00100000:1.0:1780340683.836871:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1182 00000100:00100000:1.0:1780340683.836879:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940408960:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:1.0:1780340683.836901:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340683.836958:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940408960:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 79us (1667us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340683.836965:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1182 00000100:00100000:3.0:1780340684.171879:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340684.171899:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961080704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340684.171961:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340684.172017:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961080704 00000100:00100000:3.0:1780340684.172033:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961080704 00000100:00100000:3.0:1780340684.172113:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1984 00000100:00100000:3.0:1780340684.172123:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961080704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340684.172162:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340684.172203:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961080704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340684.172210:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1984 00000100:00100000:3.0:1780340684.172249:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961080704:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1780340684.174735:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000020:00000080:0.0:1780340684.174743:0:9462:0:(genops.c:906:class_export_put()) final put ffff8c047570a000/e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000020:00000080:3.0:1780340684.175025:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047570a000/e06e5cf1-1986-4ba7-9630-fad7efb74eca for lustre-OST0001 00000020:00000080:3.0:1780340684.175080:0:49688:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0475709800 for lustre-OST0001 00000001:00100000:3.0:1780340684.177817:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000020:00000080:3.0:1780340684.177825:0:8395:0:(genops.c:906:class_export_put()) final put ffff8c044d43f000/e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000100:00100000:1.0:1780340684.179564:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340684.179585:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961080832:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340684.179644:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340684.179729:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961080832 00000100:00100000:3.0:1780340684.179736:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961080832 00000100:00100000:3.0:1780340684.179814:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1985 00000100:00100000:3.0:1780340684.179823:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961080832:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340684.179850:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000020:00000080:0.0:1780340684.179997:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c044d43f000/e06e5cf1-1986-4ba7-9630-fad7efb74eca for lustre-OST0000 00000020:00000080:0.0:1780340684.180034:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c044d43c000 for lustre-OST0000 00000100:00100000:3.0:1780340684.180091:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961080832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 268us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340684.180099:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1985 00000100:00100000:1.0:1780340684.180252:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961080832:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1780340684.687204:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340685.706368:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340686.743929:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340687.755716:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780340688.779506:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340688.779514:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340688.779519:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340688.779530:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3463 00000100:00080000:2.0:1780340688.779538:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1780340688.779546:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340688.779575:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0479d8c700 x1866818961081088/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340688.779610:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340688.779614:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340688.779616:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340688.779620:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3463 00000100:00080000:2.0:1780340688.779634:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1780340688.779638:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340688.779660:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c045ef31180 x1866818961081344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340688.779688:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340688.779691:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340688.779693:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340688.779697:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3463 00000100:00080000:2.0:1780340688.779700:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340688.779704:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340688.779718:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0346ff1c00 x1866818961081600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340688.779738:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340688.779742:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340688.779744:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340688.779747:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3463 00000100:00080000:2.0:1780340688.779750:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1780340688.779753:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340688.780026:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0346ff3480 x1866818961081984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340688.780074:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961080960:0@lo:400:kworker.0 00000400:00000100:2.0:1780340688.780141:0:3659:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961080960 offset 0 length 224: 4 00000100:00100000:2.0:1780340688.780188:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961081856:0@lo:400:kworker.0 00000100:00100000:2.0:1780340688.780227:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340688.780264:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780340688.780271:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ef33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961081216:0@lo:400:kworker.0 00000100:00100000:2.0:1780340688.780301:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340688.780330:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961081728:0@lo:400:kworker.0 00000100:00100000:2.0:1780340688.780355:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340688.780372:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780340688.780377:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961081472:0@lo:400:kworker.0 00000100:00100000:2.0:1780340688.780396:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340688.780424:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961081856 00000100:00100000:2.0:1780340688.780433:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961081856 00000100:00100000:2.0:1780340688.780491:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961081728 00000100:00100000:2.0:1780340688.780494:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961081728 00000100:00100000:2.0:1780340688.780517:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2446 00000100:00100000:2.0:1780340688.780526:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961081856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340688.780578:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961081856:12345-0@lo:400:kworker.0 Request processed in 53us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340688.780586:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2446 00000100:00100000:2.0:1780340688.780602:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2447 00000100:00100000:2.0:1780340688.780607:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961081728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340688.780632:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961081728:12345-0@lo:400:kworker.0 Request processed in 26us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340688.780638:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2447 00000100:00080000:2.0:1780340688.780652:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340688.780656:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340688.780692:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961081856:0@lo:400:kworker.0 00000100:00100000:2.0:1780340688.780719:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961081728:0@lo:400:kworker.0 00000100:00100000:2.0:1780340688.780813:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0479d8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961081088:0@lo:38:kworker.0 00000100:00100000:2.0:1780340688.780846:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340688.780865:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ef31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961081344:0@lo:38:kworker.0 00000100:00100000:2.0:1780340688.780886:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340688.780901:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961081600:0@lo:38:kworker.0 00000100:00100000:2.0:1780340688.780923:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340688.780951:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961081984:0@lo:38:kworker.0 00000100:00100000:2.0:1780340688.780973:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340688.781003:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961081216 00000100:00100000:2.0:1780340688.781007:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961081216 00000100:00100000:2.0:1780340688.781033:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961081472 00000100:00100000:2.0:1780340688.781036:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961081472 00000100:00100000:2.0:1780340688.781046:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961081088 00000100:00100000:2.0:1780340688.781048:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961081088 00000100:00100000:2.0:1780340688.781057:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961081344 00000100:00100000:2.0:1780340688.781059:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961081344 00000100:00100000:2.0:1780340688.781065:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961081984 00000100:00100000:2.0:1780340688.781067:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961081984 00000100:00100000:2.0:1780340688.781077:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1780340688.781083:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961081216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340688.781118:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961081216:12345-0@lo:400:kworker.0 Request processed in 35us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340688.781125:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1780340688.781135:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1780340688.781141:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961081472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340688.781166:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961081472:12345-0@lo:400:kworker.0 Request processed in 26us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340688.781172:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1780340688.781190:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1780340688.781195:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961081088:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340688.781216:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340688.781246:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961081088:12345-0@lo:38:kworker.0 Request processed in 49us (399us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340688.781252:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:2.0:1780340688.781262:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1780340688.781266:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961081344:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340688.781274:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340688.781294:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961081344:12345-0@lo:38:kworker.0 Request processed in 27us (406us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340688.781299:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:2.0:1780340688.781309:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:2.0:1780340688.781312:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961081984:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340688.781321:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340688.781341:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961081984:12345-0@lo:38:kworker.0 Request processed in 27us (366us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340688.781347:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:2.0:1780340688.781363:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961081600 00000100:00100000:2.0:1780340688.781367:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961081600 00000100:00100000:2.0:1780340688.781387:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3785 00000100:00100000:2.0:1780340688.781392:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961081600:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340688.781401:0:8411:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340688.781423:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961081600:12345-0@lo:38:kworker.0 Request processed in 30us (499us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340688.781438:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3785 00000100:00080000:2.0:1780340688.781456:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340688.781477:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ef33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961081216:0@lo:400:kworker.0 00000100:00100000:2.0:1780340688.781502:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961081472:0@lo:400:kworker.0 00000100:00080000:2.0:1780340688.781521:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340688.781527:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340688.781530:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961081088:0@lo:38:kworker.0 00000100:00080000:2.0:1780340688.781537:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340688.781540:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340688.781543:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ef31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961081344:0@lo:38:kworker.0 00000100:00080000:2.0:1780340688.781551:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340688.781554:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340688.781557:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961081600:0@lo:38:kworker.0 00000100:00080000:2.0:1780340688.781564:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340688.781567:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340688.781569:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961081984:0@lo:38:kworker.0 00010000:00010000:0.0:1780340688.786460:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340688.939420:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340688.939959:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940409472 00000100:00100000:0.0:1780340688.939973:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940409472 00000100:00100000:0.0:1780340688.940081:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1197 00000100:00100000:0.0:1780340688.940092:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940409472:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340688.940189:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940409472:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 97us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340688.940198:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1197 00000100:00080000:3.0:1780340688.940579:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:2.0:1780340688.953712:0:3652:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940409216 offset 0 length 520: 4 00000100:00100000:2.0:1780340688.953796:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340688.953836:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940409344 00000100:00100000:2.0:1780340688.953848:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940409344 00000100:00100000:2.0:1780340688.953899:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1186 00000100:00100000:2.0:1780340688.953911:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1866818940409344:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:2.0:1780340688.953951:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340688.954044:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1866818940409344:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 134us (246us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340688.954051:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1186 00000100:00100000:0.0:1780340689.290638:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340689.290668:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961082112:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340689.290755:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340689.292408:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961082112 00000100:00100000:3.0:1780340689.292426:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961082112 00000100:00100000:3.0:1780340689.292753:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1986 00000100:00100000:3.0:1780340689.292974:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961082112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340689.293016:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340689.293631:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961082112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 662us (2873us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340689.293641:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1986 00000100:00100000:0.0:1780340689.294120:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961082112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340689.294381:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780340689.294402:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961082240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340689.294471:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340689.321736:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961082240 00000100:00100000:3.0:1780340689.321777:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961082240 00000100:00100000:3.0:1780340689.321865:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1987 00000100:00100000:3.0:1780340689.321879:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961082240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340689.321947:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340689.322065:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961082240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 188us (27593us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340689.322073:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1987 00000100:00100000:3.0:1780340689.322143:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b883480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961082240:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1780340689.803682:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1780340690.314917:0:3659:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780340673/real 1780340673] req@ffff8c04468f5c00 x1866818961076352/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780340689 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340690.314957:0:3659:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8c04468f5c00 x1866818961076352/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780340689 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340690.314969:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1780340690.314973:0:3659:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1780340690.314976:0:3659:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.116@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1780340690.314979:0:3659:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1780340690.314982:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c04468f5c00 x1866818961076352/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780340689 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340690.315001:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c03498ee680 x1866818961078144/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340694 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340690.318422:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c047a124700 x1866818961079552/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340699 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340690.318450:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c0479d8dc00 x1866818961080960/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340704 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1780340690.318460:0:3659:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1780340690.318463:0:3659:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1780340690.318464:0:3659:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1780340690.318466:0:3659:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1780340690.318507:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0479d8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961080960:0@lo:400:kworker.0 00000100:00100000:1.0:1780340690.318513:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961076352:0@lo:400:kworker.0 00000100:00100000:1.0:1780340690.318566:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961079552:0@lo:400:kworker.0 00000100:00080000:1.0:1780340690.318591:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340690.318596:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1780340690.318599:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340690.318603:0:49688:0:(import.c:512:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 3411 00000100:00080000:1.0:1780340690.318615:0:49688:0:(import.c:626:import_select_connection()) MGC192.168.203.116@tcp: import ffff8c0475490800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340690.318653:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c04440a6300 x1866818961082368/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340690.318691:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340690.318695:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340690.318696:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340690.318700:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3468 00000100:00080000:1.0:1780340690.318703:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340690.318714:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340690.318735:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c04440a5500 x1866818961082496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340690.319437:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961082368:0@lo:250:kworker.0 00000400:00000100:2.0:1780340690.319485:0:3658:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961082368 offset 0 length 520: 4 00000100:00100000:2.0:1780340690.319517:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961082496:0@lo:38:kworker.0 00000100:00100000:2.0:1780340690.319564:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340690.319601:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961082496 00000100:00100000:2.0:1780340690.319609:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961082496 00000100:00100000:2.0:1780340690.319652:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:2.0:1780340690.319659:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961082496:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340690.319686:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340690.319724:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961082496:12345-0@lo:38:kworker.0 Request processed in 64us (159us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340690.319730:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00080000:2.0:1780340690.319778:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340690.319782:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340690.319785:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961082496:0@lo:38:kworker.0 00000100:00100000:2.0:1780340690.319805:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961082624:0@lo:400:kworker.0 00000100:00100000:2.0:1780340690.319830:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340690.319859:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961082624 00000100:00100000:2.0:1780340690.319863:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961082624 00000100:00100000:2.0:1780340690.319899:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1780340690.319906:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961082624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340690.319958:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961082624:12345-0@lo:400:kworker.0 Request processed in 52us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340690.319965:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00080000:2.0:1780340690.319983:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340690.320006:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961082624:0@lo:400:kworker.0 00000100:00100000:2.0:1780340690.320016:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961078144:0@lo:400:kworker.0 00000100:00080000:1.0:1780340690.327910:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340690.327919:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340690.327923:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340690.327941:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3468 00000100:00080000:1.0:1780340690.327946:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340690.327953:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340690.327991:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c04440a4380 x1866818961082752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340690.328035:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340690.328039:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340690.328041:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340690.328044:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3468 00000100:00080000:1.0:1780340690.328047:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340690.328051:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340690.328065:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c04440a6a00 x1866818961083008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340690.328088:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340690.328091:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340690.328093:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340690.328097:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3468 00000100:00080000:1.0:1780340690.328099:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340690.328108:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340690.328122:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a124700 x1866818961083392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340690.328166:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961082752:0@lo:38:kworker.0 00000100:00100000:1.0:1780340690.328231:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340690.328361:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961083264:0@lo:400:kworker.0 00000100:00100000:0.0:1780340690.328395:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340690.328510:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961083008:0@lo:38:kworker.0 00000100:00100000:1.0:1780340690.328551:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340690.328576:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961083392:0@lo:38:kworker.0 00000100:00100000:1.0:1780340690.328599:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340690.328663:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961083008 00000100:00100000:0.0:1780340690.328670:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961083008 00000100:00100000:0.0:1780340690.328717:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3786 00000100:00100000:0.0:1780340690.328724:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961083008:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340690.328744:0:8410:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340690.328797:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961083008:12345-0@lo:38:kworker.0 Request processed in 72us (246us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340690.328804:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3786 00000100:00080000:1.0:1780340690.329387:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340690.329393:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340690.329397:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961083008:0@lo:38:kworker.0 00000100:00100000:0.0:1780340690.330474:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961083136:0@lo:400:kworker.0 00000100:00100000:0.0:1780340690.330520:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340690.330563:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340690.330570:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961082880:0@lo:400:kworker.0 00000100:00100000:0.0:1780340690.330594:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340690.339330:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961083264 00000100:00100000:0.0:1780340690.339355:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961083264 00000100:00100000:0.0:1780340690.339424:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961083136 00000100:00100000:0.0:1780340690.339428:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961083136 00000100:00100000:0.0:1780340690.339454:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2448 00000100:00100000:0.0:1780340690.339464:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961083264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340690.339558:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961083264:12345-0@lo:400:kworker.0 Request processed in 96us (11161us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340690.339565:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2448 00000100:00100000:0.0:1780340690.339581:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2449 00000100:00100000:0.0:1780340690.339589:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961083136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340690.339619:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961083136:12345-0@lo:400:kworker.0 Request processed in 31us (9098us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340690.339625:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2449 00000100:00100000:0.0:1780340690.339705:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961083264:0@lo:400:kworker.0 00000100:00100000:0.0:1780340690.339746:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961083136:0@lo:400:kworker.0 00000100:00100000:2.0:1780340690.342566:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961082752 00000100:00100000:2.0:1780340690.342579:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961082752 00000100:00080000:2.0:1780340690.342591:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340690.342595:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340690.343154:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961083392 00000100:00100000:2.0:1780340690.343159:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961083392 00000100:00100000:2.0:1780340690.343175:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961082880 00000100:00100000:2.0:1780340690.343177:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961082880 00000100:00100000:2.0:1780340690.343209:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1780340690.343217:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961082880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340690.343302:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961082880:12345-0@lo:400:kworker.0 Request processed in 85us (12706us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340690.343309:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1780340690.343325:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:2.0:1780340690.343330:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961082752:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340690.343348:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340690.343387:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961082752:12345-0@lo:38:kworker.0 Request processed in 55us (15155us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340690.343403:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:2.0:1780340690.343415:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:2.0:1780340690.343419:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961083392:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340690.343428:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340690.343455:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961083392:12345-0@lo:38:kworker.0 Request processed in 34us (14855us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340690.343460:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00080000:2.0:1780340690.343477:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340690.343513:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961082880:0@lo:400:kworker.0 00000100:00080000:1.0:1780340690.348385:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340690.348398:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340690.348403:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961082752:0@lo:38:kworker.0 00000100:00080000:1.0:1780340690.348415:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340690.348419:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340690.348422:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a124700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961083392:0@lo:38:kworker.0 00010000:00010000:1.0:1780340690.826633:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340691.856317:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340692.876276:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340693.897913:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340694.058146:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340694.058178:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340694.059093:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940409728 00000100:00100000:1.0:1780340694.059110:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940409728 00000100:00100000:1.0:1780340694.059169:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940409600 00000100:00100000:1.0:1780340694.059172:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940409600 00000100:00100000:1.0:1780340694.059193:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1200 00000100:00100000:1.0:1780340694.059210:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a206a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940409728:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340694.059281:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a206a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940409728:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 73us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340694.059282:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1190 00000100:00100000:3.0:1780340694.059288:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1866818940409600:12345-192.168.203.16@tcp:38:kworker.0 00000100:00100000:1.0:1780340694.059288:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1200 00010000:00020000:3.0:1780340694.059307:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1780340694.059320:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340694.059334:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1866818940409600:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 45us (1155us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340694.059340:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1190 00000100:00100000:2.0:1780340694.414245:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961083520:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340694.414319:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340694.414464:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961083520 00000100:00100000:3.0:1780340694.414472:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961083520 00000100:00100000:3.0:1780340694.414538:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988 00000100:00100000:3.0:1780340694.414548:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961083520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340694.414576:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340694.414621:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961083520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340694.414628:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988 00000100:00100000:3.0:1780340694.414873:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340694.414882:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961083648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340694.414920:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1780340694.415935:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340694.416031:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961083648 00000100:00100000:2.0:1780340694.416038:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961083648 00000100:00100000:2.0:1780340694.416095:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989 00000100:00100000:2.0:1780340694.416105:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961083648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340694.416128:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340694.416178:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a845880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961083648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340694.416184:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989 00000100:00100000:2.0:1780340694.416229:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961083648:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340694.416263:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961083520:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1780340694.416334:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1780340694.922119:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1780340695.434903:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340695.434912:0:49688:0:(pinger.c:249:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1780340695.434915:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340695.434922:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340695.434926:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340695.434934:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3470 00000100:00080000:0.0:1780340695.434939:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340695.434953:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340695.434988:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03498ee680 x1866818961083776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340695.435032:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340695.435036:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340695.435037:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340695.435041:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3470 00000100:00080000:0.0:1780340695.435043:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340695.435047:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340695.435058:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03498ed880 x1866818961084032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340695.435086:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340695.435089:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340695.435091:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340695.435094:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3470 00000100:00080000:0.0:1780340695.435096:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340695.435100:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340695.435111:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03476f2300 x1866818961084288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340695.435131:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340695.435134:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340695.435135:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340695.435138:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3470 00000100:00080000:0.0:1780340695.435140:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340695.435150:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340695.435162:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03476f1f80 x1866818961084672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340695.435188:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961084544:0@lo:400:kworker.0 00000100:00100000:1.0:1780340695.435198:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961083776:0@lo:38:kworker.0 00000100:00100000:0.0:1780340695.436184:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340695.436187:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340695.436231:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961084032:0@lo:38:kworker.0 00000100:00100000:0.0:1780340695.436233:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340695.436245:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961083904:0@lo:400:kworker.0 00000100:00100000:1.0:1780340695.436260:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340695.436279:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340695.436282:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961084288:0@lo:38:kworker.0 00000100:00100000:1.0:1780340695.436314:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340695.436317:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961084160:0@lo:400:kworker.0 00000100:00100000:1.0:1780340695.436339:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961084672:0@lo:38:kworker.0 00000100:00100000:0.0:1780340695.436347:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340695.436366:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340695.436372:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780340695.436381:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961084416:0@lo:400:kworker.0 00000100:00100000:1.0:1780340695.436408:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961084544 00000100:00100000:1.0:1780340695.436416:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961084544 00000100:00100000:0.0:1780340695.436420:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340695.436459:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961084416 00000100:00100000:0.0:1780340695.436463:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961084416 00000100:00100000:1.0:1780340695.436466:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2450 00000100:00100000:1.0:1780340695.436477:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961084544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340695.436498:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2451 00000100:00100000:1.0:1780340695.436529:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961084544:12345-0@lo:400:kworker.0 Request processed in 54us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340695.436536:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2450 00000100:00100000:1.0:1780340695.436557:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961083776 00000100:00100000:1.0:1780340695.436561:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961083776 00000100:00100000:1.0:1780340695.436574:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961084032 00000100:00100000:1.0:1780340695.436576:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961084032 00000100:00100000:1.0:1780340695.436584:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961083904 00000100:00100000:1.0:1780340695.436586:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961083904 00000100:00100000:1.0:1780340695.436621:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961084160 00000100:00100000:1.0:1780340695.436624:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961084160 00000100:00100000:1.0:1780340695.436637:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961084672 00000100:00100000:1.0:1780340695.436640:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961084672 00000100:00100000:1.0:1780340695.436650:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:1.0:1780340695.436656:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961083904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340695.436687:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961083904:12345-0@lo:400:kworker.0 Request processed in 30us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340695.436693:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:1.0:1780340695.436705:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:1.0:1780340695.436711:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961084160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340695.436746:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961084160:12345-0@lo:400:kworker.0 Request processed in 36us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340695.436753:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:1.0:1780340695.436787:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1780340695.436791:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961083776:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340695.436807:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340695.436846:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961083776:12345-0@lo:38:kworker.0 Request processed in 53us (663us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340695.436852:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1780340695.436863:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:1.0:1780340695.436867:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961084032:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340695.436875:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340695.436907:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a124700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961084032:12345-0@lo:38:kworker.0 Request processed in 39us (647us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340695.436913:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:0.0:1780340695.436922:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961084416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340695.436932:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:1.0:1780340695.436937:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961084672:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340695.436947:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340695.436960:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961084416:12345-0@lo:400:kworker.0 Request processed in 454us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340695.436968:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2451 00000100:00100000:1.0:1780340695.436981:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961084672:12345-0@lo:38:kworker.0 Request processed in 41us (614us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340695.436988:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:1.0:1780340695.437016:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961084288 00000100:00100000:1.0:1780340695.437020:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961084288 00000100:00100000:1.0:1780340695.437046:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3787 00000100:00100000:1.0:1780340695.437051:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961084288:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340695.437060:0:8411:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340695.437085:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961084288:12345-0@lo:38:kworker.0 Request processed in 34us (771us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340695.437091:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3787 00000100:00080000:1.0:1780340695.437117:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340695.437142:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961084416:0@lo:400:kworker.0 00000100:00100000:1.0:1780340695.437153:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961084160:0@lo:400:kworker.0 00000100:00100000:1.0:1780340695.437362:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961083904:0@lo:400:kworker.0 00000100:00100000:1.0:1780340695.437373:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961084544:0@lo:400:kworker.0 00000100:00080000:3.0:1780340695.438472:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340695.438478:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340695.438482:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961083776:0@lo:38:kworker.0 00000100:00080000:3.0:1780340695.438491:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340695.438494:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340695.438497:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961084032:0@lo:38:kworker.0 00000100:00080000:3.0:1780340695.438506:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340695.438509:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340695.438511:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961084288:0@lo:38:kworker.0 00000100:00080000:3.0:1780340695.438518:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340695.438521:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340695.438524:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961084672:0@lo:38:kworker.0 00010000:00010000:2.0:1780340695.946202:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1780340696.064391:0:85461:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1780340696.064396:0:85461:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1780340696.064398:0:85461:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1780340696.064518:0:85461:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8c0351bee800 00000020:01000004:1.0:1780340696.064533:0:85461:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1780340696.064547:0:85461:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1780340696.064560:0:85461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8c0445ba19c0) 00000020:00000080:1.0:1780340696.064581:0:85461:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1780340696.165071:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1780340696.165927:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1780340696.171597:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1780340696.172158:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1780340696.172339:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1780340696.172506:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1780340696.172665:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1780340696.173004:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1780340696.173226:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1780340696.173388:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1780340696.173599:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1780340696.173998:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1780340696.174211:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1780340696.174373:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1780340696.174572:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1780340696.175050:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1780340696.175218:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1780340696.175513:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1780340696.175676:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1780340696.176058:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1780340696.176266:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1780340696.176430:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1780340696.176626:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1780340696.176916:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1780340696.177156:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1780340696.177320:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1780340696.177481:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1780340696.177687:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1780340696.178063:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1780340696.178226:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1780340696.178418:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1780340696.178614:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1780340696.178903:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1780340696.179173:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1780340696.183269:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1780340696.184343:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1780340696.184546:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1780340696.185393:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1780340696.185644:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1780340696.186588:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1780340696.187462:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1780340696.187742:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1780340696.188072:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1780340696.188333:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1780340696.188620:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1780340696.188835:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1780340696.189185:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1780340696.190322:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1780340696.190707:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1780340696.190904:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1780340696.194715:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1780340696.195105:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1780340696.195286:0:85461:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:3.0:1780340696.196242:0:85461:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1780340696.196448:0:85461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1780340696.196456:0:85461:0:(osd_handler.c:8933:osd_obd_connect()) connect #0 00000020:00000080:3.0:1780340696.196467:0:85461:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432773d4f 00000020:01000004:3.0:1780340696.196473:0:85461:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1780340696.196484:0:85461:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1780340696.196489:0:85461:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c0351bee800 from MGS 00000020:01000004:3.0:1780340696.196492:0:85461:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1780340696.196501:0:85461:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8c047658b380) 00000020:00000080:3.0:1780340696.196512:0:85461:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1780340696.196572:0:85461:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0351bee800 from MGS, refs=2 00080000:01000000:3.0:1780340696.196576:0:85461:0:(osd_handler.c:8933:osd_obd_connect()) connect #1 00000020:00000080:3.0:1780340696.196581:0:85461:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432773d5d 00010000:00010000:3.0:1780340696.196699:0:85461:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1780340696.202309:0:85461:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1780340696.202991:0:85465:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1780340696.203031:0:85461:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1780340696.203061:0:85461:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1780340696.203631:0:85461:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1780340696.204559:0:85461:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1780340696.204695:0:85461:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1780340696.204700:0:85461:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1780340696.205387:0:85461:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1780340696.205397:0:85461:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1780340696.205648:0:85461:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1780340696.205653:0:85461:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1780340696.207574:0:85461:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1780340696.207597:0:85461:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1780340696.207598:0:85461:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.116@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1780340696.207602:0:85461:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.116@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1780340696.207607:0:85461:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8c0475490800 already not connected (conn 60, was 0): CONNECTING 00000100:00100000:0.0:1780340696.207612:0:85461:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00010000:00010000:2.0:1780340696.970732:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340697.994514:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340699.018302:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340699.181958:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340699.182005:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340699.182076:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940409856 00000100:00100000:2.0:1780340699.182085:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340699.182099:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940409856 00000100:00100000:3.0:1780340699.182140:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:3.0:1780340699.182149:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476321450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2406:x1866818940409856:12345-192.168.203.16@tcp:250:kworker.0 00010000:00080000:3.0:1780340699.182175:0:85466:0:(ldlm_lib.c:1430:target_handle_connect()) MGS: connection from ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4@192.168.203.16@tcp t0 exp 0000000000000000 cur 3479 last 0 00000020:00000080:3.0:1780340699.182200:0:85466:0:(genops.c:1406:class_connect()) connect: client ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4, cookie 0xa24651432773d64 00000100:00080000:3.0:1780340699.182325:0:85466:0:(import.c:65:import_set_state_nolock()) ffff8c046b96f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340699.182402:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476321450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+4:2406:x1866818940409856:12345-192.168.203.16@tcp:250:kworker.0 Request processed in 253us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340699.182410:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:0.0:1780340699.182548:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940410112 00000100:00100000:0.0:1780340699.182553:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940410112 00000100:00100000:0.0:1780340699.182612:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940409984 00000100:00100000:0.0:1780340699.182625:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940409984 00000100:00100000:0.0:1780340699.182646:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1203 00000100:00100000:0.0:1780340699.182657:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940410112:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340699.182707:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940410112:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 53us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340699.182714:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1203 00000100:00100000:0.0:1780340699.182729:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1194 00000100:00100000:0.0:1780340699.182733:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ef31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940409984:12345-192.168.203.16@tcp:38:kworker.0 00000100:00080000:3.0:1780340699.183117:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00020000:0.0:1780340699.183271:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340699.183567:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ef31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940409984:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 829us (1479us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340699.183575:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1194 00000100:00100000:0.0:1780340699.530245:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ef33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961084800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340699.530318:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340699.530398:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961084800 00000100:00100000:0.0:1780340699.530418:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961084800 00000100:00100000:0.0:1780340699.530490:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1990 00000100:00100000:0.0:1780340699.530502:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961084800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340699.530534:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340699.530585:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961084800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340699.530595:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1990 00000100:00080000:0.0:1780340699.530627:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340699.530670:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ef33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961084800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340699.530967:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340699.530978:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961084928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340699.531016:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340699.531078:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961084928 00000100:00100000:3.0:1780340699.531083:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961084928 00000100:00100000:3.0:1780340699.531124:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991 00000100:00100000:3.0:1780340699.531133:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961084928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340699.531152:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340699.531207:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961084928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340699.531215:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991 00000100:00100000:3.0:1780340699.531263:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961084928:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1780340699.532093:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1780340700.042778:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340700.458136:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340700.458845:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940410240 00000100:00100000:3.0:1780340700.458865:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940410240 00000100:00100000:3.0:1780340700.458931:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:3.0:1780340700.458941:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476320450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+4:41995:x1866818940410240:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340700.458980:0:85468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340700.459001:0:85468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0440031c00/0xa24651432773d6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2305 expref: -99 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.459029:0:85468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0440031c00/0xa24651432773d6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2305 expref: 5 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.459039:0:85468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0440031c00/0xa24651432773d6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2305 expref: 5 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.459047:0:85468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440031c00, rc 0) 00000100:00100000:3.0:1780340700.459115:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476320450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+5:41995:x1866818940410240:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 176us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340700.459123:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:2.0:1780340700.478379:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340700.488483:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940410368 00000100:00100000:3.0:1780340700.488497:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940410368 00000100:00100000:3.0:1780340700.488562:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:3.0:1780340700.488572:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476321850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+5:41995:x1866818940410368:12345-192.168.203.16@tcp:256:ll_cfg_requeue.0 00000100:00100000:3.0:1780340700.488663:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476321850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+5:41995:x1866818940410368:12345-192.168.203.16@tcp:256:ll_cfg_requeue.0 Request processed in 92us (10294us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780340700.488671:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:1.0:1780340700.505101:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340700.506329:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940410496 00000100:00100000:2.0:1780340700.506341:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940410496 00000100:00100000:2.0:1780340700.506413:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:2.0:1780340700.506425:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046f953450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+5:41995:x1866818940410496:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340700.506441:0:85467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340700.506462:0:85467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04722ae800/0xa24651432773d72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced230c expref: -99 pid: 85467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.506502:0:85467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04722ae800/0xa24651432773d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced230c expref: 6 pid: 85467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.506512:0:85467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04722ae800/0xa24651432773d72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced230c expref: 6 pid: 85467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.506521:0:85467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722ae800, rc 0) 00000100:00100000:2.0:1780340700.506588:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046f953450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+6:41995:x1866818940410496:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 166us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340700.506595:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:0.0:1780340700.510577:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340700.510649:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940410624 00000100:00100000:2.0:1780340700.510658:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940410624 00000100:00100000:2.0:1780340700.510707:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:2.0:1780340700.510715:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+6:41995:x1866818940410624:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 10000000:01000000:0.0:1780340700.512281:0:85471:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1780340700.512384:0:85468:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 108 20000000:01000000:2.0:1780340700.515535:0:85472:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1780340700.515543:0:85472:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1780340700.515546:0:85472:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1780340700.515549:0:85472:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1780340700.516475:0:85472:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1780340700.518110:0:85468:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1780340700.518287:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+7:41995:x1866818940410624:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 7566us (7712us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340700.518298:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:0.0:1780340700.529471:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340700.529653:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940410752 00000100:00100000:3.0:1780340700.529663:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940410752 00000100:00100000:3.0:1780340700.529740:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:3.0:1780340700.529750:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+7:41995:x1866818940410752:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340700.529922:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+7:41995:x1866818940410752:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 173us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340700.529930:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:1.0:1780340700.535666:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340700.536445:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940410880 00000100:00100000:3.0:1780340700.536456:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940410880 00000100:00100000:3.0:1780340700.536516:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:3.0:1780340700.536525:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446c5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+7:41995:x1866818940410880:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340700.536540:0:85468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340700.536559:0:85468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0440031400/0xa24651432773d79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2313 expref: -99 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.536584:0:85468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0440031400/0xa24651432773d79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2313 expref: 8 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.536594:0:85468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0440031400/0xa24651432773d79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2313 expref: 8 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.536602:0:85468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440031400, rc 0) 00000100:00100000:3.0:1780340700.536662:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446c5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940410880:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 138us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340700.536668:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:1.0:1780340700.541608:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340700.541799:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940411008 00000100:00100000:0.0:1780340700.541809:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940411008 00000100:00100000:0.0:1780340700.541870:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:0.0:1780340700.541880:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940411008:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340700.542030:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940411008:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 151us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340700.542038:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:0.0:1780340700.545335:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340700.545429:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940411136 00000100:00100000:2.0:1780340700.545439:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940411136 00000100:00100000:2.0:1780340700.545491:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:2.0:1780340700.545501:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0345379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940411136:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340700.545654:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0345379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940411136:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 153us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340700.545662:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:1.0:1780340700.551583:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340700.552039:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940411264 00000100:00100000:3.0:1780340700.552048:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940411264 00000100:00100000:3.0:1780340700.552099:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:3.0:1780340700.552108:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034537b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940411264:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340700.552287:0:85468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340700.552301:0:85468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0440031000/0xa24651432773d80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced231a expref: -99 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.552327:0:85468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0440031000/0xa24651432773d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced231a expref: 9 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.552337:0:85468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0440031000/0xa24651432773d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced231a expref: 9 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.552345:0:85468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440031000, rc 0) 00000100:00100000:3.0:1780340700.552447:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034537b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:41995:x1866818940411264:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 340us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340700.552454:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:2.0:1780340700.554283:0:3658:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780340690/real 1780340690] req@ffff8c04440a6300 x1866818961082368/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780340700 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340700.554311:0:3658:0:(client.c:2511:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c04440a6300 x1866818961082368/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780340700 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340700.554330:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340700.554355:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1780340700.554379:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961082368:0@lo:250:kworker.0 00000100:00080000:3.0:1780340700.554894:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340700.554900:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1780340700.554902:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340700.554906:0:49688:0:(import.c:512:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 3470 00000100:00080000:3.0:1780340700.554911:0:49688:0:(import.c:591:import_select_connection()) MGC192.168.203.116@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1780340700.554917:0:49688:0:(import.c:626:import_select_connection()) MGC192.168.203.116@tcp: import ffff8c0475490800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340700.554945:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a846300 x1866818961085056/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340700.554968:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340700.554972:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340700.554973:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340700.554976:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3475 00000100:00080000:3.0:1780340700.554991:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340700.554995:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340700.555014:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a845500 x1866818961085184/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340700.555044:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340700.555048:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340700.555049:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340700.555052:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3475 00000100:00080000:3.0:1780340700.555054:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340700.555057:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340700.555068:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034933a680 x1866818961085440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340700.555089:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340700.555092:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340700.555093:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340700.555097:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3475 00000100:00080000:3.0:1780340700.555099:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340700.555102:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340700.555114:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046ba2ed80 x1866818961085696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340700.555257:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340700.555260:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340700.555262:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340700.555265:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3475 00000100:00080000:3.0:1780340700.555273:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340700.555276:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340700.555288:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0348a6b800 x1866818961086080/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340700.555314:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961085952:0@lo:400:kworker.0 00000100:00100000:3.0:1780340700.555374:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340700.555517:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340700.555524:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961085312:0@lo:400:kworker.0 00000100:00100000:3.0:1780340700.555550:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340700.555579:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961085824:0@lo:400:kworker.0 00000100:00100000:3.0:1780340700.555602:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340700.555617:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340700.555623:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961085568:0@lo:400:kworker.0 00000100:00100000:3.0:1780340700.555968:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340700.556002:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961085952 00000100:00100000:3.0:1780340700.556009:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961085952 00000100:00100000:3.0:1780340700.556045:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961085824 00000100:00100000:3.0:1780340700.556048:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961085824 00000100:00100000:3.0:1780340700.556067:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2452 00000100:00100000:3.0:1780340700.556075:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961085952:12345-0@lo:400:kworker.0 10000000:01000000:1.0:1780340700.556261:0:85461:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1780340700.556276:0:85461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04441c5e00/0xa246514327739a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa246514327739ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340700.556286:0:85461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04441c5e00/0xa246514327739a5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa246514327739ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340700.556293:0:85461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1780340700.556303:0:85461:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340700.556310:0:85461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04441c5e00/0xa246514327739a5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa246514327739ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.556325:0:85461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0476763000/0xa2465143277390b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773912 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340700.556331:0:85461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0476763000/0xa2465143277390b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773912 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340700.556336:0:85461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340700.556339:0:85461:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340700.556342:0:85461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0476763000/0xa2465143277390b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773912 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.556349:0:85461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04441c5800/0xa24651432773927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xa2465143277392e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340700.556377:0:85461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04441c5800/0xa24651432773927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xa2465143277392e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340700.556382:0:85461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340700.556385:0:85461:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340700.556389:0:85461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04441c5800/0xa24651432773927 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xa2465143277392e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.556484:0:85461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c047a32ae00/0xa24651432773951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773958 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340700.556490:0:85461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c047a32ae00/0xa24651432773951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773958 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340700.556495:0:85461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340700.556498:0:85461:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340700.556501:0:85461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c047a32ae00/0xa24651432773951 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773958 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.556509:0:85461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa2465143277395f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773966 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340700.556515:0:85461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa2465143277395f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773966 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340700.556520:0:85461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340700.556523:0:85461:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340700.556526:0:85461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa2465143277395f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773966 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.556545:0:85461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04441c5200/0xa2465143277397b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773982 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340700.556551:0:85461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04441c5200/0xa2465143277397b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773982 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340700.556556:0:85461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340700.556560:0:85461:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340700.556563:0:85461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04441c5200/0xa2465143277397b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773982 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.556571:0:85461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432773989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773990 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340700.556577:0:85461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432773989 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773990 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340700.556582:0:85461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340700.556585:0:85461:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340700.556588:0:85461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432773989 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773990 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.556597:0:85461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04441c5600/0xa246514327739b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa246514327739ba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340700.556603:0:85461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04441c5600/0xa246514327739b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa246514327739ba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340700.556608:0:85461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340700.556617:0:85461:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340700.556621:0:85461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04441c5600/0xa246514327739b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa246514327739ba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.556632:0:85461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04441c4600/0xa24651432773919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773920 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340700.556718:0:85461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04441c4600/0xa24651432773919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773920 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340700.556724:0:85461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340700.556728:0:85461:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340700.556817:0:85461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04441c4600/0xa24651432773919 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773920 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.556833:0:85461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0476763400/0xa24651432773935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa2465143277393c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340700.556840:0:85461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0476763400/0xa24651432773935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa2465143277393c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340700.556845:0:85461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340700.556848:0:85461:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340700.556864:0:85461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0476763400/0xa24651432773935 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa2465143277393c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.556875:0:85461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c046fb21600/0xa24651432773943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xa2465143277394a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340700.556881:0:85461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c046fb21600/0xa24651432773943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xa2465143277394a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340700.556896:0:85461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1780340700.556900:0:85461:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340700.556904:0:85461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c046fb21600/0xa24651432773943 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xa2465143277394a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.556913:0:85461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04441c5a00/0xa2465143277396d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773974 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340700.556919:0:85461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04441c5a00/0xa2465143277396d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773974 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340700.556924:0:85461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1780340700.556927:0:85461:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340700.556930:0:85461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04441c5a00/0xa2465143277396d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773974 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.556937:0:85461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04441c5400/0xa24651432773997 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa2465143277399e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340700.556943:0:85461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04441c5400/0xa24651432773997 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa2465143277399e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340700.556948:0:85461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1780340700.556951:0:85461:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1780340700.556954:0:85461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04441c5400/0xa24651432773997 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa2465143277399e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1780340700.556968:0:85461:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8c0475490800 already not connected (conn 61, was 0): CONNECTING 00000100:00080000:1.0:1780340700.556972:0:85461:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1780340700.557002:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961085312 00000100:00100000:1.0:1780340700.557006:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961085312 00000100:00100000:1.0:1780340700.557041:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961085568 00000100:00100000:1.0:1780340700.557044:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961085568 00000100:00100000:1.0:1780340700.557065:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:1.0:1780340700.557071:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961085312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340700.557112:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961085312:12345-0@lo:400:kworker.0 Request processed in 40us (1560us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340700.557119:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:3.0:1780340700.557529:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961085952:12345-0@lo:400:kworker.0 Request processed in 46us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340700.557539:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2452 00000100:00100000:3.0:1780340700.557557:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2453 00000100:00100000:3.0:1780340700.557565:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961085824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340700.557601:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961085824:12345-0@lo:400:kworker.0 Request processed in 39us (1999us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340700.557614:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2453 00000100:00100000:2.0:1780340700.557891:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961085056:0@lo:250:kworker.0 00000100:00100000:2.0:1780340700.557929:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340700.557959:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961085184:0@lo:38:kworker.0 00000100:00100000:2.0:1780340700.557984:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340700.558001:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961085440:0@lo:38:kworker.0 00000100:00100000:2.0:1780340700.558021:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340700.558031:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961085696:0@lo:38:kworker.0 00000100:00100000:2.0:1780340700.558051:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340700.558068:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961086080:0@lo:38:kworker.0 00000100:00100000:2.0:1780340700.558087:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340700.558111:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961085184 00000100:00100000:2.0:1780340700.558115:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961085184 00000100:00100000:3.0:1780340700.558275:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961085824:0@lo:400:kworker.0 00000100:00100000:3.0:1780340700.558314:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349338a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961085312:0@lo:400:kworker.0 00000100:00100000:3.0:1780340700.558326:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961085952:0@lo:400:kworker.0 00000100:00100000:3.0:1780340700.558372:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961085056 00000100:00100000:3.0:1780340700.558375:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961085056 00000100:00100000:1.0:1780340700.558628:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961085440 00000100:00100000:1.0:1780340700.558632:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961085440 00000100:00100000:2.0:1780340700.558728:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961086080 00000100:00100000:2.0:1780340700.558740:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961086080 00000100:00100000:2.0:1780340700.558754:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:1.0:1780340700.558877:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:1.0:1780340700.558882:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ef33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961085184:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340700.558900:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340700.558971:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1780340700.558977:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0345378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3658:x1866818961085056:12345-0@lo:250:kworker.0 00010000:00080000:3.0:1780340700.558994:0:85467:0:(ldlm_lib.c:1430:target_handle_connect()) MGS: connection from f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo t0 exp 0000000000000000 cur 3480 last 0 00000020:00000080:3.0:1780340700.559020:0:85467:0:(genops.c:1406:class_connect()) connect: client f26f7947-2bb0-4491-8dd4-005fa8e64f3a, cookie 0xa24651432773d87 00000100:00080000:3.0:1780340700.559154:0:85467:0:(import.c:65:import_set_state_nolock()) ffff8c047a95a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340700.561883:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961085568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340700.561971:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961085568:12345-0@lo:400:kworker.0 Request processed in 120us (6002us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340700.561994:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:2.0:1780340700.562025:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1780340700.562030:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961086080:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340700.562049:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340700.562620:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ef33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961085184:12345-0@lo:38:kworker.0 Request processed in 3735us (4633us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340700.562628:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:1.0:1780340700.562654:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:1.0:1780340700.562658:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961085440:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340700.562669:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340700.563482:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0345378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:3658:x1866818961085056:12345-0@lo:250:kworker.0 Request processed in 4501us (5549us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340700.563492:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961086080:12345-0@lo:38:kworker.0 Request processed in 1458us (5401us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340700.563496:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1780340700.563506:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1780340700.563545:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961085696 00000100:00100000:2.0:1780340700.563552:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961085696 00000100:00100000:0.0:1780340700.563580:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340700.563588:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349339180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961085568:0@lo:400:kworker.0 00000100:00100000:2.0:1780340700.563588:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3788 00000100:00100000:2.0:1780340700.563598:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961085696:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340700.563612:0:8410:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340700.563619:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940411392 00000100:00100000:3.0:1780340700.563622:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940411392 00000100:00100000:2.0:1780340700.563649:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961085696:12345-0@lo:38:kworker.0 Request processed in 52us (5596us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340700.563657:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3788 00000100:00100000:3.0:1780340700.563663:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:3.0:1780340700.563672:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0345379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:41995:x1866818940411392:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00080000:2.0:1780340700.563687:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.116@tcp: connect to target with instance 0 10000000:01000000:2.0:1780340700.563697:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:2.0:1780340700.563703:0:3658:0:(import.c:1286:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0xa24651432773d87 00000100:00100000:3.0:1780340700.563779:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0345379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:41995:x1866818940411392:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 90us (183us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780340700.563786:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00080000:3.0:1780340700.563999:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340700.572874:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961085440:12345-0@lo:38:kworker.0 Request processed in 10205us (14843us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340700.572888:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00080000:2.0:1780340700.575598:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:2.0:1780340700.575609:0:3658:0:(import.c:1675:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:2.0:1780340700.576064:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a846300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961085056:0@lo:250:kworker.0 00000100:00080000:2.0:1780340700.576096:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340700.576100:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340700.576104:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961085184:0@lo:38:kworker.0 00000100:00080000:2.0:1780340700.576112:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340700.576121:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340700.576135:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961085440:0@lo:38:kworker.0 00000100:00080000:2.0:1780340700.576147:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340700.576150:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340700.576152:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961085696:0@lo:38:kworker.0 00000100:00080000:2.0:1780340700.576160:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340700.576163:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340700.576166:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961086080:0@lo:38:kworker.0 00000100:00080000:2.0:1780340700.576217:0:85461:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished EVICTED, rc = 0 00000020:01000004:2.0:1780340700.576228:0:85461:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1780340700.576261:0:85461:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1780340700.576266:0:85461:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1780340700.576368:0:85461:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1780340700.576397:0:85461:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.116@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1780340700.576401:0:85461:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1780340700.576402:0:85461:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1780340700.576404:0:85461:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340700.576405:0:85461:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340700.576406:0:85461:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340700.576407:0:85461:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340700.576409:0:85461:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780340700.576410:0:85461:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1780340700.576411:0:85461:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340700.576412:0:85461:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1780340700.576414:0:85461:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1780340700.576416:0:85461:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1780340700.576418:0:85461:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1780340700.576418:0:85461:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340700.576419:0:85461:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340700.576420:0:85461:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340700.576421:0:85461:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340700.576422:0:85461:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780340700.576426:0:85461:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1780340700.576427:0:85461:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340700.576428:0:85461:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1780340700.576450:0:85461:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1780340700.576462:0:85461:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0444c90780 going to sleep for 0 seconds 00000100:00100000:2.0:1780340700.576466:0:85461:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961086208:0@lo:253:mount.lustre.0 00000020:00080000:2.0:1780340700.576477:0:85461:0:(tgt_mount.c:1425:server_register_target()) lustre-MDT0000: error registering with the MGS: rc = -108 (not fatal) 00000020:01000004:2.0:1780340700.576485:0:85461:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c0351bee800 from lustre-MDT0000 10000000:01000000:2.0:1780340700.576502:0:85461:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1780340700.576504:0:85461:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1780340700.576512:0:85461:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c0351bee800 10000000:01000000:2.0:1780340700.577332:0:85461:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1780340700.577340:0:85461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c0351bee800 10000000:01000000:2.0:1780340700.577346:0:85461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1780340700.577350:0:85461:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8c0351bee800 from 1 10000000:01000000:2.0:1780340700.577352:0:85461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1780340700.577430:0:85461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773d8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.577440:0:85461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773d8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.577449:0:85461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773d8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340700.577461:0:85461:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345fe83c0 going to sleep for 0 seconds 00000100:00100000:2.0:1780340700.577466:0:85461:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961086336:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780340700.577474:0:85461:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773d8e lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.577482:0:85461:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773d8e lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.577496:0:85461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773d8e lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.577502:0:85461:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773d8e lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.577509:0:85461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773d8e lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.579079:0:85461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722aee00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:2.0:1780340700.579088:0:85461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773d8e lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.579100:0:85461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773d8e lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120e400000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340700.579107:0:85461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773d8e lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120f400000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340700.579112:0:85461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340700.579116:0:85461:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:1.0:1780340700.579262:0:85473:0:(import.c:1599:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.203.116@tcp to MGS@0@lo 00000100:00100000:1.0:1780340700.579267:0:85473:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1780340700.579270:0:85473:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1780340700.579299:0:85461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773d8e lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.579308:0:85461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773d8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340700.579329:0:85461:0:(mgc_request.c:1816:mgc_process_log()) Can't get cfg lock: -108 00000100:00080000:2.0:1780340700.579332:0:85461:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:EVICTED 00000100:00080000:3.0:1780340700.580952:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level EVICTED/10 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340700.580959:0:49688:0:(pinger.c:249:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:1.0:1780340700.581788:0:85473:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:1.0:1780340700.581810:0:85473:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from RECOVER to FULL 10000000:01000000:1.0:1780340700.581813:0:85473:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1780340700.581833:0:85473:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:1.0:1780340700.581837:0:85473:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) MGC192.168.203.116@tcp: Connection restored to 0@lo (at 0@lo) 00000020:01000000:0.0:1780340700.581982:0:49688:0:(tgt_mount.c:1581:tgt_import_update()) NID #0: 192.168.203.116@tcp 10000000:01000000:0.0:1780340700.582002:0:49688:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1780340700.582005:0:49688:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1780340700.582007:0:49688:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1780340700.582008:0:49688:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340700.582010:0:49688:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780340700.582018:0:49688:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340700.582019:0:49688:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340700.582020:0:49688:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1780340700.582022:0:49688:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780340700.582024:0:49688:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1780340700.582105:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961086464:0@lo:253:kworker.0 00000100:00100000:3.0:1780340700.582173:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340700.582218:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961086464 00000100:00100000:1.0:1780340700.582226:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961086464 00000020:01000000:0.0:1780340700.582237:0:49688:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1780340700.582246:0:49688:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1780340700.582247:0:49688:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1780340700.582248:0:49688:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1780340700.582249:0:49688:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340700.582250:0:49688:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780340700.582251:0:49688:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340700.582252:0:49688:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340700.582253:0:49688:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1780340700.582254:0:49688:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780340700.582255:0:49688:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1780340700.582281:0:49688:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1780340700.582285:0:49688:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1780340700.582288:0:49688:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1780340700.582289:0:49688:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1780340700.582290:0:49688:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340700.582291:0:49688:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780340700.582292:0:49688:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340700.582294:0:49688:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340700.582295:0:49688:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780340700.582296:0:49688:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780340700.582297:0:49688:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1780340700.582309:0:49688:0:(tgt_mount.c:1592:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:1.0:1780340700.582334:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1780340700.582343:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0345379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:3662:x1866818961086464:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1780340700.582371:0:85467:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:3.0:1780340700.582374:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961086720:0@lo:253:kworker.0 20000000:01000000:1.0:1780340700.582383:0:85467:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1780340700.582403:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340700.582465:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340700.582472:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961086592:0@lo:253:kworker.0 00000100:00100000:3.0:1780340700.582500:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340700.582528:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961086720 10000000:01000000:2.0:1780340700.582532:0:85461:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8c0351bee800 from 1 00000100:00100000:1.0:1780340700.582532:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961086720 10000000:01000000:2.0:1780340700.582538:0:85461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00000100:00100000:1.0:1780340700.582551:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961086592 00000100:00100000:1.0:1780340700.582556:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961086592 00000100:00100000:1.0:1780340700.582570:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1780340700.582576:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034b0e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:3660:x1866818961086720:12345-0@lo:253:kworker.0 00010000:00010000:2.0:1780340700.582579:0:85461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432773d95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.582590:0:85461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432773d95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1780340700.582592:0:85466:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00010000:00010000:2.0:1780340700.582603:0:85461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432773d95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340700.582619:0:85461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346ff3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961086848:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780340700.582662:0:85461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340700.582681:0:85461:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345fe83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340700.582689:0:85468:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:0.0:1780340700.582696:0:85468:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 20000000:01000000:3.0:1780340700.588486:0:85466:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1780340700.588681:0:85467:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1780340700.588743:0:85467:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1780340700.588926:0:85471:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1780340700.588931:0:85471:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1780340700.588956:0:85471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c04722ae200/0xa24651432773d9c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.588974:0:85471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0440031c00/0xa24651432773d6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2305 expref: 8 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.588983:0:85471:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c04722ae200/0xa24651432773d9c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.589018:0:85471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0440031c00/0xa24651432773d6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2305 expref: 8 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.589032:0:85471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0440031c00/0xa24651432773d6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2305 expref: 8 pid: 85468 timeout: 3580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340700.589045:0:85471:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346ff3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85471:1866818961086976:192.168.203.16@tcp:104: 00000100:00100000:2.0:1780340700.589181:0:85471:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345fe8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1780340700.589218:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961086848 00000100:00100000:1.0:1780340700.589225:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961086848 00000100:00100000:2.0:1780340700.589329:0:85474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1780340700.589338:0:85474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034b0e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3660:x1866818961086592:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1780340700.589363:0:85474:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1780340700.598697:0:85471:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff3800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85471:1866818961086976:192.168.203.16@tcp:104: 00010000:00010000:2.0:1780340700.598732:0:85471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c04722ae200/0xa24651432773d9c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1780340700.599544:0:85474:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1780340700.599569:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0345379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3662:x1866818961086464:12345-0@lo:253:kworker.0 Request processed in 17225us (17392us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340700.599581:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1780340700.599621:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1780340700.599632:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034ac08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:85461:x1866818961086848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780340700.599646:0:85467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340700.599665:0:85467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453122600/0xa24651432773da3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773d95 expref: -99 pid: 85467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.599688:0:85467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453122600/0xa24651432773da3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773d95 expref: 7 pid: 85467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.599712:0:85467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453122600/0xa24651432773da3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773d95 expref: 7 pid: 85467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.599720:0:85467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122600, rc 0) 00000100:00100000:1.0:1780340700.599784:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034ac08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:85461:x1866818961086848:12345-0@lo:101:mount.lustre.0 Request processed in 156us (17121us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340700.599790:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1780340700.599849:0:85461:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961086848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780340700.599877:0:85461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432773d95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773da3 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.599888:0:85461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432773d95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773da3 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340700.599908:0:85461:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1780340700.599926:0:85461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432773d95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773da3 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.599941:0:85461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432773d95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773da3 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1780340700.599949:0:3662:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 10000000:01000000:2.0:1780340700.599950:0:85461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 00000020:01000004:0.0:1780340700.599952:0:3662:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1780340700.599955:0:3662:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340700.599956:0:3662:0:(tgt_mount.c:1149:server_mti_print()) uuid: 10000000:01000000:2.0:1780340700.599958:0:85461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 00000020:01000004:0.0:1780340700.599958:0:3662:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340700.599961:0:3662:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340700.599964:0:3662:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1780340700.599966:0:3662:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 10000000:01000000:2.0:1780340700.599967:0:85461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c0351bee800 10000000:01000000:2.0:1780340700.599971:0:85461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 00000020:01000004:0.0:1780340700.599975:0:3662:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1780340700.599977:0:85461:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 00000100:00100000:0.0:1780340700.599980:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961086464:0@lo:253:kworker.0 10000000:01000000:2.0:1780340700.599988:0:85461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1780340700.600013:0:85461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.600021:0:85461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.600029:0:85461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340700.600050:0:85461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346ff3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961087104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780340700.600083:0:85461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340700.600118:0:85461:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345fe83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340700.600159:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961087104 00000100:00100000:1.0:1780340700.600165:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961087104 00000100:00100000:1.0:1780340700.600199:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1780340700.600205:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034ac08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:85461:x1866818961087104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780340700.600212:0:85468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340700.600220:0:85468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453123e00/0xa24651432773db1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773daa expref: -99 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.600234:0:85468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453123e00/0xa24651432773db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773daa expref: 8 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.600242:0:85468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453123e00/0xa24651432773db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773daa expref: 8 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.600248:0:85468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123e00, rc 0) 00000100:00100000:1.0:1780340700.600283:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034ac08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:85461:x1866818961087104:12345-0@lo:101:mount.lustre.0 Request processed in 78us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340700.600288:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1780340700.600805:0:85461:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961087104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780340700.600821:0:85461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773daa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773db1 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.600830:0:85461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773daa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773db1 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1780340700.601152:0:85466:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1780340700.601157:0:85466:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1780340700.604453:0:85461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961087232:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780340700.604525:0:85461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340700.604563:0:85461:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034992b240 going to sleep for 11 seconds 00000100:00100000:1.0:1780340700.604661:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961087232 00000100:00100000:1.0:1780340700.604667:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961087232 00000100:00100000:1.0:1780340700.604723:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1780340700.604730:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034ac09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:85461:x1866818961087232:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780340700.604888:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034ac09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:85461:x1866818961087232:12345-0@lo:501:mount.lustre.0 Request processed in 157us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340700.604896:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1780340700.605067:0:85461:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961087232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780340700.605104:0:85461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346ff3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961087360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780340700.605142:0:85461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340700.605205:0:85461:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345fe83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340700.605249:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961087360 00000100:00100000:1.0:1780340700.605253:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961087360 00000100:00100000:1.0:1780340700.605271:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1780340700.605277:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034ac0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:85461:x1866818961087360:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780340700.605973:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034ac0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:85461:x1866818961087360:12345-0@lo:503:mount.lustre.0 Request processed in 693us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340700.605981:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1780340700.608525:0:85461:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961087360:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780340700.609240:0:85475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a68700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85475:1866818961087488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340700.609312:0:85475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340700.609342:0:85475:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acb9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1780340700.609888:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961087488 00000100:00100000:1.0:1780340700.609894:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961087488 00000100:00100000:1.0:1780340700.609928:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1780340700.609935:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:85475:x1866818961087488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340700.610010:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034b0e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:3660:x1866818961086720:12345-0@lo:253:kworker.0 Request processed in 27432us (27604us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340700.610019:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 20000000:01000000:3.0:1780340700.610070:0:85474:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1780340700.610075:0:85474:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000020:01000004:2.0:1780340700.610197:0:3660:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1780340700.610200:0:3660:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1780340700.610201:0:3660:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340700.610208:0:3660:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340700.610210:0:3660:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340700.610211:0:3660:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340700.610213:0:3660:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780340700.610215:0:3660:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340700.610216:0:3660:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1780340700.610220:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961086720:0@lo:253:kworker.0 00000100:00100000:3.0:1780340700.610738:0:85474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034b0e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:3660:x1866818961086592:12345-0@lo:253:kworker.0 Request processed in 21394us (28230us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340700.610746:0:85474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1780340700.610808:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000020:01000004:2.0:1780340700.610870:0:3660:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1780340700.610872:0:3660:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1780340700.610873:0:3660:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340700.610874:0:3660:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340700.610875:0:3660:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340700.610877:0:3660:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340700.610878:0:3660:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780340700.610879:0:3660:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340700.610880:0:3660:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1780340700.610883:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961086592:0@lo:253:kworker.0 00000100:00100000:3.0:1780340700.611045:0:25499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940411520 00000100:00100000:3.0:1780340700.611050:0:25499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940411520 00010000:00010000:3.0:1780340700.611075:0:25499:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0440031c00/0xa24651432773d6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2305 expref: 9 pid: 85468 timeout: 3580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340700.611119:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2543 00000100:00100000:3.0:1780340700.611128:0:25499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940411520:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780340700.611140:0:25499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340700.611146:0:25499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0440031c00/0xa24651432773d6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2305 expref: 9 pid: 85468 timeout: 3580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.611157:0:25499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0440031c00/0xa24651432773d6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2305 expref: 9 pid: 85468 timeout: 3580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.611174:0:25499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0440031c00/0xa24651432773d6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2305 expref: 9 pid: 85468 timeout: 3580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.611189:0:25499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c04722ae200/0xa24651432773d9c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.611198:0:25499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04722ae200/0xa24651432773d9c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1780340700.611212:0:25499:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.022281799s 00010000:00010000:3.0:1780340700.611217:0:25499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c04722ae200/0xa24651432773d9c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.611224:0:25499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c04722ae200/0xa24651432773d9c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.611231:0:25499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c04722ae200/0xa24651432773d9c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.611238:0:25499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c04722ae200/0xa24651432773d9c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.611250:0:25499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340700.611254:0:25499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c04722ae200/0xa24651432773d9c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.611329:0:25499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c04722ae200/0xa24651432773d9c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.611349:0:25499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c04722ae200/0xa24651432773d9c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.611419:0:25499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340700.611463:0:25499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:2408:x1866818940411520:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 336us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340700.611470:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2543 00010000:00010000:2.0:1780340700.611599:0:85471:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c04722ae200/0xa24651432773d9c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.611608:0:85471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c04722ae200/0xa24651432773d9c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.611615:0:85471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04722ae200/0xa24651432773d9c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340700.614713:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:85475:x1866818961087488:12345-0@lo:502:llog_process_th.0 Request processed in 4770us (5393us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340700.614727:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1780340700.614910:0:85475:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a68700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85475:1866818961087488:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780340700.615027:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340700.615039:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340700.615041:0:85475:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1780340700.615046:0:85475:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1780340700.615048:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1780340700.615062:0:85475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8c047ac70000) 00000020:00000080:2.0:1780340700.615087:0:85475:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:2.0:1780340700.615101:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1780340700.615185:0:85475:0:(osd_handler.c:8933:osd_obd_connect()) connect #2 00000020:00000080:2.0:1780340700.615194:0:85475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432773dbf 00000020:00000080:2.0:1780340700.615379:0:85475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1780340700.615382:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340700.615385:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340700.615386:0:85475:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1780340700.615388:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340700.615391:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340700.615391:0:85475:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1780340700.615393:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1780340700.615399:0:85475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8c047ac74d40) 00000020:00000080:2.0:1780340700.615407:0:85475:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:2.0:1780340700.615410:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1780340700.615411:0:85475:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1780340700.615413:0:85475:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1780340700.615418:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1780340700.615449:0:85475:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0351bee800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1780340700.615458:0:85475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8c047ac719c0) 00000020:00000080:2.0:1780340700.615464:0:85475:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:2.0:1780340700.615499:0:85475:0:(lod_dev.c:2290:lod_obd_connect()) connect #0 00000020:00000080:2.0:1780340700.615503:0:85475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432773dd4 00000020:00000080:2.0:1780340700.615576:0:85475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1780340700.615580:0:85475:0:(mdd_device.c:1668:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1780340700.615583:0:85475:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa24651432773ddb 00080000:01000000:2.0:1780340700.615586:0:85475:0:(osd_handler.c:8933:osd_obd_connect()) connect #3 00000020:00000080:2.0:1780340700.615588:0:85475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432773de2 00010000:00010000:3.0:1780340700.713024:0:85475:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1780340700.713340:0:85475:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: e06e5cf1-1986-4ba7-9630-fad7efb74eca idx: 0 lr: 98784247817 srv lr: 103079215104 lx: 0 gen 22 00000001:00080000:3.0:1780340700.713380:0:85475:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 103079215104 lx: 0 gen 21 00000001:00000004:3.0:1780340700.713401:0:85475:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 103079215104 00000001:00080000:3.0:1780340700.713489:0:85475:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1780340700.713604:0:85475:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8c04775bbcc0: xid 1866818940402176, transno 103079215109, client gen 22, slot idx 0 00000001:00080000:3.0:1780340700.713615:0:85475:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8c04775bb900: xid 1866818940402432, transno 103079215110, client gen 22, slot idx 1 00000020:00000080:3.0:1780340700.720379:0:85475:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8c047658cd40) 00000020:00000080:3.0:1780340700.720405:0:85475:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:3.0:1780340700.720492:0:85475:0:(osd_handler.c:8933:osd_obd_connect()) connect #4 00000020:00000080:3.0:1780340700.720498:0:85475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432773dfe 00000020:00000080:1.0:1780340700.741013:0:85475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1780340700.747003:0:85475:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa24651432773e05 00000020:00000080:1.0:1780340700.748785:0:85475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1780340700.748799:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340700.748806:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340700.748808:0:85475:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1780340700.748813:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1780340700.748816:0:85475:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1780340700.748818:0:85475:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780340700.748820:0:85475:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780340700.748822:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1780340700.748834:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340700.748836:0:85475:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1780340700.748839:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780340700.748844:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340700.748846:0:85475:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1780340700.748861:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1780340700.748911:0:85475:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1780340700.748930:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340700.748933:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340700.748934:0:85475:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1780340700.748937:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780340700.748940:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340700.748942:0:85475:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1780340700.748945:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1780340700.748950:0:85475:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:00000080:1.0:1780340700.748970:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780340700.748983:0:85475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8c0445ba3380) 00000020:00000080:1.0:1780340700.749004:0:85475:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1780340700.749008:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1780340700.749057:0:85475:0:(osp_dev.c:1197:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1780340700.749062:0:85475:0:(osd_handler.c:8933:osd_obd_connect()) connect #5 00000020:00000080:1.0:1780340700.749068:0:85475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432773e13 00010000:00080000:1.0:1780340700.749098:0:85475:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c047b19c800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:1.0:1780340700.750812:0:85475:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1780340700.755949:0:85475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780340700.755964:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1780340700.756008:0:85475:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1780340700.756027:0:85475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432773e1a 00000100:00080000:1.0:1780340700.756036:0:85475:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1780340700.756041:0:85475:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c047b19c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340700.756077:0:85475:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c04440a5500 x1866818961087616/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340700.756104:0:85475:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1780340700.756164:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340700.756168:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340700.756170:0:85475:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1780340700.756173:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1780340700.756176:0:85475:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1780340700.756178:0:85475:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780340700.756180:0:85475:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780340700.756182:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1780340700.756184:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340700.756185:0:85475:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1780340700.756188:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1780340700.756193:0:85475:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1780340700.756196:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340700.756197:0:85475:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1780340700.756200:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1780340700.756204:0:85475:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:01000000:1.0:1780340700.756226:0:85475:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1780340700.756229:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780340700.756241:0:85475:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c0445ba0000) 00000020:00000080:1.0:1780340700.756256:0:85475:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1780340700.756262:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1780340700.756322:0:85475:0:(osp_dev.c:1197:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1780340700.756328:0:85475:0:(osd_handler.c:8933:osd_obd_connect()) connect #6 00000020:00000080:1.0:1780340700.756334:0:85475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432773e28 00010000:00080000:1.0:1780340700.756363:0:85475:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c0458281800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:1.0:1780340700.756532:0:85475:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1780340700.756799:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961087616:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1780340700.756874:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340700.757114:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961087616 00000100:00100000:1.0:1780340700.757121:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961087616 00000100:00100000:1.0:1780340700.757152:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3789 00000100:00100000:1.0:1780340700.757159:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961087616:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1780340700.757193:0:8411:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3480 last 0 00000020:00000080:1.0:1780340700.757221:0:8411:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432773e2f 00000004:00100000:1.0:1780340700.757235:0:8411:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780340700.757317:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8c0458287000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780340700.757375:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1866818961087616:12345-0@lo:38:llog_process_th.0 Request processed in 214us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340700.757381:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3789 00000100:00100000:3.0:1780340700.757423:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1780340700.757432:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:3.0:1780340700.757441:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1780340700.757446:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1780340700.757448:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c047b19c800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1780340700.757468:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961087616:0@lo:38:llog_process_th.0 00000040:01000000:2.0:1780340700.760913:0:85475:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1780340700.760945:0:85475:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1780340700.761010:0:85475:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:2.0:1780340700.762380:0:85475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1780340700.762414:0:85475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].25, 64 off9792 00000040:00080000:2.0:1780340700.762812:0:85475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x64:0x0].1, 64 off8256 00000040:00080000:2.0:1780340700.764531:0:85481:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:2.0:1780340700.764537:0:85481:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1780340700.764684:0:85481:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:2.0:1780340700.764703:0:85481:0:(llog_cat.c:1250:llog_cat_cleanup()) cancel plain log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1780340700.764827:0:85481:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:2.0:1780340700.764831:0:85481:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1780340700.765503:0:85475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780340700.765514:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1780340700.765547:0:85475:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1780340700.765564:0:85475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432773e36 00000100:00080000:1.0:1780340700.765572:0:85475:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1780340700.765578:0:85475:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c0458281800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340700.765608:0:85475:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c04440a5500 x1866818961088000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340700.765661:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961088000:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1780340700.765723:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780340700.765814:0:85475:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1780340700.774228:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340700.774235:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340700.774238:0:85475:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1780340700.774241:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1780340700.774245:0:85475:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1780340700.774247:0:85475:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780340700.774248:0:85475:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780340700.774250:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1780340700.774252:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340700.774254:0:85475:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1780340700.774256:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1780340700.774261:0:85475:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1780340700.774264:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340700.774273:0:85475:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1780340700.774277:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1780340700.774281:0:85475:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:01000000:1.0:1780340700.774302:0:85475:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1780340700.774304:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780340700.774319:0:85475:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c0445ba4d40) 00000020:00000080:1.0:1780340700.774352:0:85475:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:1.0:1780340700.774357:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1780340700.774430:0:85475:0:(osp_dev.c:1197:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1780340700.774435:0:85475:0:(osd_handler.c:8933:osd_obd_connect()) connect #7 00000020:00000080:1.0:1780340700.774440:0:85475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432773e44 00010000:00080000:1.0:1780340700.774471:0:85475:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c0349151800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:1.0:1780340700.774681:0:85475:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1780340700.774743:0:85475:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1780340700.774756:0:85475:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1780340700.774878:0:85475:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000100:00100000:0.0:1780340700.775213:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961088000 00000100:00100000:0.0:1780340700.775223:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961088000 00000100:00100000:0.0:1780340700.775263:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5882 00000100:00100000:0.0:1780340700.775271:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3658:x1866818961088000:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1780340700.775299:0:25488:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3480 last 0 00000020:00000080:0.0:1780340700.775322:0:25488:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432773e4b 00002000:00100000:0.0:1780340700.775334:0:25488:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c04858fc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211351c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1780340700.775338:0:25488:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1780340700.775342:0:25488:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1780340700.775391:0:25488:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1780340700.775411:0:25488:0:(import.c:65:import_set_state_nolock()) ffff8c04858fb800 : changing import state from RECOVER to FULL 00000040:00080000:1.0:1780340700.775626:0:85475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1780340700.775652:0:85475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].25, 64 off9792 00000040:00080000:1.0:1780340700.775900:0:85475:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x66:0x0].1, 64 off8256 00000100:00100000:0.0:1780340700.776221:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3658:x1866818961088000:12345-0@lo:8:llog_process_th.0 Request processed in 948us (10495us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340700.776230:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5882 00000100:00100000:3.0:1780340700.776254:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1780340700.776264:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00100000:0.0:1780340700.776270:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961087744:0@lo:400:kworker.0 00000100:00080000:3.0:1780340700.776272:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1780340700.776280:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1780340700.776283:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0458281800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1780340700.776311:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340700.776356:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780340700.776363:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961087872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340700.776390:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1780340700.776417:0:3658:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:3.0:1780340700.776426:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961088000:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1780340700.776445:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961087872 00000100:00100000:0.0:1780340700.776451:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961087872 00000100:00100000:0.0:1780340700.776489:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3790 00000100:00100000:0.0:1780340700.776496:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961087872:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340700.776497:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961087744 00000100:00100000:1.0:1780340700.776504:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961087744 00000004:00000024:0.0:1780340700.776527:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:1.0:1780340700.776546:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1780340700.776556:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3661:x1866818961087744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340700.776568:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961087872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340700.776575:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3790 00000100:00100000:1.0:1780340700.776601:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3661:x1866818961087744:12345-0@lo:400:kworker.0 Request processed in 47us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340700.776608:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000004:00080000:2.0:1780340700.776704:0:85481:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1780340700.776985:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961088128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340700.777019:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1780340700.777191:0:85481:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3480766430439ns, next at 0ns, rc = 0 00080000:00080000:2.0:1780340700.777198:0:85481:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000040:00080000:2.0:1780340700.778041:0:85483:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:2.0:1780340700.778046:0:85483:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1780340700.778190:0:85483:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000100:00100000:0.0:1780340700.778590:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961087872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340700.778619:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961087744:0@lo:400:kworker.0 00000100:00100000:0.0:1780340700.778660:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961088128 00000100:00100000:0.0:1780340700.778665:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961088128 00000100:00100000:0.0:1780340700.778725:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:0.0:1780340700.778734:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961088128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340700.778754:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340700.778831:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961088128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1810us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340700.778838:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00100000:0.0:1780340700.778899:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961088128:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1780340700.779008:0:85475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780340700.779021:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000100:00080000:1.0:1780340700.779149:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:01000000:2.0:1780340700.779172:0:85475:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1780340700.779191:0:85475:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432773e52 00000100:00080000:2.0:1780340700.779199:0:85475:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1780340700.779204:0:85475:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c0349151800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340700.779230:0:85475:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a845500 x1866818961088256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340700.779258:0:85475:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1780340700.779342:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340700.779346:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340700.779349:0:85475:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1780340700.779352:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340700.779361:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340700.779362:0:85475:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1780340700.779365:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1780340700.779367:0:85475:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1780340700.779370:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340700.779372:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340700.779373:0:85475:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1780340700.779375:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340700.779378:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340700.779379:0:85475:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1780340700.779382:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1780340700.779408:0:85475:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a846300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85475:1866818961088384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340700.779453:0:85475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340700.779476:0:85475:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034b093180 going to sleep for 11 seconds 00000100:00100000:0.0:1780340700.780006:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961088384 00000100:00100000:0.0:1780340700.780013:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961088384 00000100:00100000:0.0:1780340700.780050:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1780340700.780069:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:85475:x1866818961088384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340700.780178:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:85475:x1866818961088384:12345-0@lo:502:llog_process_th.0 Request processed in 120us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340700.780184:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1780340700.780223:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961088256:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1780340700.780258:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340700.780291:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961088256 00000100:00100000:0.0:1780340700.780295:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961088256 00000100:00100000:0.0:1780340700.780315:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5883 00000100:00100000:0.0:1780340700.780320:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3658:x1866818961088256:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1780340700.780476:0:23153:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3480 last 0 00000020:00000080:0.0:1780340700.780503:0:23153:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432773e59 00002000:00100000:0.0:1780340700.780515:0:23153:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c0447db0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211351c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1780340700.780519:0:23153:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1780340700.780522:0:23153:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1780340700.780583:0:23153:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1780340700.780606:0:23153:0:(import.c:65:import_set_state_nolock()) ffff8c047a28a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340700.780644:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3658:x1866818961088256:12345-0@lo:8:llog_process_th.0 Request processed in 323us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340700.780651:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5883 00000100:00100000:0.0:1780340700.780682:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1780340700.780688:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1780340700.780695:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1780340700.780699:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1780340700.780702:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0349151800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1780340700.780706:0:3658:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:0.0:1780340700.780710:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961088256:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1780340700.780737:0:85475:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a846300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85475:1866818961088384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1780340700.780780:0:85475:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780340700.780786:0:85475:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340700.780788:0:85475:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1780340700.780796:0:85475:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1780340700.780884:0:85461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1780340700.780908:0:85461:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1780340700.780924:0:85461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773daa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773db1 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340700.780935:0:85461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773db1 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340700.780943:0:85461:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c0351bee800 from 1 10000000:01000000:0.0:1780340700.780946:0:85461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1780340700.780972:0:85461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432773e60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340700.780980:0:85461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432773e60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340700.780989:0:85461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432773e60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340700.781003:0:85461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961088512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1780340700.781030:0:85461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340700.781047:0:85461:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034992b780 going to sleep for 11 seconds 00000100:00100000:0.0:1780340700.781242:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961088512 00000100:00100000:0.0:1780340700.781247:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961088512 00000100:00100000:0.0:1780340700.781276:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1780340700.781283:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0475e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:85461:x1866818961088512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340700.781292:0:85466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340700.781303:0:85466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa5200/0xa24651432773e67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773e60 expref: -99 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1780340700.781684:0:85483:0:(llog_cat.c:1250:llog_cat_cleanup()) cancel plain log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1780340700.781867:0:85483:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:2.0:1780340700.781872:0:85483:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000004:00080000:2.0:1780340700.781894:0:85483:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1780340700.781930:0:85483:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3480771169974ns, next at 0ns, rc = 0 00080000:00080000:2.0:1780340700.781937:0:85483:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:0.0:1780340700.782166:0:85466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa5200/0xa24651432773e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773e60 expref: 8 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340700.782182:0:85466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa5200/0xa24651432773e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773e60 expref: 8 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340700.782191:0:85466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5200, rc 0) 00000100:00100000:0.0:1780340700.782236:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0475e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:85461:x1866818961088512:12345-0@lo:101:mount.lustre.0 Request processed in 953us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340700.782242:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1780340700.782288:0:85461:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961088512:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340700.782302:0:85461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432773e60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773e67 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340700.782311:0:85461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432773e60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773e67 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340700.782934:0:85461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961088640:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1780340700.782976:0:85461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340700.783004:0:85461:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034992b780 going to sleep for 11 seconds 00000100:00100000:0.0:1780340700.783022:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961088640 00000100:00100000:0.0:1780340700.783027:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961088640 00000100:00100000:0.0:1780340700.783262:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1780340700.783273:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0475e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:85461:x1866818961088640:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1780340700.783291:0:85467:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1780340700.783308:0:85467:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1780340700.783317:0:85467:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1780340700.783320:0:85467:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1780340700.783322:0:85467:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 111 00000100:00100000:0.0:1780340700.783475:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0475e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:85461:x1866818961088640:12345-0@lo:256:mount.lustre.0 Request processed in 204us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340700.783482:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1780340700.783520:0:85461:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961088640:0@lo:256:mount.lustre.0 00000004:00080000:3.0:1780340700.784092:0:85462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 10000000:01000000:0.0:1780340700.784570:0:85461:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1780340700.784585:0:85461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432773e60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773e67 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340700.784597:0:85461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432773e60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773e67 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340700.784605:0:85461:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c0351bee800 from 1 10000000:01000000:0.0:1780340700.784608:0:85461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1780340700.784636:0:85461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa24651432773e6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340700.784644:0:85461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa24651432773e6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340700.784652:0:85461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa24651432773e6e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340700.784668:0:85461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961088768:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1780340700.784706:0:85461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340700.784722:0:85461:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034992b780 going to sleep for 11 seconds 00000100:00100000:3.0:1780340700.784971:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961088896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340700.785006:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340700.785042:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961088896 00000100:00100000:3.0:1780340700.785047:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961088896 00000100:00080000:1.0:1780340700.785165:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340700.785286:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993 00000100:00100000:3.0:1780340700.785293:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961088896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340700.785308:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340700.785416:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961088896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340700.785421:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993 00000100:00100000:0.0:1780340700.785471:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961088768 00000100:00100000:0.0:1780340700.785477:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961088768 00000100:00100000:0.0:1780340700.785501:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1780340700.785505:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0475e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:85461:x1866818961088768:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340700.785511:0:85466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340700.785520:0:85466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa5a00/0xa24651432773e75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773e6e expref: -99 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340700.785535:0:85466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa5a00/0xa24651432773e75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773e6e expref: 9 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340700.785541:0:85466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa5a00/0xa24651432773e75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773e6e expref: 9 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340700.785547:0:85466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5a00, rc 0) 00000100:00100000:0.0:1780340700.785567:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0475e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:85461:x1866818961088768:12345-0@lo:101:mount.lustre.0 Request processed in 62us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340700.785571:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1780340700.785599:0:85461:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961088768:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340700.785607:0:85461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa24651432773e6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773e75 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340700.785612:0:85461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa24651432773e6e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773e75 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340700.785651:0:85461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961089024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780340700.785672:0:85461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340700.785691:0:85461:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034992b780 going to sleep for 11 seconds 00000100:00100000:0.0:1780340700.785702:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961089024 00000100:00100000:0.0:1780340700.785711:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961089024 00000100:00100000:0.0:1780340700.785748:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1780340700.785755:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0475e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:85461:x1866818961089024:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780340700.785871:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0475e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:85461:x1866818961089024:12345-0@lo:501:mount.lustre.0 Request processed in 116us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340700.785878:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1780340700.785908:0:85461:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961089024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780340700.785934:0:85461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961089152:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780340700.785970:0:85461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340700.785981:0:85461:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034992b780 going to sleep for 11 seconds 00000100:00100000:0.0:1780340700.785992:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961089152 00000100:00100000:0.0:1780340700.785995:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961089152 00000100:00100000:0.0:1780340700.786014:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1780340700.786019:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0475e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:85461:x1866818961089152:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780340700.786290:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0475e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:85461:x1866818961089152:12345-0@lo:503:mount.lustre.0 Request processed in 270us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340700.786297:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1780340700.786923:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961088896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340700.787230:0:85461:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961089152:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780340700.787679:0:85485:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a68a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85485:1866818961089280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340700.787729:0:85485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340700.787895:0:85485:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04775bb6c0 going to sleep for 11 seconds 00000004:00080000:2.0:1780340700.787927:0:85462:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1780340700.787973:0:85474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961089280 00000100:00100000:1.0:1780340700.787978:0:85474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961089280 00000100:00100000:1.0:1780340700.788016:0:85474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1780340700.788023:0:85474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0475e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:85485:x1866818961089280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340700.788372:0:85474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0475e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:85485:x1866818961089280:12345-0@lo:502:llog_process_th.0 Request processed in 348us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340700.788379:0:85474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1780340700.788435:0:85485:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a68a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85485:1866818961089280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780340700.788462:0:85485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780340700.788472:0:85485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340700.788474:0:85485:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1780340700.788481:0:85485:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0351bee800 00000020:00000080:3.0:1780340700.788483:0:85485:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1780340700.788492:0:85485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780340700.788494:0:85485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340700.788495:0:85485:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1780340700.788497:0:85485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780340700.788500:0:85485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340700.788501:0:85485:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1780340700.788503:0:85485:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0351bee800 00000020:00000080:3.0:1780340700.788505:0:85485:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1780340700.788625:0:85485:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a68a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85485:1866818961089408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340700.788658:0:85485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340700.788678:0:85485:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04775bb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340700.788717:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961089408 00000100:00100000:0.0:1780340700.788721:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961089408 00000100:00100000:0.0:1780340700.788884:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1780340700.788892:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0475e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:85485:x1866818961089408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340700.788978:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0475e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:85485:x1866818961089408:12345-0@lo:502:llog_process_th.0 Request processed in 87us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340700.788985:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1780340700.789051:0:85485:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a68a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85485:1866818961089408:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780340700.789077:0:85485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340700.789082:0:85485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340700.789084:0:85485:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1780340700.789089:0:85485:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1780340700.789151:0:85461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1780340700.789171:0:85461:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1780340700.789184:0:85461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa24651432773e6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773e75 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.789195:0:85461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa24651432773e6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773e75 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340700.789241:0:85461:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1780340700.789244:0:85461:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c0351bee800 10000000:01000000:1.0:1780340700.789246:0:85461:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c0351bee800 10000000:01000000:1.0:1780340700.789250:0:85461:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1780340700.789254:0:85461:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c0351bee800 from 1 10000000:01000000:1.0:1780340700.789257:0:85461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780340700.789277:0:85461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa24651432773e7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.789290:0:85461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa24651432773e7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.789299:0:85461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa24651432773e7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340700.789312:0:85461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961089536:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1780340700.789349:0:85461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340700.791667:0:85461:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c03483883c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340700.791951:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961089536 00000100:00100000:3.0:1780340700.791960:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961089536 00000100:00100000:3.0:1780340700.792010:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1780340700.792019:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0475e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:85461:x1866818961089536:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780340700.792033:0:85468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340700.792050:0:85468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0440031c00/0xa24651432773e83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773e7c expref: -99 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.792086:0:85468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0440031c00/0xa24651432773e83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773e7c expref: 10 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.792105:0:85468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0440031c00/0xa24651432773e83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773e7c expref: 10 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.792115:0:85468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440031c00, rc 0) 00000100:00100000:3.0:1780340700.792166:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0475e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:85461:x1866818961089536:12345-0@lo:101:mount.lustre.0 Request processed in 148us (2816us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340700.792174:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1780340700.792220:0:85461:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961089536:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780340700.792235:0:85461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa24651432773e7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773e83 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.792245:0:85461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa24651432773e7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773e83 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340700.792312:0:85461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961089664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780340700.792460:0:85461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340700.792475:0:85461:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04775bbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1780340700.792487:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961089664 00000100:00100000:3.0:1780340700.792491:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961089664 00000100:00100000:3.0:1780340700.792508:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1780340700.792513:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:85461:x1866818961089664:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780340700.792613:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:85461:x1866818961089664:12345-0@lo:501:mount.lustre.0 Request processed in 100us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340700.792621:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1780340700.792648:0:85461:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961089664:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780340700.792681:0:85461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961089792:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780340700.792716:0:85461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340700.792816:0:85461:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04775bbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1780340700.792829:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961089792 00000100:00100000:3.0:1780340700.792833:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961089792 00000100:00100000:3.0:1780340700.792860:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1780340700.792867:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034ab42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:85461:x1866818961089792:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780340700.792940:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034ab42050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:85461:x1866818961089792:12345-0@lo:503:mount.lustre.0 Request processed in 74us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340700.792947:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1780340700.792982:0:85461:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961089792:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780340700.794667:0:85487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a846300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85487:1866818961089920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340700.794724:0:85487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340700.794954:0:85487:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034b0936c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340700.795674:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961089920 00000100:00100000:3.0:1780340700.795682:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961089920 00000100:00100000:3.0:1780340700.795731:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1780340700.795740:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034ab40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:85487:x1866818961089920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340700.795998:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034ab40850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:85487:x1866818961089920:12345-0@lo:502:llog_process_th.0 Request processed in 259us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340700.796006:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1780340700.796150:0:85487:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a846300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85487:1866818961089920:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1780340700.796206:0:85487:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1780340700.796222:0:85487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8c0476588000) 00000020:00000080:3.0:1780340700.796247:0:85487:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1780340700.796510:0:85487:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0351bee800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1780340700.796514:0:85487:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0351bee800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1780340700.796517:0:85487:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c0351bee800 4 00010000:00080000:3.0:1780340700.796544:0:85487:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c0345f1c800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:3.0:1780340700.799271:0:85487:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1780340700.799949:0:85487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1780340700.799997:0:85487:0:(lwp_dev.c:494:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1780340700.800010:0:85487:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa24651432773e91 00000100:00080000:3.0:1780340700.800020:0:85487:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1780340700.800025:0:85487:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c0345f1c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340700.800119:0:85487:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0348a69c00 x1866818961090048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340700.800170:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961090048:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1780340700.800240:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1780340700.801147:0:85487:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1780340700.802956:0:85487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85487:1866818961090176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340700.803030:0:85487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340700.803133:0:85487:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04775bbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340700.803412:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961090048 00000100:00100000:0.0:1780340700.803420:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961090048 00000100:00100000:0.0:1780340700.803484:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1780340700.803491:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961090048:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1780340700.803545:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961090048:12345-0@lo:38:llog_process_th.0 Request processed in 53us (3304us total) trans 0 rc -11/-11 00000100:00100000:0.0:1780340700.803552:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1780340700.804959:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961090176 00000100:00100000:2.0:1780340700.804974:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961090176 00000100:00100000:2.0:1780340700.805013:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1780340700.805021:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034abb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:85487:x1866818961090176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340700.805161:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034abb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:85487:x1866818961090176:12345-0@lo:502:llog_process_th.0 Request processed in 141us (2131us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340700.805169:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1780340700.805363:0:85487:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85487:1866818961090176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340700.805420:0:85487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85487:1866818961090304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340700.805458:0:85487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340700.805476:0:85487:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04775bbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340700.805582:0:85474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961090304 00000100:00100000:0.0:1780340700.805586:0:85474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961090304 00000100:00100000:0.0:1780340700.805617:0:85474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1780340700.805624:0:85474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034abb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:85487:x1866818961090304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340700.805699:0:85474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034abb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:85487:x1866818961090304:12345-0@lo:502:llog_process_th.0 Request processed in 74us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340700.805705:0:85474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1780340700.805776:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1780340700.805783:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0345f1c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340700.805788:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1780340700.805792:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961090048:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1780340700.805819:0:85487:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85487:1866818961090304:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1780340700.805840:0:85487:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1780340700.806050:0:85461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1780340700.806135:0:85461:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780340700.806154:0:85461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa24651432773e7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773e83 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340700.806167:0:85461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa24651432773e7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773e83 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1780340700.806219:0:85461:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1780340700.806222:0:85461:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1780340700.806224:0:85461:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780340700.806226:0:85461:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780340700.806227:0:85461:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780340700.806229:0:85461:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780340700.806234:0:85461:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780340700.806235:0:85461:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1780340700.806237:0:85461:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780340700.806238:0:85461:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1780340700.806243:0:85461:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1780340700.806245:0:85461:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1780340700.806247:0:85461:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1780340700.806248:0:85461:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780340700.806249:0:85461:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780340700.806250:0:85461:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780340700.806251:0:85461:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780340700.806252:0:85461:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780340700.806253:0:85461:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1780340700.806254:0:85461:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780340700.806255:0:85461:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1780340700.806269:0:85461:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1780340700.806279:0:85461:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a69500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961090432:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1780340700.806312:0:85461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340700.806402:0:85461:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04775bb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340700.806560:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961090432 00000100:00100000:2.0:1780340700.806565:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961090432 00000100:00100000:2.0:1780340700.806625:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1780340700.806634:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:85461:x1866818961090432:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1780340700.806653:0:85467:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1780340700.806665:0:85467:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1780340700.812311:0:85467:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1780340700.812327:0:85467:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1780340700.812620:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:85461:x1866818961090432:12345-0@lo:253:mount.lustre.0 Request processed in 5983us (6302us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340700.812632:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 20000000:01000000:2.0:1780340700.812701:0:85471:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1780340700.812713:0:85471:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1780340700.812737:0:85471:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c04722ae200/0xa24651432773e98 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.812752:0:85471:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0475fa5200/0xa24651432773e67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773e60 expref: 9 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.812784:0:85471:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c04722ae200/0xa24651432773e98 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.812817:0:85471:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0475fa5200/0xa24651432773e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432773e60 expref: 9 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.812830:0:85471:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0475fa5200/0xa24651432773e67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432773e60 expref: 9 pid: 85466 timeout: 3580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340700.812843:0:85471:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85471:1866818961090560:0@lo:104: 00000100:00100000:2.0:1780340700.812891:0:85471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340700.812921:0:85471:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034b0939c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340700.813280:0:6499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961090560 00000100:00100000:1.0:1780340700.813288:0:6499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961090560 00000100:00100000:1.0:1780340700.813472:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1780340700.813484:0:6499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:85471:x1866818961090560:12345-0@lo:104: 00000100:00100000:3.0:1780340700.813491:0:85461:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a69500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:85461:1866818961090432:0@lo:253:mount.lustre.0 00010000:00010000:1.0:1780340700.813498:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432773e60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432773e67 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340700.813503:0:85461:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1780340700.813508:0:85461:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1780340700.813510:0:85461:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1780340700.813512:0:85461:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780340700.813513:0:85461:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780340700.813515:0:85461:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780340700.813516:0:85461:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780340700.813518:0:85461:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780340700.813520:0:85461:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1780340700.813521:0:85461:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780340700.813523:0:85461:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1780340700.813536:0:85461:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1780340700.813560:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1780340700.813566:0:6499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:85471:x1866818961090560:12345-0@lo:104: Request processed in 86us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340700.813573:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1780340700.813826:0:85471:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85471:1866818961090560:0@lo:104: 00010000:00010000:0.0:1780340700.813840:0:85471:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c04722ae200/0xa24651432773e98 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.813907:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340700.813913:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432773e60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432773e67 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.813922:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4000 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:2.0:1780340700.813925:0:41205:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432773e60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432773e67 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.813934:0:41205:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432773e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432773e67 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340700.813942:0:41205:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432773e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432773e67 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340700.813948:0:41205:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340700.813976:0:41205:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432773e60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432773e67 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.813982:0:41205:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780340700.814003:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432773e60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432773e67 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.814010:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432773e60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432773e67 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.814023:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340700.814025:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340700.814027:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340700.814122:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340700.814133:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961090688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780340700.814163:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340700.814228:0:6502:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961090688 00000100:00100000:2.0:1780340700.814238:0:6502:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961090688 00010000:00010000:2.0:1780340700.814254:0:6502:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0475fa5200/0xa24651432773e67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432773e60 expref: 10 pid: 85466 timeout: 3580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340700.814284:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:2.0:1780340700.814291:0:6502:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:3662:x1866818961090688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340700.814302:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340700.814306:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0475fa5200/0xa24651432773e67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432773e60 expref: 10 pid: 85466 timeout: 3580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.814316:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0475fa5200/0xa24651432773e67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432773e60 expref: 10 pid: 85466 timeout: 3580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.814329:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5200/0xa24651432773e67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432773e60 expref: 10 pid: 85466 timeout: 3580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.814408:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c04722ae200/0xa24651432773e98 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.814416:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04722ae200/0xa24651432773e98 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1780340700.814429:0:6502:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.022281799s 00010000:00010000:2.0:1780340700.814433:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c04722ae200/0xa24651432773e98 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.814439:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c04722ae200/0xa24651432773e98 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.814447:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c04722ae200/0xa24651432773e98 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.814463:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c04722ae200/0xa24651432773e98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.814468:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340700.814472:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c04722ae200/0xa24651432773e98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.814479:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c04722ae200/0xa24651432773e98 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.814500:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c04722ae200/0xa24651432773e98 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340700.814509:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340700.814534:0:6502:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:3662:x1866818961090688:12345-0@lo:103:ldlm_bl.0 Request processed in 244us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340700.814540:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00000100:00100000:0.0:1780340700.814595:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961090688:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340700.814639:0:85471:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c04722ae200/0xa24651432773e98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.814648:0:85471:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c04722ae200/0xa24651432773e98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340700.814654:0:85471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04722ae200/0xa24651432773e98 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85471 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1780340700.821989:0:85461:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444069 00000040:01000000:3.0:1780340700.822297:0:85461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1780340700.822579:0:85494:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1780340700.822691:0:85461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1780340700.823168:0:85494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1780340700.824896:0:85493:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444069 00000020:00080000:2.0:1780340700.824904:0:85493:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444069 00000040:01000000:2.0:1780340700.825257:0:85461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1780340700.825288:0:85461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1780340700.825927:0:85495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a69500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85495:1866818961090816:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780340700.825989:0:85495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340700.826071:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961090816 00000100:00100000:3.0:1780340700.826077:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961090816 00000100:00100000:3.0:1780340700.826120:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3791 00000100:00100000:3.0:1780340700.826129:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85495:x1866818961090816:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780340700.826190:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85495:x1866818961090816:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 63us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340700.826197:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3791 00000100:00100000:3.0:1780340700.826220:0:85495:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1780340700.826240:0:85495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a69500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85495:1866818961090816:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1780340700.826270:0:85495:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1780340700.826292:0:85495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a69500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85495:1866818961090944:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780340700.826316:0:85495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340700.826440:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961090944 00000100:00100000:3.0:1780340700.826444:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961090944 00000100:00100000:3.0:1780340700.826466:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792 00000100:00100000:3.0:1780340700.826472:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85495:x1866818961090944:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780340700.826552:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85495:x1866818961090944:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340700.826558:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792 00000100:00100000:3.0:1780340700.826574:0:85495:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04775bb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340700.826585:0:85495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a69500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85495:1866818961090944:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780340700.826626:0:85495:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a69500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85495:1866818961091072:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780340700.826646:0:85495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340700.826662:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961091072 00000100:00100000:3.0:1780340700.826665:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961091072 00000100:00100000:3.0:1780340700.826681:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793 00000100:00100000:3.0:1780340700.826693:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85495:x1866818961091072:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780340700.826727:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85495:x1866818961091072:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 35us (80us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340700.826733:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793 00000100:00100000:3.0:1780340700.826747:0:85495:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0444c90780 going to sleep for 11 seconds 00000004:00000080:2.0:1780340700.827964:0:85461:0:(mdd_device.c:556:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1780340700.827980:0:85461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1780340700.828046:0:85461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1780340700.828144:0:85495:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a69500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85495:1866818961091072:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1780340700.828196:0:85495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1780340700.831184:0:85494:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1780340700.831249:0:85494:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1780340700.833053:0:85461:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1780340700.835968:0:85495:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1780340700.836046:0:85495:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1780340700.836050:0:85495:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1780340700.836282:0:85461:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1780340700.836343:0:85461:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1780340700.836444:0:85461:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1780340700.836921:0:85461:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4c:0x0] (8/32) registered 00010000:00080000:2.0:1780340700.838485:0:85461:0:(ldlm_lib.c:3035:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 103079215110 00010000:00080000:1.0:1780340700.839527:0:85496:0:(ldlm_lib.c:2838:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 85496 00010000:02000000:1.0:1780340700.839571:0:85496:0:(ldlm_lib.c:2320:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1780340700.839575:0:85496:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1780340700.839578:0:85496:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:2.0:1780340700.840018:0:85461:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1780340700.840033:0:85461:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.116@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1780340700.840049:0:85461:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=47 00000080:00000004:2.0:1780340700.840064:0:85461:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1780340700.841004:0:85461:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1780340700.841269:0:85461:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1780340701.068721:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340702.096902:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340702.121527:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340702.121661:0:85474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940411648 00000100:00100000:3.0:1780340702.121672:0:85474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940411648 00000100:00100000:3.0:1780340702.121729:0:85474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 36 00000100:00100000:3.0:1780340702.121739:0:85474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940411648:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340702.121755:0:85474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340702.121800:0:85474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0440030200/0xa24651432773e9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2321 expref: -99 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340702.121828:0:85474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0440030200/0xa24651432773e9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2321 expref: 9 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340702.121850:0:85474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0440030200/0xa24651432773e9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2321 expref: 9 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340702.121865:0:85474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440030200, rc 0) 00000100:00100000:3.0:1780340702.121920:0:85474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f25d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:41995:x1866818940411648:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 183us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340702.121937:0:85474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 36 00000100:00100000:3.0:1780340702.126709:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340702.126782:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940411776 00000100:00100000:3.0:1780340702.126792:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940411776 00000100:00100000:3.0:1780340702.126855:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 37 00000100:00100000:3.0:1780340702.127276:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:41995:x1866818940411776:12345-192.168.203.16@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1780340702.127302:0:85466:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1780340702.127319:0:85466:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1780340702.127323:0:85466:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1780340702.127325:0:85466:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1780340702.127328:0:85466:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1780340702.127330:0:85466:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 112 00000100:00100000:3.0:1780340702.133365:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f25cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:41995:x1866818940411776:12345-192.168.203.16@tcp:256:ll_cfg_requeue.0 Request processed in 6084us (6649us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340702.133379:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 37 00000100:00100000:3.0:1780340702.137628:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340702.140130:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940411904 00000100:00100000:2.0:1780340702.140144:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940411904 00000100:00100000:2.0:1780340702.140190:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1199 00000100:00100000:2.0:1780340702.140200:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940411904:12345-192.168.203.16@tcp:38:ll_cfg_requeue.0 00010000:00080000:2.0:1780340702.140227:0:63711:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'e06e5cf1-1986-4ba7-9630-fad7efb74eca' at ffff8c046ba27000, cookie 0xa24651432773de9 00010000:00080000:2.0:1780340702.140233:0:63711:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp recovering/t103079215111 exp ffff8c046ba27000 cur 3482 last 1780340700 00010000:02000400:2.0:1780340702.140241:0:63711:0:(ldlm_lib.c:2021:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1780340702.140246:0:63711:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1780340702.140272:0:63711:0:(mdt_handler.c:7301:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1780340702.140613:0:63711:0:(import.c:65:import_set_state_nolock()) ffff8c047b1fa800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340702.140676:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940411904:12345-192.168.203.16@tcp:38:ll_cfg_requeue.0 Request processed in 476us (3056us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340702.140683:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1199 00000100:00100000:1.0:1780340702.144912:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340702.144955:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940403968 00000100:00100000:1.0:1780340702.144964:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940403968 00000100:00100000:1.0:1780340702.145011:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1200 00000100:00100000:1.0:1780340702.145020:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940403968:12345-192.168.203.16@tcp:36:mcreate.0 00010000:00080000:1.0:1780340702.145038:0:64454:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 103079215111, current: 103079215111, replaying 00000100:00100000:1.0:1780340702.145049:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940403968:12345-192.168.203.16@tcp:36:mcreate.0 Request processed in 31us (146us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780340702.145056:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1200 00010000:00080000:1.0:1780340702.145074:0:85496:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 10000000:01000000:0.0:1780340702.409866:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1780340702.409874:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c0351bee800 from 112 10000000:01000000:0.0:1780340702.409880:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1780340702.410186:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432773ea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.410198:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432773ea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.410210:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432773ea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340702.410236:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961091200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340702.410305:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340702.410350:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0477400480 going to sleep for 11 seconds 00000100:00100000:3.0:1780340702.410392:0:85474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961091200 00000100:00100000:3.0:1780340702.410401:0:85474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961091200 00000100:00100000:3.0:1780340702.410459:0:85474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1780340702.410468:0:85474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:6514:x1866818961091200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340702.410481:0:85474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340702.410493:0:85474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0440030800/0xa24651432773ead lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773ea6 expref: -99 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340702.410532:0:85474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0440030800/0xa24651432773ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773ea6 expref: 10 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340702.410543:0:85474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0440030800/0xa24651432773ead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773ea6 expref: 10 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340702.410564:0:85474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440030800, rc 0) 00000100:00100000:3.0:1780340702.410610:0:85474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f25d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961091200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340702.410616:0:85474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1780340702.411050:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961091200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340702.411077:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432773ea6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ead expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.411086:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432773ea6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773ead expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340702.411136:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961091328:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1780340702.411169:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340702.411198:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0477400480 going to sleep for 11 seconds 00000100:00100000:3.0:1780340702.411313:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961091328 00000100:00100000:3.0:1780340702.411318:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961091328 00000100:00100000:3.0:1780340702.411393:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1780340702.411401:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f25e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961091328:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1780340702.411425:0:85467:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1780340702.411443:0:85467:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1780340702.411445:0:85467:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 112 00000100:00100000:3.0:1780340702.411558:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f25e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961091328:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 157us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340702.411564:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1780340702.411637:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961091328:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1780340702.411679:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1780340702.411686:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432773ea6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ead expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.411695:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432773ea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ead expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340702.411703:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1780340702.411705:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c045f0c4800 from 52 10000000:01000000:1.0:1780340702.411707:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780340702.411743:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432773eb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.411751:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432773eb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.411791:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432773eb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340702.411807:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961091456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.411835:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340702.417280:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034869f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340702.418133:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961091456 00000100:00100000:0.0:1780340702.418145:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961091456 00000100:00100000:0.0:1780340702.419998:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1780340702.420028:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961091456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340702.420046:0:85466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340702.420064:0:85466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa4200/0xa24651432773ebb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773eb4 expref: -99 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.420091:0:85466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa4200/0xa24651432773ebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773eb4 expref: 11 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.420102:0:85466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa4200/0xa24651432773ebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773eb4 expref: 11 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.420110:0:85466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4200, rc 0) 00000100:00100000:0.0:1780340702.420186:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f25d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961091456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (8348us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340702.422412:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961091456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340702.422523:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432773eb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ebb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.422637:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432773eb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773ebb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340702.422804:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961091584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.422869:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340702.422910:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034869f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340702.423156:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961091584 00000100:00100000:3.0:1780340702.423163:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961091584 00000100:00100000:3.0:1780340702.423207:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1780340702.423217:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961091584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340702.425346:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1780340702.428919:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f25c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961091584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5694us (6041us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340702.429062:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961091584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.429119:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961091712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.429177:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340702.429221:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034869f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340702.429324:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1780340702.429360:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961091712 00000100:00100000:2.0:1780340702.429367:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961091712 00000100:00100000:2.0:1780340702.429486:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1780340702.429495:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034aa98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961091712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340702.430061:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034aa98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961091712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 438us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340702.430070:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1780340702.430337:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961091712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340702.432602:0:85556:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1780340702.439495:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1780340702.439707:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1780340702.440003:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432773eb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ebb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.440018:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432773eb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ebb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340702.440030:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1780340702.440032:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c045f0c4800 from 109 10000000:01000000:1.0:1780340702.440036:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1780340702.440075:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432773ec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.440083:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432773ec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.440094:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432773ec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340702.440118:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961091840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.440182:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340702.440665:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0458a2f180 going to sleep for 11 seconds 00000100:00100000:3.0:1780340702.444405:0:85474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961091840 00000100:00100000:3.0:1780340702.444482:0:85474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961091840 00000100:00100000:3.0:1780340702.444817:0:85474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1780340702.444828:0:85474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034aa99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961091840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340702.444853:0:85474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340702.444871:0:85474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0440030e00/0xa24651432773ec9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773ec2 expref: -99 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340702.444917:0:85474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0440030e00/0xa24651432773ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773ec2 expref: 12 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340702.444927:0:85474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0440030e00/0xa24651432773ec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773ec2 expref: 12 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340702.444948:0:85474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440030e00, rc 0) 00000100:00100000:3.0:1780340702.445026:0:85474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034aa99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961091840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (4844us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340702.445033:0:85474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1780340702.445128:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961091840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340702.445146:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432773ec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ec9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.445154:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432773ec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773ec9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340702.445223:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961091968:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.445271:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340702.453818:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0458a2f180 going to sleep for 11 seconds 00000100:00100000:2.0:1780340702.457079:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961091968 00000100:00100000:2.0:1780340702.457093:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961091968 00000100:00100000:2.0:1780340702.457158:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1780340702.457169:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034aa9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961091968:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1780340702.457194:0:85467:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1780340702.457217:0:85467:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1780340702.457222:0:85467:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1780340702.457225:0:85467:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1780340702.457228:0:85467:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1780340702.457230:0:85467:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 112 00000100:00100000:2.0:1780340702.457364:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034aa9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961091968:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 196us (12092us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340702.457372:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1780340702.457794:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961091968:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1780340702.457892:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1780340702.457903:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432773ec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ec9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.457914:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432773ec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ec9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340702.457924:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1780340702.457926:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1780340702.457929:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1780340702.458071:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122400/0xa24651432773ed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.458081:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453122400/0xa24651432773ed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.458090:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453122400/0xa24651432773ed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340702.458109:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961092096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.458142:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340702.458171:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0458a2f180 going to sleep for 11 seconds 00000100:00100000:1.0:1780340702.458186:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961092096 00000100:00100000:1.0:1780340702.458196:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961092096 00000100:00100000:1.0:1780340702.458220:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1780340702.458227:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034aa9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961092096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340702.458295:0:85466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340702.458308:0:85466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453123000/0xa24651432773ed7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773ed0 expref: -99 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.458329:0:85466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453123000/0xa24651432773ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773ed0 expref: 13 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.458339:0:85466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453123000/0xa24651432773ed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773ed0 expref: 13 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.458347:0:85466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123000, rc 0) 00000100:00100000:1.0:1780340702.458378:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034aa9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961092096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340702.458384:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1780340702.458407:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961092096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340702.459032:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453122400/0xa24651432773ed0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ed7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.459044:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453122400/0xa24651432773ed0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773ed7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340702.459102:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961092224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.459133:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340702.459146:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0458a2f180 going to sleep for 11 seconds 00000100:00100000:1.0:1780340702.459164:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961092224 00000100:00100000:1.0:1780340702.459173:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961092224 00000100:00100000:1.0:1780340702.459194:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1780340702.459201:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034aa99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961092224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.460102:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034aa99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961092224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 898us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340702.460112:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1780340702.460190:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961092224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340702.460228:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961092352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340702.460280:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340702.460303:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1780340702.460430:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961092352 00000100:00100000:0.0:1780340702.460441:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961092352 00000100:00100000:0.0:1780340702.460481:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1780340702.460489:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034aa9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961092352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340702.463156:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034aa9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961092352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2661us (2868us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340702.463170:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1780340702.463440:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961092352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780340702.471083:0:85557:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:2.0:1780340702.471363:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:2.0:1780340702.471388:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1780340702.471411:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122400/0xa24651432773ed0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ed7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.471434:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453122400/0xa24651432773ed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ed7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340702.471444:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1780340702.471447:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8c045f0c4800 from 1 10000000:01000000:2.0:1780340702.471450:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1780340702.471483:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722ae400/0xa24651432773ede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.471491:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04722ae400/0xa24651432773ede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.471501:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04722ae400/0xa24651432773ede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340702.471807:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961092480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340702.471882:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340702.471914:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1780340702.472049:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961092480 00000100:00100000:1.0:1780340702.472056:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961092480 00000100:00100000:1.0:1780340702.472139:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1780340702.472148:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034aa98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961092480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340702.472160:0:85466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340702.472173:0:85466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453123c00/0xa24651432773ee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773ede expref: -99 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.472195:0:85466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453123c00/0xa24651432773ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773ede expref: 14 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.472205:0:85466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453123c00/0xa24651432773ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773ede expref: 14 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.472215:0:85466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123c00, rc 0) 00000100:00100000:1.0:1780340702.472269:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034aa98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:6514:x1866818961092480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340702.472275:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1780340702.472336:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961092480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340702.472349:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04722ae400/0xa24651432773ede lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ee5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.472357:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04722ae400/0xa24651432773ede lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773ee5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340702.472372:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1780340702.472376:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722ae400/0xa24651432773ede lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ee5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.472389:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04722ae400/0xa24651432773ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ee5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340702.472396:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1780340702.472397:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c045f0c4800 from 7 10000000:01000000:2.0:1780340702.472399:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1780340702.472424:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722afa00/0xa24651432773eec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.472431:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04722afa00/0xa24651432773eec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.472438:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04722afa00/0xa24651432773eec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340702.472452:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961092608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340702.472476:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340702.479046:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961092608 00000100:00100000:0.0:1780340702.479061:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961092608 00000100:00100000:2.0:1780340702.479093:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1780340702.479133:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1780340702.479142:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034aa98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:6514:x1866818961092608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340702.479157:0:85468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340702.479174:0:85468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa4400/0xa24651432773ef3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773eec expref: -99 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.479202:0:85468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa4400/0xa24651432773ef3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773eec expref: 15 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.479214:0:85468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa4400/0xa24651432773ef3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773eec expref: 15 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.479222:0:85468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4400, rc 0) 00000100:00100000:0.0:1780340702.479375:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034aa98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961092608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (6897us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340702.479383:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1780340702.484168:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961092608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340702.484197:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04722afa00/0xa24651432773eec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ef3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.484213:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04722afa00/0xa24651432773eec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773ef3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340702.484310:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961092736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340702.484366:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340702.484426:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1780340702.485807:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961092736 00000100:00100000:0.0:1780340702.485819:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961092736 00000100:00100000:0.0:1780340702.485890:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1780340702.485901:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034aa98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961092736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340702.486129:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034aa98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961092736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340702.486138:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1780340702.488386:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961092736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340702.488456:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961092864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340702.488540:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340702.488579:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1780340702.488702:0:85474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961092864 00000100:00100000:3.0:1780340702.488710:0:85474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961092864 00000100:00100000:3.0:1780340702.488796:0:85474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1780340702.488806:0:85474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034aa9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961092864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340702.488921:0:85474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034aa9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961092864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340702.488929:0:85474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1780340702.489423:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961092864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340702.491230:0:85558:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1780340702.498873:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1780340702.498915:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1780340702.498926:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722afa00/0xa24651432773eec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ef3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.498949:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04722afa00/0xa24651432773eec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ef3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340702.498960:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780340702.498963:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c04773ad000 from 52 10000000:01000000:0.0:1780340702.498966:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780340702.499007:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa24651432773efa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.499015:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa24651432773efa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.499310:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa24651432773efa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340702.499340:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961092992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340702.499403:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340702.499523:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0349845480 going to sleep for 11 seconds 00000100:00100000:3.0:1780340702.499643:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961092992 00000100:00100000:3.0:1780340702.499650:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961092992 00000100:00100000:3.0:1780340702.499697:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1780340702.499705:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034aa9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961092992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340702.499717:0:85467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340702.499728:0:85467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0440031800/0xa24651432773f01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773efa expref: -99 pid: 85467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340702.499749:0:85467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0440031800/0xa24651432773f01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773efa expref: 16 pid: 85467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340702.499810:0:85467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0440031800/0xa24651432773f01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773efa expref: 16 pid: 85467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340702.499818:0:85467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440031800, rc 0) 00000100:00100000:3.0:1780340702.499864:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034aa9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961092992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340702.499870:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1780340702.501078:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961092992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340702.501097:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa24651432773efa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f01 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.501120:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa24651432773efa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773f01 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340702.501196:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961093120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340702.501255:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340702.501286:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0349845480 going to sleep for 11 seconds 00000100:00100000:1.0:1780340702.501688:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961093120 00000100:00100000:1.0:1780340702.501695:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961093120 00000100:00100000:1.0:1780340702.501732:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1780340702.501741:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b09ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961093120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.501923:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b09ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961093120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340702.502055:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961093120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340702.502090:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961093248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340702.502134:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340702.502154:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8840 going to sleep for 11 seconds 00000100:00100000:3.0:1780340702.502279:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961093248 00000100:00100000:3.0:1780340702.502284:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961093248 00000100:00100000:1.0:1780340702.503664:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1780340702.508989:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1780340702.509009:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b09e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961093248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340702.509189:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b09e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961093248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (7053us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340702.509198:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1780340702.509315:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961093248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340702.513221:0:85559:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1780340702.513448:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1780340702.513477:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780340702.513488:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa24651432773efa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f01 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.513500:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa24651432773efa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f01 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340702.513510:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1780340702.513512:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1780340702.513515:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1780340702.513559:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773f08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.513567:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773f08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.513576:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773f08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340702.513602:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961093376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340702.513662:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340702.536271:0:85474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961093376 00000100:00100000:1.0:1780340702.536287:0:85474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961093376 00000100:00100000:1.0:1780340702.536364:0:85474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1780340702.536374:0:85474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b09e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961093376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340702.536391:0:85474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340702.536410:0:85474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453122a00/0xa24651432773f0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773f08 expref: -99 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.536437:0:85474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453122a00/0xa24651432773f0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773f08 expref: 17 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.536448:0:85474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453122a00/0xa24651432773f0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773f08 expref: 17 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.536456:0:85474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122a00, rc 0) 00000100:00100000:1.0:1780340702.536530:0:85474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b09e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961093376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (22868us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340702.536538:0:85474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1780340702.537873:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0349845780 going to sleep for 11 seconds 00000100:00100000:1.0:1780340702.537905:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961093376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340702.537925:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773f08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f0f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.537935:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773f08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773f0f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340702.538097:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961093504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.538144:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340702.538172:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0458a2fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340702.538216:0:85474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961093504 00000100:00100000:3.0:1780340702.538222:0:85474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961093504 00000100:00100000:3.0:1780340702.538259:0:85474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1780340702.538267:0:85474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b09dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961093504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340702.538398:0:85474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b09dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961093504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340702.538406:0:85474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1780340702.539147:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961093504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.539181:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961093632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.539222:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340702.539253:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0458a2fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340702.539295:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961093632 00000100:00100000:3.0:1780340702.539300:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961093632 00000100:00100000:3.0:1780340702.539335:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1780340702.539342:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b09d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961093632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340702.540675:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b09d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961093632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1328us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340702.540831:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1780340702.542260:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961093632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780340702.548892:0:85561:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1780340702.549247:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1780340702.549272:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1780340702.549283:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773f08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f0f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.549296:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773f08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f0f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340702.549305:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1780340702.549308:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c04773ad000 from 7 10000000:01000000:1.0:1780340702.549311:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1780340702.549346:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122200/0xa24651432773f16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.549354:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453122200/0xa24651432773f16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.549365:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453122200/0xa24651432773f16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340702.549403:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961093760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.549466:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340702.549516:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0458a2fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340702.550409:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961093760 00000100:00100000:3.0:1780340702.550418:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961093760 00000100:00100000:3.0:1780340702.550478:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1780340702.550489:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961093760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340702.550501:0:85466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340702.550516:0:85466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f8200/0xa24651432773f1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773f16 expref: -99 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340702.550541:0:85466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f8200/0xa24651432773f1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773f16 expref: 18 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340702.550551:0:85466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f8200/0xa24651432773f1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773f16 expref: 18 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340702.550560:0:85466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8200, rc 0) 00000100:00100000:3.0:1780340702.550604:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961093760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340702.550611:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1780340702.551135:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961093760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340702.551152:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453122200/0xa24651432773f16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f1d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.551163:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453122200/0xa24651432773f16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773f1d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340702.551224:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961093888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.551255:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340702.551289:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0458a2fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340702.551419:0:85474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961093888 00000100:00100000:3.0:1780340702.551424:0:85474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961093888 00000100:00100000:3.0:1780340702.551473:0:85474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1780340702.551479:0:85474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349832850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961093888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340702.551578:0:85474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349832850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961093888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340702.551585:0:85474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1780340702.551806:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961093888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340702.551884:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961094016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340702.551927:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340702.551949:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0349845480 going to sleep for 11 seconds 00000100:00100000:3.0:1780340702.555552:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961094016 00000100:00100000:3.0:1780340702.555579:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961094016 00000100:00100000:3.0:1780340702.555646:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1780340702.555655:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349833850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961094016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340702.555834:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349833850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961094016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (3906us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340702.555850:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1780340702.556003:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961094016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780340702.559078:0:85562:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1780340702.559287:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1780340702.559313:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1780340702.559325:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122200/0xa24651432773f16 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f1d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.559337:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453122200/0xa24651432773f16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f1d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340702.559347:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1780340702.559350:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c047b065000 from 52 10000000:01000000:1.0:1780340702.559353:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780340702.559390:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432773f24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.559409:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432773f24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.559419:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432773f24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340702.559445:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961094144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.559508:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340702.559551:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0458a2fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340702.563143:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961094144 00000100:00100000:0.0:1780340702.563156:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961094144 00000100:00100000:0.0:1780340702.563215:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1780340702.563225:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034af4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961094144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340702.563241:0:85468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340702.563258:0:85468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa5800/0xa24651432773f2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773f24 expref: -99 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.563287:0:85468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa5800/0xa24651432773f2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773f24 expref: 19 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.563300:0:85468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa5800/0xa24651432773f2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773f24 expref: 19 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.563309:0:85468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5800, rc 0) 00000100:00100000:0.0:1780340702.563385:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034af4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961094144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (3876us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340702.563392:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1780340702.563490:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961094144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340702.563508:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432773f24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f2b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.563517:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432773f24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773f2b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340702.563589:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961094272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.563619:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340702.563655:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0458a2fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340702.563859:0:85474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961094272 00000100:00100000:3.0:1780340702.563864:0:85474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961094272 00000100:00100000:3.0:1780340702.563902:0:85474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1780340702.563909:0:85474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034af4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961094272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340702.564013:0:85474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034af4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961094272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340702.564030:0:85474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1780340702.564150:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961094272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.564178:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961094400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.564217:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340702.564246:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0458a2fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340702.564316:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961094400 00000100:00100000:0.0:1780340702.564321:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961094400 00000100:00100000:0.0:1780340702.564342:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1780340702.564349:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034af4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961094400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340702.564425:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034af4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961094400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340702.564431:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1780340702.564515:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961094400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780340702.565346:0:85563:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1780340702.565571:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1780340702.565591:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780340702.565598:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432773f24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f2b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.565608:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432773f24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f2b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340702.565618:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1780340702.565620:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1780340702.565623:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1780340702.565645:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4e00/0xa24651432773f32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.565652:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4e00/0xa24651432773f32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.565660:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4e00/0xa24651432773f32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340702.565676:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961094528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340702.565710:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340702.565741:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0349845780 going to sleep for 11 seconds 00000100:00100000:3.0:1780340702.566241:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961094528 00000100:00100000:3.0:1780340702.566247:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961094528 00000100:00100000:3.0:1780340702.566281:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1780340702.566288:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476321450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961094528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340702.566299:0:85468:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340702.566311:0:85468:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f8c00/0xa24651432773f39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773f32 expref: -99 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340702.566330:0:85468:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f8c00/0xa24651432773f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773f32 expref: 20 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340702.566339:0:85468:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f8c00/0xa24651432773f39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773f32 expref: 20 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340702.566347:0:85468:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8c00, rc 0) 00000100:00100000:3.0:1780340702.566388:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476321450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961094528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340702.566395:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1780340702.566501:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961094528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340702.566525:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4e00/0xa24651432773f32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f39 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.566539:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4e00/0xa24651432773f32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773f39 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340702.566591:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961094656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340702.566616:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340702.566646:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0349845780 going to sleep for 11 seconds 00000100:00100000:3.0:1780340702.566777:0:85474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961094656 00000100:00100000:3.0:1780340702.566782:0:85474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961094656 00000100:00100000:3.0:1780340702.566805:0:85474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1780340702.566811:0:85474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476320450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961094656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340702.566931:0:85474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476320450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961094656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340702.566937:0:85474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1780340702.567882:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961094656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340702.567924:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961094784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340702.567972:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340702.567993:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0349845780 going to sleep for 11 seconds 00000100:00100000:3.0:1780340702.568059:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961094784 00000100:00100000:3.0:1780340702.568064:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961094784 00000100:00100000:3.0:1780340702.568101:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1780340702.568109:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476321850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961094784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340702.570227:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476321850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961094784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2113us (2248us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340702.570238:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1780340702.570343:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961094784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780340702.577751:0:85564:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1780340702.578261:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1780340702.578287:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1780340702.578298:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4e00/0xa24651432773f32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f39 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.578311:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4e00/0xa24651432773f32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f39 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340702.578321:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1780340702.578323:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c047b065000 from 7 10000000:01000000:1.0:1780340702.578326:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1780340702.578361:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123800/0xa24651432773f40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.578369:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453123800/0xa24651432773f40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340702.578380:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453123800/0xa24651432773f40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340702.578404:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961094912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340702.578466:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340702.578518:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0458a2fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340702.578630:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961094912 00000100:00100000:0.0:1780340702.578636:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961094912 00000100:00100000:0.0:1780340702.578677:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1780340702.578684:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046f953450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961094912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340702.578695:0:85467:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340702.578705:0:85467:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa5e00/0xa24651432773f47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773f40 expref: -99 pid: 85467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.578723:0:85467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa5e00/0xa24651432773f47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773f40 expref: 21 pid: 85467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.578730:0:85467:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa5e00/0xa24651432773f47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773f40 expref: 21 pid: 85467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.578748:0:85467:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5e00, rc 0) 00000100:00100000:0.0:1780340702.578880:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046f953450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961094912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 197us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340702.578885:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1780340702.579120:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961094912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340702.579135:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453123800/0xa24651432773f40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f47 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.579144:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453123800/0xa24651432773f40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773f47 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340702.579202:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961095040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340702.579230:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340702.579256:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1780340702.579275:0:85474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961095040 00000100:00100000:0.0:1780340702.579280:0:85474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961095040 00000100:00100000:0.0:1780340702.579317:0:85474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1780340702.579325:0:85474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961095040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340702.579416:0:85474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446c5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961095040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340702.579422:0:85474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1780340702.580633:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961095040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340702.580693:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961095168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340702.580742:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340702.580795:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8840 going to sleep for 11 seconds 00000100:00100000:2.0:1780340702.580812:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961095168 00000100:00100000:2.0:1780340702.580817:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961095168 00000100:00100000:2.0:1780340702.580861:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1780340702.580869:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961095168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340702.580964:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446c5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961095168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340702.580970:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1780340702.581003:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961095168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780340702.591792:0:85565:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1780340702.591963:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1780340702.591992:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1780340702.592003:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123800/0xa24651432773f40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f47 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.592015:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453123800/0xa24651432773f40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f47 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340702.592037:0:6514:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1780340702.592039:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8c0471e119c0 from 1 10000000:01000000:2.0:1780340702.592042:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1780340702.592080:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432773f4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.592089:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432773f4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.592117:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432773f4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340702.592142:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961095296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340702.592206:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340702.592249:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8780 going to sleep for 11 seconds 00000100:00100000:0.0:1780340702.592349:0:85474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961095296 00000100:00100000:0.0:1780340702.592357:0:85474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961095296 00000100:00100000:0.0:1780340702.592404:0:85474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1780340702.592414:0:85474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446c5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961095296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340702.592426:0:85474:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340702.592440:0:85474:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa5c00/0xa24651432773f55 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773f4e expref: -99 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.592461:0:85474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa5c00/0xa24651432773f55 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773f4e expref: 22 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.592471:0:85474:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa5c00/0xa24651432773f55 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773f4e expref: 22 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340702.592478:0:85474:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5c00, rc 0) 00000100:00100000:0.0:1780340702.592520:0:85474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446c5c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961095296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340702.592527:0:85474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1780340702.592600:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961095296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340702.592612:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432773f4e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f55 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.592621:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432773f4e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773f55 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340702.592637:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1780340702.592641:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432773f4e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f55 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.592646:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432773f4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f55 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340702.592653:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1780340702.592654:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8c0471e119c0 from 1 10000000:01000000:2.0:1780340702.592656:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1780340702.592670:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432773f5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.592678:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432773f5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.592697:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432773f5c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340702.592709:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961095424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340702.592732:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340702.592756:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8780 going to sleep for 11 seconds 00000100:00100000:2.0:1780340702.592793:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961095424 00000100:00100000:2.0:1780340702.592796:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961095424 00000100:00100000:2.0:1780340702.592818:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1780340702.592824:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961095424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340702.592830:0:85466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340702.592848:0:85466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04722aec00/0xa24651432773f63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432773f5c expref: -99 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.592862:0:85466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04722aec00/0xa24651432773f63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432773f5c expref: 23 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.592869:0:85466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04722aec00/0xa24651432773f63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432773f5c expref: 23 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.592876:0:85466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722aec00, rc 0) 00000100:00100000:2.0:1780340702.592903:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961095424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340702.592908:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1780340702.592928:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961095424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340702.592937:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432773f5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f63 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.592949:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432773f5c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773f63 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340702.592994:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961095552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340702.593015:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340702.593038:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8780 going to sleep for 11 seconds 00000100:00100000:2.0:1780340702.593052:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961095552 00000100:00100000:2.0:1780340702.593055:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961095552 00000100:00100000:2.0:1780340702.593071:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1780340702.593076:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0345379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961095552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340702.593139:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0345379050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961095552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (123us total) trans 0 rc -2/-2 00000100:00100000:2.0:1780340702.593146:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1780340702.593168:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961095552:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1780340702.593185:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1780340702.593190:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432773f5c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f63 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340702.593196:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432773f5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773f63 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340703.115002:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340704.138035:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340704.299305:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340704.299348:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340704.301200:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940412160 00000100:00100000:0.0:1780340704.301214:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940412160 00000100:00100000:0.0:1780340704.301287:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1206 00000100:00100000:0.0:1780340704.301297:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940412160:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340704.301372:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940412160:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 76us (2075us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340704.301379:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1206 00000100:00080000:0.0:1780340704.301400:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340704.302054:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940412032 00000100:00100000:2.0:1780340704.302060:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940412032 00000100:00100000:2.0:1780340704.302099:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 73 00000100:00100000:2.0:1780340704.302107:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034537b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940412032:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340704.302161:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034537b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940412032:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 55us (2811us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340704.302167:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 73 00000100:00100000:1.0:1780340704.650666:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340704.650687:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961095680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340704.650775:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340704.650816:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961095808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340704.650848:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340704.650891:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961095680 00000100:00100000:1.0:1780340704.650905:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961095680 00000100:00100000:1.0:1780340704.650963:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961095808 00000100:00100000:1.0:1780340704.650966:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961095808 00000100:00080000:0.0:1780340704.650978:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340704.650983:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340704.650995:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1994 00000100:00100000:1.0:1780340704.652636:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961095680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780340704.652679:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340704.652692:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1995 00000100:00100000:0.0:1780340704.652706:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961095808:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340704.652725:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340704.652757:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961095680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1752us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340704.652787:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1994 00000100:00100000:0.0:1780340704.652797:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961095808:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (1946us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340704.652805:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1995 00000100:00100000:1.0:1780340704.654648:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961095808:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340704.654695:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961095680:0@lo:13:osp-pre-0-1.0 00000001:02000400:3.0:1780340705.024682:0:85729:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1780340705.167106:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1780340706.155415:0:85781:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1780340706.155637:0:85781:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:3.0:1780340706.187186:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340706.187192:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340706.187195:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340706.187203:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3480 00000100:00080000:3.0:1780340706.187208:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340706.187222:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340706.187245:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0348a6aa00 x1866818961096064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340706.187992:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340706.188013:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961095936:0@lo:400:kworker.0 00000100:00100000:1.0:1780340706.188145:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340706.191366:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961096064:0@lo:38:kworker.0 00000100:00100000:0.0:1780340706.191433:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340706.191477:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961096064 00000100:00100000:2.0:1780340706.191485:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961096064 00010000:00010000:0.0:1780340706.191504:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340706.191517:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:2.0:1780340706.191524:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961096064:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1780340706.191553:0:70100:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3486 last 0 00000100:00100000:1.0:1780340706.191566:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961095936 00000100:00100000:1.0:1780340706.191570:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961095936 00000100:00100000:1.0:1780340706.191609:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1780340706.191616:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0345378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961095936:12345-0@lo:400:kworker.0 00000020:00000080:2.0:1780340706.191660:0:70100:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa24651432773f6a 00000100:00100000:1.0:1780340706.191666:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0345378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961095936:12345-0@lo:400:kworker.0 Request processed in 51us (3522us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340706.191672:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000004:00100000:2.0:1780340706.191675:0:70100:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1780340706.191748:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961095936:0@lo:400:kworker.0 00000100:00100000:0.0:1780340706.191889:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340706.191900:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961096192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340706.191948:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1780340706.192017:0:70100:0:(import.c:65:import_set_state_nolock()) ffff8c045f0c2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340706.192069:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1866818961096064:12345-0@lo:38:kworker.0 Request processed in 544us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340706.192076:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:3.0:1780340706.192226:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961096192 00000100:00100000:3.0:1780340706.192231:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961096192 00010000:00080000:0.0:1780340706.192233:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c0348a6aa00 x1866818961096064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340706.192246:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 25 00000100:00100000:3.0:1780340706.192266:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3794 00000100:00100000:3.0:1780340706.192273:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961096192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780340706.192298:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:3.0:1780340706.192334:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485813050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961096192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340706.192340:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3794 00000100:00100000:3.0:1780340706.192578:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961096192:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1780340706.192610:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340706.192614:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340706.192617:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340706.192621:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3480 00000100:00080000:3.0:1780340706.192625:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340706.192628:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340706.192637:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961096320:0@lo:400:kworker.0 00000100:00100000:3.0:1780340706.192663:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340706.192696:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961096320 00000100:00100000:3.0:1780340706.192700:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961096320 00000100:00100000:3.0:1780340706.192740:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:3.0:1780340706.192747:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961096320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340706.192880:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961096320:12345-0@lo:400:kworker.0 Request processed in 133us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340706.192896:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00080000:2.0:1780340706.192916:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340706.192928:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961096320:0@lo:400:kworker.0 00000100:00100000:3.0:1780340706.192956:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0348a6a680 x1866818961096448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340706.192991:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340706.192995:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340706.192997:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340706.193000:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3480 00000100:00080000:3.0:1780340706.193003:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340706.193006:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340706.193018:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0348a69c00 x1866818961096704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340706.193040:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340706.193044:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340706.193045:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340706.193048:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3480 00000100:00080000:3.0:1780340706.193051:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340706.193054:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340706.193061:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961096960:0@lo:400:kworker.0 00000100:00100000:3.0:1780340706.193085:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340706.193117:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961096960 00000100:00100000:3.0:1780340706.193120:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961096960 00000100:00100000:3.0:1780340706.193149:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2454 00000100:00100000:3.0:1780340706.193155:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961096960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340706.193400:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961096960:12345-0@lo:400:kworker.0 Request processed in 246us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340706.193407:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2454 00000100:00100000:3.0:1780340706.193432:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961096960:0@lo:400:kworker.0 00000100:00080000:3.0:1780340706.193444:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340706.193457:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0348a6b480 x1866818961097088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340706.193480:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961097216:0@lo:400:kworker.0 00000100:00100000:3.0:1780340706.193500:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1780340706.193528:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1780340706.193531:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340706.193533:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0345f1c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340706.193537:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c0345f1c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340706.193547:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c04467fd180 x1866818961097472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340706.193656:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961096832:0@lo:400:kworker.0 00000100:00100000:2.0:1780340706.193683:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340706.193862:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1780340706.193869:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961096576:0@lo:400:kworker.0 00000100:00100000:2.0:1780340706.193893:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340706.193909:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961097344:0@lo:400:kworker.0 00000100:00100000:2.0:1780340706.193926:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780340706.194146:0:3658:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8c0348a6aa00 x1866818961096064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340731 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340706.194155:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1780340706.194361:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1780340706.194367:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1780340706.194371:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961096064:0@lo:38:kworker.0 00000100:00100000:0.0:1780340706.194388:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961096448:0@lo:38:kworker.0 00000100:00100000:0.0:1780340706.194412:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340706.194466:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961096704:0@lo:38:kworker.0 00000100:00100000:0.0:1780340706.194526:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340706.194544:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961097088:0@lo:38:kworker.0 00000100:00100000:0.0:1780340706.194562:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340706.194617:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961097472:0@lo:38:kworker.0 00000100:00100000:0.0:1780340706.194638:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340706.194653:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961096576 00000100:00100000:3.0:1780340706.194659:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961096576 00000100:00100000:3.0:1780340706.194699:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961096448 00000100:00100000:3.0:1780340706.194702:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961096448 00000100:00100000:3.0:1780340706.194715:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961097088 00000100:00100000:3.0:1780340706.194717:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961097088 00000100:00100000:3.0:1780340706.194728:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1780340706.194735:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961096576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340706.194800:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961096576:12345-0@lo:400:kworker.0 Request processed in 65us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340706.194807:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1780340706.194847:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1780340706.194851:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961096448:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1780340706.194879:0:70100:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3486 last 0 00000020:00000080:3.0:1780340706.194911:0:70100:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa24651432773f71 00000004:00100000:3.0:1780340706.194925:0:70100:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1780340706.194953:0:70100:0:(import.c:65:import_set_state_nolock()) ffff8c04754ef800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340706.194984:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1866818961096448:12345-0@lo:38:kworker.0 Request processed in 131us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340706.194991:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:3.0:1780340706.195004:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1780340706.195007:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961097088:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1780340706.195019:0:70100:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3486 last 0 00000020:00000080:3.0:1780340706.195038:0:70100:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa24651432773f78 00000004:00100000:3.0:1780340706.195044:0:70100:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1780340706.195056:0:70100:0:(import.c:65:import_set_state_nolock()) ffff8c04506d1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340706.195082:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1866818961097088:12345-0@lo:38:kworker.0 Request processed in 73us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340706.195087:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00080000:3.0:1780340706.195109:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340706.195135:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961096576:0@lo:400:kworker.0 00000100:00100000:3.0:1780340706.196975:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961097216 00000100:00100000:3.0:1780340706.196987:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961097216 00000100:00100000:3.0:1780340706.197036:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961096832 00000100:00100000:3.0:1780340706.197040:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961096832 00000100:00100000:3.0:1780340706.199745:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961097344 00000100:00100000:3.0:1780340706.199772:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961097344 00000100:00100000:3.0:1780340706.199805:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2455 00000100:00100000:3.0:1780340706.199835:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961097216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340706.199922:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961097216:12345-0@lo:400:kworker.0 Request processed in 89us (6420us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340706.199929:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2455 00000100:00100000:3.0:1780340706.199945:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2456 00000100:00100000:3.0:1780340706.199951:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961096832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340706.199981:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961096832:12345-0@lo:400:kworker.0 Request processed in 30us (6297us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340706.199986:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2456 00000100:00100000:3.0:1780340706.199996:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2457 00000100:00100000:3.0:1780340706.200001:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961097344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340706.200022:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349955880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961097344:12345-0@lo:400:kworker.0 Request processed in 22us (6096us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340706.200027:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2457 00000100:00100000:3.0:1780340706.200082:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961097216:0@lo:400:kworker.0 00000100:00080000:3.0:1780340706.200106:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340706.200109:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340706.200124:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961097344:0@lo:400:kworker.0 00000100:00100000:3.0:1780340706.200133:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961096832:0@lo:400:kworker.0 00010000:00080000:0.0:1780340706.201616:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c0348a6a680 x1866818961096448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340706.201633:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 25 00000100:00080000:0.0:1780340706.202467:0:3658:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8c0348a6a680 x1866818961096448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340731 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340706.202478:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1780340706.202490:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1780340706.202495:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1780340706.202500:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961096448:0@lo:38:kworker.0 00010000:00080000:0.0:1780340706.202522:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c0348a6b480 x1866818961097088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340706.202533:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 25 00000100:00080000:0.0:1780340706.203309:0:3658:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8c0348a6b480 x1866818961097088/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340731 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340706.203317:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1780340706.203320:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1780340706.203324:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1780340706.203328:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961097088:0@lo:38:kworker.0 00000100:00100000:0.0:1780340706.203366:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961096704 00000100:00100000:0.0:1780340706.203372:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961096704 00000100:00100000:0.0:1780340706.203415:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795 00000100:00100000:0.0:1780340706.203422:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961096704:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1780340706.203450:0:8410:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8c046ba24000, cookie 0xa24651432773df0 00010000:00080000:0.0:1780340706.203455:0:8410:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff8c046ba24000 cur 3486 last 1780340700 00000004:00100000:0.0:1780340706.203477:0:8410:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1780340706.203505:0:8410:0:(import.c:65:import_set_state_nolock()) ffff8c0346fd3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340706.203583:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818961096704:12345-0@lo:38:kworker.0 Request processed in 160us (9055us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340706.203589:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795 00010000:00080000:0.0:1780340706.203617:0:85496:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1780340706.203626:0:85496:0:(ldlm_lib.c:2668:replay_request_or_update()) Waiting for transno 103079215111 00000020:00080000:0.0:1780340706.203631:0:85496:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780340706.203634:0:85496:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 103079215111, next_transno: 103079215111 00010000:00080000:0.0:1780340706.203637:0:85496:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (103079215111) 00000020:00080000:0.0:1780340706.203639:0:85496:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780340706.203648:0:85496:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940403968 t103079215111 from 192.168.203.16@tcp req@ffff8c04440a5500 x1866818940403968/t0(103079215111) o36->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:128/0 lens 528/0 e 0 to 0 dl 1780340713 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340706.203731:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 25 00000100:00080000:0.0:1780340706.203740:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1780340706.203744:0:3658:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1780340706.203747:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:0.0:1780340706.203750:0:3658:0:(recover.c:53:ptlrpc_replay_next()) import ffff8c034a39c800 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:0.0:1780340706.203753:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:0.0:1780340706.203871:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961097472 00000100:00100000:0.0:1780340706.203876:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961097472 00000100:00100000:0.0:1780340706.203899:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:0.0:1780340706.203904:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961097472:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1780340706.203917:0:64454:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3486 last 0 00000020:00000080:0.0:1780340706.203947:0:64454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa24651432773f7f 00000004:00100000:0.0:1780340706.203954:0:64454:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1780340706.203970:0:64454:0:(import.c:65:import_set_state_nolock()) ffff8c0346fd0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340706.204005:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1866818961097472:12345-0@lo:38:kworker.0 Request processed in 99us (9365us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340706.204012:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:0.0:1780340706.204060:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961096704:0@lo:38:kworker.0 00010000:00080000:0.0:1780340706.204074:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c04467fd180 x1866818961097472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340706.204090:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 25 00000100:00080000:0.0:1780340706.204094:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1780340706.204098:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1780340706.204100:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0345f1c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1780340706.204105:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961097472:0@lo:38:kworker.0 00010000:00080000:0.0:1780340706.204124:0:85785:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1780340706.204127:0:85785:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1780340706.204132:0:85785:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000004:00080000:1.0:1780340706.204390:0:85496:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 697us 00000100:00080000:0.0:1780340706.204542:0:85785:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:0.0:1780340706.204577:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961097600:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1780340706.204614:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340706.204806:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961097600 00000100:00100000:3.0:1780340706.204820:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961097600 00000100:00100000:3.0:1780340706.204856:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3796 00000100:00100000:3.0:1780340706.204863:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818961097600:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1780340706.204877:0:22660:0:(ldlm_lib.c:3119:target_queue_recovery_request()) @@@ queue final req req@ffff8c0348a6b480 x1866818961097600/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:132/0 lens 224/0 e 0 to 0 dl 1780340717 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340706.204893:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818961097600:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 31us (279us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340706.204899:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3796 00010000:00010000:3.0:1780340706.258905:0:85496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773f86 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.258925:0:85496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773f86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.258939:0:85496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773f86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.258953:0:85496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432773f8d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.258960:0:85496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432773f8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.258966:0:85496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432773f8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.259328:0:85496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773f86 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.259336:0:85496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773f86 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.259342:0:85496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773f86 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.259347:0:85496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340706.259359:0:85496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773f86 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.259367:0:85496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773f86 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.259379:0:85496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04506cfb00) 00010000:00010000:3.0:1780340706.259383:0:85496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340706.259387:0:85496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773f86 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.259393:0:85496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773f86 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340706.259408:0:85496:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000cc916e0c reply state 0000000016fc5bf2 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432773f8d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.259419:0:85496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432773f8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.259425:0:85496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04506cf100) 00010000:00010000:3.0:1780340706.259428:0:85496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340706.259431:0:85496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1780340706.259536:0:85496:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1780340706.259554:0:85496:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340706.259557:0:85496:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000020:00080000:3.0:1780340706.259561:0:85496:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340706.259563:0:85496:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000001:00080000:3.0:1780340706.267590:0:85462:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215111 is committed 00010000:00010000:1.0:1780340706.267665:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432773f8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.267692:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432773f8d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.267699:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432773f8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.267704:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340706.267708:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432773f8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.267715:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432773f8d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.267733:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04506cf100) 00010000:00010000:1.0:1780340706.267737:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340706.267741:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432773f8d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.267747:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432773f8d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340706.281001:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340706.281093:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940404480 00000100:00100000:1.0:1780340706.281106:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940404480 00000100:00100000:1.0:1780340706.281166:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1205 00000100:00100000:1.0:1780340706.281176:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940404480:12345-192.168.203.16@tcp:36:rm.0 00010000:00080000:1.0:1780340706.281196:0:63712:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 103079215112, current: 103079215112, replaying 00000100:00100000:1.0:1780340706.281210:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940404480:12345-192.168.203.16@tcp:36:rm.0 Request processed in 37us (218us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780340706.281222:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1205 00000020:00080000:1.0:1780340706.281260:0:85496:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340706.281264:0:85496:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215112, next_transno: 103079215112 00010000:00080000:1.0:1780340706.281268:0:85496:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (103079215112) 00000020:00080000:1.0:1780340706.281276:0:85496:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340706.281291:0:85496:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940404480 t103079215112 from 192.168.203.16@tcp req@ffff8c04467fc700 x1866818940404480/t0(103079215112) o36->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:132/0 lens 512/0 e 0 to 0 dl 1780340717 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1780340706.281377:0:85496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa24651432773f94 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281403:0:85496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa24651432773f94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281414:0:85496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa24651432773f94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281429:0:85496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432773f9b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281436:0:85496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432773f9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281441:0:85496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432773f9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281519:0:85496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432773fa2 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281527:0:85496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432773fa2 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281534:0:85496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432773fa2 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281806:0:85496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432773fa2 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281824:0:85496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432773fa2 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281831:0:85496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432773fa2 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281836:0:85496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340706.281840:0:85496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432773fa2 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281848:0:85496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432773fa2 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281859:0:85496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff8c04428aaf00) 00010000:00010000:1.0:1780340706.281863:0:85496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1780340706.281867:0:85496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432773fa2 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281873:0:85496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432773fa2 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281894:0:85496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa24651432773f94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281900:0:85496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa24651432773f94 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281905:0:85496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa24651432773f94 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281917:0:85496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340706.281920:0:85496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa24651432773f94 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281984:0:85496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa24651432773f94 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.281996:0:85496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428aa300) 00010000:00010000:1.0:1780340706.281998:0:85496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340706.282001:0:85496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa24651432773f94 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.282006:0:85496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa24651432773f94 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340706.282018:0:85496:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e9342892 reply state 000000005ccb6ba6 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432773f9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.282028:0:85496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432773f9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.282034:0:85496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04428aa400) 00010000:00010000:1.0:1780340706.282037:0:85496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340706.282039:0:85496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1780340706.282111:0:85496:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1780340706.282124:0:85496:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340706.282127:0:85496:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000020:00080000:1.0:1780340706.282130:0:85496:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340706.282132:0:85496:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000100:00100000:0.0:1780340706.286399:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340706.286527:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940405888 00000100:00100000:3.0:1780340706.286576:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940405888 00000100:00100000:3.0:1780340706.286655:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1206 00000100:00100000:3.0:1780340706.286665:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2406:x1866818940405888:12345-192.168.203.16@tcp:36:dd.0 00010000:00080000:3.0:1780340706.286707:0:64454:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 103079215113, current: 103079215114, replaying 00000100:00100000:3.0:1780340706.286726:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2406:x1866818940405888:12345-192.168.203.16@tcp:36:dd.0 Request processed in 63us (333us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340706.286734:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1206 00000020:00080000:0.0:1780340706.286942:0:85496:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780340706.286946:0:85496:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215114, next_transno: 103079215113 00010000:00080000:0.0:1780340706.286950:0:85496:0:(ldlm_lib.c:2243:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 103079215113, ql: 1, comp: 1, conn: 2, next: 103079215114, next_update 0 last_committed: 103079215111) 00000020:00080000:0.0:1780340706.286955:0:85496:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780340706.286964:0:85496:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940405888 t103079215114 from 192.168.203.16@tcp req@ffff8c0348a6a680 x1866818940405888/t0(103079215114) o36->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:132/0 lens 488/0 e 0 to 0 dl 1780340717 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1780340706.287149:0:85496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773fa9 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.287163:0:85496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773fa9 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.287184:0:85496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773fa9 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340706.287334:0:85496:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000093772ef6 reply state 000000009adf26fc transno 103079215114 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773fa9 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.287346:0:85496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773fa9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.287354:0:85496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff8c04428a8a00) 00010000:00010000:0.0:1780340706.287357:0:85496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340706.287360:0:85496:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1780340706.287466:0:85496:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1780340706.287480:0:85496:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780340706.287482:0:85496:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215115 00000020:00080000:0.0:1780340706.287485:0:85496:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780340706.287487:0:85496:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215115 00000100:00100000:1.0:1780340706.315999:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340706.316273:0:63724:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940406144 00000100:00100000:2.0:1780340706.316283:0:63724:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940406144 00000100:00100000:2.0:1780340706.316351:0:63724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:2.0:1780340706.316361:0:63724:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2406:x1866818940406144:12345-192.168.203.16@tcp:10:dd.0 00010000:00080000:2.0:1780340706.316383:0:63724:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 103079215115, current: 103079215115, replaying 00000100:00100000:2.0:1780340706.316406:0:63724:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2406:x1866818940406144:12345-192.168.203.16@tcp:10:dd.0 Request processed in 46us (414us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340706.316414:0:63724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1 00000020:00080000:3.0:1780340706.316459:0:85496:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340706.316464:0:85496:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215115, next_transno: 103079215115 00010000:00080000:3.0:1780340706.316468:0:85496:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (103079215115) 00000020:00080000:3.0:1780340706.316472:0:85496:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340706.316480:0:85496:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940406144 t103079215115 from 192.168.203.16@tcp req@ffff8c03498ed180 x1866818940406144/t0(103079215115) o10->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:132/0 lens 440/0 e 0 to 0 dl 1780340717 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780340706.316717:0:85496:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1780340706.316731:0:85496:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340706.316734:0:85496:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215116 00000020:00080000:3.0:1780340706.316737:0:85496:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340706.316739:0:85496:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215116 00000100:00100000:3.0:1780340706.327441:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340706.328993:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940412288 00000100:00100000:0.0:1780340706.329008:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940412288 00000100:00100000:0.0:1780340706.329062:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1207 00000100:00100000:0.0:1780340706.329073:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:2406:x1866818940412288:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1780340706.329098:0:70100:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c04467fd180 x1866818940412288/t0(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:132/0 lens 328/0 e 0 to 0 dl 1780340717 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340706.329119:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:2406:x1866818940412288:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 Request processed in 47us (1686us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340706.329126:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1207 00000020:00080000:3.0:1780340706.329200:0:85496:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340706.329205:0:85496:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 103079215116 00010000:00080000:3.0:1780340706.329208:0:85496:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1780340706.329211:0:85496:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340706.329217:0:85496:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1780340706.329220:0:85496:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1780340706.329227:0:85496:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 192.168.203.16@tcp: req@ffff8c04467fd180 x1866818940412288/t0(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:132/0 lens 328/0 e 0 to 0 dl 1780340717 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1780340706.329258:0:85496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340706.329284:0:85496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773fb0 lrc: 2/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced22f7 expref: -99 pid: 85496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.329311:0:85496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773fb0 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 12 pid: 85496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.329327:0:85496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773fb0 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 12 pid: 85496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.329336:0:85496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9200, rc 0) 00010000:00080000:3.0:1780340706.329404:0:85496:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:3.0:1780340706.329415:0:85496:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1780340706.331266:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340706.331337:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940412416 00000100:00100000:3.0:1780340706.331347:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940412416 00000100:00100000:3.0:1780340706.331390:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1209 00000100:00100000:3.0:1780340706.331400:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:2406:x1866818940412416:12345-192.168.203.16@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1780340706.331419:0:63711:0:(ldlm_lib.c:3119:target_queue_recovery_request()) @@@ queue final req req@ffff8c0348a68a80 x1866818940412416/t0(0) o400->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:132/0 lens 224/0 e 0 to 0 dl 1780340717 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340706.331445:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:2406:x1866818940412416:12345-192.168.203.16@tcp:400:ptlrpcd_rcv.0 Request processed in 48us (187us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340706.331451:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1209 00010000:00080000:1.0:1780340706.331495:0:85496:0:(ldlm_lib.c:2270:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1780340706.331596:0:85496:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 107374182400 00000001:00100000:2.0:1780340706.341186:0:85462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000001:00100000:2.0:1780340706.341199:0:85462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1780340706.341224:0:85462:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215115 is committed 00000001:00080000:1.0:1780340706.341302:0:85496:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1780340706.341336:0:85496:0:(ldlm_lib.c:1981:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1780340706.341349:0:85496:0:(ldlm_lib.c:2922:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8c0348a6b480 x1866818961097600/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:132/0 lens 224/0 e 0 to 0 dl 1780340717 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1780340706.341463:0:85496:0:(ldlm_lib.c:2922:target_recovery_thread()) @@@ processing final ping from 192.168.203.16@tcp: req@ffff8c0348a68a80 x1866818940412416/t0(0) o400->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:132/0 lens 224/0 e 0 to 0 dl 1780340717 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1780340706.341518:0:85496:0:(ldlm_lib.c:1853:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00010000:00010000:3.0:1780340706.342882:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432773f9b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.342898:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432773f9b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.342918:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432773f9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.342924:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340706.342928:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432773f9b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.342936:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432773f9b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.342951:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04428aa400) 00010000:00010000:3.0:1780340706.342954:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340706.342959:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432773f9b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.342965:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432773f9b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.342991:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773fa9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.342997:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773fa9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.343003:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773fa9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.343008:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340706.343010:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773fa9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.343026:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773fa9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.343035:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff8c04428a8a00) 00010000:00010000:3.0:1780340706.343037:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340706.343040:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773fa9 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.343046:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432773fa9 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85496 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1780340706.343427:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1780340706.343439:0:3658:0:(client.c:3224:ptlrpc_resend_req()) @@@ going to resend req@ffff8c0348a69c00 x1866818961097600/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340722 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340706.343448:0:3658:0:(client.c:3233:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8c0348a69c00 x1866818961097600/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340722 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340706.343454:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1780340706.343469:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1780340706.343475:0:3658:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000bde5a328): req@ffff8c0349087800 x1866818961075840/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340684 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340706.343489:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961097600:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1780340706.343644:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961097728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340706.343703:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340706.343742:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340706.343939:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961097728 00000100:00100000:3.0:1780340706.343945:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961097728 00000100:00100000:3.0:1780340706.343983:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961075840 00000100:00100000:3.0:1780340706.343986:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961075840 00000100:00100000:3.0:1780340706.344006:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3797 00000100:00100000:3.0:1780340706.344014:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1866818961097728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340706.344045:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1445236736 avail 1298997248 00000100:00100000:3.0:1780340706.344090:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1866818961097728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340706.344097:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3797 00000100:00100000:3.0:1780340706.344113:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3798 00000100:00100000:3.0:1780340706.344119:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818961075840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340706.344129:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 28672 pending 0 free 1445236736 avail 1298997248 00000100:00100000:3.0:1780340706.344161:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818961075840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 43us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340706.344167:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3798 00000100:00100000:3.0:1780340706.344205:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961097728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340706.344213:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961075840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340706.351177:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340706.351217:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340706.351253:0:63725:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940407296 00000100:00100000:0.0:1780340706.351262:0:63725:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940407296 00002000:00100000:0.0:1780340706.351304:0:63725:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff8c0348a68000 x1866818940407296/t0(0) o4->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:132/0 lens 496/0 e 0 to 0 dl 1780340717 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780340706.351315:0:63725:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8c0348a68000 with x1866818940407296 00002000:00010000:0.0:1780340706.351325:0:63725:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773fb0 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 7 pid: 85496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340706.351357:0:63725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:0.0:1780340706.351366:0:63725:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:0:x1866818940407296:12345-192.168.203.16@tcp:4:dd.0 00000100:00100000:2.0:1780340706.351852:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940407424 00000100:00100000:2.0:1780340706.351857:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940407424 00000100:00100000:2.0:1780340706.351896:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1208 00000100:00100000:2.0:1780340706.351903:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:0:x1866818940407424:12345-192.168.203.16@tcp:16:kworker.0 00000100:00100000:0.0:1780340706.356099:0:63725:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:0:x1866818940407296:12345-192.168.203.16@tcp:4:dd.0 Request processed in 4723us (4870us total) trans 107374182401 rc 0/0 00000100:00100000:0.0:1780340706.356112:0:63725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2 00002000:00100000:0.0:1780340706.356124:0:63725:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff8c0348a68000 x1866818940407296/t107374182401(0) o4->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:132/0 lens 496/448 e 0 to 0 dl 1780340717 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780340706.356133:0:63725:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8c0348a68000 with x1866818940407296 00002000:00010000:0.0:1780340706.356141:0:63725:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773fb0 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 10 pid: 85496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1780340706.357352:0:85462:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182401 is committed 00000100:00100000:0.0:1780340706.357913:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:0:x1866818940407424:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 6006us (6738us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340706.357925:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1208 00000004:00000080:3.0:1780340706.393142:0:85496:0:(mdd_device.c:2374:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff992747f37e10 00100000:10000000:3.0:1780340706.393157:0:85496:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1780340706.407424:0:85482:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x282:0x0] 00000100:00100000:3.0:1780340706.407477:0:85482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b830700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85482:1866818961097856:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1780340706.407541:0:85482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340706.407567:0:85482:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0450132e40 going to sleep for 11 seconds 00000004:00080000:3.0:1780340706.407583:0:85484:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x90:0x0] 00000100:00100000:3.0:1780340706.407598:0:85484:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048527c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85484:1866818961097984:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1780340706.407621:0:85484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340706.407636:0:85484:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0450132a80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340706.407659:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961097856 00000100:00100000:3.0:1780340706.407667:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961097856 00000100:00100000:0.0:1780340706.407914:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961097984 00000100:00100000:0.0:1780340706.407919:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961097984 00000100:00100000:0.0:1780340706.407967:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5884 00000100:00100000:0.0:1780340706.407976:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:85484:x1866818961097984:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1780340706.408002:0:8830:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 769 -> diff = -625 00002000:02000040:0.0:1780340706.408007:0:8830:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:145 to 0x2c0000401:769) 00000100:00100000:3.0:1780340706.408974:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5885 00000100:00100000:3.0:1780340706.408986:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:85482:x1866818961097856:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1780340706.409008:0:25489:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 769 -> diff = -127 00002000:02000040:3.0:1780340706.409012:0:25489:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:643 to 0x280000401:769) 00002000:00010000:0.0:1780340706.421664:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x301:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.421677:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432773fb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.421694:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.421696:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.421701:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432773fb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.421717:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432773fb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.421727:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432773fb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.421734:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432773fb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.421756:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.421987:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.421993:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432773fb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.422001:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.422010:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432773fb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.422019:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432773fb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.422034:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432773fb7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.422041:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432773fb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.422056:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.422058:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.422059:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.422698:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x300:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.422705:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432773fbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.422713:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.422714:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.422717:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432773fbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.422725:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432773fbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.422733:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432773fbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.422746:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432773fbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.422777:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.422786:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.422790:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432773fbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.422797:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.422800:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432773fbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.432886:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432773fbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.432927:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432773fbe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.432936:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432773fbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.432966:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.432968:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.432971:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.433236:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.433250:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432773fc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433262:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.433264:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.433269:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432773fc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433281:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432773fc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433291:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432773fc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433300:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432773fc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433320:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.433329:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.433334:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432773fc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433341:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.433345:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432773fc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433354:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432773fc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433376:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432773fc5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433384:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432773fc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433399:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.433400:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.433402:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.433442:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.433448:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773fcc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433456:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.433458:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.433461:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773fcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433470:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773fcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433477:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773fcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433485:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773fcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433509:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.433516:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.433520:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773fcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433527:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.433530:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773fcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433537:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773fcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433547:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773fcc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433554:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432773fcc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433566:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.433567:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.433569:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.433602:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.433607:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432773fd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433615:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.433621:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.433624:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432773fd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433633:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432773fd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433641:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432773fd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433648:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432773fd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433662:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.433669:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.433673:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432773fd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.433680:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.435388:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432773fd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.435408:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432773fd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.435426:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432773fd3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.435446:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432773fd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.435470:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.435472:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.435474:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.435981:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.435988:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432773fda lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436000:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.436002:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.436007:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432773fda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436017:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432773fda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436026:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432773fda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436033:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432773fda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436053:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.436062:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.436073:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432773fda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436080:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.436084:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432773fda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436092:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432773fda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436102:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432773fda lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436110:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432773fda lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436123:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.436125:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.436126:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.436163:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.436168:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432773fe1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436175:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.436177:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.436180:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432773fe1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436199:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432773fe1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436207:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432773fe1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436215:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432773fe1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436228:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.436235:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.436238:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432773fe1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436245:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.436248:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432773fe1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436255:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432773fe1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436264:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432773fe1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436269:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432773fe1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436286:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.436288:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.436290:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.436325:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.436330:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432773fe8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436337:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.436339:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.436342:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432773fe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436350:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432773fe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436358:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432773fe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436365:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432773fe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436378:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.436384:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.436388:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432773fe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436405:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.436408:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432773fe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436416:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432773fe8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436426:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432773fe8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436433:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432773fe8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436445:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.436447:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.436448:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.436482:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.436487:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432773fef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436494:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.436496:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.436499:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432773fef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436507:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432773fef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436520:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432773fef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436528:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432773fef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436540:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.436547:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.436551:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432773fef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436557:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.436560:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432773fef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436568:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432773fef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436578:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432773fef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436586:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432773fef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436599:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.436605:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.436606:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.436643:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.436647:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432773ff6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436655:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.436656:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.436659:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432773ff6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436668:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432773ff6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436675:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432773ff6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.436681:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432773ff6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780340706.440755:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x301:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340706.440807:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa24651432773ffd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.440844:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.440847:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.440852:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa24651432773ffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.440878:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa24651432773ffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.440888:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa24651432773ffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.440896:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa24651432773ffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.440924:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340706.440936:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340706.440942:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa24651432773ffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.440950:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340706.440955:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa24651432773ffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.440963:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa24651432773ffd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.440992:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa24651432773ffd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.441000:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa24651432773ffd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.441020:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.441022:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.441024:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340706.444079:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x300:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340706.444127:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774004 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.444144:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.444146:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.444151:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774004 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.444165:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774004 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.444174:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774004 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.444182:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774004 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.444296:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340706.444308:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340706.444314:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774004 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.444324:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340706.444328:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774004 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.444337:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774004 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.444354:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774004 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.444362:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774004 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.444877:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.444880:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.444882:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340706.445083:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340706.445088:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f77e1d/0xa2465143277400b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.445097:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.445108:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.445111:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003f77e1d/0xa2465143277400b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.445122:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003f77e1d/0xa2465143277400b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.445130:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000003f77e1d/0xa2465143277400b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.445137:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000003f77e1d/0xa2465143277400b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.448460:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.448478:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.448484:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432773ff6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.448497:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.448502:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432773ff6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.448522:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432773ff6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.448542:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432773ff6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.448550:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432773ff6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.448572:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.448573:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.448575:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.448672:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.448678:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774012 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.448689:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.448691:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.448696:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774012 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.448706:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774012 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.448715:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774012 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.448733:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774012 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.448748:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.448756:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.448792:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774012 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.448800:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.448803:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774012 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.453151:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774012 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.453175:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774012 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.453184:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774012 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1780340706.453348:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1780340706.453746:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.454002:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.454009:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000003f77e1d/0xa2465143277400b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454032:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.454036:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f77e1d/0xa2465143277400b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454045:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000003f77e1d/0xa2465143277400b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454057:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000003f77e1d/0xa2465143277400b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454064:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003f77e1d/0xa2465143277400b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454080:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.454082:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.454084:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.454090:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.454092:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.454093:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.454383:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.454389:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432774019 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454400:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.454402:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.454407:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432774019 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454424:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432774019 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454433:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432774019 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454440:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432774019 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454454:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340706.454488:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.454493:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432774020 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454500:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.454502:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.454505:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432774020 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454513:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432774020 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454520:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432774020 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454527:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432774020 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454546:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1780340706.454553:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780340706.454557:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432774019 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454564:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.454567:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432774019 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454575:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432774019 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454584:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432774019 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454591:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cad6900c/0xa24651432774019 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454604:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.454607:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432774020 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454613:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.454616:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432774020 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454633:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432774020 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454642:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432774020 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454648:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bc9e19a/0xa24651432774020 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454660:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.454661:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.454663:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.454702:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.454707:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432774027 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454714:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.454716:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.454718:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432774027 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454726:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432774027 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454733:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432774027 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454750:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432774027 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454782:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.454791:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.454795:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432774027 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454801:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.454804:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432774027 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454823:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432774027 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454834:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432774027 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454840:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0176fa5/0xa24651432774027 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454854:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.454855:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.454857:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.454896:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.454908:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa2465143277402e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454915:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.454917:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.454919:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa2465143277402e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454927:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa2465143277402e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454934:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa2465143277402e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454941:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa2465143277402e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454953:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.454959:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.454962:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa2465143277402e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454967:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.454970:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa2465143277402e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454976:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa2465143277402e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.454994:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa2465143277402e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455001:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa2465143277402e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455013:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.455014:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.455016:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.455050:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.455055:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774035 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455063:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.455064:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.455066:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774035 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455074:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774035 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455082:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774035 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455090:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774035 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455115:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.455123:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.455126:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774035 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455133:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.455135:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774035 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455143:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774035 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455153:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774035 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455160:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774035 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455173:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.455174:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.455176:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.455211:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.455216:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afac9295/0xa2465143277403c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455224:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.455229:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.455232:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afac9295/0xa2465143277403c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455241:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afac9295/0xa2465143277403c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455248:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afac9295/0xa2465143277403c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455255:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afac9295/0xa2465143277403c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455266:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.455272:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.455275:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afac9295/0xa2465143277403c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455281:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.455284:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afac9295/0xa2465143277403c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455291:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afac9295/0xa2465143277403c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455300:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afac9295/0xa2465143277403c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455315:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afac9295/0xa2465143277403c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455327:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.455329:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.455331:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.455365:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.455370:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000179d0384/0xa24651432774043 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455377:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.455379:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.455381:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000179d0384/0xa24651432774043 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455389:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000179d0384/0xa24651432774043 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455396:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000179d0384/0xa24651432774043 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455403:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000179d0384/0xa24651432774043 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455413:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.455418:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.455427:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000179d0384/0xa24651432774043 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455433:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.455436:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000179d0384/0xa24651432774043 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455444:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000179d0384/0xa24651432774043 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455455:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000179d0384/0xa24651432774043 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455462:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000179d0384/0xa24651432774043 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455475:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.455478:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.455480:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.455518:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.455524:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa2465143277404a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455532:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.455533:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.455535:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa2465143277404a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455552:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa2465143277404a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455560:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa2465143277404a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455567:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa2465143277404a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455578:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.455585:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.455588:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa2465143277404a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455594:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.455597:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa2465143277404a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455604:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa2465143277404a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455612:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa2465143277404a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455618:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa2465143277404a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455635:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.455637:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.455639:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.455672:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.455677:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774051 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455684:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.455685:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.455688:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774051 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455695:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774051 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455703:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774051 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455710:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774051 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455722:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.455727:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.455730:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774051 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455746:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.455750:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774051 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.455751:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.455779:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774051 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455790:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774051 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455797:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774051 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455820:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.455822:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.455823:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.455863:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.455867:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ca52c6e/0xa24651432774058 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455874:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.455875:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.455878:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ca52c6e/0xa24651432774058 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455886:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ca52c6e/0xa24651432774058 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455901:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ca52c6e/0xa24651432774058 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455908:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ca52c6e/0xa24651432774058 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455921:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.455927:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.455930:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ca52c6e/0xa24651432774058 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455937:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.455939:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ca52c6e/0xa24651432774058 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455946:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ca52c6e/0xa24651432774058 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455956:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ca52c6e/0xa24651432774058 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455963:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ca52c6e/0xa24651432774058 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.455974:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.455980:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.455982:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.456018:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.456023:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa2465143277405f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456030:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.456032:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.456034:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa2465143277405f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456042:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa2465143277405f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456049:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa2465143277405f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456055:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa2465143277405f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456066:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.456071:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.456074:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa2465143277405f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456080:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.456083:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa2465143277405f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456098:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa2465143277405f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456107:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa2465143277405f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456113:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa2465143277405f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456124:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.456125:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.456127:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.456161:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.456165:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa24651432774066 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456173:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.456174:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.456176:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa24651432774066 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456183:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa24651432774066 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456190:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa24651432774066 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456206:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa24651432774066 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456216:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.456223:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.456225:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa24651432774066 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456231:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.456234:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa24651432774066 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456240:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa24651432774066 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456250:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa24651432774066 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456256:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa24651432774066 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456268:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.456270:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.456271:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.456305:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.456316:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa2465143277406d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456322:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.456324:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.456326:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa2465143277406d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456334:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa2465143277406d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456342:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa2465143277406d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456349:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa2465143277406d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456373:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340706.456408:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.456413:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774074 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456420:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.456422:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.456425:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774074 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456433:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774074 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456445:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774074 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456452:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774074 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456465:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1780340706.456472:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780340706.456475:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa2465143277406d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456482:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.456486:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa2465143277406d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456494:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa2465143277406d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456504:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa2465143277406d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456511:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa2465143277406d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456523:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.456530:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774074 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456536:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.456539:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774074 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456546:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774074 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456556:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774074 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456563:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774074 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456572:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.456574:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.456575:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.456609:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.456614:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa2465143277407b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456621:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.456623:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.456626:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa2465143277407b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456647:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa2465143277407b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456655:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa2465143277407b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456662:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa2465143277407b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456674:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.456681:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.456684:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa2465143277407b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456690:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.456693:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa2465143277407b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456701:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa2465143277407b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456710:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa2465143277407b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456716:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa2465143277407b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456734:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.456736:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.456738:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.456790:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.456795:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774082 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.456802:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.456804:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.456806:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774082 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.457168:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1780340706.457241:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1780340706.457284:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774082 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.457292:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774082 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.457299:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774082 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.457342:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340706.457382:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.457387:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774089 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.457404:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.457405:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.457408:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774089 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.457416:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774089 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.457422:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774089 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.457429:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774089 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.457454:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780340706.457460:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774082 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.457466:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340706.457469:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774082 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.457475:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774082 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.457485:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774082 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.457492:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774082 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.457513:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340706.457516:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774089 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.457522:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340706.457525:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774089 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.457532:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774089 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.457542:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774089 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.457548:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340706.457550:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340706.457552:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.457609:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1780340706.457614:0:8830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774089 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340706.457657:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.457662:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774090 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.457670:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.457671:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.457673:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774090 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.457831:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774090 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.457838:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774090 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.457845:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774090 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.458217:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340706.458222:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774090 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.458230:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340706.458233:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774090 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.458250:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774090 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.458260:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774090 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.458268:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340706.458269:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340706.458271:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.458324:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1780340706.458328:0:8830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774090 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458344:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.458388:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.458393:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432774097 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458399:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.458400:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.458403:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432774097 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458410:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432774097 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458425:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432774097 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458431:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432774097 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458442:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.458448:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.458451:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432774097 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458456:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.458459:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432774097 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458465:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432774097 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458475:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432774097 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458482:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa24651432774097 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458493:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.458499:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.458500:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340706.458534:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.458538:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa2465143277409e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458545:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.458547:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.458550:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa2465143277409e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458557:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa2465143277409e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458565:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa2465143277409e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458572:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa2465143277409e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458588:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340706.458622:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.458626:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000915f18ac/0xa246514327740a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458634:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.458635:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.458638:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000915f18ac/0xa246514327740a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458656:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000915f18ac/0xa246514327740a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458663:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000915f18ac/0xa246514327740a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458671:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000915f18ac/0xa246514327740a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.458824:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780340706.459778:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340706.459786:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa2465143277409e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.459883:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340706.459888:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa2465143277409e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.459897:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa2465143277409e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.459912:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa2465143277409e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.459920:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa2465143277409e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.459945:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340706.459948:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000915f18ac/0xa246514327740a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.459954:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04497b7200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340706.459957:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000915f18ac/0xa246514327740a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.459965:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000915f18ac/0xa246514327740a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.459975:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000915f18ac/0xa246514327740a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.459987:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000915f18ac/0xa246514327740a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.460074:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.460076:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.460077:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1780340706.462611:0:8830:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:144 00000100:00100000:0.0:1780340706.462842:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:85484:x1866818961097984:12345-0@lo:5:osp-pre-1-0.0 Request processed in 54864us (55215us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340706.462855:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5884 00000100:00100000:0.0:1780340706.462907:0:85484:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048527c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85484:1866818961097984:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1780340706.462922:0:85484:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x301:0x0] from OST, last_created [0x2c0000401:0x301:0x0]last_used is [0x2c0000401:0x90:0x0] 00000100:00100000:0.0:1780340706.462990:0:85484:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85484:1866818961098240:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1780340706.463023:0:85484:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340706.463045:0:85484:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a89fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340706.463066:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961098112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340706.463090:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340706.463125:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961098240 00000100:00100000:0.0:1780340706.463131:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961098240 00000100:00100000:0.0:1780340706.463167:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5886 00000100:00100000:0.0:1780340706.463184:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:85484:x1866818961098240:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1780340706.463219:0:25492:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 770 00002000:00010000:3.0:1780340706.463634:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340706.463644:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa246514327740ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.463659:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.463662:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.463667:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa246514327740ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.463682:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa246514327740ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.463693:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa246514327740ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.463708:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa246514327740ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.463726:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780340706.464147:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340706.464154:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa246514327740b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464163:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.464165:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.464168:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa246514327740b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464178:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa246514327740b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464187:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa246514327740b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464195:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa246514327740b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464222:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1780340706.464280:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340706.464287:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa246514327740ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464307:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.464309:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.464312:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa246514327740ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464322:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa246514327740ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464331:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa246514327740ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464339:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa246514327740ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464357:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1780340706.464368:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780340706.464374:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa246514327740ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464383:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340706.464388:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa246514327740ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464396:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa246514327740ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464426:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa246514327740ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464435:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa246514327740ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464456:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340706.464460:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa246514327740b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464466:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340706.464470:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa246514327740b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464476:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa246514327740b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464487:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa246514327740b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464494:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa246514327740b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464506:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340706.464510:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa246514327740ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464523:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340706.464526:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa246514327740ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464533:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa246514327740ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464545:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa246514327740ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464551:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa246514327740ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464571:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.464574:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.464577:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340706.464627:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340706.464633:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa246514327740c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464641:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.464643:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.464647:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa246514327740c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464655:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa246514327740c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464671:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa246514327740c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464679:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa246514327740c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464695:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340706.464704:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340706.464708:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa246514327740c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464714:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340706.464717:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa246514327740c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464724:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa246514327740c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.464735:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa246514327740c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.464854:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340706.464897:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961098112 00000100:00100000:1.0:1780340706.464903:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961098112 00000100:00100000:1.0:1780340706.464949:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996 00000100:00100000:1.0:1780340706.464958:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1866818961098112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780340706.464975:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340706.465015:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1866818961098112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (1923us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340706.465022:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996 00000100:00100000:1.0:1780340706.465069:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961098112:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1780340706.465232:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340706.465238:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340706.465337:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:85484:x1866818961098240:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2154us (2312us total) trans 4294969451 rc 0/0 00000100:00100000:0.0:1780340706.465345:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5886 00000100:00100000:0.0:1780340706.465383:0:85484:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85484:1866818961098240:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1780340706.465395:0:85484:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x301:0x0]-[0x2c0000401:0x321:0x0] 00002000:00010000:2.0:1780340706.466067:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340706.466075:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327740c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.466086:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.466088:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.466091:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327740c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.466102:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327740c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.466109:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327740c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.466116:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327740c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.466176:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340706.466223:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340706.466227:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327740cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.466234:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.466236:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.466238:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327740cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.466247:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327740cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.466255:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327740cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.466261:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327740cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.467094:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa246514327740c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.467119:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340706.467129:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327740c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.467136:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722afe00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340706.467140:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327740c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.467148:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327740c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.467162:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327740c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.467167:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327740c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.467179:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340706.467182:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327740cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.467188:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340706.467190:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327740cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.467197:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327740cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.467217:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327740cf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.467224:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.467226:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.468090:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.468169:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1780340706.468177:0:25489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073a1ea8e/0xa246514327740cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340706.468297:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340706.468303:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327740d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468314:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.468316:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.468326:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327740d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468337:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327740d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468347:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327740d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468354:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327740d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468373:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340706.468412:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340706.468416:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa246514327740dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468424:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.468425:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.468427:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa246514327740dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468435:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa246514327740dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468441:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa246514327740dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468457:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa246514327740dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468469:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1780340706.468504:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340706.468509:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327740e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468516:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.468517:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.468520:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327740e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468528:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327740e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468535:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327740e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468542:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327740e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.468545:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780340706.468551:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327740d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468555:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780340706.468559:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340706.468560:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340706.468564:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa246514327740dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.468568:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327740d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.468576:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327740d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468579:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340706.468582:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa246514327740dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468588:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa246514327740dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.468590:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327740d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468598:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa246514327740dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.468598:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc095a6d/0xa246514327740d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468605:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa246514327740dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.468613:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340706.468615:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340706.468616:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327740e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468617:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.468618:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340706.468622:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340706.468624:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327740e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.468631:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327740e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.468639:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327740e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.468646:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa246514327740e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340706.468651:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340706.468656:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa246514327740eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468663:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.468664:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340706.468664:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340706.468666:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.468667:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa246514327740eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.468668:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340706.468674:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.468675:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa246514327740eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.468687:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa246514327740eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.468776:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.469197:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.470261:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa246514327740eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470290:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340706.470371:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340706.470377:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa246514327740f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470388:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.470390:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.470394:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa246514327740f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470404:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa246514327740f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470413:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa246514327740f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470419:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa246514327740f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470432:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780340706.470446:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340706.470452:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa246514327740eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470459:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722aea00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340706.470463:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa246514327740eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470472:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa246514327740eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470486:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa246514327740eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470494:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055210d3c/0xa246514327740eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470509:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340706.470512:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa246514327740f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470518:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340706.470521:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa246514327740f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470527:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa246514327740f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470545:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa246514327740f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470552:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061621c35/0xa246514327740f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470563:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.470564:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.470567:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340706.470603:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340706.470608:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa246514327740f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470615:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.470617:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.470619:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa246514327740f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470627:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa246514327740f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470634:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa246514327740f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470641:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa246514327740f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.470672:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780340706.470795:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340706.470800:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa246514327740f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.470816:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722afc00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340706.470820:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa246514327740f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.470827:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa246514327740f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.470837:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa246514327740f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.470845:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa246514327740f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340706.470857:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340706.470859:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340706.470860:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.471102:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340706.472117:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340706.472127:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fc2ffd5/0xa24651432774100 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472143:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.472145:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.472149:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009fc2ffd5/0xa24651432774100 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472160:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009fc2ffd5/0xa24651432774100 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472168:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009fc2ffd5/0xa24651432774100 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472175:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009fc2ffd5/0xa24651432774100 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472198:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340706.472256:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340706.472260:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000206590f5/0xa24651432774107 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472268:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.472270:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.472281:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000206590f5/0xa24651432774107 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472290:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000206590f5/0xa24651432774107 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472297:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000206590f5/0xa24651432774107 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472304:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000206590f5/0xa24651432774107 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472320:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780340706.472332:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340706.472337:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009fc2ffd5/0xa24651432774100 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472343:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340706.472347:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009fc2ffd5/0xa24651432774100 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472354:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009fc2ffd5/0xa24651432774100 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472367:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009fc2ffd5/0xa24651432774100 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472385:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009fc2ffd5/0xa24651432774100 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472404:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340706.472407:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000206590f5/0xa24651432774107 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472413:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340706.472416:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000206590f5/0xa24651432774107 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472423:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000206590f5/0xa24651432774107 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472433:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000206590f5/0xa24651432774107 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472441:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000206590f5/0xa24651432774107 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472452:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.472454:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.472455:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340706.472497:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340706.472502:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6aab590/0xa2465143277410e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472514:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.472516:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.472519:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6aab590/0xa2465143277410e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472528:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6aab590/0xa2465143277410e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472535:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6aab590/0xa2465143277410e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472542:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6aab590/0xa2465143277410e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472556:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340706.472563:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340706.472567:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6aab590/0xa2465143277410e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472574:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32ae00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340706.472577:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6aab590/0xa2465143277410e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472583:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6aab590/0xa2465143277410e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472602:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6aab590/0xa2465143277410e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472609:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6aab590/0xa2465143277410e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472621:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.472623:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.472625:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340706.472663:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340706.472668:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000147b1d7/0xa24651432774115 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472675:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.472676:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.472679:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000147b1d7/0xa24651432774115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472687:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000147b1d7/0xa24651432774115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.472694:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000147b1d7/0xa24651432774115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.473147:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.474114:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000147b1d7/0xa24651432774115 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.478976:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.479004:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.479013:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000147b1d7/0xa24651432774115 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479026:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32ba00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.479031:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000147b1d7/0xa24651432774115 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479040:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000147b1d7/0xa24651432774115 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479059:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000147b1d7/0xa24651432774115 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479066:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000147b1d7/0xa24651432774115 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780340706.479096:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340706.479101:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277411c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479106:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.479107:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.479109:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.479112:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.479114:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.479118:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277411c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479130:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277411c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479139:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277411c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479146:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277411c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479179:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.479196:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.479201:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277411c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479208:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.479211:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277411c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780340706.479215:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340706.479219:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa24651432774123 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479219:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277411c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479227:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.479229:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.479230:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277411c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479231:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa24651432774123 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479237:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277411c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479240:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa24651432774123 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479247:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa24651432774123 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479250:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.479251:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.479253:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.479254:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa24651432774123 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479277:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780340706.479313:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340706.479318:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277412a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479321:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.479325:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa24651432774123 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479326:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.479327:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.479335:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277412a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479341:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340706.479344:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277412a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479344:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa24651432774123 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479353:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277412a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479353:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa24651432774123 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479361:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277412a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479364:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa24651432774123 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479371:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086e6f877/0xa24651432774123 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479375:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.479383:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.479386:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277412a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479392:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.479395:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277412a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479402:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277412a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780340706.479406:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340706.479410:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774131 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479411:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277412a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479416:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.479418:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.479420:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774131 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479423:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277412a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479428:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774131 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479435:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.479437:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.479438:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.479447:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774131 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479466:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774131 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479485:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.479510:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.479515:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774131 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780340706.479521:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340706.479522:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.479525:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774131 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479526:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774138 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479534:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340706.479534:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774131 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479536:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.479539:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774138 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479544:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774131 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479547:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774138 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479552:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432774131 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479555:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774138 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479562:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774138 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479564:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.479566:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.479567:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.479574:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340706.479578:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340706.479581:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774138 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479587:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340706.479590:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774138 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479597:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774138 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780340706.479602:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340706.479606:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa2465143277413f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479607:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774138 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479614:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774138 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479623:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.479624:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.479627:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa2465143277413f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.479627:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.479628:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.479629:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.479636:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa2465143277413f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479643:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa2465143277413f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479650:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa2465143277413f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479664:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340706.479671:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340706.479675:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa2465143277413f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479681:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340706.479829:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa2465143277413f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479840:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa2465143277413f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479862:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa2465143277413f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479869:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa2465143277413f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479883:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.479884:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.479886:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340706.479925:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340706.479930:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa24651432774146 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479938:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.479939:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.479941:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa24651432774146 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479949:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa24651432774146 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479956:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa24651432774146 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479963:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa24651432774146 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.479986:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340706.479993:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340706.479996:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa24651432774146 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480003:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340706.480006:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa24651432774146 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480013:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa24651432774146 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480023:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa24651432774146 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480030:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa24651432774146 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480043:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.480045:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.480046:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340706.480082:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340706.480087:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277414d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480094:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.480102:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.480105:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277414d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480114:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277414d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480121:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277414d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480127:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277414d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480139:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780340706.480174:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340706.480179:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa24651432774154 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480186:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.480187:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.480190:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa24651432774154 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480198:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa24651432774154 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480204:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa24651432774154 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480219:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa24651432774154 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.480220:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340706.480225:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277414d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480230:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340706.480232:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340706.480235:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277414d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.480242:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277414d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.480252:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277414d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.480259:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277414d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780340706.480260:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340706.480264:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa2465143277415b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480271:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.480272:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.480273:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340706.480275:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa2465143277415b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.480276:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa24651432774154 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.480282:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340706.480284:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa2465143277415b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.480285:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa24651432774154 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480292:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa2465143277415b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480299:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa2465143277415b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480311:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340706.480317:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340706.480320:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa2465143277415b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.480333:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa24651432774154 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480335:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340706.480339:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa2465143277415b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.480343:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa24651432774154 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480346:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa2465143277415b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.480351:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa24651432774154 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480355:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa2465143277415b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480361:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa2465143277415b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.480363:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.480365:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.480366:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.480371:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.480373:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.480374:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340706.480411:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340706.480415:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774162 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.480422:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.480424:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340706.480426:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774162 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340706.480426:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340706.480429:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.481246:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774162 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.481264:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774162 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.481272:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774162 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481515:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340706.481575:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340706.481580:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa24651432774169 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481589:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.481590:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.481593:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa24651432774169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481602:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa24651432774169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481609:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa24651432774169 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481620:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa24651432774169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481637:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1780340706.481672:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340706.481677:0:25489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa486f20/0xa24651432774170 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481684:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.481685:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340706.481688:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa486f20/0xa24651432774170 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481707:0:25489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa486f20/0xa24651432774170 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481714:0:25489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa486f20/0xa24651432774170 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481720:0:25489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa486f20/0xa24651432774170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481735:0:25489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1780340706.481743:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1780340706.481749:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774162 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.481783:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340706.481788:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa24651432774169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481799:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340706.481803:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774162 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481821:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774162 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481834:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774162 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481840:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774162 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481857:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340706.481860:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa486f20/0xa24651432774170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.481863:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32ac00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340706.481866:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa24651432774169 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481866:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340706.481869:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa486f20/0xa24651432774170 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.481874:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa24651432774169 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481876:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa486f20/0xa24651432774170 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.481885:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa24651432774169 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481885:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa486f20/0xa24651432774170 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.481892:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa24651432774169 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340706.481897:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa486f20/0xa24651432774170 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340706.481906:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.481907:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340706.481913:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.482132:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.482135:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340706.482136:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1780340706.482678:0:25489:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:642 00000100:00100000:3.0:1780340706.482894:0:85482:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b830700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85482:1866818961097856:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1780340706.482899:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:85482:x1866818961097856:12345-0@lo:5:osp-pre-0-0.0 Request processed in 73917us (75357us total) trans 0 rc 0/0 00000004:00080000:3.0:1780340706.482910:0:85482:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x301:0x0] from OST, last_created [0x280000401:0x301:0x0]last_used is [0x280000401:0x282:0x0] 00000100:00100000:2.0:1780340706.482969:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5885 00000100:00100000:3.0:1780340706.482977:0:85482:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b830700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85482:1866818961098496:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1780340706.483010:0:85482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340706.483032:0:85482:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0450132e40 going to sleep for 11 seconds 00000100:00100000:3.0:1780340706.483048:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048527c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961098368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340706.483073:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1780340706.483109:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340706.483539:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961098496 00000100:00100000:3.0:1780340706.483546:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961098496 00000100:00100000:3.0:1780340706.483594:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5887 00000100:00100000:3.0:1780340706.483603:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:85482:x1866818961098496:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1780340706.483641:0:25488:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 770 00000100:00100000:2.0:1780340706.484604:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961098368 00000100:00100000:2.0:1780340706.484612:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961098368 00000100:00100000:2.0:1780340706.484685:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1997 00000100:00100000:2.0:1780340706.484701:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961098368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780340706.484720:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 896 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340706.484820:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a127100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961098368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340706.484826:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1997 00000100:00100000:2.0:1780340706.485190:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048527c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961098368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340706.487406:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a126680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:85482:x1866818961098496:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3798us (4389us total) trans 4294969451 rc 0/0 00000100:00100000:0.0:1780340706.487418:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5887 00000100:00100000:3.0:1780340706.489726:0:85482:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b830700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85482:1866818961098496:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1780340706.489746:0:85482:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x301:0x0]-[0x280000401:0x321:0x0] 00000020:00000004:2.0:1780340707.163016:0:85834:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1780340707.163359:0:85834:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1780340707.212836:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1780340707.214698:0:72681:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1780340707.314041:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340707.314076:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340707.317490:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340707.317525:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940412672 00000100:00100000:1.0:1780340707.317536:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940412672 00000100:00100000:1.0:1780340707.317585:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940412800 00000100:00100000:1.0:1780340707.317588:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940412800 00000100:00100000:1.0:1780340707.317619:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1210 00000100:00100000:1.0:1780340707.317629:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2408:x1866818940412672:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340707.317716:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2408:x1866818940412672:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 89us (3684us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340707.317725:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1210 00000100:00100000:1.0:1780340707.317743:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1211 00000100:00100000:1.0:1780340707.317750:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940412800:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340707.317794:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940412800:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 44us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340707.317800:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1211 00000100:00080000:3.0:1780340707.320377:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340707.322238:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940412544 00000100:00100000:2.0:1780340707.322253:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940412544 00000100:00100000:2.0:1780340707.322315:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 75 00000100:00100000:2.0:1780340707.322335:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0345379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940412544:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340707.322422:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0345379c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940412544:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 99us (8344us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340707.322432:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 75 00010000:00010000:0.0:1780340708.233990:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340709.258151:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340709.317121:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340709.317275:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940412928 00000100:00100000:0.0:1780340709.317318:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940412928 00000100:00100000:0.0:1780340709.317411:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1209 00000100:00100000:0.0:1780340709.317423:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:67570:x1866818940412928:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1780340709.317449:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340709.317479:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6600/0xa24651432774177 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2328 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340709.317567:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6c00/0xa2465143277417e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340709.317584:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6c00/0xa2465143277417e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340709.317597:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6c00/0xa2465143277417e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340709.317940:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780340709.317945:0:64454:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780340709.317990:0:64454:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6c00/0xa2465143277417e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340709.318020:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6600/0xa24651432774177 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2328 expref: 9 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340709.318042:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6c00/0xa2465143277417e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2328 expref: 8 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340709.318051:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8200) 00010000:00010000:0.0:1780340709.318055:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780340709.318059:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04497b6c00, rc 0) 00000100:00100000:0.0:1780340709.318145:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:67570:x1866818940412928:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 723us (1036us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340709.318152:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1209 00000100:00080000:3.0:1780340709.318752:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780340709.324043:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340709.324208:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940413056 00000100:00100000:1.0:1780340709.324221:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940413056 00000100:00100000:1.0:1780340709.324292:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1210 00000100:00100000:1.0:1780340709.324310:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:67570:x1866818940413056:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:1.0:1780340709.324360:0:63710:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445232640 avail 1298993152 00000100:00100000:1.0:1780340709.324590:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:67570:x1866818940413056:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 281us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340709.324599:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1210 00000100:00100000:1.0:1780340709.326950:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340709.327044:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940413184 00000100:00100000:3.0:1780340709.327056:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940413184 00000100:00100000:3.0:1780340709.327143:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1211 00000100:00100000:3.0:1780340709.327156:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:67570:x1866818940413184:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:3.0:1780340709.327208:0:63711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:3.0:1780340709.327317:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:67570:x1866818940413184:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 163us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340709.327325:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1211 00000100:00080000:0.0:1780340709.327410:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340709.330409:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340709.331074:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940413312 00000100:00100000:2.0:1780340709.331089:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940413312 00000100:00100000:2.0:1780340709.331151:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5888 00000100:00100000:2.0:1780340709.331160:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2406:x1866818940413312:12345-192.168.203.16@tcp:8:lfs.0 00010000:00080000:2.0:1780340709.331204:0:23153:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0000: connection from e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp t0 exp 0000000000000000 cur 3489 last 0 00000020:00000080:2.0:1780340709.331244:0:23153:0:(genops.c:1406:class_connect()) connect: client e06e5cf1-1986-4ba7-9630-fad7efb74eca, cookie 0xa24651432774185 00002000:00100000:2.0:1780340709.331261:0:23153:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e06e5cf1-1986-4ba7-9630-fad7efb74eca/ffff8c04514b3800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211351c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1780340709.331286:0:23153:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1780340709.331374:0:23153:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1780340709.331430:0:23153:0:(import.c:65:import_set_state_nolock()) ffff8c04514b0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340709.331516:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940413312:12345-192.168.203.16@tcp:8:lfs.0 Request processed in 356us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340709.331524:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5888 00000100:00100000:2.0:1780340709.334037:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340709.334140:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940413440 00000100:00100000:1.0:1780340709.334168:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940413440 00000100:00100000:1.0:1780340709.334257:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1998 00000100:00100000:1.0:1780340709.334269:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:67570:x1866818940413440:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:1.0:1780340709.334315:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340709.334579:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:67570:x1866818940413440:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 312us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340709.334588:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1998 00000100:00080000:3.0:1780340709.335158:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340709.337887:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340709.338044:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940413568 00000100:00100000:3.0:1780340709.338058:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940413568 00000100:00100000:3.0:1780340709.338114:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5889 00000100:00100000:3.0:1780340709.338125:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2406:x1866818940413568:12345-192.168.203.16@tcp:8:lfs.0 00010000:00080000:3.0:1780340709.338171:0:25486:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0001: connection from e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp t0 exp 0000000000000000 cur 3489 last 0 00000020:00000080:3.0:1780340709.338210:0:25486:0:(genops.c:1406:class_connect()) connect: client e06e5cf1-1986-4ba7-9630-fad7efb74eca, cookie 0xa2465143277418c 00002000:00100000:3.0:1780340709.338225:0:25486:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e06e5cf1-1986-4ba7-9630-fad7efb74eca/ffff8c0471e4f000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211351c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1780340709.338248:0:25486:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1780340709.338349:0:25486:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1780340709.338384:0:25486:0:(import.c:65:import_set_state_nolock()) ffff8c0471e48800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340709.338577:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940413568:12345-192.168.203.16@tcp:8:lfs.0 Request processed in 452us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340709.338585:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5889 00000100:00100000:0.0:1780340709.341954:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340709.342062:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940413696 00000100:00100000:2.0:1780340709.342076:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940413696 00000100:00100000:2.0:1780340709.342215:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1999 00000100:00100000:2.0:1780340709.342228:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:67570:x1866818940413696:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:2.0:1780340709.342264:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340709.342363:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:67570:x1866818940413696:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 138us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340709.342371:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1999 00000100:00080000:3.0:1780340709.342448:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340709.773345:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340709.773377:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961098624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340709.773479:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340709.774189:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961098624 00000100:00100000:1.0:1780340709.774201:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961098624 00000100:00100000:1.0:1780340709.774283:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2000 00000100:00100000:1.0:1780340709.774294:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b48d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961098624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340709.774337:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340709.774402:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b48d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961098624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340709.774410:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2000 00000100:00080000:0.0:1780340709.775177:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340709.775238:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961098624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340709.777457:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961098752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340709.777551:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340709.779021:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961098752 00000100:00100000:2.0:1780340709.779041:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961098752 00000100:00100000:2.0:1780340709.779151:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2001 00000100:00100000:2.0:1780340709.779162:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961098752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340709.779199:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340709.779310:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961098752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 149us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340709.779335:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2001 00000100:00100000:3.0:1780340709.779520:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961098752:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1780340709.779806:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1780340710.284028:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340711.307649:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961098880:0@lo:400:kworker.0 00010000:00010000:0.0:1780340711.307692:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340711.307743:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340711.307826:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961099392:0@lo:400:kworker.0 00000100:00100000:2.0:1780340711.307856:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340711.307885:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961099904:0@lo:400:kworker.0 00000100:00100000:2.0:1780340711.307907:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340711.307925:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961100416:0@lo:400:kworker.0 00000100:00100000:2.0:1780340711.307952:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340711.307977:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1780340711.307983:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961099008:0@lo:400:kworker.0 00000100:00100000:1.0:1780340711.307996:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961099392 00000100:00100000:1.0:1780340711.308007:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961099392 00000100:00100000:2.0:1780340711.308017:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340711.308034:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961099520:0@lo:400:kworker.0 00000100:00100000:2.0:1780340711.308058:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340711.308073:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961099904 00000100:00100000:2.0:1780340711.308075:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961100032:0@lo:400:kworker.0 00000100:00100000:1.0:1780340711.308076:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961099904 00000100:00100000:1.0:1780340711.308090:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961100416 00000100:00100000:1.0:1780340711.308093:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961100416 00000100:00100000:2.0:1780340711.308094:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340711.308104:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961099008 00000100:00100000:1.0:1780340711.308107:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961099008 00000100:00100000:2.0:1780340711.308109:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961100544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340711.308124:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:1.0:1780340711.308133:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961099392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340711.308144:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340711.308178:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:2.0:1780340711.308187:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961099904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340711.308201:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961099392:12345-0@lo:400:kworker.0 Request processed in 68us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340711.308215:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961099904:12345-0@lo:400:kworker.0 Request processed in 31us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340711.308218:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:2.0:1780340711.308221:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:1.0:1780340711.308238:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:1.0:1780340711.308244:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961100416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340711.308248:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:2.0:1780340711.308254:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961099008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340711.308274:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961100416:12345-0@lo:400:kworker.0 Request processed in 30us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340711.308275:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349954000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961099008:12345-0@lo:400:kworker.0 Request processed in 22us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340711.308281:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:1.0:1780340711.308290:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:2.0:1780340711.308300:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961099520 00000100:00100000:2.0:1780340711.308304:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961099520 00000100:00080000:1.0:1780340711.308310:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780340711.308314:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340711.308330:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961100032 00000100:00100000:2.0:1780340711.308333:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961100032 00000100:00100000:2.0:1780340711.308344:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961100544 00000100:00100000:2.0:1780340711.308346:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961100544 00000100:00100000:1.0:1780340711.308349:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961099008:0@lo:400:kworker.0 00000100:00100000:2.0:1780340711.308356:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3799 00000100:00100000:1.0:1780340711.308361:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961099392:0@lo:400:kworker.0 00000100:00100000:2.0:1780340711.308362:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961099520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340711.308370:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961099904:0@lo:400:kworker.0 00000100:00100000:1.0:1780340711.308383:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961100416:0@lo:400:kworker.0 00000100:00100000:0.0:1780340711.308769:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961098880 00000100:00100000:0.0:1780340711.308784:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961098880 00000100:00100000:0.0:1780340711.308820:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1780340711.308826:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0345379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961098880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340711.316604:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961099520:0@lo:400:kworker.0 00000100:00100000:3.0:1780340711.317272:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961099136:0@lo:400:kworker.0 00000100:00100000:3.0:1780340711.320216:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340711.320277:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961099648:0@lo:400:kworker.0 00000100:00100000:3.0:1780340711.320322:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340711.320353:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961100160:0@lo:400:kworker.0 00000100:00100000:3.0:1780340711.320377:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340711.320426:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1780340711.320435:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961099264:0@lo:400:kworker.0 00000100:00100000:3.0:1780340711.320461:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340711.320481:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961099776:0@lo:400:kworker.0 00000100:00100000:3.0:1780340711.320505:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340711.320524:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961100288:0@lo:400:kworker.0 00000100:00100000:3.0:1780340711.320546:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340711.320600:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961099136 00000100:00100000:3.0:1780340711.320610:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961099136 00000100:00100000:3.0:1780340711.320672:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961099264 00000100:00100000:3.0:1780340711.320675:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961099264 00000100:00100000:3.0:1780340711.320700:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1780340711.320708:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961099136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340711.320855:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349954380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961099520:12345-0@lo:400:kworker.0 Request processed in 12490us (12792us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340711.320867:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3799 00000100:00100000:2.0:1780340711.320895:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3800 00000100:00100000:2.0:1780340711.320903:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961100032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340711.320966:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349957800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961100032:12345-0@lo:400:kworker.0 Request processed in 65us (12870us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340711.320983:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3800 00000100:00100000:2.0:1780340711.321097:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3801 00000100:00100000:2.0:1780340711.321106:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961100544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340711.321136:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:2.0:1780340711.321168:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961100544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (13023us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340711.321174:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3801 00000100:00100000:2.0:1780340711.321240:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961099648 00000100:00100000:2.0:1780340711.321244:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961099648 00000100:00100000:2.0:1780340711.321273:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961100160 00000100:00100000:2.0:1780340711.321275:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961100160 00000100:00100000:2.0:1780340711.321294:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961099776 00000100:00100000:2.0:1780340711.321297:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961099776 00000100:00100000:2.0:1780340711.321323:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961100288 00000100:00100000:2.0:1780340711.321325:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961100288 00000100:00100000:2.0:1780340711.321344:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2458 00000100:00100000:2.0:1780340711.321350:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961099648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340711.321387:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961099648:12345-0@lo:400:kworker.0 Request processed in 37us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340711.321486:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2458 00000100:00100000:2.0:1780340711.321500:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2459 00000100:00100000:2.0:1780340711.321507:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961100160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340711.321536:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961100160:12345-0@lo:400:kworker.0 Request processed in 30us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340711.321542:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2459 00000100:00100000:2.0:1780340711.321715:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2460 00000100:00100000:2.0:1780340711.321723:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961099776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340711.321808:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961099776:12345-0@lo:400:kworker.0 Request processed in 86us (1301us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340711.321814:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2460 00000100:00100000:2.0:1780340711.321826:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2461 00000100:00100000:2.0:1780340711.321832:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961100288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340711.321858:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961100288:12345-0@lo:400:kworker.0 Request processed in 27us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340711.321864:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2461 00000100:00100000:2.0:1780340711.321922:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961099776:0@lo:400:kworker.0 00000100:00100000:3.0:1780340711.321923:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961099136:12345-0@lo:400:kworker.0 Request processed in 1215us (1715us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340711.321930:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:2.0:1780340711.321936:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961100288:0@lo:400:kworker.0 00000100:00100000:3.0:1780340711.321946:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:2.0:1780340711.321946:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961099136:0@lo:400:kworker.0 00000100:00100000:3.0:1780340711.321954:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961099264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340711.321956:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961099648:0@lo:400:kworker.0 00000100:00100000:2.0:1780340711.321966:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961100160:0@lo:400:kworker.0 00000100:00100000:3.0:1780340711.321982:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961099264:12345-0@lo:400:kworker.0 Request processed in 30us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340711.321987:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00080000:1.0:1780340711.323034:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340711.323043:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780340711.323047:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780340711.323050:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340711.323209:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961100032:0@lo:400:kworker.0 00000100:00100000:1.0:1780340711.323232:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961100544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340711.324957:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961099264:0@lo:400:kworker.0 00000100:00100000:0.0:1780340711.325299:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0345379850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961098880:12345-0@lo:400:kworker.0 Request processed in 16470us (17553us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340711.325311:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1780340711.325359:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961098880:0@lo:400:kworker.0 00000100:00100000:3.0:1780340711.819802:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961100672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340711.819912:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340711.820102:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961100672 00000100:00100000:1.0:1780340711.820114:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961100672 00000100:00100000:1.0:1780340711.820177:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2002 00000100:00100000:1.0:1780340711.820188:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961100672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780340711.820236:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340711.820303:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961100672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340711.820312:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2002 00000100:00100000:2.0:1780340711.820884:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961100672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340711.820906:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780340711.820913:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048527c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961100800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340711.820955:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340711.820987:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961100800 00000100:00100000:2.0:1780340711.820991:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961100800 00000100:00100000:2.0:1780340711.821026:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3802 00000100:00100000:2.0:1780340711.821032:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961100800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780340711.821236:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445232640 avail 1298993152 00000100:00100000:2.0:1780340711.821294:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961100800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 261us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340711.821302:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3802 00000100:00100000:2.0:1780340711.821338:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048527c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961100800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340711.822011:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961100928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340711.822058:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:1.0:1780340711.822350:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000001:00080000:1.0:1780340711.822364:0:9462:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969451 is committed 00000100:00100000:1.0:1780340711.822885:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961100928 00000100:00100000:1.0:1780340711.822896:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961100928 00000100:00100000:1.0:1780340711.822941:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2003 00000100:00100000:1.0:1780340711.822951:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961100928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780340711.822988:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340711.823051:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961100928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340711.823059:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2003 00000100:00100000:0.0:1780340711.823400:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961100928:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1780340711.830383:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000001:00080000:1.0:1780340711.830412:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969451 is committed 00010000:00010000:2.0:1780340712.330103:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340712.487742:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340712.487835:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940413824 00000100:00100000:2.0:1780340712.487837:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340712.487848:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940413824 00000100:00100000:2.0:1780340712.487870:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340712.487924:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:0.0:1780340712.487936:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034ac08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940413824:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340712.487953:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340712.487979:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340712.488024:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034ac08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940413824:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 90us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340712.488031:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940414080 00000100:00100000:0.0:1780340712.488032:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:3.0:1780340712.488036:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940414080 00000100:00100000:3.0:1780340712.488096:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940413952 00000100:00100000:3.0:1780340712.488099:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940413952 00000100:00100000:3.0:1780340712.488143:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1218 00000100:00100000:3.0:1780340712.488149:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940414080:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340712.488184:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940414080:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 36us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340712.488191:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1218 00000100:00100000:3.0:1780340712.488204:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1219 00000100:00100000:3.0:1780340712.488210:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2408:x1866818940413952:12345-192.168.203.16@tcp:400:kworker.0 00000100:00080000:0.0:1780340712.488228:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780340712.488233:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340712.488240:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2408:x1866818940413952:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 31us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340712.488246:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1219 00000100:00100000:1.0:1780340712.503889:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940414336 00000100:00100000:1.0:1780340712.503910:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940414336 00000100:00100000:1.0:1780340712.504041:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940414208 00000100:00100000:1.0:1780340712.504045:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940414208 00000100:00100000:1.0:1780340712.504091:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2462 00000100:00100000:1.0:1780340712.504104:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940414336:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340712.504224:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940414336:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 122us (16351us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340712.504233:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2462 00000100:00100000:1.0:1780340712.504255:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2463 00000100:00100000:1.0:1780340712.504279:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940414208:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340712.504321:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471571180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940414208:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 43us (16340us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340712.504328:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2463 00000100:00080000:2.0:1780340712.505325:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340712.505332:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1780340713.353879:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1780340713.937672:0:85931:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:3.0:1780340714.382579:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340714.890899:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780340714.890920:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961101056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340714.890996:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340714.891057:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961101056 00000100:00100000:0.0:1780340714.891064:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961101056 00000100:00100000:2.0:1780340714.891089:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961101184:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340714.891126:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2004 00000100:00100000:0.0:1780340714.891138:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961101056:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340714.891162:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1780340714.891172:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1780340714.891231:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340714.891246:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961101056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340714.891250:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961101184 00000100:00100000:0.0:1780340714.891257:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2004 00000100:00100000:2.0:1780340714.891258:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961101184 00000100:00100000:0.0:1780340714.891325:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961101056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340714.891327:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2005 00000100:00100000:2.0:1780340714.891349:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961101184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340714.891381:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340714.891448:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961101184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340714.891455:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2005 00000100:00080000:2.0:1780340714.891481:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340714.891754:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961101184:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1780340715.404802:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1780340715.714408:0:85980:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1780340716.425951:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340716.426004:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961101312:0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.426100:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340716.426145:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961101824:0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.426171:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340716.426192:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961102336:0@lo:400:kworker.0 00000100:00100000:1.0:1780340716.426197:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961101824 00000100:00100000:1.0:1780340716.426206:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961101824 00000100:00100000:0.0:1780340716.426214:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340716.426232:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1866818961102848:0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.426254:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340716.426261:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961102336 00000100:00100000:1.0:1780340716.426266:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961102336 00000100:00100000:0.0:1780340716.426273:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1780340716.426281:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961101696:0@lo:400:kworker.0 00000100:00100000:1.0:1780340716.426289:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961102848 00000100:00100000:1.0:1780340716.426293:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961102848 00000100:00100000:0.0:1780340716.426307:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340716.426314:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:0.0:1780340716.426321:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961102208:0@lo:400:kworker.0 00000100:00100000:1.0:1780340716.426326:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961101824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.426348:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340716.426466:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961101568:0@lo:400:kworker.0 00000100:00100000:3.0:1780340716.426579:0:85474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961101312 00000100:00100000:3.0:1780340716.426583:0:85474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961101312 00000100:00100000:3.0:1780340716.426613:0:85474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1780340716.426620:0:85474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034ac08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961101312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.430285:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961102720:0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.430366:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340716.430416:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961101440:0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.430442:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340716.430454:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961101952:0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.430472:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340716.430498:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961102464:0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.430517:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340716.430535:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961102976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340716.430553:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340716.430587:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961101696 00000100:00100000:0.0:1780340716.430594:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961101696 00000100:00100000:0.0:1780340716.430641:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961101440 00000100:00100000:0.0:1780340716.430644:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961101440 00000100:00100000:0.0:1780340716.430662:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:0.0:1780340716.430669:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961102336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.430721:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961102336:12345-0@lo:400:kworker.0 Request processed in 51us (4505us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340716.430728:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00100000:0.0:1780340716.430754:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:0.0:1780340716.430780:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1866818961102848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.430811:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1866818961102848:12345-0@lo:400:kworker.0 Request processed in 32us (4557us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340716.430817:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:0.0:1780340716.430828:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:0.0:1780340716.430834:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961101696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.431119:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961101696:12345-0@lo:400:kworker.0 Request processed in 285us (4813us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340716.431126:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:0.0:1780340716.431139:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:0.0:1780340716.431145:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961101440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.431177:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961101440:12345-0@lo:400:kworker.0 Request processed in 32us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340716.431182:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:0.0:1780340716.431204:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961102208 00000100:00100000:0.0:1780340716.431208:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961102208 00000100:00100000:0.0:1780340716.431236:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961102720 00000100:00100000:0.0:1780340716.431239:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961102720 00000100:00100000:0.0:1780340716.431257:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2464 00000100:00100000:0.0:1780340716.431270:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961102208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.431301:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961102208:12345-0@lo:400:kworker.0 Request processed in 32us (4953us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340716.431306:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2464 00000100:00100000:0.0:1780340716.431317:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2465 00000100:00100000:0.0:1780340716.431323:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961102720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.431347:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961102720:12345-0@lo:400:kworker.0 Request processed in 25us (982us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340716.431352:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2465 00000100:00100000:0.0:1780340716.431373:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961101952 00000100:00100000:0.0:1780340716.431376:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961101952 00000100:00100000:0.0:1780340716.431401:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961102464 00000100:00100000:0.0:1780340716.431403:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961102464 00000100:00100000:0.0:1780340716.431413:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961102976 00000100:00100000:0.0:1780340716.431416:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961102976 00000100:00100000:0.0:1780340716.431425:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3803 00000100:00100000:0.0:1780340716.431430:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961101952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.431460:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961101952:12345-0@lo:400:kworker.0 Request processed in 29us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340716.431466:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3803 00000100:00100000:0.0:1780340716.431479:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3804 00000100:00100000:0.0:1780340716.431484:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961102464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.431509:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961102464:12345-0@lo:400:kworker.0 Request processed in 24us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340716.431514:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3804 00000100:00100000:0.0:1780340716.431524:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3805 00000100:00100000:0.0:1780340716.431530:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961102976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780340716.431558:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:0.0:1780340716.431589:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961102976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340716.431595:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3805 00000100:00100000:0.0:1780340716.431644:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961101440:0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.431654:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961101952:0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.431662:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961102464:0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.431675:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961102976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340716.431716:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961101696:0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.431725:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961102208:0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.431743:0:3660:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 2 00000100:00100000:0.0:1780340716.431754:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961102720:0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.431790:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961102336:0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.431801:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1866818961102848:0@lo:400:kworker.0 00000100:00080000:2.0:1780340716.433517:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340716.433525:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780340716.433528:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340716.433564:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340716.433607:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961101568 00000100:00100000:2.0:1780340716.433615:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961101568 00000100:00100000:2.0:1780340716.433689:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:2.0:1780340716.433708:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961101568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340716.433797:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961101568:12345-0@lo:400:kworker.0 Request processed in 91us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340716.433804:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00080000:2.0:1780340716.433822:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340716.433851:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961101568:0@lo:400:kworker.0 00000100:00100000:2.0:1780340716.433863:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961102080:0@lo:400:kworker.0 00000100:00100000:2.0:1780340716.433893:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340716.433920:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961102592:0@lo:400:kworker.0 00000100:00100000:2.0:1780340716.433940:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340716.434009:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961102080 00000100:00100000:2.0:1780340716.434013:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961102080 00000100:00100000:2.0:1780340716.434039:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961102592 00000100:00100000:2.0:1780340716.434042:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961102592 00000100:00100000:2.0:1780340716.434059:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2466 00000100:00100000:2.0:1780340716.434065:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961102080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340716.434097:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961102080:12345-0@lo:400:kworker.0 Request processed in 32us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340716.434103:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2466 00000100:00100000:2.0:1780340716.434113:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2467 00000100:00100000:2.0:1780340716.434132:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961102592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340716.434159:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961102592:12345-0@lo:400:kworker.0 Request processed in 28us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340716.434165:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2467 00000100:00080000:2.0:1780340716.434178:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340716.434199:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961102080:0@lo:400:kworker.0 00000100:00100000:2.0:1780340716.434206:0:3662:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 2 00000100:00100000:2.0:1780340716.434216:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961102592:0@lo:400:kworker.0 00000100:00100000:1.0:1780340716.436384:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961101824:12345-0@lo:400:kworker.0 Request processed in 10053us (10203us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340716.436400:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1780340716.436577:0:85474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034ac08450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961101312:12345-0@lo:400:kworker.0 Request processed in 9956us (10476us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340716.436587:0:85474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1780340716.445556:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961101824:0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.445576:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961101312:0@lo:400:kworker.0 00000100:00100000:0.0:1780340716.941029:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961103232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340716.941101:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340716.941150:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340716.941157:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961103360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340716.941206:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340716.941241:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780340716.941251:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961103104:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340716.941275:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340716.941304:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961103232 00000100:00100000:0.0:1780340716.941311:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961103232 00000100:00100000:0.0:1780340716.941349:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961103104 00000100:00100000:0.0:1780340716.941352:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961103104 00000100:00100000:0.0:1780340716.941371:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2006 00000100:00100000:0.0:1780340716.941379:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961103232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780340716.941407:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340716.941447:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961103232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340716.941454:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2006 00000100:00100000:0.0:1780340716.941470:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007 00000100:00100000:0.0:1780340716.941477:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961103104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340716.941491:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340716.941521:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961103104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340716.941527:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007 00000100:00100000:0.0:1780340716.941564:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961103232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340716.941595:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961103104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340716.942200:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961103360 00000100:00100000:2.0:1780340716.942205:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961103360 00000100:00100000:2.0:1780340716.942233:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3806 00000100:00100000:2.0:1780340716.942239:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961103360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780340716.942264:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445232640 avail 1298993152 00000100:00100000:2.0:1780340716.942314:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961103360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340716.942320:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3806 00000100:00100000:1.0:1780340716.942394:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961103360:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1780340717.450087:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340717.613209:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340717.613249:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340717.613287:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340717.613317:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340717.613351:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340717.613412:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940414464 00000100:00100000:3.0:1780340717.613426:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940414464 00000100:00100000:3.0:1780340717.613512:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 79 00000100:00100000:3.0:1780340717.613522:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034ac09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940414464:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340717.613584:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034ac09850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940414464:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 64us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340717.613604:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 79 00000100:00100000:0.0:1780340717.613670:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940414592 00000100:00100000:0.0:1780340717.613674:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940414592 00000100:00100000:0.0:1780340717.613708:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940414720 00000100:00100000:0.0:1780340717.613712:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940414720 00000100:00100000:0.0:1780340717.613756:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1226 00000100:00100000:0.0:1780340717.613811:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2408:x1866818940414592:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340717.613843:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2408:x1866818940414592:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 35us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340717.613848:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1226 00000100:00100000:0.0:1780340717.613860:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1227 00000100:00100000:0.0:1780340717.613865:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940414720:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340717.613884:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940414720:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 19us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340717.613889:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1227 00000100:00100000:2.0:1780340717.613960:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940414848 00000100:00100000:2.0:1780340717.613964:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940414848 00000100:00100000:2.0:1780340717.614000:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940414976 00000100:00100000:2.0:1780340717.614003:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940414976 00000100:00100000:2.0:1780340717.614023:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2468 00000100:00100000:2.0:1780340717.614029:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940414848:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340717.614053:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940414848:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 25us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340717.614059:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2468 00000100:00100000:2.0:1780340717.614076:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2469 00000100:00100000:2.0:1780340717.614082:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940414976:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340717.614106:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940414976:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340717.614111:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2469 00000100:00080000:2.0:1780340717.614129:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340717.614132:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340717.614134:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340717.614136:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780340717.927143:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340717.929375:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940415104 00000100:00100000:1.0:1780340717.929389:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940415104 00000100:00100000:1.0:1780340717.931818:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1212 00000100:00100000:1.0:1780340717.931842:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:68016:x1866818940415104:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:1.0:1780340717.931898:0:64454:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445232640 avail 1298993152 00000100:00100000:1.0:1780340717.932058:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:68016:x1866818940415104:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 227us (4923us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340717.932066:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1212 00000100:00100000:2.0:1780340717.938928:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340717.939012:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940415232 00000100:00100000:0.0:1780340717.939022:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940415232 00000100:00100000:0.0:1780340717.939079:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1213 00000100:00100000:0.0:1780340717.939090:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:68016:x1866818940415232:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:0.0:1780340717.939129:0:63712:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:0.0:1780340717.939197:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:68016:x1866818940415232:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 108us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340717.939204:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1213 00000100:00100000:2.0:1780340717.943939:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340717.944041:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940415360 00000100:00100000:0.0:1780340717.944054:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940415360 00000100:00100000:0.0:1780340717.944122:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2008 00000100:00100000:0.0:1780340717.944131:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:68016:x1866818940415360:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:0.0:1780340717.944157:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340717.944233:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:68016:x1866818940415360:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 102us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340717.944255:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2008 00000100:00100000:3.0:1780340717.952915:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340717.953165:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940415488 00000100:00100000:2.0:1780340717.953179:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940415488 00000100:00100000:2.0:1780340717.953274:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2009 00000100:00100000:2.0:1780340717.953288:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:68016:x1866818940415488:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:2.0:1780340717.953322:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340717.953531:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:68016:x1866818940415488:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 245us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340717.953541:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2009 00000100:00100000:2.0:1780340718.058369:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340718.058591:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940415744 00000100:00100000:0.0:1780340718.058614:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940415744 00000100:00100000:0.0:1780340718.058693:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1214 00000100:00100000:0.0:1780340718.058706:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:68034:x1866818940415744:12345-192.168.203.16@tcp:101:cat.0 00010000:00010000:0.0:1780340718.058743:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340718.058804:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7e00/0xa24651432774193 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced232f expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.058961:0:63710:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773fb0 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 9 pid: 85496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.058982:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa2465143277419a lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.058999:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa2465143277419a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.059016:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa2465143277419a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.059144:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa2465143277419a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.059153:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa2465143277419a lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.059160:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa2465143277419a lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.059191:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04497b7000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340718.059196:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa2465143277419a lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.059203:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa2465143277419a lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.059217:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff8c04428a8a00) 00010000:00010000:0.0:1780340718.059221:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340718.059473:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa2465143277419a lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.059483:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa2465143277419a lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.059569:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7e00/0xa24651432774193 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced232f expref: 10 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.059581:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8200) 00010000:00010000:0.0:1780340718.059583:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1780340718.059588:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7e00/0xa24651432774193 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced232f expref: 10 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.059607:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04497b7e00, rc 0) 00000100:00100000:0.0:1780340718.060028:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:68034:x1866818940415744:12345-192.168.203.16@tcp:101:cat.0 Request processed in 1323us (1672us total) trans 107374182402 rc 301/301 00000100:00100000:0.0:1780340718.060037:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1214 00000100:00100000:1.0:1780340718.070403:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340718.070560:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940415872 00000100:00100000:0.0:1780340718.070592:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940415872 00000100:00100000:0.0:1780340718.070677:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1215 00000100:00100000:0.0:1780340718.070689:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:68034:x1866818940415872:12345-192.168.203.16@tcp:101:cat.0 00010000:00010000:0.0:1780340718.070731:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340718.070798:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7e00/0xa246514327741a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2336 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.070905:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa246514327741af lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.070923:0:70100:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773fb0 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 10 pid: 85496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.070933:0:70100:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa246514327741af lrc: 4/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.070975:0:70100:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773fb0 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 10 pid: 85496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.070991:0:70100:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773fb0 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 10 pid: 85496 timeout: 3598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340718.071008:0:70100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:70100:1866818961103488:192.168.203.16@tcp:104: 00000100:00100000:0.0:1780340718.071115:0:70100:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0349845180 going to sleep for 11 seconds 00000100:00100000:0.0:1780340718.075366:0:70100:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:70100:1866818961103488:192.168.203.16@tcp:104: 00010000:00010000:0.0:1780340718.075411:0:70100:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa246514327741af lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340718.091718:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340718.092502:0:19125:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940416000 00000100:00100000:3.0:1780340718.092516:0:19125:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940416000 00010000:00010000:3.0:1780340718.092562:0:19125:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773fb0 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 11 pid: 85496 timeout: 3598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340718.092620:0:19125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2545 00000100:00100000:3.0:1780340718.092630:0:19125:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:2407:x1866818940416000:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780340718.092648:0:19125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:3.0:1780340718.092675:0:19125:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 8 00000004:00010000:3.0:1780340718.092678:0:19125:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 0 -> 1780340666 00000004:00010000:3.0:1780340718.092681:0:19125:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 0 -> 1780340658 00000004:00010000:3.0:1780340718.092683:0:19125:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 0 -> 1780340666 00010000:00010000:3.0:1780340718.092689:0:19125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773fb0 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 11 pid: 85496 timeout: 3598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340718.092703:0:19125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773fb0 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 11 pid: 85496 timeout: 3598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340718.092739:0:19125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432773fb0 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced22f7 expref: 11 pid: 85496 timeout: 3598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340718.092814:0:19125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff8c04428a8a00) 00010000:00010000:3.0:1780340718.092821:0:19125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa246514327741af lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340718.092848:0:19125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa246514327741af lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340718.092857:0:19125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa246514327741af lrc: 4/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340718.093996:0:19125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340718.094097:0:19125:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2407:x1866818940416000:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 1461us (2384us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340718.094108:0:19125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2545 00010000:00010000:2.0:1780340718.102022:0:70100:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa246514327741af lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340718.102045:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa246514327741af lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340718.102134:0:70100:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780340718.102175:0:70100:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa246514327741af lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340718.103512:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7e00/0xa246514327741a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2336 expref: 10 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340718.103553:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa246514327741af lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2336 expref: 9 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340718.103565:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff8c04428a8a00) 00010000:00010000:2.0:1780340718.103568:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780340718.103573:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04497b7000, rc 0) 00000100:00100000:2.0:1780340718.104064:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:68034:x1866818940415872:12345-192.168.203.16@tcp:101:cat.0 Request processed in 33374us (33678us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340718.104076:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1215 00000100:00100000:1.0:1780340718.119932:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340718.120157:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940416128 00000100:00100000:2.0:1780340718.120171:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940416128 00000100:00100000:2.0:1780340718.120249:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1216 00000100:00100000:2.0:1780340718.120262:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:68034:x1866818940416128:12345-192.168.203.16@tcp:101:cat.0 00010000:00010000:2.0:1780340718.120289:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340718.120317:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32aa00/0xa246514327741b6 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced233d expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340718.120404:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32aa00/0xa246514327741b6 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced233d expref: 10 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340718.120423:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32aa00/0xa246514327741b6 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced233d expref: 10 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340718.120468:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff8c04428a8a00) 00010000:00010000:2.0:1780340718.120472:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1780340718.120477:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32aa00, rc 0) 00000100:00100000:2.0:1780340718.120537:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:68034:x1866818940416128:12345-192.168.203.16@tcp:101:cat.0 Request processed in 279us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340718.120545:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1216 00000100:00100000:3.0:1780340718.126866:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340718.127055:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940416256 00000100:00100000:0.0:1780340718.127087:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940416256 00000100:00100000:0.0:1780340718.127158:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1217 00000100:00100000:0.0:1780340718.127169:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2409:x1866818940416256:12345-192.168.203.16@tcp:101:cat.0 00010000:00010000:0.0:1780340718.127197:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340718.127224:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6400/0xa246514327741bd lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2344 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.127280:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6400/0xa246514327741bd lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2344 expref: 11 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340718.127313:0:63710:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 8 -> 8 00000004:00010000:0.0:1780340718.127317:0:63710:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1780340666 -> 1780340666 00000004:00010000:0.0:1780340718.127320:0:63710:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1780340658 -> 1780340658 00000004:00010000:0.0:1780340718.127322:0:63710:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1780340666 -> 1780340666 00000004:00010000:0.0:1780340718.127324:0:63710:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 8 00002000:00010000:0.0:1780340718.127329:0:63710:0:(mdt_io.c:1550:mdt_lvb2reply()) size 8 00010000:00010000:0.0:1780340718.127338:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6400/0xa246514327741bd lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2344 expref: 11 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340718.127353:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff8c04428a8a00) 00010000:00010000:0.0:1780340718.127356:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1780340718.127360:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04497b6400, rc 0) 00000100:00100000:0.0:1780340718.127492:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:2409:x1866818940416256:12345-192.168.203.16@tcp:101:cat.0 Request processed in 323us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340718.127500:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1217 00000100:00100000:0.0:1780340718.136105:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340718.136242:0:63724:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940416384 00000100:00100000:2.0:1780340718.136256:0:63724:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940416384 00002000:00100000:2.0:1780340718.136325:0:63724:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff8c04440a7b80 x1866818940416384/t0(0) o3->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:144/0 lens 488/0 e 0 to 0 dl 1780340729 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1780340718.136337:0:63724:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8c04440a7b80 with x1866818940416384 00000100:00100000:2.0:1780340718.136382:0:63724:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:2.0:1780340718.136404:0:63724:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:2408:x1866818940416384:12345-192.168.203.16@tcp:3:cat.0 00000100:00100000:2.0:1780340718.143062:0:63724:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:2408:x1866818940416384:12345-192.168.203.16@tcp:3:cat.0 Request processed in 6660us (6960us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1780340718.143074:0:63724:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 3 00002000:00100000:2.0:1780340718.143084:0:63724:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff8c04440a7b80 x1866818940416384/t0(0) o3->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:144/0 lens 488/4536 e 0 to 0 dl 1780340729 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1780340718.143093:0:63724:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff8c04440a7b80 with x1866818940416384 00000100:00100000:1.0:1780340718.156806:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340718.157260:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940416640 00000100:00100000:0.0:1780340718.157291:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940416640 00000100:00100000:0.0:1780340718.157363:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 226 00000100:00100000:0.0:1780340718.157376:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:68034:x1866818940416640:12345-192.168.203.16@tcp:35:cat.0 00000100:00100000:0.0:1780340718.157701:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:68034:x1866818940416640:12345-192.168.203.16@tcp:35:cat.0 Request processed in 327us (951us total) trans 107374182403 rc 0/0 00000100:00100000:0.0:1780340718.157710:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 226 00010000:00010000:0.0:1780340718.473989:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340719.498846:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340720.010690:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340720.010722:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961103616:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340720.010813:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340720.010869:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961103616 00000100:00100000:3.0:1780340720.010876:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961103616 00000100:00100000:3.0:1780340720.010929:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010 00000100:00100000:3.0:1780340720.010938:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961103616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340720.010968:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340720.011025:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961103616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340720.011032:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010 00000100:00080000:3.0:1780340720.011052:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340720.011087:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961103616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340720.013268:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340720.013289:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961103744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340720.013347:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340720.013948:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961103744 00000100:00100000:2.0:1780340720.013958:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961103744 00000100:00100000:2.0:1780340720.014140:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2011 00000100:00100000:2.0:1780340720.014151:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961103744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340720.014178:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340720.014743:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961103744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 594us (1395us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340720.014751:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2011 00000100:00080000:1.0:1780340720.014817:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340720.017429:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961103744:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1780340720.521996:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340721.545932:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340721.546133:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340721.546153:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961103872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340721.546226:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340721.546299:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961103872 00000100:00100000:2.0:1780340721.546307:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961103872 00000100:00100000:2.0:1780340721.546359:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807 00000100:00100000:2.0:1780340721.546367:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961103872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340721.546399:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:2.0:1780340721.546447:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961103872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340721.546453:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807 00000100:00100000:0.0:1780340721.546537:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961103872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340721.548513:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961104384:0@lo:400:kworker.0 00000100:00100000:3.0:1780340721.548805:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961104128:0@lo:400:kworker.0 00000100:00100000:3.0:1780340721.548843:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340721.548889:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961104640:0@lo:400:kworker.0 00000100:00100000:3.0:1780340721.548910:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340721.548926:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961105152:0@lo:400:kworker.0 00000100:00100000:3.0:1780340721.548947:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340721.548967:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1780340721.548973:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961104256:0@lo:400:kworker.0 00000100:00100000:2.0:1780340721.549022:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961104000:0@lo:400:kworker.0 00000100:00100000:2.0:1780340721.549060:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340721.549092:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961104512:0@lo:400:kworker.0 00000100:00100000:3.0:1780340721.549107:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340721.549126:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961104768:0@lo:400:kworker.0 00000100:00100000:3.0:1780340721.549147:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340721.549203:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961105280:0@lo:400:kworker.0 00000100:00100000:3.0:1780340721.549223:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340721.549248:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961104640 00000100:00100000:3.0:1780340721.549254:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961104640 00000100:00100000:3.0:1780340721.549290:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808 00000100:00100000:3.0:1780340721.549297:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961104640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340721.549341:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961104640:12345-0@lo:400:kworker.0 Request processed in 45us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340721.549348:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808 00000100:00100000:2.0:1780340721.549359:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340721.549373:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961104128 00000100:00100000:3.0:1780340721.549377:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961104128 00000100:00100000:2.0:1780340721.549383:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961105024:0@lo:400:kworker.0 00000100:00100000:2.0:1780340721.549411:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340721.549412:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961104256 00000100:00100000:3.0:1780340721.549415:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961104256 00000100:00100000:3.0:1780340721.549432:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961104512 00000100:00100000:3.0:1780340721.549435:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961104512 00000100:00100000:2.0:1780340721.549451:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961104000 00000100:00100000:2.0:1780340721.549456:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961104000 00000100:00100000:3.0:1780340721.549465:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961105024 00000100:00100000:3.0:1780340721.549469:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961105024 00000100:00100000:3.0:1780340721.549489:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:2.0:1780340721.549495:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1780340721.549497:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961104128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340721.549509:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034ac0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961104000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340721.549542:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961104128:12345-0@lo:400:kworker.0 Request processed in 46us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340721.549549:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:2.0:1780340721.549556:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034ac0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961104000:12345-0@lo:400:kworker.0 Request processed in 51us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340721.549563:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1780340721.549592:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:2.0:1780340721.549605:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961104256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340721.549671:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:1.0:1780340721.549681:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961104512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340721.549724:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961104512:12345-0@lo:400:kworker.0 Request processed in 46us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340721.549730:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:1.0:1780340721.549743:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:1.0:1780340721.549748:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961105024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340721.549791:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961105024:12345-0@lo:400:kworker.0 Request processed in 43us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340721.549797:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:1.0:1780340721.549817:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961105152 00000100:00100000:1.0:1780340721.549820:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961105152 00000100:00100000:1.0:1780340721.549844:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961104768 00000100:00100000:1.0:1780340721.549847:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961104768 00000100:00100000:1.0:1780340721.549870:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961105280 00000100:00100000:1.0:1780340721.549872:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961105280 00000100:00100000:1.0:1780340721.549892:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2470 00000100:00100000:1.0:1780340721.549897:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961105152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340721.549924:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961105152:12345-0@lo:400:kworker.0 Request processed in 27us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340721.549929:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2470 00000100:00100000:1.0:1780340721.549940:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2471 00000100:00100000:1.0:1780340721.549944:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961104768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340721.549964:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961104768:12345-0@lo:400:kworker.0 Request processed in 20us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340721.549969:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2471 00000100:00100000:1.0:1780340721.549978:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2472 00000100:00100000:1.0:1780340721.549983:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961105280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340721.550003:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961105280:12345-0@lo:400:kworker.0 Request processed in 20us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340721.550008:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2472 00000100:00080000:1.0:1780340721.550028:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340721.550032:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780340721.550035:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780340721.550037:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340721.550163:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961104768:0@lo:400:kworker.0 00000100:00100000:1.0:1780340721.550173:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961105280:0@lo:400:kworker.0 00000100:00100000:1.0:1780340721.550181:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961104128:0@lo:400:kworker.0 00000100:00100000:1.0:1780340721.550191:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961104640:0@lo:400:kworker.0 00000100:00100000:1.0:1780340721.550209:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961105152:0@lo:400:kworker.0 00000100:00100000:1.0:1780340721.550249:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961104000:0@lo:400:kworker.0 00000100:00100000:1.0:1780340721.550259:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961104512:0@lo:400:kworker.0 00000100:00100000:1.0:1780340721.550266:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961105024:0@lo:400:kworker.0 00000100:00100000:0.0:1780340721.550452:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340721.550482:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961104896:0@lo:400:kworker.0 00000100:00100000:0.0:1780340721.550510:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340721.550524:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961105408:0@lo:400:kworker.0 00000100:00100000:0.0:1780340721.550541:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340721.551241:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961104256:12345-0@lo:400:kworker.0 Request processed in 1636us (2134us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340721.551249:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:2.0:1780340721.551266:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961104384 00000100:00100000:2.0:1780340721.551270:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961104384 00000100:00100000:2.0:1780340721.551302:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961105408 00000100:00100000:2.0:1780340721.551304:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961105408 00000100:00100000:2.0:1780340721.551315:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:2.0:1780340721.551320:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961104384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340721.551354:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961104384:12345-0@lo:400:kworker.0 Request processed in 33us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340721.551359:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00100000:2.0:1780340721.551370:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:2.0:1780340721.551374:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961105408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340721.551398:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961105408:12345-0@lo:400:kworker.0 Request processed in 24us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340721.551403:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00080000:2.0:1780340721.551420:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780340721.551456:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961104256:0@lo:400:kworker.0 00000100:00100000:0.0:1780340721.551708:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961104896 00000100:00100000:0.0:1780340721.551713:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961104896 00000100:00100000:0.0:1780340721.551749:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2473 00000100:00100000:0.0:1780340721.551755:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04776c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961104896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340721.551799:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04776c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961104896:12345-0@lo:400:kworker.0 Request processed in 44us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340721.551805:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2473 00000100:00100000:0.0:1780340721.551992:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961104384:0@lo:400:kworker.0 00000100:00100000:0.0:1780340721.552002:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961104896:0@lo:400:kworker.0 00000100:00100000:0.0:1780340721.552010:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961105408:0@lo:400:kworker.0 00000100:00100000:0.0:1780340722.065739:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961105536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340722.065853:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340722.065997:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961105536 00000100:00100000:1.0:1780340722.066004:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961105536 00000100:00100000:1.0:1780340722.066047:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2012 00000100:00100000:1.0:1780340722.066055:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961105536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780340722.066083:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340722.066125:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961105536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340722.066132:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2012 00000100:00100000:3.0:1780340722.066503:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340722.066513:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961105664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340722.066541:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340722.066566:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961105664 00000100:00100000:3.0:1780340722.066569:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961105664 00000100:00100000:3.0:1780340722.066592:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2013 00000100:00100000:3.0:1780340722.066610:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961105664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340722.066624:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340722.066652:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961105664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340722.066657:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2013 00000100:00100000:3.0:1780340722.066708:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961105664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340722.067784:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961105536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340722.067899:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340722.067910:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961105792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340722.067948:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340722.067980:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961105792 00000100:00100000:1.0:1780340722.067984:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961105792 00000100:00100000:1.0:1780340722.068016:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809 00000100:00100000:1.0:1780340722.068023:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961105792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780340722.068048:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445232640 avail 1298993152 00000100:00100000:1.0:1780340722.068081:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961105792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340722.068087:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809 00000100:00100000:1.0:1780340722.068116:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961105792:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1780340722.584349:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340722.729309:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340722.729357:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340722.729387:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340722.729424:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340722.729451:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340722.729482:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940417024 00000100:00100000:2.0:1780340722.729512:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940417024 00000100:00100000:2.0:1780340722.729602:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940416896 00000100:00100000:2.0:1780340722.729605:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940416896 00000100:00100000:2.0:1780340722.729636:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1234 00000100:00100000:2.0:1780340722.729649:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940417024:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340722.729755:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940417024:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 110us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340722.729797:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1234 00000100:00100000:2.0:1780340722.729819:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1235 00000100:00100000:2.0:1780340722.729826:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:2408:x1866818940416896:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340722.729859:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:2408:x1866818940416896:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 34us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340722.729865:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1235 00000100:00080000:2.0:1780340722.729888:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780340722.729893:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340722.730118:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940416768 00000100:00100000:0.0:1780340722.730123:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940416768 00000100:00100000:0.0:1780340722.730162:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 81 00000100:00100000:0.0:1780340722.730170:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034b0e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940416768:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340722.730208:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034b0e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940416768:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 39us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340722.730214:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 81 00000100:00100000:0.0:1780340722.730249:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940417280 00000100:00100000:0.0:1780340722.730253:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940417280 00000100:00100000:0.0:1780340722.730291:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940417152 00000100:00100000:0.0:1780340722.730294:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940417152 00000100:00100000:0.0:1780340722.730319:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2474 00000100:00100000:0.0:1780340722.730326:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940417280:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340722.730354:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940417280:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 29us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340722.730360:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2474 00000100:00100000:0.0:1780340722.730372:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2475 00000100:00100000:0.0:1780340722.730378:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940417152:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340722.730416:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940417152:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 38us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340722.730423:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2475 00000100:00080000:0.0:1780340722.730519:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340722.730522:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1780340723.594128:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1780340724.115475:0:85462:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182403 is committed 00010000:00010000:3.0:1780340724.618322:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340725.132660:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961105920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340725.132785:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340725.132856:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961105920 00000100:00100000:1.0:1780340725.132865:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961105920 00000100:00100000:1.0:1780340725.132934:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2014 00000100:00100000:1.0:1780340725.132944:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961105920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340725.132979:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340725.133027:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961105920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340725.133035:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2014 00000100:00080000:1.0:1780340725.133057:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340725.133164:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961105920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340725.140868:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961106048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340725.140965:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340725.145327:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961106048 00000100:00100000:3.0:1780340725.145348:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961106048 00000100:00100000:3.0:1780340725.145453:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2015 00000100:00100000:3.0:1780340725.145466:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961106048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340725.145509:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340725.145613:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961106048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 151us (4648us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340725.145636:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2015 00000100:00080000:1.0:1780340725.145933:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340725.147498:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961106048:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1780340725.645787:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340726.680678:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340726.680905:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340726.680933:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961106176:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780340726.681019:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340726.681071:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961106176 00000100:00100000:3.0:1780340726.681080:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961106176 00000100:00100000:3.0:1780340726.681140:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810 00000100:00100000:3.0:1780340726.681151:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961106176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780340726.681206:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:3.0:1780340726.681261:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961106176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340726.681269:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810 00000100:00100000:3.0:1780340726.681329:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961106176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340726.692434:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340726.694073:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340726.694113:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0477585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961106688:0@lo:400:kworker.0 00000100:00100000:3.0:1780340726.694228:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340726.694302:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961106688 00000100:00100000:3.0:1780340726.694311:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961106688 00000100:00100000:3.0:1780340726.694408:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:3.0:1780340726.694421:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961106688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340726.694485:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961106688:12345-0@lo:400:kworker.0 Request processed in 68us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340726.694493:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:3.0:1780340726.694556:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0477585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961106688:0@lo:400:kworker.0 00000100:00080000:0.0:1780340726.697475:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340726.701088:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a07c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961106304:0@lo:400:kworker.0 00000100:00100000:1.0:1780340726.701283:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340726.702551:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961106304 00000100:00100000:0.0:1780340726.702566:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961106304 00000100:00100000:0.0:1780340726.702645:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1780340726.702668:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034b0e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961106304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340726.702794:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034b0e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961106304:12345-0@lo:400:kworker.0 Request processed in 140us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340726.702803:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1780340726.704102:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a07c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961106304:0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.706484:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0477585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961106432:0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.706583:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340726.706627:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0477586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961106944:0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.706669:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340726.706688:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961107456:0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.706962:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340726.706991:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1780340726.706999:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0477585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961106560:0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.707024:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340726.707041:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0477584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961107072:0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.707079:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340726.707097:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961107584:0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.707119:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340726.707159:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961106432 00000100:00100000:2.0:1780340726.707172:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961106432 00000100:00100000:2.0:1780340726.707311:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961106560 00000100:00100000:2.0:1780340726.707315:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961106560 00000100:00100000:2.0:1780340726.707343:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:2.0:1780340726.707364:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961106432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.707426:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961106432:12345-0@lo:400:kworker.0 Request processed in 74us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340726.707433:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:2.0:1780340726.707450:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:2.0:1780340726.707456:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961106560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.707482:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961106560:12345-0@lo:400:kworker.0 Request processed in 26us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340726.707488:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:2.0:1780340726.707512:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961107456 00000100:00100000:2.0:1780340726.707516:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961107456 00000100:00100000:0.0:1780340726.707646:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0477587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961106816:0@lo:400:kworker.0 00000100:00100000:0.0:1780340726.707691:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340726.707723:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961107328:0@lo:400:kworker.0 00000100:00100000:0.0:1780340726.707743:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340726.707773:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1780340726.707780:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0477585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961107200:0@lo:400:kworker.0 00000100:00100000:0.0:1780340726.707803:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340726.707881:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961106944 00000100:00100000:1.0:1780340726.707886:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961106944 00000100:00100000:1.0:1780340726.707919:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811 00000100:00100000:1.0:1780340726.707926:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961106944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340726.707975:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961106944:12345-0@lo:400:kworker.0 Request processed in 50us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340726.707982:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811 00000100:00100000:0.0:1780340726.717168:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961107712:0@lo:400:kworker.0 00000100:00100000:1.0:1780340726.717715:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961106816 00000100:00100000:1.0:1780340726.717749:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961106816 00000100:00100000:1.0:1780340726.717837:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961107328 00000100:00100000:1.0:1780340726.717842:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961107328 00000100:00100000:1.0:1780340726.717864:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:1.0:1780340726.717876:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961106816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340726.718005:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961106816:12345-0@lo:400:kworker.0 Request processed in 131us (10313us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340726.718013:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:1.0:1780340726.718035:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:1.0:1780340726.718042:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818961107328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340726.718075:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818961107328:12345-0@lo:400:kworker.0 Request processed in 35us (10331us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340726.718081:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:0.0:1780340726.720952:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340726.721039:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0477587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961106816:0@lo:400:kworker.0 00000100:00100000:0.0:1780340726.721056:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961107328:0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.721288:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961107072 00000100:00100000:2.0:1780340726.721297:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961107072 00000100:00100000:2.0:1780340726.722691:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0477585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961106560:0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.722713:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0477585880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961106432:0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.722727:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0477586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961106944:0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.722794:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961107712 00000100:00100000:2.0:1780340726.722801:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961107712 00000100:00100000:2.0:1780340726.722883:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:2.0:1780340726.722893:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961107712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.722993:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961107712:12345-0@lo:400:kworker.0 Request processed in 100us (2051us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340726.723001:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00100000:2.0:1780340726.723039:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961107584 00000100:00100000:2.0:1780340726.723044:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961107584 00000100:00100000:2.0:1780340726.723076:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961107200 00000100:00100000:2.0:1780340726.723080:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961107200 00000100:00100000:2.0:1780340726.723102:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476 00000100:00100000:2.0:1780340726.723111:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961107456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.723152:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961107456:12345-0@lo:400:kworker.0 Request processed in 43us (16190us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340726.723158:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476 00000100:00100000:2.0:1780340726.723171:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477 00000100:00100000:2.0:1780340726.723177:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961107584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.724792:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961107584:12345-0@lo:400:kworker.0 Request processed in 1610us (17666us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340726.724803:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477 00000100:00100000:2.0:1780340726.724834:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2478 00000100:00100000:2.0:1780340726.724844:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961107200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.724879:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961107200:12345-0@lo:400:kworker.0 Request processed in 39us (17075us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340726.724884:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2478 00000100:00100000:2.0:1780340726.724954:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961107584:0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.724968:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961107456:0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.725030:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0477585f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961107200:0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.725044:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961107712:0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.725118:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2479 00000100:00100000:2.0:1780340726.725125:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961107072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340726.725164:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961107072:12345-0@lo:400:kworker.0 Request processed in 40us (18083us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340726.725170:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2479 00000100:00080000:0.0:1780340726.726336:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340726.726347:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340726.726363:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340726.726367:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780340726.728513:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0477584380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961107072:0@lo:400:kworker.0 00000100:00100000:0.0:1780340727.178003:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04441b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961107840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340727.178096:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340727.178358:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340727.178370:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04441b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961107968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340727.178404:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340727.178440:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961107840 00000100:00100000:3.0:1780340727.178449:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961107840 00000100:00100000:3.0:1780340727.178505:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961107968 00000100:00100000:3.0:1780340727.178508:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961107968 00000100:00100000:3.0:1780340727.178532:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016 00000100:00100000:3.0:1780340727.178558:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961107840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340727.178595:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340727.178647:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961107840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340727.178665:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016 00000100:00100000:3.0:1780340727.178688:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2017 00000100:00100000:3.0:1780340727.178694:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961107968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780340727.178712:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340727.178745:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961107968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340727.178751:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2017 00000100:00100000:3.0:1780340727.178839:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04441b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961107968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340727.178875:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04441b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961107840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340727.179836:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340727.179855:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961108096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340727.179911:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340727.180069:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961108096 00000100:00100000:0.0:1780340727.180077:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961108096 00000100:00100000:0.0:1780340727.180143:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812 00000100:00100000:0.0:1780340727.180162:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961108096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780340727.180207:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445232640 avail 1298993152 00000100:00100000:0.0:1780340727.180260:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961108096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340727.180267:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812 00000100:00100000:3.0:1780340727.180799:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961108096:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1780340727.699889:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1780340727.853669:0:86175:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_131b skipping excluded test 131b 00000100:00100000:0.0:1780340727.856313:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340727.856354:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340727.856399:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340727.856426:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340727.856454:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340727.856490:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940417408 00000100:00100000:0.0:1780340727.856503:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940417408 00000100:00100000:0.0:1780340727.856566:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 83 00000100:00100000:0.0:1780340727.856578:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940417408:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340727.856700:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940417408:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 123us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340727.856709:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 83 00000100:00100000:0.0:1780340727.856751:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940417536 00000100:00100000:0.0:1780340727.856755:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940417536 00000100:00100000:0.0:1780340727.856822:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940417664 00000100:00100000:0.0:1780340727.856826:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940417664 00000100:00100000:0.0:1780340727.856851:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1242 00000100:00100000:0.0:1780340727.856857:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2408:x1866818940417536:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340727.856892:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2408:x1866818940417536:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 34us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340727.856899:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1242 00000100:00100000:0.0:1780340727.856911:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1243 00000100:00100000:0.0:1780340727.856918:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940417664:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340727.856945:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940417664:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 27us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340727.856951:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1243 00000100:00100000:0.0:1780340727.856974:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940417792 00000100:00100000:0.0:1780340727.856977:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940417792 00000100:00100000:0.0:1780340727.857005:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940417920 00000100:00100000:0.0:1780340727.857008:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940417920 00000100:00100000:0.0:1780340727.857029:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2480 00000100:00100000:0.0:1780340727.857036:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940417792:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340727.857063:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940417792:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 28us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340727.857081:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2480 00000100:00100000:0.0:1780340727.857108:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2481 00000100:00100000:0.0:1780340727.857115:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940417920:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340727.857145:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940417920:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 31us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340727.857152:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2481 00000100:00080000:0.0:1780340727.857320:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340727.857326:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340727.857329:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340727.857331:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1780340728.715594:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340729.749561:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1780340730.218575:0:86224:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 132a: PFL new component instantiate replay ========================================================== 15:05:28 (1780340728) 00000100:00100000:2.0:1780340730.250123:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0477586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961108224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340730.250200:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340730.250256:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961108224 00000100:00100000:1.0:1780340730.250265:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961108224 00000100:00100000:1.0:1780340730.250343:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018 00000100:00100000:1.0:1780340730.250353:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961108224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780340730.250380:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1780340730.250444:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340730.250714:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04441b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961108352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340730.250744:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340730.250792:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961108352 00000100:00100000:0.0:1780340730.250796:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961108352 00000100:00100000:0.0:1780340730.250826:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019 00000100:00100000:0.0:1780340730.250832:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961108352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340730.250849:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340730.250881:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961108352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340730.250889:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019 00000100:00080000:0.0:1780340730.250922:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340730.250951:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04441b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961108352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340730.267147:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961108224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 16784us (16935us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340730.267161:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018 00000100:00100000:2.0:1780340730.269247:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0477586a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961108224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340730.381093:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340730.381125:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940418048 00000100:00100000:3.0:1780340730.381134:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940418048 00000100:00100000:3.0:1780340730.381195:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1218 00000100:00100000:3.0:1780340730.381205:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:68758:x1866818940418048:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1780340730.381223:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340730.381241:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327741c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced234b expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381299:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327741cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381313:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327741cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381325:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327741cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381338:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa246514327741d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381344:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa246514327741d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381349:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa246514327741d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381387:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327741cb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381393:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327741cb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381408:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327741cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381414:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327741cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381420:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340730.381424:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327741cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381431:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327741cb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381444:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8200) 00010000:00010000:3.0:1780340730.381447:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340730.381451:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327741cb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381456:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327741cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381466:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa246514327741d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381471:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa246514327741d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381476:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa246514327741d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381492:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340730.381503:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa246514327741d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381508:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa246514327741d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381517:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8c044412bc00) 00010000:00010000:3.0:1780340730.381519:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340730.381522:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa246514327741d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381526:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa246514327741d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381554:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327741c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced234b expref: 11 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381563:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8200) 00010000:00010000:3.0:1780340730.381565:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340730.381568:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327741c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced234b expref: 11 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.381576:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9a00, rc 0) 00000100:00100000:3.0:1780340730.381629:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:68758:x1866818940418048:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 426us (542us total) trans 0 rc 301/301 00000100:00100000:3.0:1780340730.381646:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1218 00000100:00080000:3.0:1780340730.381667:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780340730.389037:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340730.389076:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940418304 00000100:00100000:3.0:1780340730.389087:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940418304 00000100:00100000:3.0:1780340730.389148:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1219 00000100:00100000:3.0:1780340730.389160:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:68758:x1866818940418304:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1780340730.389181:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340730.389184:0:70100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1780340730.389211:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6c00/0xa2465143277417e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2328 expref: 10 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.389229:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8200) 00010000:00010000:3.0:1780340730.389239:0:70100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340730.389252:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327741d9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2352 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.389348:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327741e0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.389362:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327741e0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.389372:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327741e0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.389385:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8000/0xa246514327741e7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.389392:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8000/0xa246514327741e7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.389398:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8000/0xa246514327741e7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.389817:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9000/0xa246514327741ee lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.389833:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9000/0xa246514327741ee lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.389841:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9000/0xa246514327741ee lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340730.389852:0:70100:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00010000:00010000:3.0:1780340730.389878:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327741e0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.389886:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327741e0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.389892:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327741e0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.389898:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340730.389903:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327741e0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.389910:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327741e0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.389919:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c044412be00) 00010000:00010000:3.0:1780340730.389921:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340730.389924:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327741e0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.389931:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327741e0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340730.389940:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000072aee1b7 reply state 00000000e79f3cf4 transno 107374182404 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8000/0xa246514327741e7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.389957:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8000/0xa246514327741e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.389963:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8c044412b300) 00010000:00010000:3.0:1780340730.389965:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340730.389967:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1780340730.389993:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327741d9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2352 expref: 12 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.390008:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9000/0xa246514327741ee lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2352 expref: 11 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340730.390015:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c044412b700) 00010000:00010000:3.0:1780340730.390018:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780340730.390020:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9000, rc 0) 00000100:00100000:3.0:1780340730.390074:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:68758:x1866818940418304:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 916us (1047us total) trans 107374182404 rc 0/0 00000100:00100000:3.0:1780340730.390082:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1219 00000100:00100000:3.0:1780340730.394339:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340730.394431:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940418560 00000100:00100000:1.0:1780340730.394440:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940418560 00000100:00100000:1.0:1780340730.394497:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1220 00000100:00100000:1.0:1780340730.394506:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:68758:x1866818940418560:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1780340730.394529:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340730.394552:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2800/0xa246514327741fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2359 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340730.394691:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3600/0xa24651432774203 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340730.394718:0:63712:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9000/0xa246514327741ee lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2352 expref: 13 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340730.394727:0:63712:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3600/0xa24651432774203 lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340730.394777:0:63712:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9000/0xa246514327741ee lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2352 expref: 13 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340730.394790:0:63712:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9000/0xa246514327741ee lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2352 expref: 13 pid: 70100 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340730.394804:0:63712:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:63712:1866818961108480:192.168.203.16@tcp:104: 00000100:00100000:1.0:1780340730.394867:0:63712:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443719f00 going to sleep for 11 seconds 00000100:00100000:0.0:1780340730.399068:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340730.399252:0:63712:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:63712:1866818961108480:192.168.203.16@tcp:104: 00010000:00010000:1.0:1780340730.399277:0:63712:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3600/0xa24651432774203 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340730.399362:0:25499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940418688 00000100:00100000:2.0:1780340730.399369:0:25499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940418688 00010000:00010000:2.0:1780340730.399398:0:25499:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9000/0xa246514327741ee lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2352 expref: 14 pid: 70100 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340730.399439:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2546 00000100:00100000:2.0:1780340730.399447:0:25499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:e06e5cf1-1986-4ba7-9630-fad7efb74eca+14:2408:x1866818940418688:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780340730.399460:0:25499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340730.399471:0:25499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9000/0xa246514327741ee lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2352 expref: 14 pid: 70100 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340730.399832:0:25499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9000/0xa246514327741ee lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2352 expref: 14 pid: 70100 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340730.399857:0:25499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9000/0xa246514327741ee lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2352 expref: 14 pid: 70100 timeout: 3610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340730.399872:0:25499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c044412b700) 00010000:00010000:2.0:1780340730.399876:0:25499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3600/0xa24651432774203 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340730.399884:0:25499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3600/0xa24651432774203 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340730.399891:0:25499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3600/0xa24651432774203 lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340730.400018:0:25499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340730.400076:0:25499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477585500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:2408:x1866818940418688:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 629us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340730.400083:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2546 00010000:00010000:1.0:1780340730.410622:0:63712:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3600/0xa24651432774203 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340730.410648:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3600/0xa24651432774203 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340730.410669:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00000004:00080000:1.0:1780340730.411606:0:63712:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x91:0x0], count =625 00000004:00080000:1.0:1780340730.411617:0:63712:0:(osp_object.c:1640:osp_create()) Writing gap [0x2c0000401:0x91:0x0]+625 in llog 00000004:00080000:1.0:1780340730.411659:0:63712:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x302:0x0], index 1: 0 00010000:00010000:1.0:1780340730.412115:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3600/0xa24651432774203 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340730.412126:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3600/0xa24651432774203 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340730.412133:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3600/0xa24651432774203 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340730.412139:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b3600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340730.412143:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3600/0xa24651432774203 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340730.412150:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3600/0xa24651432774203 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340730.412165:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c044412b700) 00010000:00010000:1.0:1780340730.412168:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1780340730.412172:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3600/0xa24651432774203 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340730.412178:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3600/0xa24651432774203 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340730.412236:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2800/0xa246514327741fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2359 expref: 13 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340730.412247:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c047a3b5a00) 00010000:00010000:1.0:1780340730.412249:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1780340730.412259:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2800/0xa246514327741fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2359 expref: 13 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340730.412272:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a8b2800, rc 0) 00000100:00100000:1.0:1780340730.412646:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:68758:x1866818940418560:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 18140us (18314us total) trans 107374182405 rc 301/301 00000100:00100000:1.0:1780340730.412655:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1220 00000100:00100000:0.0:1780340730.435984:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340730.436099:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940418944 00000100:00100000:0.0:1780340730.436109:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940418944 00000100:00100000:0.0:1780340730.436159:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 227 00000100:00100000:0.0:1780340730.436168:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:68758:x1866818940418944:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:0.0:1780340730.437889:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:68758:x1866818940418944:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 1713us (1903us total) trans 107374182406 rc 0/0 00000100:00100000:0.0:1780340730.437901:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 227 00000100:00100000:2.0:1780340730.449284:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340730.449331:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940419200 00000100:00100000:2.0:1780340730.449341:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940419200 00000100:00100000:2.0:1780340730.449401:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 228 00000100:00100000:2.0:1780340730.452815:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:68758:x1866818940419200:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1780340730.456098:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+14:68758:x1866818940419200:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 6676us (6812us total) trans 107374182407 rc 0/0 00000100:00100000:2.0:1780340730.456118:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 228 00010000:00010000:3.0:1780340730.767784:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1780340731.453747:0:85462:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182407 is committed 00010000:00010000:1.0:1780340731.453855:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8000/0xa246514327741e7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.453868:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8000/0xa246514327741e7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.453876:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8000/0xa246514327741e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.453882:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340731.453887:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8000/0xa246514327741e7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.453895:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8000/0xa246514327741e7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.454024:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8c044412b300) 00010000:00010000:1.0:1780340731.454028:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340731.454033:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8000/0xa246514327741e7 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.454039:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8000/0xa246514327741e7 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340731.602670:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340731.602808:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940419328 00000100:00100000:0.0:1780340731.602818:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940419328 00000100:00100000:0.0:1780340731.602876:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1221 00000100:00100000:0.0:1780340731.602889:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:68774:x1866818940419328:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1780340731.602913:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340731.602937:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7600/0xa24651432774211 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2360 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340731.602991:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7400/0xa24651432774218 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340731.603002:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7400/0xa24651432774218 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340731.603013:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7400/0xa24651432774218 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340731.603053:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780340731.603057:0:63710:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780340731.603081:0:63710:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7400/0xa24651432774218 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340731.603114:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7600/0xa24651432774211 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2360 expref: 11 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340731.603133:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7400/0xa24651432774218 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2360 expref: 10 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340731.603139:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8400) 00010000:00010000:0.0:1780340731.603142:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780340731.603144:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04497b7400, rc 0) 00000100:00100000:0.0:1780340731.603193:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:68774:x1866818940419328:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 309us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340731.603198:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1221 00000100:00100000:0.0:1780340731.612213:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340731.615519:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940419456 00000100:00100000:3.0:1780340731.615530:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940419456 00000100:00100000:3.0:1780340731.616118:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1222 00000100:00100000:3.0:1780340731.616132:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:68774:x1866818940419456:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:3.0:1780340731.616169:0:64454:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445232640 avail 1298993152 00000100:00100000:3.0:1780340731.616261:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477586a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:68774:x1866818940419456:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 132us (4056us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340731.616270:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1222 00000100:00100000:3.0:1780340731.623605:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340731.624830:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940419584 00000100:00100000:1.0:1780340731.624842:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940419584 00000100:00100000:1.0:1780340731.624909:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1223 00000100:00100000:1.0:1780340731.624920:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:68774:x1866818940419584:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:1.0:1780340731.624956:0:63712:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00080000:3.0:1780340731.625051:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340731.625101:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:68774:x1866818940419584:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 182us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340731.625109:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1223 00000100:00100000:0.0:1780340731.633047:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340731.633077:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940419712 00000100:00100000:0.0:1780340731.633086:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940419712 00000100:00100000:0.0:1780340731.633139:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2020 00000100:00100000:0.0:1780340731.633149:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:68774:x1866818940419712:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:0.0:1780340731.633174:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340731.633233:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:68774:x1866818940419712:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 85us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340731.633241:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2020 00000100:00080000:0.0:1780340731.633261:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340731.637962:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340731.638044:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940419840 00000100:00100000:2.0:1780340731.638056:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940419840 00000100:00080000:0.0:1780340731.638107:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340731.638133:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2021 00000100:00100000:2.0:1780340731.638144:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b991880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:68774:x1866818940419840:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:2.0:1780340731.638169:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340731.638239:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b991880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:68774:x1866818940419840:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 97us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340731.638247:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2021 00000100:00100000:0.0:1780340731.728981:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340731.729066:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940420096 00000100:00100000:3.0:1780340731.729076:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940420096 00000100:00100000:3.0:1780340731.729131:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1224 00000100:00100000:3.0:1780340731.729140:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:68781:x1866818940420096:12345-192.168.203.16@tcp:36:mcreate.0 00010000:00010000:3.0:1780340731.729198:0:63710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340731.729222:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7400/0xa24651432774218 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2360 expref: 10 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.729244:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8400) 00010000:00010000:3.0:1780340731.729254:0:63710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340731.729308:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277421f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.729322:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277421f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.729332:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277421f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.729343:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432774226 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.729351:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432774226 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.729374:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432774226 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.730135:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277421f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.730145:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277421f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.730152:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277421f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.730158:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277421f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.730164:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340731.730168:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277421f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.730174:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277421f lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.730241:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c044412b700) 00010000:00010000:3.0:1780340731.730244:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340731.730248:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277421f lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.730254:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277421f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340731.730268:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f310fdb0 reply state 00000000a8f1103e transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432774226 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.730287:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432774226 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.730294:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c044412bf00) 00010000:00010000:3.0:1780340731.730297:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340731.730300:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780340731.730375:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:68781:x1866818940420096:12345-192.168.203.16@tcp:36:mcreate.0 Request processed in 1234us (1401us total) trans 107374182408 rc 0/0 00000100:00100000:3.0:1780340731.730383:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1224 00000100:00100000:0.0:1780340731.758905:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340731.758983:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940420224 00000100:00100000:3.0:1780340731.758991:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940420224 00000100:00100000:3.0:1780340731.759037:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1225 00000100:00100000:3.0:1780340731.759044:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:68784:x1866818940420224:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:3.0:1780340731.759062:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340731.759079:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277422d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2367 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.759126:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432774234 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.759136:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432774234 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.759144:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432774234 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340731.759177:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1780340731.759179:0:63711:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780340731.759207:0:63711:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432774234 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.759223:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277422d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2367 expref: 13 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.759236:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432774234 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2367 expref: 12 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.759241:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c044412b700) 00010000:00010000:3.0:1780340731.759243:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1780340731.759246:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9a00, rc 0) 00000100:00100000:3.0:1780340731.759297:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:68784:x1866818940420224:12345-192.168.203.16@tcp:101:rm.0 Request processed in 254us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340731.759301:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1225 00000100:00100000:2.0:1780340731.766135:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340731.766322:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940420352 00000100:00100000:1.0:1780340731.766339:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940420352 00000100:00100000:1.0:1780340731.766388:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1226 00000100:00100000:1.0:1780340731.766408:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:68784:x1866818940420352:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:1.0:1780340731.766428:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340731.766448:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3400/0xa2465143277423b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced236e expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.766524:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2a00/0xa24651432774242 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.766537:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2a00/0xa24651432774242 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.766549:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2a00/0xa24651432774242 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.766560:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3e00/0xa24651432774249 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.766586:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3e00/0xa24651432774249 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.766593:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3e00/0xa24651432774249 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.766896:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2200/0xa24651432774250 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.766905:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2200/0xa24651432774250 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.766912:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2200/0xa24651432774250 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340731.767090:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0xa:0x0]: returning size 0 00000004:00200000:1.0:1780340731.767094:0:63712:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780340731.767112:0:63712:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2200/0xa24651432774250 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767122:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2200/0xa24651432774250 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767131:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2a00/0xa24651432774242 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767137:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2a00/0xa24651432774242 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767144:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2a00/0xa24651432774242 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767159:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2a00/0xa24651432774242 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767165:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b2a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340731.767169:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2a00/0xa24651432774242 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767176:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2a00/0xa24651432774242 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767187:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c044412b700) 00010000:00010000:1.0:1780340731.767190:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340731.767195:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2a00/0xa24651432774242 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767202:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2a00/0xa24651432774242 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767213:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3e00/0xa24651432774249 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767218:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3e00/0xa24651432774249 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767223:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3e00/0xa24651432774249 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767228:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b3e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340731.767478:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3e00/0xa24651432774249 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767552:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3e00/0xa24651432774249 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767561:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c044412bf00) 00010000:00010000:1.0:1780340731.767564:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340731.767567:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3e00/0xa24651432774249 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767573:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3e00/0xa24651432774249 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767603:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3400/0xa2465143277423b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced236e expref: 14 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767960:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2200/0xa24651432774250 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced236e expref: 13 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.767970:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff8c047a3b5a00) 00010000:00010000:1.0:1780340731.767972:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780340731.767975:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a8b2200, rc 0) 00000100:00100000:1.0:1780340731.768931:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:68784:x1866818940420352:12345-192.168.203.16@tcp:101:rm.0 Request processed in 2521us (2802us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340731.768940:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1226 00000100:00100000:1.0:1780340731.773823:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340731.773954:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940420608 00000100:00100000:3.0:1780340731.773964:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940420608 00000100:00100000:3.0:1780340731.774023:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1227 00000100:00100000:3.0:1780340731.774033:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:68784:x1866818940420608:12345-192.168.203.16@tcp:36:rm.0 00010000:00010000:3.0:1780340731.774086:0:63710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1780340731.774112:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b2200/0xa24651432774250 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced236e expref: 13 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.774131:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff8c047a3b5a00) 00010000:00010000:3.0:1780340731.774148:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432774234 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2367 expref: 12 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.774156:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c044412b700) 00010000:00010000:3.0:1780340731.774176:0:63710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340731.774212:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774257 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.774225:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774257 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.774234:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774257 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.774245:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa2465143277425e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.774253:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa2465143277425e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.774260:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa2465143277425e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.774332:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432774265 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.774340:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432774265 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.774347:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432774265 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.774537:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa2465143277426c lrc: 3/0,1 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.774547:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa2465143277426c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.774564:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa2465143277426c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.774571:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa2465143277426c lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.774578:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa2465143277426c lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.774583:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa2465143277426c lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.775224:0:63710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340731.775250:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432774265 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.775257:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432774265 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.775264:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432774265 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.775269:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340731.775273:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432774265 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.775280:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432774265 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.775290:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff8c044412b200) 00010000:00010000:3.0:1780340731.775292:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1780340731.775304:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432774265 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.775310:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432774265 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.775328:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774257 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.775334:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774257 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.775340:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774257 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.775345:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774257 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.775350:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340731.775352:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774257 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.775358:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774257 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.775365:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c044412b500) 00010000:00010000:3.0:1780340731.775380:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340731.775383:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774257 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.775389:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774257 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340731.775401:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003c52610d reply state 000000000c71269f transno 107374182409 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa2465143277425e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.775417:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa2465143277425e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340731.775424:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c044412bf00) 00010000:00010000:3.0:1780340731.775426:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340731.775429:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780340731.775520:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:68784:x1866818940420608:12345-192.168.203.16@tcp:36:rm.0 Request processed in 1484us (1704us total) trans 107374182409 rc 0/0 00000100:00100000:3.0:1780340731.775529:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1227 00010000:00010000:1.0:1780340731.776362:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340731.776371:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa2465143277426c lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.776381:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340731.776394:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa2465143277426c lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.776402:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa2465143277426c lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.776414:0:23160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff8c044412b200) 00010000:00010000:1.0:1780340731.776417:0:23160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1780340731.776420:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa2465143277426c lrc: 1/0,0 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.776426:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa2465143277426c lrc: 0/0,0 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340731.776441:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340731.776443:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340731.776445:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340731.786009:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961108992:0@lo:400:kworker.0 00000100:00100000:2.0:1780340731.786080:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340731.786123:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961109504:0@lo:400:kworker.0 00000100:00100000:2.0:1780340731.786150:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340731.786172:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961110016:0@lo:400:kworker.0 00000100:00100000:2.0:1780340731.786192:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340731.786214:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1780340731.786220:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961109120:0@lo:400:kworker.0 00000100:00100000:2.0:1780340731.786242:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340731.786242:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818961108864:0@lo:400:kworker.0 00000100:00100000:2.0:1780340731.786258:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961109632:0@lo:400:kworker.0 00000100:00100000:1.0:1780340731.786269:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340731.786274:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340731.786287:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961110144:0@lo:400:kworker.0 00000100:00100000:1.0:1780340731.786287:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961109376:0@lo:400:kworker.0 00000100:00100000:2.0:1780340731.786304:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340731.786306:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340731.786320:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961109888:0@lo:400:kworker.0 00000100:00100000:2.0:1780340731.786336:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961109504 00000100:00100000:1.0:1780340731.786342:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340731.786356:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961109504 00000100:00100000:1.0:1780340731.786360:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [0->1] 00000100:00100000:1.0:1780340731.786364:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961108608:0@lo:400:kworker.0 00000100:00100000:1.0:1780340731.786387:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340731.786400:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961110016 00000100:00100000:2.0:1780340731.786403:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961110016 00000100:00100000:1.0:1780340731.786414:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961108736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340731.786432:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961109632 00000100:00100000:2.0:1780340731.786434:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961109632 00000100:00100000:1.0:1780340731.786436:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340731.786445:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961108608 00000100:00100000:0.0:1780340731.786451:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961108608 00000100:00100000:2.0:1780340731.786453:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961110144 00000100:00100000:1.0:1780340731.786454:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961109248:0@lo:400:kworker.0 00000100:00100000:2.0:1780340731.786457:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961110144 00000100:00100000:1.0:1780340731.786486:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340731.786492:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1780340731.786507:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961109760:0@lo:400:kworker.0 00000100:00100000:0.0:1780340731.786510:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961108608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340731.786533:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340731.786554:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1866818961110272:0@lo:400:kworker.0 00000100:00100000:2.0:1780340731.786558:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482 00000100:00100000:0.0:1780340731.786564:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961108608:12345-0@lo:400:kworker.0 Request processed in 56us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340731.786570:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961109504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340731.786576:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1780340731.786580:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340731.786605:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961108608:0@lo:400:kworker.0 00000100:00100000:2.0:1780340731.786607:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a210700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961109504:12345-0@lo:400:kworker.0 Request processed in 42us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340731.786613:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482 00000100:00100000:2.0:1780340731.786642:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483 00000100:00100000:2.0:1780340731.786648:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961110016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340731.786695:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961109376 00000100:00100000:1.0:1780340731.786699:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961109376 00000100:00100000:1.0:1780340731.786727:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961109888 00000100:00100000:1.0:1780340731.786730:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961109888 00000100:00100000:1.0:1780340731.786743:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961108736 00000100:00100000:1.0:1780340731.786745:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961108736 00000100:00100000:1.0:1780340731.786755:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3813 00000100:00100000:1.0:1780340731.786789:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818961109376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340731.786816:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3814 00000100:00100000:0.0:1780340731.786826:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961109888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340731.786833:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961110016:12345-0@lo:400:kworker.0 Request processed in 184us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340731.786833:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818961109376:12345-0@lo:400:kworker.0 Request processed in 47us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340731.786841:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483 00000100:00100000:1.0:1780340731.786841:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3813 00000100:00100000:2.0:1780340731.786857:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2484 00000100:00100000:1.0:1780340731.786857:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815 00000100:00100000:0.0:1780340731.786867:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961109888:12345-0@lo:400:kworker.0 Request processed in 42us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340731.786868:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961109632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340731.786868:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961108736:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340731.786881:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3814 00000004:00000024:1.0:1780340731.786890:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:0.0:1780340731.786910:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961108992 00000100:00100000:2.0:1780340731.786912:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961109632:12345-0@lo:400:kworker.0 Request processed in 48us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340731.786914:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961108992 00000100:00100000:1.0:1780340731.786916:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961108736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340731.786923:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815 00000100:00100000:0.0:1780340731.786939:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961109120 00000100:00100000:0.0:1780340731.786942:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961109120 00000100:00100000:0.0:1780340731.786956:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961108864 00000100:00100000:0.0:1780340731.786959:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961108864 00000100:00100000:1.0:1780340731.786972:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961108736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340731.786974:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961109248 00000100:00100000:0.0:1780340731.786977:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961109248 00000100:00100000:1.0:1780340731.786993:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961109376:0@lo:400:kworker.0 00000100:00100000:0.0:1780340731.786994:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961109760 00000100:00100000:0.0:1780340731.786997:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961109760 00000100:00100000:0.0:1780340731.787011:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961110272 00000100:00100000:0.0:1780340731.787014:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961110272 00000100:00100000:1.0:1780340731.787019:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961109888:0@lo:400:kworker.0 00000100:00100000:0.0:1780340731.787030:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1780340731.787037:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961108992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340731.787053:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:2.0:1780340731.787063:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2484 00000100:00100000:1.0:1780340731.787063:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961109120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340731.787072:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961108992:12345-0@lo:400:kworker.0 Request processed in 36us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340731.787079:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2485 00000100:00100000:0.0:1780340731.787081:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:2.0:1780340731.787091:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961110144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340731.787105:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a213480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961109120:12345-0@lo:400:kworker.0 Request processed in 42us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340731.787105:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:1.0:1780340731.787115:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:2.0:1780340731.787119:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a213800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961110144:12345-0@lo:400:kworker.0 Request processed in 32us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340731.787119:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1866818961108864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340731.787128:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2485 00000100:00100000:1.0:1780340731.787135:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:1.0:1780340731.787141:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961109248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340731.787160:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:2.0:1780340731.787167:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961109760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340731.787184:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961109248:12345-0@lo:400:kworker.0 Request processed in 44us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340731.787189:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:2.0:1780340731.787192:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961109760:12345-0@lo:400:kworker.0 Request processed in 28us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340731.787197:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1866818961108864:12345-0@lo:400:kworker.0 Request processed in 82us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340731.787202:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:1.0:1780340731.787829:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1780340731.787840:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1866818961110272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340731.787886:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1866818961110272:12345-0@lo:400:kworker.0 Request processed in 50us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340731.787894:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:0.0:1780340731.788118:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:0.0:1780340731.788155:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961109248:0@lo:400:kworker.0 00000100:00100000:0.0:1780340731.788168:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961109760:0@lo:400:kworker.0 00000100:00100000:0.0:1780340731.788179:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1866818961110272:0@lo:400:kworker.0 00000100:00080000:1.0:1780340731.788183:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780340731.788188:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780340731.788191:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340731.788193:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818961108864:0@lo:400:kworker.0 00000100:00080000:1.0:1780340731.788195:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1780340731.788198:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340731.788232:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961109120:0@lo:400:kworker.0 00000100:00100000:2.0:1780340731.788248:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961109632:0@lo:400:kworker.0 00000100:00100000:2.0:1780340731.788259:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961110144:0@lo:400:kworker.0 00000100:00100000:2.0:1780340731.788270:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961108992:0@lo:400:kworker.0 00000100:00100000:2.0:1780340731.788281:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961109504:0@lo:400:kworker.0 00000100:00100000:2.0:1780340731.788290:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961110016:0@lo:400:kworker.0 00000100:00100000:0.0:1780340732.300083:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961110400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340732.300162:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340732.300226:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961110656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340732.300253:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340732.300271:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340732.300277:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961110528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340732.300296:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340732.300321:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961110656 00000100:00100000:0.0:1780340732.300327:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961110656 00000100:00100000:0.0:1780340732.300370:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816 00000100:00100000:0.0:1780340732.300379:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818961110656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780340732.300416:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445232640 avail 1298993152 00000100:00100000:0.0:1780340732.300460:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818961110656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340732.300467:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816 00000100:00100000:0.0:1780340732.300490:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961110400 00000100:00100000:0.0:1780340732.300493:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961110400 00000100:00100000:0.0:1780340732.300544:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961110528 00000100:00100000:0.0:1780340732.300548:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961110528 00000100:00100000:0.0:1780340732.300566:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022 00000100:00100000:0.0:1780340732.300573:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961110400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780340732.300592:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340732.300640:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961110400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340732.300646:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022 00000100:00100000:0.0:1780340732.300658:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2023 00000100:00100000:0.0:1780340732.300664:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961110528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340732.300678:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340732.300703:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961110528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340732.300709:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2023 00000100:00100000:0.0:1780340732.302405:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961110528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340732.302450:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961110656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340732.303368:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961110400:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1780340732.814953:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340732.972974:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340732.973002:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340732.973048:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340732.973051:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940421120 00000100:00100000:2.0:1780340732.973060:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940421120 00000100:00100000:0.0:1780340732.973067:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340732.973086:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340732.973111:0:85468:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940420736 00000100:00100000:0.0:1780340732.973114:0:85468:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940420736 00000100:00100000:0.0:1780340732.973146:0:85468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 85 00000100:00100000:0.0:1780340732.973155:0:85468:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940420736:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340732.973241:0:85468:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940420736:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 87us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340732.973249:0:85468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 85 00000100:00100000:0.0:1780340732.973280:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940420864 00000100:00100000:0.0:1780340732.973284:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940420864 00000100:00100000:0.0:1780340732.973315:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940420992 00000100:00100000:0.0:1780340732.973318:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940420992 00000100:00100000:0.0:1780340732.973335:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1250 00000100:00100000:0.0:1780340732.973342:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:2408:x1866818940420864:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340732.973374:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:2408:x1866818940420864:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 33us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340732.973380:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1250 00000100:00100000:0.0:1780340732.973392:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1251 00000100:00100000:0.0:1780340732.973398:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940420992:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340732.973418:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940420992:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 21us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340732.973423:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1251 00000100:00080000:1.0:1780340732.973683:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780340732.980773:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940421248 00000100:00100000:2.0:1780340732.980791:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940421248 00000100:00100000:2.0:1780340732.980846:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2486 00000100:00100000:2.0:1780340732.980857:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940421120:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340732.980953:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940421120:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 97us (7949us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340732.980961:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2486 00000100:00100000:2.0:1780340732.980978:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2487 00000100:00100000:2.0:1780340732.980985:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940421248:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340732.981027:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940421248:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 43us (7940us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340732.981034:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2487 00010000:00010000:3.0:1780340733.835969:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340734.860088:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340735.370445:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961110784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340735.370512:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340735.372929:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961110784 00000100:00100000:3.0:1780340735.372943:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961110784 00000100:00100000:3.0:1780340735.373014:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024 00000100:00100000:3.0:1780340735.373023:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961110784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340735.373052:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340735.373116:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961110784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (2605us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340735.373123:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024 00000100:00100000:0.0:1780340735.373206:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961110784:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1780340735.375301:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340735.377097:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340735.377119:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961110912:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340735.377184:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340735.379487:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961110912 00000100:00100000:0.0:1780340735.379499:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961110912 00000100:00100000:0.0:1780340735.379572:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2025 00000100:00100000:0.0:1780340735.379582:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961110912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340735.379631:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340735.379700:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961110912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (2516us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340735.379707:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2025 00000100:00100000:0.0:1780340735.379754:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961110912:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1780340735.385329:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1780340735.888619:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340736.907362:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780340736.907384:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961111040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340736.907451:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340736.907495:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961111040 00000100:00100000:2.0:1780340736.907502:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961111040 00000100:00100000:2.0:1780340736.907548:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3817 00000100:00100000:2.0:1780340736.907556:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961111040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340736.907598:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:2.0:1780340736.907642:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a212d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961111040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340736.907650:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3817 00000100:00100000:2.0:1780340736.907692:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a210380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961111040:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1780340736.908900:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340736.914372:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961111296:0@lo:400:kworker.0 00000100:00100000:1.0:1780340736.914436:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340736.914467:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961111808:0@lo:400:kworker.0 00000100:00100000:1.0:1780340736.914502:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340736.914523:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961112320:0@lo:400:kworker.0 00000100:00100000:1.0:1780340736.914544:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340736.914568:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1780340736.914575:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961111424:0@lo:400:kworker.0 00000100:00100000:1.0:1780340736.914608:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340736.914625:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961111936:0@lo:400:kworker.0 00000100:00100000:1.0:1780340736.914642:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340736.914655:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a204a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961112448:0@lo:400:kworker.0 00000100:00100000:1.0:1780340736.914671:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340736.914703:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961111808 00000100:00100000:1.0:1780340736.914710:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961111808 00000100:00100000:1.0:1780340736.914749:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818 00000100:00100000:2.0:1780340736.915198:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961111168:0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.915233:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340736.915261:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961111680:0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.915282:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340736.915299:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961112192:0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.915319:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340736.915336:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1780340736.915341:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961111552:0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.915366:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340736.915381:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961112064:0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.915397:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340736.915411:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961112576:0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.915428:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340736.915448:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961111296 00000100:00100000:2.0:1780340736.915451:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961111296 00000100:00100000:2.0:1780340736.915483:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961111424 00000100:00100000:2.0:1780340736.915486:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961111424 00000100:00100000:2.0:1780340736.915497:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961111680 00000100:00100000:2.0:1780340736.915499:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961111680 00000100:00100000:2.0:1780340736.915509:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961112192 00000100:00100000:2.0:1780340736.915511:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961112192 00000100:00100000:2.0:1780340736.915520:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961111552 00000100:00100000:2.0:1780340736.915522:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961111552 00000100:00100000:2.0:1780340736.915532:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961112576 00000100:00100000:2.0:1780340736.915534:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961112576 00000100:00100000:2.0:1780340736.915545:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1780340736.915551:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961111296:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340736.915572:0:64454:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0346f52a00 x1866818961111296/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:162/0 lens 224/224 e 0 to 0 dl 1780340747 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340736.915626:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961111296:12345-0@lo:400:kworker.0 Request processed in 74us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340736.915633:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1780340736.915650:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:2.0:1780340736.915656:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961111424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.915682:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961111424:12345-0@lo:400:kworker.0 Request processed in 27us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340736.915696:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:2.0:1780340736.915709:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:2.0:1780340736.915715:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961111680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.915746:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a210380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961111680:12345-0@lo:400:kworker.0 Request processed in 32us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340736.915751:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:1.0:1780340736.916052:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961111808:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780340736.916071:0:26074:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0346f50700 x1866818961111808/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:162/0 lens 224/224 e 0 to 0 dl 1780340747 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340736.916103:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961111808:12345-0@lo:400:kworker.0 Request processed in 1347us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340736.916109:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818 00000100:00100000:1.0:1780340736.916132:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:1.0:1780340736.916138:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818961112192:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780340736.916148:0:63711:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046b880a80 x1866818961112192/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:162/0 lens 224/224 e 0 to 0 dl 1780340747 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340736.916170:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818961112192:12345-0@lo:400:kworker.0 Request processed in 34us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340736.916185:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:1.0:1780340736.916198:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:1.0:1780340736.916204:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961111552:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780340736.916215:0:63711:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046b882300 x1866818961111552/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:162/0 lens 224/224 e 0 to 0 dl 1780340747 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340736.916238:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961111552:12345-0@lo:400:kworker.0 Request processed in 35us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340736.916244:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:1.0:1780340736.916254:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:1.0:1780340736.916259:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961112576:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780340736.916268:0:63711:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0346ff1500 x1866818961112576/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:162/0 lens 224/224 e 0 to 0 dl 1780340747 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340736.916289:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961112576:12345-0@lo:400:kworker.0 Request processed in 30us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340736.916294:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:1.0:1780340736.916311:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961112320 00000100:00100000:1.0:1780340736.916315:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961112320 00000100:00100000:1.0:1780340736.916695:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961111936 00000100:00100000:1.0:1780340736.916700:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961111936 00000100:00100000:1.0:1780340736.916724:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961112448 00000100:00100000:1.0:1780340736.916727:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961112448 00000100:00100000:1.0:1780340736.916747:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961112064 00000100:00100000:1.0:1780340736.916750:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961112064 00000100:00100000:1.0:1780340736.916805:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2488 00000100:00100000:1.0:1780340736.916812:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961112320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340736.916849:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961112320:12345-0@lo:400:kworker.0 Request processed in 38us (2303us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340736.916862:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2488 00000100:00100000:1.0:1780340736.916894:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2489 00000100:00100000:1.0:1780340736.918191:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961111936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340736.918256:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961111936:12345-0@lo:400:kworker.0 Request processed in 1354us (3610us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340736.918265:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2489 00000100:00100000:1.0:1780340736.918290:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490 00000100:00100000:1.0:1780340736.918298:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03474c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961112448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340736.918323:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03474c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961112448:12345-0@lo:400:kworker.0 Request processed in 27us (3651us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340736.918329:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490 00000100:00100000:1.0:1780340736.918340:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491 00000100:00100000:1.0:1780340736.918346:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961112064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340736.918374:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961112064:12345-0@lo:400:kworker.0 Request processed in 29us (2976us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340736.918380:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491 00000100:00100000:2.0:1780340736.922706:0:85467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961111168 00000100:00100000:2.0:1780340736.922718:0:85467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961111168 00000100:00100000:2.0:1780340736.922802:0:85467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1780340736.922812:0:85467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0475e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961111168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.923255:0:85467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0475e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961111168:12345-0@lo:400:kworker.0 Request processed in 92us (7668us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340736.923264:0:85467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1780340736.923310:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340736.923315:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340736.923318:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340736.923321:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780340736.923355:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961111552:0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.923368:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961112064:0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.923379:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961112576:0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.923387:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961111168:0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.923397:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961111680:0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.923407:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961112192:0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.923485:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961111424:0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.923498:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349862a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961111936:0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.923508:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a204a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961112448:0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.923518:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961111296:0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.923528:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961111808:0@lo:400:kworker.0 00000100:00100000:2.0:1780340736.923538:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961112320:0@lo:400:kworker.0 00000100:00100000:2.0:1780340737.419889:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961112704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340737.419954:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340737.423819:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961112704 00000100:00100000:3.0:1780340737.423831:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961112704 00000100:00100000:3.0:1780340737.423890:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2026 00000100:00100000:3.0:1780340737.423900:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961112704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780340737.423930:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340737.424014:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961112704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (4060us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340737.424021:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2026 00000100:00100000:3.0:1780340737.424077:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961112704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340737.424550:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961112960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340737.424599:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340737.424624:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780340737.424631:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961112832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340737.424654:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340737.424681:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961112832 00000100:00100000:1.0:1780340737.424685:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961112832 00000100:00100000:1.0:1780340737.424712:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027 00000100:00100000:1.0:1780340737.424718:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961112832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780340737.424741:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340737.424790:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961112832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340737.424797:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027 00000100:00100000:1.0:1780340737.424839:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961112832:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340737.426617:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961112960 00000100:00100000:3.0:1780340737.426629:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961112960 00000100:00100000:3.0:1780340737.426686:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819 00000100:00100000:3.0:1780340737.426696:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818961112960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340737.426731:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445232640 avail 1298993152 00010000:00000080:3.0:1780340737.426747:0:22660:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c034d876680 x1866818961112960/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:163/0 lens 224/368 e 0 to 0 dl 1780340748 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340737.426837:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1866818961112960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (2238us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340737.426843:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819 00000100:00100000:1.0:1780340737.430289:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961112960:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1780340737.930590:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340738.090445:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340738.090489:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340738.090516:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340738.090542:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940421632 00000100:00100000:1.0:1780340738.090548:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340738.090554:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940421632 00000100:00100000:1.0:1780340738.090588:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340738.090617:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940421888 00000100:00100000:1.0:1780340738.090621:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940421888 00000100:00100000:2.0:1780340738.090630:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940421504 00000100:00100000:2.0:1780340738.090635:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940421504 00000100:00100000:1.0:1780340738.090657:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940421760 00000100:00100000:1.0:1780340738.090661:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940421760 00000100:00100000:2.0:1780340738.090672:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1258 00000100:00100000:2.0:1780340738.090683:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940421632:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340738.090694:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2492 00000100:00100000:1.0:1780340738.090704:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940421888:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340738.090754:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940421632:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 73us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340738.090756:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940421888:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 53us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340738.090787:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2492 00000100:00100000:2.0:1780340738.090795:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1258 00000100:00100000:1.0:1780340738.090811:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2493 00000100:00100000:2.0:1780340738.090817:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1259 00000100:00100000:1.0:1780340738.090822:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940421760:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340738.090831:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:2408:x1866818940421504:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000080:2.0:1780340738.090850:0:63711:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0479d8ca80 x1866818940421504/t0(0) o400->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:164/0 lens 224/224 e 0 to 0 dl 1780340749 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340738.090854:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2408:x1866818940421760:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 34us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340738.090869:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2493 00000100:00100000:2.0:1780340738.090906:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:2408:x1866818940421504:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 79us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340738.090915:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1259 00000100:00080000:2.0:1780340738.090947:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340738.090951:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780340738.090953:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340738.090954:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340738.091026:0:85466:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940421376 00000100:00100000:0.0:1780340738.091031:0:85466:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940421376 00000100:00100000:0.0:1780340738.091102:0:85466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 87 00000100:00100000:0.0:1780340738.091111:0:85466:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0475e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940421376:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340738.091139:0:85466:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0475e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940421376:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 29us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340738.091145:0:85466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 87 00000001:00080000:3.0:1780340738.683775:0:85462:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182409 is committed 00010000:00010000:1.0:1780340738.683847:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432774226 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340738.683859:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432774226 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340738.683867:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432774226 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340738.683873:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340738.683877:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432774226 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340738.683884:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432774226 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340738.683900:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c044412bf00) 00010000:00010000:1.0:1780340738.683904:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340738.683908:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432774226 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340738.683914:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432774226 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340738.683932:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa2465143277425e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340738.683937:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa2465143277425e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340738.683942:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa2465143277425e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340738.683961:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340738.683964:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa2465143277425e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340738.683970:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa2465143277425e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340738.683978:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c044412bf00) 00010000:00010000:1.0:1780340738.683981:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340738.683983:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa2465143277425e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340738.683989:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa2465143277425e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340738.956179:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1780340739.664701:0:86619:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1780340739.733979:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340739.734368:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940422016 00000100:00100000:0.0:1780340739.734378:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940422016 00000100:00100000:0.0:1780340739.734450:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1228 00000100:00100000:0.0:1780340739.734461:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:68851:x1866818940422016:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:0.0:1780340739.734480:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340739.734503:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6c00/0xa24651432774273 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2375 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340739.734577:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7400/0xa2465143277427a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340739.734591:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7400/0xa2465143277427a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340739.734616:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7400/0xa2465143277427a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340739.734655:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780340739.734659:0:63710:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780340739.734678:0:63710:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7400/0xa2465143277427a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340739.734704:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6c00/0xa24651432774273 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2375 expref: 11 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340739.734722:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7400/0xa2465143277427a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2375 expref: 10 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340739.734730:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8d00) 00010000:00010000:0.0:1780340739.734744:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780340739.734748:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04497b7400, rc 0) 00010000:00000080:0.0:1780340739.734757:0:63710:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0346ff1c00 x1866818940422016/t0(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:165/0 lens 576/688 e 0 to 0 dl 1780340750 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340739.734843:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:68851:x1866818940422016:12345-192.168.203.16@tcp:101:dd.0 Request processed in 384us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340739.734850:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1228 00000100:00100000:1.0:1780340739.764317:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340739.764385:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940422272 00000100:00100000:3.0:1780340739.764395:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940422272 00000100:00100000:3.0:1780340739.764519:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1229 00000100:00100000:3.0:1780340739.764529:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:68851:x1866818940422272:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340739.764549:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340739.764552:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1780340739.764585:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7400/0xa2465143277427a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2375 expref: 10 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.764602:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8d00) 00010000:00010000:3.0:1780340739.764622:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340739.764637:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432774281 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced237c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.764751:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774288 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.764797:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774288 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.764808:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774288 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.764821:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa2465143277428f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.764828:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa2465143277428f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.764835:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa2465143277428f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.764892:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774296 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.764899:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774296 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.764906:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774296 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340739.764914:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00010000:00010000:3.0:1780340739.764997:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774288 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.765012:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774288 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.765018:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774288 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.765025:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774288 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.765030:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340739.765034:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774288 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.765041:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774288 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.765051:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c044412b700) 00010000:00010000:3.0:1780340739.765054:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340739.765058:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774288 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.765064:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774288 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.765074:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa2465143277428f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.765080:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa2465143277428f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.765086:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa2465143277428f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.765096:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340739.765099:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa2465143277428f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.765104:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa2465143277428f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.765112:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8c044412b100) 00010000:00010000:3.0:1780340739.765115:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340739.765117:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa2465143277428f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.765123:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa2465143277428f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340739.765385:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432774281 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced237c expref: 12 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340739.765404:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774296 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced237c expref: 11 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340739.765411:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c044412b900) 00010000:00010000:2.0:1780340739.765413:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340739.765416:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8e00, rc 0) 00010000:00000080:2.0:1780340739.765424:0:63711:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0479d8c380 x1866818940422272/t107374182410(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:165/0 lens 776/848 e 0 to 0 dl 1780340750 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340739.766650:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:68851:x1866818940422272:12345-192.168.203.16@tcp:101:dd.0 Request processed in 2117us (2335us total) trans 107374182410 rc 0/0 00000100:00100000:2.0:1780340739.766659:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1229 00000100:00100000:3.0:1780340739.769579:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340739.769644:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940422400 00000100:00100000:2.0:1780340739.769654:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940422400 00000100:00100000:2.0:1780340739.769707:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1230 00000100:00100000:2.0:1780340739.769717:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:68851:x1866818940422400:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340739.769748:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340739.769800:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa246514327742a4 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2383 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340739.769836:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b000/0xa246514327742ab lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340739.769850:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b000/0xa246514327742ab lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340739.769861:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b000/0xa246514327742ab lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340739.769965:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a400/0xa246514327742a4 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2383 expref: 13 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340739.769979:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b000/0xa246514327742ab lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2383 expref: 12 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340739.769988:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c044412b900) 00010000:00010000:2.0:1780340739.769992:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780340739.769996:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32b000, rc 0) 00010000:00000080:2.0:1780340739.770003:0:70100:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c034759ce00 x1866818940422400/t0(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:165/0 lens 568/1344 e 0 to 0 dl 1780340750 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340739.770061:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:68851:x1866818940422400:12345-192.168.203.16@tcp:101:dd.0 Request processed in 346us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340739.770069:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1230 00000100:00100000:0.0:1780340739.780942:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340739.781200:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940422656 00000100:00100000:3.0:1780340739.781210:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940422656 00000100:00100000:3.0:1780340739.781262:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1231 00000100:00100000:3.0:1780340739.781271:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:68851:x1866818940422656:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:3.0:1780340739.781318:0:64454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340739.781341:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774296 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced237c expref: 12 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.781359:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c044412b900) 00010000:00010000:3.0:1780340739.781364:0:64454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340739.781661:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327742b2 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.781692:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327742b2 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.781702:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327742b2 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1780340739.781748:0:64454:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 107374182411 00000004:00010000:3.0:1780340739.781791:0:64454:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001346f8ab reply state 000000004ffe9a36 transno 107374182412 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327742b2 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.781802:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327742b2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340739.781807:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c044412b900) 00010000:00010000:3.0:1780340739.781810:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340739.781812:0:64454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1780340739.781846:0:64454:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04440a4380 x1866818940422656/t107374182412(0) o36->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:165/0 lens 488/456 e 0 to 0 dl 1780340750 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340739.781906:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+14:68851:x1866818940422656:12345-192.168.203.16@tcp:36:dd.0 Request processed in 636us (973us total) trans 107374182412 rc 0/0 00000100:00100000:3.0:1780340739.781913:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1231 00000020:00080000:3.0:1780340739.781918:0:64454:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1780340739.787077:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340739.788325:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940422784 00000100:00100000:1.0:1780340739.788339:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940422784 00000100:00100000:1.0:1780340739.788410:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1232 00000100:00100000:1.0:1780340739.788421:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+14:68851:x1866818940422784:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:1.0:1780340739.788449:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340739.788468:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3200/0xa246514327742b9 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced238a expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340739.788523:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3200/0xa246514327742b9 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced238a expref: 15 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340739.788538:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3200/0xa246514327742b9 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced238a expref: 15 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340739.788580:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c044412b900) 00010000:00010000:1.0:1780340739.788583:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1780340739.788588:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a8b3200, rc 0) 00010000:00000080:1.0:1780340739.788597:0:63711:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c034759c380 x1866818940422784/t0(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:165/0 lens 376/584 e 0 to 0 dl 1780340750 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340739.788674:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+15:68851:x1866818940422784:12345-192.168.203.16@tcp:101:dd.0 Request processed in 255us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340739.788682:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1232 00000100:00100000:3.0:1780340739.792742:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340739.792869:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940423040 00000100:00100000:0.0:1780340739.792884:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940423040 00000100:00100000:0.0:1780340739.792953:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1233 00000100:00100000:0.0:1780340739.792963:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+15:68851:x1866818940423040:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:0.0:1780340739.792991:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340739.792995:0:63710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1780340739.793021:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a8b3200/0xa246514327742b9 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced238a expref: 15 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340739.793040:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c044412b900) 00010000:00010000:0.0:1780340739.793044:0:63710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780340739.793057:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6c00/0xa246514327742c0 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2391 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340739.793100:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7e00/0xa246514327742c7 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340739.793113:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7e00/0xa246514327742c7 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340739.793121:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7e00/0xa246514327742c7 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780340739.793244:0:63710:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x283:0x0], count =127 00000004:00080000:0.0:1780340739.793252:0:63710:0:(osp_object.c:1640:osp_create()) Writing gap [0x280000401:0x283:0x0]+127 in llog 00000004:00080000:0.0:1780340739.793278:0:63710:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x302:0x0], index 0: 0 00000004:00080000:0.0:1780340739.793284:0:63710:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x303:0x0], index 1: 0 00010000:00010000:0.0:1780340739.793365:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7e00/0xa246514327742c7 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2391 expref: 17 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340739.793373:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c044412b900) 00010000:00010000:0.0:1780340739.793375:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1780340739.793383:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6c00/0xa246514327742c0 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2391 expref: 17 pid: 63710 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340739.793404:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7e00/0xa246514327742c7 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2391 expref: 16 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340739.793432:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c044412b900) 00010000:00010000:0.0:1780340739.793435:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1780340739.793437:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04497b7e00, rc 0) 00010000:00000080:0.0:1780340739.793444:0:63710:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c034759df80 x1866818940423040/t107374182413(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:165/0 lens 376/608 e 0 to 0 dl 1780340750 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340739.793511:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+16:68851:x1866818940423040:12345-192.168.203.16@tcp:101:dd.0 Request processed in 549us (785us total) trans 107374182413 rc 0/0 00000100:00100000:0.0:1780340739.793518:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1233 00000100:00100000:3.0:1780340739.798665:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340739.798736:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940423168 00000100:00100000:2.0:1780340739.798754:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940423168 00000100:00100000:2.0:1780340739.798845:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5890 00000100:00100000:2.0:1780340739.798855:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:68851:x1866818940423168:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340739.798871:0:25495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340739.798891:0:25495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa246514327742ce lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2398 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340739.798916:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x302:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340739.798935:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340739.798937:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340739.798945:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa246514327742ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2398 expref: 6 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340739.798962:0:25495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa246514327742ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2398 expref: 6 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340739.798974:0:25495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32a400, rc 0) 00000100:00100000:2.0:1780340739.799022:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:68851:x1866818940423168:12345-192.168.203.16@tcp:101:dd.0 Request processed in 169us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340739.799029:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5890 00000100:00100000:1.0:1780340739.808925:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340739.808987:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940423296 00000100:00100000:2.0:1780340739.808997:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940423296 00000100:00100000:2.0:1780340739.809056:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5891 00000100:00100000:2.0:1780340739.809066:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:68851:x1866818940423296:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340739.809083:0:25491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340739.809102:0:25491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000879fd871/0xa246514327742d5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced239f expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340739.809144:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x302:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340739.809176:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340739.809179:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340739.809195:0:25491:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000879fd871/0xa246514327742d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced239f expref: 6 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340739.809213:0:25491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000879fd871/0xa246514327742d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced239f expref: 6 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340739.809226:0:25491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32be00, rc 0) 00000100:00100000:2.0:1780340739.809282:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:68851:x1866818940423296:12345-192.168.203.16@tcp:101:dd.0 Request processed in 217us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340739.809289:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5891 00000100:00100000:3.0:1780340739.812398:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340739.812527:0:25497:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940423424 00000100:00100000:0.0:1780340739.812537:0:25497:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940423424 00000100:00100000:0.0:1780340739.812594:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5892 00000100:00100000:0.0:1780340739.812604:0:25497:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:68851:x1866818940423424:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:0.0:1780340739.812620:0:25497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340739.812640:0:25497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aaa2f86f/0xa246514327742dc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced23a6 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340739.812664:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x303:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340739.812684:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340739.812686:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340739.812693:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aaa2f86f/0xa246514327742dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23a6 expref: 7 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340739.812722:0:25497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aaa2f86f/0xa246514327742dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23a6 expref: 7 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340739.812734:0:25497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04497b6c00, rc 0) 00000100:00100000:0.0:1780340739.812804:0:25497:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:68851:x1866818940423424:12345-192.168.203.16@tcp:101:dd.0 Request processed in 201us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340739.812811:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5892 00000100:00100000:3.0:1780340739.817021:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340739.818874:0:24752:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940423552 00000100:00100000:0.0:1780340739.818888:0:24752:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940423552 00002000:00010000:0.0:1780340739.818928:0:24752:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/770 (1048576->18446744073709551615) 00002000:00100000:0.0:1780340739.818933:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c034759ea00 with x1866818940423552 ext(1048576->18446744073709551615) 00002000:00010000:0.0:1780340739.818945:0:24752:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c034759ea00. 00000100:00100000:0.0:1780340739.818987:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1000 00000100:00100000:0.0:1780340739.818996:0:24752:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940423552:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:0.0:1780340739.819310:0:24752:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:0.0:1780340739.819314:0:24752:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb mtime from disk: 0 -> 1780340740 00002000:00010000:0.0:1780340739.819316:0:24752:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1780340739.819318:0:24752:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb ctime from disk: 0 -> 1780340740 00002000:00010000:0.0:1780340739.819320:0:24752:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1780340739.819386:0:24752:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2407:x1866818940423552:12345-192.168.203.16@tcp:10:dd.0 Request processed in 391us (2374us total) trans 4294969452 rc 0/0 00000100:00100000:0.0:1780340739.819394:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1000 00002000:00010000:0.0:1780340739.819398:0:24752:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/770 (1048576->18446744073709551615) 00002000:00100000:0.0:1780340739.819401:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c034759ea00 with x1866818940423552 ext(1048576->18446744073709551615) 00002000:00010000:0.0:1780340739.819412:0:24752:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c034759ea00. 00000100:00100000:3.0:1780340739.825175:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340739.825306:0:8407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940423680 00000100:00100000:0.0:1780340739.825317:0:8407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940423680 00002000:00010000:0.0:1780340739.825355:0:8407:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/771 (0->18446744073709551615) 00002000:00100000:0.0:1780340739.825361:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0349338380 with x1866818940423680 ext(0->18446744073709551615) 00002000:00010000:0.0:1780340739.825372:0:8407:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c0349338380. 00000100:00100000:0.0:1780340739.825405:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1001 00000100:00100000:0.0:1780340739.825414:0:8407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2408:x1866818940423680:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:0.0:1780340739.825607:0:8407:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x2c0000401:0x303:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1780340739.825611:0:8407:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x2c0000401:0x303:0x0] updating lvb mtime from disk: 0 -> 1780340740 00002000:00010000:0.0:1780340739.825613:0:8407:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x2c0000401:0x303:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1780340739.825615:0:8407:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x303:0x0] updating lvb ctime from disk: 0 -> 1780340740 00002000:00010000:0.0:1780340739.825617:0:8407:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x2c0000401:0x303:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1780340739.825679:0:8407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349338380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2408:x1866818940423680:12345-192.168.203.16@tcp:10:dd.0 Request processed in 265us (512us total) trans 4294969452 rc 0/0 00000100:00100000:0.0:1780340739.825686:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1001 00002000:00010000:0.0:1780340739.825690:0:8407:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/771 (0->18446744073709551615) 00002000:00100000:0.0:1780340739.825692:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0349338380 with x1866818940423680 ext(0->18446744073709551615) 00002000:00010000:0.0:1780340739.825696:0:8407:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c0349338380. 00010000:00010000:3.0:1780340739.980263:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340739.990578:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340739.990670:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940423936 00000100:00100000:3.0:1780340739.990680:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940423936 00000100:00100000:3.0:1780340739.990735:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 229 00000100:00100000:3.0:1780340739.990745:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034af3b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+16:68851:x1866818940423936:12345-192.168.203.16@tcp:35:dd.0 00010000:00000080:3.0:1780340739.991014:0:77826:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c034af3b450 x1866818940423936/t107374182414(0) o35->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:165/0 lens 392/456 e 0 to 0 dl 1780340750 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340739.991080:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034af3b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+17:68851:x1866818940423936:12345-192.168.203.16@tcp:35:dd.0 Request processed in 336us (509us total) trans 107374182414 rc 0/0 00000100:00100000:3.0:1780340739.991087:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 229 00000100:00100000:1.0:1780340740.053903:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340740.054108:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940424064 00000100:00100000:0.0:1780340740.054119:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940424064 00000100:00100000:0.0:1780340740.054220:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1234 00000100:00100000:0.0:1780340740.054230:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+17:68852:x1866818940424064:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1780340740.054253:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340740.054276:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6200/0xa246514327742e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced23ad expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340740.054362:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7600/0xa246514327742ea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340740.054376:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7600/0xa246514327742ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340740.054387:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7600/0xa246514327742ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340740.054427:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780340740.054431:0:63712:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780340740.054450:0:63712:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7600/0xa246514327742ea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340740.054472:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6200/0xa246514327742e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23ad expref: 19 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340740.054490:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7600/0xa246514327742ea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23ad expref: 18 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340740.054498:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8700) 00010000:00010000:0.0:1780340740.054501:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780340740.054504:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04497b7600, rc 0) 00010000:00000080:0.0:1780340740.054512:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0479d8f100 x1866818940424064/t0(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:166/0 lens 576/688 e 0 to 0 dl 1780340751 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340740.054582:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+18:68852:x1866818940424064:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 354us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340740.054588:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1234 00000100:00080000:2.0:1780340740.054754:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340740.090904:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340740.091095:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940424320 00000100:00100000:2.0:1780340740.091105:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940424320 00000100:00100000:2.0:1780340740.091172:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1235 00000100:00100000:2.0:1780340740.091181:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+18:68852:x1866818940424320:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1780340740.091321:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340740.091342:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa246514327742f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced23b4 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091409:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa246514327742f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091425:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa246514327742f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091450:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa246514327742f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091468:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa246514327742ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091474:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa246514327742ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091480:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa246514327742ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091553:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa246514327742f8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091572:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa246514327742f8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091577:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa246514327742f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091583:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa246514327742f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091588:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340740.091592:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa246514327742f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091599:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa246514327742f8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091610:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8700) 00010000:00010000:2.0:1780340740.091618:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340740.091623:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa246514327742f8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091630:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa246514327742f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091644:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa246514327742ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091649:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa246514327742ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091654:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa246514327742ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091658:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340740.091661:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa246514327742ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091666:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa246514327742ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091673:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8c0345328f00) 00010000:00010000:2.0:1780340740.091676:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340740.091678:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa246514327742ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091684:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa246514327742ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091716:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa246514327742f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23b4 expref: 19 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091739:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8700) 00010000:00010000:2.0:1780340740.091741:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780340740.091745:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa246514327742f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23b4 expref: 19 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.091755:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32bc00, rc 0) 00010000:00000080:2.0:1780340740.092105:0:63711:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0479d8ea00 x1866818940424320/t0(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:166/0 lens 800/608 e 0 to 0 dl 1780340751 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340740.092361:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+18:68852:x1866818940424320:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1180us (1464us total) trans 0 rc 301/301 00000100:00100000:2.0:1780340740.092369:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1235 00000100:00100000:1.0:1780340740.104406:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340740.104573:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940424448 00000100:00100000:3.0:1780340740.104584:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940424448 00000100:00100000:3.0:1780340740.104640:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1236 00000100:00100000:3.0:1780340740.104650:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+18:68852:x1866818940424448:12345-192.168.203.16@tcp:34:lfs.0 00010000:00010000:3.0:1780340740.104719:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774306 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.104736:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774306 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.104848:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774306 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.104866:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277430d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.104884:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277430d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.104891:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277430d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.104980:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432774314 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.104990:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432774314 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.104996:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432774314 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340740.105033:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00000004:00200000:3.0:1780340740.105037:0:64454:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780340740.105048:0:64454:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432774314 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105061:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774306 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105067:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774306 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105073:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774306 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105079:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774306 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105085:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340740.105089:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774306 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105097:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774306 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105115:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8700) 00010000:00010000:3.0:1780340740.105118:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340740.105123:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774306 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105130:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774306 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105155:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277430d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105161:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277430d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105166:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277430d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105171:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340740.105173:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277430d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105179:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277430d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105411:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8c044412b100) 00010000:00010000:3.0:1780340740.105414:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340740.105418:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277430d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105424:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa2465143277430d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105449:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432774314 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105456:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432774314 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105462:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432774314 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105467:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340740.105470:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432774314 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105476:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432774314 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105483:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c044412b900) 00010000:00010000:3.0:1780340740.105485:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340740.105488:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432774314 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.105493:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432774314 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:3.0:1780340740.105516:0:64454:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0479d8c700 x1866818940424448/t0(0) o34->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:166/0 lens 472/728 e 0 to 0 dl 1780340751 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340740.105630:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+18:68852:x1866818940424448:12345-192.168.203.16@tcp:34:lfs.0 Request processed in 982us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340740.105639:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1236 00000100:00100000:1.0:1780340740.172215:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340740.172313:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940424704 00000100:00100000:3.0:1780340740.172342:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940424704 00000100:00100000:3.0:1780340740.172426:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1237 00000100:00100000:3.0:1780340740.172449:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+18:68854:x1866818940424704:12345-192.168.203.16@tcp:101:md5sum.0 00010000:00010000:3.0:1780340740.172478:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340740.172507:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa2465143277431b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced23bb expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.172617:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774322 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.172636:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774322 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.172649:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774322 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.172666:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774329 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.172673:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340740.172680:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.172943:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa24651432774330 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.172975:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa24651432774330 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.172988:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa24651432774330 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340740.173008:0:70100:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00010000:00010000:2.0:1780340740.173112:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774322 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.173120:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774322 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.173126:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774322 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.173144:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340740.173149:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774322 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.173156:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774322 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.173168:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8700) 00010000:00010000:2.0:1780340740.173171:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340740.173176:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774322 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.173182:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432774322 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.173207:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.173213:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774329 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.173219:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774329 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.173223:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340740.173226:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774329 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.173231:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774329 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.173249:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8c044412b100) 00010000:00010000:2.0:1780340740.173251:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340740.173254:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774329 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.173260:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774329 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.173330:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa2465143277431b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23bb expref: 21 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.173344:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa24651432774330 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23bb expref: 20 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.173351:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c044412b900) 00010000:00010000:2.0:1780340740.173354:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340740.173356:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32b800, rc 0) 00010000:00000080:2.0:1780340740.173364:0:70100:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c03476f0380 x1866818940424704/t107374182415(0) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:166/0 lens 800/872 e 0 to 0 dl 1780340751 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340740.173445:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+20:68854:x1866818940424704:12345-192.168.203.16@tcp:101:md5sum.0 Request processed in 1008us (1243us total) trans 107374182415 rc 0/0 00000100:00100000:2.0:1780340740.173454:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1237 00000100:00100000:2.0:1780340740.178985:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340740.179197:0:8406:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940424832 00000100:00100000:3.0:1780340740.179214:0:8406:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940424832 00002000:00100000:3.0:1780340740.179319:0:8406:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x302:0x0] (0->32767) req@ffff8c0346ff3100 x1866818940424832/t0(0) o3->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:166/0 lens 488/0 e 0 to 0 dl 1780340751 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340740.179332:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0346ff3100 with x1866818940424832 ext(0->32767) 00002000:00010000:3.0:1780340740.179340:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c0346ff3100 00000100:00100000:3.0:1780340740.179397:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1002 00000100:00100000:3.0:1780340740.179408:0:8406:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2407:x1866818940424832:12345-192.168.203.16@tcp:3:md5sum.0 00000100:00080000:2.0:1780340740.181041:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340740.191523:0:8406:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2407:x1866818940424832:12345-192.168.203.16@tcp:3:md5sum.0 Request processed in 12107us (12538us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340740.191536:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1002 00002000:00100000:0.0:1780340740.191549:0:8406:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x302:0x0] (0->32767) req@ffff8c0346ff3100 x1866818940424832/t0(0) o3->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:166/0 lens 488/440 e 0 to 0 dl 1780340751 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780340740.191571:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0346ff3100 with x1866818940424832 ext(0->32767) 00002000:00010000:0.0:1780340740.191577:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c0346ff3100 00000100:00100000:1.0:1780340740.199393:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340740.199496:0:24762:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940424960 00000100:00100000:0.0:1780340740.199506:0:24762:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940424960 00002000:00100000:0.0:1780340740.199651:0:24762:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x302:0x0] (32768->1048575) req@ffff8c03476f0700 x1866818940424960/t0(0) o3->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:166/0 lens 488/0 e 0 to 0 dl 1780340751 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780340740.199664:0:24762:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c03476f0700 with x1866818940424960 ext(32768->1048575) 00002000:00010000:0.0:1780340740.199669:0:24762:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c03476f0700 00000100:00100000:0.0:1780340740.199704:0:24762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1003 00000100:00100000:0.0:1780340740.199714:0:24762:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2408:x1866818940424960:12345-192.168.203.16@tcp:3:md5sum.0 00000100:00100000:0.0:1780340740.206579:0:24762:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2408:x1866818940424960:12345-192.168.203.16@tcp:3:md5sum.0 Request processed in 6859us (7186us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340740.206590:0:24762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1003 00002000:00100000:0.0:1780340740.206602:0:24762:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x2c0000401:0x302:0x0] (32768->1048575) req@ffff8c03476f0700 x1866818940424960/t0(0) o3->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:166/0 lens 488/440 e 0 to 0 dl 1780340751 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780340740.206613:0:24762:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c03476f0700 with x1866818940424960 ext(32768->1048575) 00002000:00010000:0.0:1780340740.206618:0:24762:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c03476f0700 00000100:00100000:1.0:1780340740.243746:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340740.243903:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940425216 00000100:00100000:0.0:1780340740.243916:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940425216 00000100:00100000:0.0:1780340740.243985:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 230 00000100:00100000:0.0:1780340740.244006:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+20:68854:x1866818940425216:12345-192.168.203.16@tcp:35:md5sum.0 00010000:00000080:0.0:1780340740.244249:0:63713:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c03476f3480 x1866818940425216/t107374182416(0) o35->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:166/0 lens 392/456 e 0 to 0 dl 1780340751 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340740.244317:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+21:68854:x1866818940425216:12345-192.168.203.16@tcp:35:md5sum.0 Request processed in 313us (586us total) trans 107374182416 rc 0/0 00000100:00100000:0.0:1780340740.244325:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 230 00000100:00100000:1.0:1780340740.278107:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340740.279222:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940425344 00000100:00100000:2.0:1780340740.279237:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940425344 00000100:00100000:2.0:1780340740.279372:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1238 00000100:00100000:2.0:1780340740.279397:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+21:68856:x1866818940425344:12345-192.168.203.16@tcp:34:lfs.0 00010000:00010000:2.0:1780340740.279478:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa2465143277433e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279496:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa2465143277433e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279509:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa2465143277433e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279524:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432774345 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279530:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432774345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279536:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432774345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279622:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa2465143277434c lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279632:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa2465143277434c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279640:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa2465143277434c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340740.279677:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00000004:00200000:2.0:1780340740.279682:0:63711:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780340740.279693:0:63711:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa2465143277434c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279718:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa2465143277433e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279725:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa2465143277433e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279731:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa2465143277433e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279738:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa2465143277433e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279744:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340740.279748:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa2465143277433e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279755:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa2465143277433e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279828:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428a8700) 00010000:00010000:2.0:1780340740.279832:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340740.279837:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa2465143277433e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279844:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b600/0xa2465143277433e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279857:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432774345 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279863:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432774345 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279889:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432774345 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279894:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32bc00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340740.279897:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432774345 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279903:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432774345 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279911:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8c0345328f00) 00010000:00010000:2.0:1780340740.279913:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340740.279916:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432774345 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279922:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32bc00/0xa24651432774345 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279936:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa2465143277434c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279943:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa2465143277434c lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279948:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa2465143277434c lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279953:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340740.279956:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa2465143277434c lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279971:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa2465143277434c lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279979:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c044412b900) 00010000:00010000:2.0:1780340740.279981:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340740.279984:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa2465143277434c lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340740.279989:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa2465143277434c lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:2.0:1780340740.280011:0:63711:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c03476f3b80 x1866818940425344/t0(0) o34->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:166/0 lens 472/728 e 0 to 0 dl 1780340751 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340740.280083:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+21:68856:x1866818940425344:12345-192.168.203.16@tcp:34:lfs.0 Request processed in 688us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340740.280092:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1238 00000100:00100000:1.0:1780340740.490089:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961113088:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340740.490162:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340740.490362:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961113088 00000100:00100000:0.0:1780340740.490370:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961113088 00000100:00100000:0.0:1780340740.490437:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:0.0:1780340740.490446:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961113088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340740.490472:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340740.490519:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961113088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340740.490526:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00100000:0.0:1780340740.490581:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961113088:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1780340740.490641:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340740.491082:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961113216:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340740.491118:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340740.491204:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961113216 00000100:00100000:1.0:1780340740.491209:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961113216 00000100:00100000:1.0:1780340740.491257:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:1.0:1780340740.491264:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a204a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961113216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340740.491283:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340740.491329:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a204a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961113216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340740.491335:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00080000:2.0:1780340740.491511:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340740.491537:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961113216:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1780340741.014573:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340742.026298:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340742.026320:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961113344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340742.026386:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340742.026611:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961113344 00000100:00100000:2.0:1780340742.026620:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961113344 00000100:00100000:2.0:1780340742.026669:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3820 00000100:00100000:2.0:1780340742.026678:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961113344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340742.026726:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:2.0:1780340742.026792:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961113344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340742.026800:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3820 00000100:00100000:2.0:1780340742.026846:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349863480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961113344:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1780340742.028169:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340742.030903:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961113728:0@lo:400:kworker.0 00000100:00100000:2.0:1780340742.030972:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340742.031003:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961114240:0@lo:400:kworker.0 00000100:00100000:2.0:1780340742.031025:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340742.031042:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961114752:0@lo:400:kworker.0 00000100:00100000:2.0:1780340742.032656:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340742.032696:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1780340742.032708:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961113600:0@lo:400:kworker.0 00000100:00100000:2.0:1780340742.032741:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340742.032748:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961114240 00000100:00100000:2.0:1780340742.032773:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961114112:0@lo:400:kworker.0 00000100:00100000:2.0:1780340742.032800:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340742.032820:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961114624:0@lo:400:kworker.0 00000100:00100000:2.0:1780340742.032841:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340742.032871:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961114752 00000100:00100000:2.0:1780340742.032879:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961114752 00000100:00100000:1.0:1780340742.032895:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961114240 00000100:00100000:1.0:1780340742.032925:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961114624 00000100:00100000:1.0:1780340742.032928:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961114624 00000100:00100000:0.0:1780340742.033336:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961113856:0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.033371:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340742.033391:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961114368:0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.035185:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340742.037050:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961114880:0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.037120:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340742.037150:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1780340742.037158:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961113472:0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.037185:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340742.037349:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961113984:0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.037374:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340742.037394:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961114496:0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.037606:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340742.037887:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961113728 00000100:00100000:0.0:1780340742.037895:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961113728 00000100:00100000:0.0:1780340742.037938:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961113600 00000100:00100000:0.0:1780340742.037941:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961113600 00000100:00100000:0.0:1780340742.037954:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961113856 00000100:00100000:0.0:1780340742.037956:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961113856 00000100:00100000:0.0:1780340742.037969:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961114880 00000100:00100000:0.0:1780340742.037972:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961114880 00000100:00100000:0.0:1780340742.037983:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961113984 00000100:00100000:0.0:1780340742.037985:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961113984 00000100:00100000:0.0:1780340742.037996:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961114496 00000100:00100000:0.0:1780340742.037999:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961114496 00000100:00100000:0.0:1780340742.038013:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1780340742.038022:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961113728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.038156:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961113728:12345-0@lo:400:kworker.0 Request processed in 135us (7183us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340742.038164:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1780340742.038184:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1780340742.038190:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818961113600:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1780340742.038273:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04529d6a00 x1866818961113600/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:168/0 lens 224/224 e 0 to 0 dl 1780340753 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340742.038303:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818961113600:12345-0@lo:400:kworker.0 Request processed in 114us (5561us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340742.038309:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:0.0:1780340742.038335:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1780340742.038340:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961113856:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1780340742.038351:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046ba2fb80 x1866818961113856/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:168/0 lens 224/224 e 0 to 0 dl 1780340753 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340742.038385:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961113856:12345-0@lo:400:kworker.0 Request processed in 45us (5013us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340742.038574:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1780340742.038589:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:0.0:1780340742.038595:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961114880:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1780340742.038607:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046ba2ed80 x1866818961114880/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:168/0 lens 224/224 e 0 to 0 dl 1780340753 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340742.038637:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961114880:12345-0@lo:400:kworker.0 Request processed in 42us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340742.038643:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:0.0:1780340742.038654:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1780340742.038660:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961113984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.038683:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961113984:12345-0@lo:400:kworker.0 Request processed in 24us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340742.038688:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1780340742.038699:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1780340742.038705:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961114496:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1780340742.038716:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046ba2ea00 x1866818961114496/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:168/0 lens 224/224 e 0 to 0 dl 1780340753 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340742.038739:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961114496:12345-0@lo:400:kworker.0 Request processed in 35us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340742.038752:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:2.0:1780340742.039672:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961114368 00000100:00100000:2.0:1780340742.039683:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961114368 00000100:00100000:2.0:1780340742.039742:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2494 00000100:00100000:2.0:1780340742.039752:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961114240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340742.039835:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961114240:12345-0@lo:400:kworker.0 Request processed in 85us (8808us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340742.039841:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2494 00000100:00100000:2.0:1780340742.039860:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2495 00000100:00100000:2.0:1780340742.039867:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961114752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340742.039896:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961114752:12345-0@lo:400:kworker.0 Request processed in 30us (7244us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340742.039901:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2495 00000100:00100000:2.0:1780340742.039913:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2496 00000100:00100000:2.0:1780340742.039919:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b990700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961114624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340742.039944:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b990700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961114624:12345-0@lo:400:kworker.0 Request processed in 25us (7102us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340742.039950:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2496 00000100:00100000:2.0:1780340742.039961:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2497 00000100:00100000:2.0:1780340742.039966:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961114368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340742.039994:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961114368:12345-0@lo:400:kworker.0 Request processed in 28us (4817us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340742.039999:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2497 00000100:00100000:2.0:1780340742.040022:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961114112 00000100:00100000:2.0:1780340742.040026:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961114112 00000100:00100000:2.0:1780340742.040068:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3821 00000100:00100000:2.0:1780340742.040075:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818961114112:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340742.040089:0:22660:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0346f50000 x1866818961114112/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:168/0 lens 224/224 e 0 to 0 dl 1780340753 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340742.040116:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818961114112:12345-0@lo:400:kworker.0 Request processed in 42us (7316us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340742.040129:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3821 00000100:00080000:2.0:1780340742.040149:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780340742.040153:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340742.040156:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340742.040159:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340742.040743:0:85474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961113472 00000100:00100000:0.0:1780340742.040750:0:85474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961113472 00000100:00100000:0.0:1780340742.040803:0:85474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1780340742.040811:0:85474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0475e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961113472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.040853:0:85474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0475e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961113472:12345-0@lo:400:kworker.0 Request processed in 43us (3666us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340742.040859:0:85474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1780340742.041028:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961113472:0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.041043:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961113984:0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.041054:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961114496:0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.041064:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961113856:0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.041074:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961114368:0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.041083:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961114880:0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.041792:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961113600:0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.041804:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961114112:0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.041813:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961114624:0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.041822:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961113728:0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.041831:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961114240:0@lo:400:kworker.0 00000100:00100000:0.0:1780340742.041840:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961114752:0@lo:400:kworker.0 00000100:00100000:1.0:1780340742.539896:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340742.539919:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961115008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340742.539983:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340742.542811:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961115136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340742.542880:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340742.544155:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961115136 00000100:00100000:3.0:1780340742.544166:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961115136 00000100:00100000:3.0:1780340742.544220:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822 00000100:00100000:3.0:1780340742.544230:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b993b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961115136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340742.544266:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445232640 avail 1298993152 00010000:00000080:3.0:1780340742.544284:0:26074:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046b993b80 x1866818961115136/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:168/0 lens 224/368 e 0 to 0 dl 1780340753 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340742.544342:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b993b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961115136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340742.544350:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822 00000100:00100000:2.0:1780340742.544696:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961115136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340742.545708:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780340742.545719:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961115264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340742.545780:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340742.547702:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961115008 00000100:00100000:0.0:1780340742.547715:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961115008 00000100:00100000:0.0:1780340742.547940:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961115264 00000100:00100000:0.0:1780340742.547945:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961115264 00000100:00100000:0.0:1780340742.547972:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030 00000100:00100000:0.0:1780340742.547980:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961115008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780340742.548009:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340742.548072:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961115008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (8089us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340742.548080:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030 00000100:00100000:0.0:1780340742.548098:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2031 00000100:00100000:0.0:1780340742.548104:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961115264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340742.548120:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340742.548151:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961115264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (2371us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340742.548158:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2031 00000100:00100000:0.0:1780340742.548203:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b993800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961115264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340742.551906:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961115008:0@lo:13:osp-pre-1-0.0 00000020:01000004:1.0:1780340742.960453:0:86716:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1780340742.960506:0:86716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa24651432773e7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773e83 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.960521:0:86716:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa24651432773e7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773e83 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.960529:0:86716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa24651432773e7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773e83 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.960535:0:86716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa24651432773e7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773e83 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.960568:0:86716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1780340742.960573:0:86716:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1780340742.960594:0:86716:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1780340742.960598:0:86716:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1780340742.960604:0:86716:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1780340742.960638:0:86716:0:(import.c:65:import_set_state_nolock()) ffff8c0345f1c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1780340742.961107:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340742.961114:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa24651432773e7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773e83 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.961123:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123a00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:2.0:1780340742.961127:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa24651432773e7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773e83 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.961136:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa24651432773e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432773e83 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340742.961143:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa24651432773e7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432773e83 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340742.961149:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1780340742.961151:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1780340742.961153:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1780340742.961187:0:6504:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa24651432773e7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773e83 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.961193:0:6504:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780340742.961217:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa24651432773e7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773e83 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.961223:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa24651432773e7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773e83 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.961235:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340742.961236:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340742.961238:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340742.961255:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961115392:0@lo:39:umount.0 00000100:00100000:2.0:1780340742.961317:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340742.961363:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340742.961372:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961115520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340742.961400:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340742.961568:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961115520 00000100:00100000:2.0:1780340742.961574:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961115520 00000100:00100000:2.0:1780340742.961623:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1780340742.961631:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04757d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961115520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340742.961643:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340742.961656:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0440031c00/0xa24651432773e83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773e7c expref: 23 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.961669:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340742.961700:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04757d7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3660:x1866818961115520:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340742.961717:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1780340742.961803:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961115520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780340742.962009:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961115392 00000100:00100000:0.0:1780340742.962014:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961115392 00000100:00100000:0.0:1780340742.962056:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:0.0:1780340742.962063:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1866818961115392:12345-0@lo:39:umount.0 00000020:00000080:0.0:1780340742.962083:0:63712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773f7f 00000100:00080000:0.0:1780340742.962096:0:63712:0:(import.c:65:import_set_state_nolock()) ffff8c0346fd0800 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1780340742.962122:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0349084380 x1866818961115392/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:168/0 lens 224/224 e 0 to 0 dl 1780340753 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340742.962160:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3658:x1866818961115392:12345-0@lo:39:umount.0 Request processed in 98us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340742.962175:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000020:00000080:0.0:1780340742.962182:0:63712:0:(genops.c:906:class_export_put()) final put ffff8c0346fd1800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1780340742.962239:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0345f1c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1780340742.962249:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961115392:0@lo:39:umount.0 00000020:00000080:0.0:1780340742.962263:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0346fd1800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1780340742.962298:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0346fd0800 for lustre-MDT0000 00000100:00080000:1.0:1780340742.962645:0:86716:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1780340742.962649:0:86716:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1780340742.962654:0:86716:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1780340742.965015:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340742.967527:0:86716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773daa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773db1 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.967554:0:86716:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773daa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773db1 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.967561:0:86716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773daa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773db1 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.967567:0:86716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773db1 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.967582:0:86716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780340742.967587:0:86716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432773ea6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773ead expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.967593:0:86716:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432773ea6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773ead expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.967598:0:86716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432773ea6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773ead expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.967604:0:86716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432773ea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773ead expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.967619:0:86716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780340742.967648:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780340742.967653:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773db1 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.967660:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722aee00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340742.967663:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773db1 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.967670:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773daa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432773db1 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340742.967677:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773daa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432773db1 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340742.967682:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1780340742.967684:0:23160:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1780340742.967715:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773daa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773db1 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.967720:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340742.967749:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773daa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773db1 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.967755:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432773daa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773db1 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.967787:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340742.967790:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432773ea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773ead expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.967797:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5000 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340742.967806:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432773ea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773ead expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.967813:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432773ea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432773ead expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340742.967819:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432773ea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432773ead expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340742.967823:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1780340742.967825:0:23160:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1780340742.967828:0:23160:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1780340742.967844:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432773ea6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773ead expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.967850:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340742.967862:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432773ea6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773ead expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.967868:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432773ea6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773ead expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.967878:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340742.967880:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340742.967881:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340742.967891:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340742.967906:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961115648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340742.967966:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340742.968017:0:6503:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961115648 00000100:00100000:1.0:1780340742.968024:0:6503:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961115648 00000100:00100000:1.0:1780340742.968502:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1780340742.968518:0:6503:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3659:x1866818961115648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340742.968533:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340742.968556:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453123e00/0xa24651432773db1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773daa expref: 22 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.968569:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340742.968609:0:6503:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:3659:x1866818961115648:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340742.968616:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1780340742.968654:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961115648:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340742.968682:0:86716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa24651432773e6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773e75 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.968689:0:86716:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa24651432773e6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773e75 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.968695:0:86716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa24651432773e6e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773e75 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.968701:0:86716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa24651432773e6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773e75 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.968715:0:86716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780340742.968720:0:86716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432773d95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432773da3 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.968726:0:86716:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432773d95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432773da3 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.968742:0:86716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432773d95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773da3 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.968749:0:86716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432773d95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432773da3 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.968779:0:86716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1780340742.968783:0:86716:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1780340742.968787:0:86716:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1780340742.968816:0:86716:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1780340742.968820:0:86716:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:1.0:1780340742.968824:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1780340742.968829:0:86716:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:0.0:1780340742.969356:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961115776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780340742.969400:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340742.969451:0:6502:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961115776 00000100:00100000:0.0:1780340742.969457:0:6502:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961115776 00000100:00100000:0.0:1780340742.969497:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1780340742.969503:0:6502:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b993800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:3661:x1866818961115776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780340742.969513:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340742.969523:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0440030800/0xa24651432773ead lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773ea6 expref: 21 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340742.969533:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340742.969572:0:6502:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b993800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3661:x1866818961115776:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340742.969579:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:0.0:1780340742.969610:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961115776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340742.969872:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340742.969879:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa24651432773e6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773e75 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.969886:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4600 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:2.0:1780340742.969889:0:41205:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa24651432773e6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773e75 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.969896:0:41205:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa24651432773e6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432773e75 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340742.969902:0:41205:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa24651432773e6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432773e75 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340742.969907:0:41205:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1780340742.969910:0:41205:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1780340742.969912:0:41205:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1780340742.969933:0:41205:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa24651432773e6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773e75 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.969939:0:41205:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780340742.969951:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa24651432773e6e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773e75 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.969957:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa24651432773e6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773e75 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.969967:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340742.969979:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432773d95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773da3 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.969985:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af400 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:2.0:1780340742.969988:0:41205:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432773d95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432773da3 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.969993:0:41205:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432773d95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432773da3 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340742.969999:0:41205:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432773d95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432773da3 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340742.970003:0:41205:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1780340742.970006:0:41205:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1780340742.970007:0:41205:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1780340742.970021:0:41205:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432773d95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773da3 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.970026:0:41205:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780340742.970038:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432773d95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773da3 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.970056:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432773d95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432773da3 expref: -99 pid: 85461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.970066:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340742.970067:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340742.970070:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340742.970075:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340742.970080:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340742.970089:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961116032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340742.970122:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340742.970155:0:7443:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961116032 00000100:00100000:2.0:1780340742.970159:0:7443:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961116032 00000100:00100000:2.0:1780340742.970185:0:7443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:2.0:1780340742.970191:0:7443:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3660:x1866818961116032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340742.970199:0:7443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340742.970207:0:7443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453122600/0xa24651432773da3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773d95 expref: 20 pid: 85467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.970216:0:7443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340742.970240:0:7443:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:3660:x1866818961116032:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340742.970246:0:7443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:2.0:1780340742.970271:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961116032:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340742.972508:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340742.972533:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961115904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340742.972612:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340742.973167:0:19125:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961115904 00000100:00100000:2.0:1780340742.973177:0:19125:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961115904 00000100:00100000:2.0:1780340742.973226:0:19125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:2.0:1780340742.973234:0:19125:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349339c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:3662:x1866818961115904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340742.973246:0:19125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340742.973263:0:19125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5a00/0xa24651432773e75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773e6e expref: 19 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.973281:0:19125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340742.973321:0:19125:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349339c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:3662:x1866818961115904:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340742.973327:0:19125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1780340742.975154:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961115904:0@lo:103:ldlm_bl.0 00000004:00000080:1.0:1780340742.981416:0:86716:0:(mdt_handler.c:8186:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1780340742.982106:0:85462:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182416 is committed 00010000:00010000:1.0:1780340742.982226:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327742b2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.982237:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327742b2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.982243:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327742b2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.982249:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340742.982253:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327742b2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.982260:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327742b2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.982273:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c044412b900) 00010000:00010000:1.0:1780340742.982281:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340742.982287:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327742b2 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340742.982293:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327742b2 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1780340742.982347:0:86716:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:1.0:1780340742.982356:0:86716:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c04754ec800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780340742.982361:0:86716:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c047a28e000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780340742.982365:0:86716:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c044d43f000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780340742.982369:0:86716:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c046ba24000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780340742.982374:0:86716:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c046ba27000 e06e5cf1-1986-4ba7-9630-fad7efb74eca 192.168.203.16@tcp 12 (0 0 7) 0 0 0 0: 0000000000000000 107374182416 stale:0 00000020:00080000:1.0:1780340742.982379:0:86716:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff8c047ac74d40) has exports, disconnecting them 00000020:00080000:1.0:1780340742.982384:0:86716:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c04754ec800), last request at 1780340706 00000020:00000080:1.0:1780340742.982391:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773f78 00000100:00080000:1.0:1780340742.982398:0:86716:0:(import.c:65:import_set_state_nolock()) ffff8c04506d1800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780340742.982745:0:86716:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c04754ec800): rc 0 00000020:00000080:1.0:1780340742.982748:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c04754ec800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1780340742.982781:0:86716:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c047a28e000), last request at 1780340742 00000020:00000080:1.0:1780340742.982785:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773f71 00000100:00080000:1.0:1780340742.982790:0:86716:0:(import.c:65:import_set_state_nolock()) ffff8c04754ef800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1780340742.982938:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1780340742.982948:0:86716:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c047a28e000): rc 0 00000020:00000080:1.0:1780340742.982951:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c047a28e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1780340742.982956:0:86716:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c044d43f000), last request at 1780340742 00000020:00000080:1.0:1780340742.982959:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773f6a 00000100:00080000:1.0:1780340742.982973:0:86716:0:(import.c:65:import_set_state_nolock()) ffff8c045f0c2000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780340742.982982:0:86716:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c044d43f000): rc 0 00000020:00000080:1.0:1780340742.982984:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c044d43f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1780340742.982988:0:86716:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c046ba24000), last request at 1780340700 00000020:00000080:1.0:1780340742.982995:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773df0 00000100:00080000:1.0:1780340742.983004:0:86716:0:(import.c:65:import_set_state_nolock()) ffff8c0346fd3800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780340742.983038:0:86716:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c046ba24000): rc 0 00000020:00000080:1.0:1780340742.983040:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c046ba24000/lustre-MDT0001-mdtlov_UUID 00010000:00010000:2.0:1780340742.983180:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340742.983185:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340742.983189:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1780340742.983214:0:86716:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.16@tcp (ffff8c046ba27000), last request at 1780340740 00000020:00000080:1.0:1780340742.983218:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773de9 00000020:00010000:1.0:1780340742.983225:0:86716:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c046ba27000: total 4 00000100:00080000:1.0:1780340742.983228:0:86716:0:(import.c:65:import_set_state_nolock()) ffff8c047b1fa800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780340742.983247:0:86716:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.16@tcp (ffff8c046ba27000): rc 0 00000004:00000080:1.0:1780340742.983253:0:86716:0:(mdd_device.c:2374:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff992740dabae0 00000100:00080000:1.0:1780340742.983270:0:86716:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1780340742.983273:0:86716:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:2.0:1780340742.984158:0:7442:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c046ba27000: total 4 00010000:00010000:2.0:1780340742.984223:0:7442:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c046ba27000, canceled 0 locks, left on hash table 7. 00010000:00010000:2.0:1780340742.984258:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7000/0xa246514327741af lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2336 expref: 8 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.984284:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6400/0xa246514327741bd lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2344 expref: 7 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.984298:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b000/0xa246514327742ab lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2383 expref: 6 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.984313:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7e00/0xa246514327742c7 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2391 expref: 5 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.984326:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b7600/0xa246514327742ea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23ad expref: 4 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.984344:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32aa00/0xa246514327741b6 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced233d expref: 3 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.984362:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32b800/0xa24651432774330 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23bb expref: 2 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340742.984375:0:7442:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c046ba27000, canceled 7 locks, left on hash table 0. 00000100:00080000:1.0:1780340742.986362:0:86716:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1780340742.986398:0:86716:0:(import.c:65:import_set_state_nolock()) ffff8c047b19c800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1780340742.986623:0:86716:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1780340742.986628:0:86716:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 3 00000004:00080000:1.0:1780340742.986641:0:86716:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:1.0:1780340742.986694:0:86716:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1780340742.986703:0:86716:0:(import.c:65:import_set_state_nolock()) ffff8c0458281800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1780340742.986709:0:86716:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1780340742.986711:0:86716:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 3 00000004:00080000:1.0:1780340742.986719:0:86716:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:1.0:1780340742.987498:0:86716:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1780340742.987514:0:86716:0:(import.c:65:import_set_state_nolock()) ffff8c0349151800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1780340742.987568:0:86716:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8c047ac74d40) has no exports 00000020:00080000:1.0:1780340742.991220:0:86716:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8c047ac74d40) has no exports 00000100:00100000:3.0:1780340742.991448:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961116160:0@lo:39:umount.0 00000100:00100000:3.0:1780340742.991519:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340742.991562:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961116288:0@lo:9:umount.0 00000100:00100000:3.0:1780340742.991584:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340742.991600:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961116416:0@lo:9:umount.0 00000100:00100000:3.0:1780340742.991617:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340742.991665:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961116160 00000100:00100000:3.0:1780340742.991673:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961116160 00000100:00100000:3.0:1780340742.991723:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3823 00000100:00100000:3.0:1780340742.991730:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818961116160:12345-0@lo:39:umount.0 00000020:00000080:3.0:1780340742.991775:0:22660:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773e2f 00000100:00080000:3.0:1780340742.991783:0:22660:0:(import.c:65:import_set_state_nolock()) ffff8c0458287000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780340742.991803:0:22660:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378733 00000100:00100000:3.0:1780340742.991936:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349338e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3658:x1866818961116160:12345-0@lo:39:umount.0 Request processed in 205us (417us total) trans 81604378734 rc 0/0 00000100:00100000:3.0:1780340742.991943:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3823 00000100:00100000:3.0:1780340742.991968:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961116288 00000100:00100000:3.0:1780340742.991972:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961116288 00000100:00100000:3.0:1780340742.991994:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961116416 00000100:00100000:3.0:1780340742.991997:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961116416 00000100:00100000:3.0:1780340742.992015:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5893 00000100:00100000:3.0:1780340742.992020:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818961116288:12345-0@lo:9:umount.0 00000020:00000080:3.0:1780340742.992035:0:23157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773e4b 00000100:00080000:3.0:1780340742.992040:0:23157:0:(import.c:65:import_set_state_nolock()) ffff8c04858fb800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780340742.992072:0:23157:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969452 00000100:00100000:3.0:1780340742.992150:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:3658:x1866818961116288:12345-0@lo:9:umount.0 Request processed in 128us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340742.992156:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5893 00000100:00100000:3.0:1780340742.992167:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5894 00000100:00100000:3.0:1780340742.992173:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818961116416:12345-0@lo:9:umount.0 00000020:00000080:3.0:1780340742.992182:0:23157:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773e59 00000100:00080000:3.0:1780340742.992187:0:23157:0:(import.c:65:import_set_state_nolock()) ffff8c047a28a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780340742.992208:0:23157:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969452 00000100:00100000:3.0:1780340742.992268:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:3658:x1866818961116416:12345-0@lo:9:umount.0 Request processed in 95us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340742.992274:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5894 00010000:00010000:3.0:1780340742.992320:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340742.992331:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340742.992336:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1780340742.992362:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c047b19c800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1780340742.992370:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961116160:0@lo:39:umount.0 00000100:00080000:3.0:1780340742.992379:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0458281800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1780340742.992388:0:3658:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:3.0:1780340742.992389:0:3658:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:3.0:1780340742.992392:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961116288:0@lo:9:umount.0 00000100:00080000:3.0:1780340742.992399:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0349151800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1780340742.992407:0:3658:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:3.0:1780340742.992408:0:3658:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:3.0:1780340742.992410:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961116416:0@lo:9:umount.0 00000020:00000080:0.0:1780340742.992687:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04754ec800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1780340742.992750:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047a28e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1780340742.992784:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c044d43f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1780340742.992825:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046ba24000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1780340742.992860:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c04506d1800 for lustre-MDT0000 00000020:00000080:0.0:1780340742.992864:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c04754ef800 for lustre-MDT0000 00000020:00000080:0.0:1780340742.992867:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c045f0c2000 for lustre-MDT0000 00000020:00000080:0.0:1780340742.992870:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0346fd3800 for lustre-MDT0000 00000020:00000080:2.0:1780340743.029469:0:7442:0:(genops.c:906:class_export_put()) final put ffff8c046ba27000/e06e5cf1-1986-4ba7-9630-fad7efb74eca 00010000:00010000:2.0:1780340743.031569:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340743.031591:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340743.031594:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1780340743.031962:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046ba27000/e06e5cf1-1986-4ba7-9630-fad7efb74eca for lustre-MDT0000 00000020:00000080:3.0:1780340743.032023:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047b1fa800 for lustre-MDT0000 00010000:00010000:0.0:1780340743.052147:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1780340743.076178:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773e05 00000020:00000080:1.0:1780340743.076194:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c045aab6000/lustre-QMT0000_UUID 00000020:01000000:1.0:1780340743.076258:0:86716:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1780340743.079852:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780340743.079871:0:86716:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1780340743.079876:0:86716:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff8c047658cd40) has no exports 00000020:00000080:2.0:1780340743.080256:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773dfe 00000020:00000080:2.0:1780340743.080264:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c0345f1f800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1780340743.081033:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045aab6000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1780340743.085678:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0345f1f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1780340743.085746:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1780340743.085839:0:86716:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1780340743.085844:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c04480ac000/lustre-QMT0000_UUID 00000020:00000080:3.0:1780340743.085847:0:86716:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04480ac000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1780340743.085852:0:86716:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1780340743.086190:0:86716:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c04772e72a0 - data ffff8c0471b0c000/ffff8c0446b61800 00000020:01000000:2.0:1780340743.086319:0:86716:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c04772e78a0 - data ffff8c0471b22438/ffff8c0446b63800 00000100:00080000:3.0:1780340743.138190:0:86716:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1780340743.138198:0:86716:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1780340743.138211:0:86716:0:(client.c:3140:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8c0348a68700 x1866818961116160/t81604378734(81604378734) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340752 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340743.138233:0:86716:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1780340743.139855:0:86716:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1780340743.139873:0:86716:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 4 00000004:00080000:3.0:1780340743.139927:0:86716:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:3.0:1780340743.139930:0:86716:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1780340743.140789:0:85481:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1780340743.140795:0:85481:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x64:0x0] index 1 count 1 00000040:00080000:0.0:1780340743.140804:0:85481:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 25 count 2 00000100:00080000:3.0:1780340743.141377:0:86716:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1780340743.141382:0:86716:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 4 00000004:00080000:3.0:1780340743.141400:0:86716:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:3.0:1780340743.141402:0:86716:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1780340743.141679:0:85483:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1780340743.141683:0:85483:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x66:0x0] index 1 count 1 00000040:00080000:0.0:1780340743.141690:0:85483:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 25 count 2 00000020:00000080:3.0:1780340743.143412:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773dbf 00000020:00000080:3.0:1780340743.143433:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c0475496000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1780340743.144015:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773dd4 00000020:00000080:3.0:1780340743.144021:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c0470f6b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1780340743.144026:0:86716:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1780340743.144031:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1780340743.144039:0:86716:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1780340743.144055:0:86716:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8c047ac70000) has no exports 00000004:01000000:3.0:1780340743.144206:0:86716:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1780340743.144213:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773e52 00000020:00000080:3.0:1780340743.144217:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c046b9a8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1780340743.144220:0:86716:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1780340743.144224:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1780340743.144228:0:86716:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1780340743.144230:0:86716:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8c0445ba4d40) has no exports 00000020:00000080:3.0:1780340743.144235:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773e44 00000020:00000080:3.0:1780340743.144237:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c047b19f000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1780340743.144534:0:86716:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1780340743.144550:0:86716:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1780340743.144554:0:86716:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 5 00000004:00080000:3.0:1780340743.144559:0:86716:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:3.0:1780340743.144561:0:86716:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1780340743.144588:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1780340743.144594:0:86716:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1780340743.144598:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773e36 00000020:00000080:3.0:1780340743.144602:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c04480ab800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1780340743.144618:0:86716:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1780340743.144621:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1780340743.144624:0:86716:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1780340743.144626:0:86716:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8c0445ba0000) has no exports 00000020:00000080:3.0:1780340743.144630:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773e28 00000020:00000080:3.0:1780340743.144632:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c0458282000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1780340743.144932:0:86716:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1780340743.144935:0:86716:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1780340743.144937:0:86716:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 5 00000004:00080000:3.0:1780340743.144941:0:86716:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:3.0:1780340743.144942:0:86716:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1780340743.144965:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1780340743.144970:0:86716:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1780340743.144980:0:86716:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1780340743.144984:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773e1a 00000020:00000080:3.0:1780340743.144988:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c034a94f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1780340743.144991:0:86716:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1780340743.144994:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1780340743.144997:0:86716:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1780340743.144999:0:86716:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8c0445ba3380) has no exports 00000020:00000080:3.0:1780340743.145002:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773e13 00000020:00000080:3.0:1780340743.145004:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c047b19c000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1780340743.145750:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0475496000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780340743.145773:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0470f6b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1780340743.145778:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b9a8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1780340743.145783:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047b19f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780340743.145788:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0349151800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1780340743.145793:0:71335:0:(genops.c:906:class_export_put()) final put ffff8c047651b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340743.145795:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047651b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1780340743.145799:0:71335:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340743.145875:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04480ab800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1780340743.145880:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0458282000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780340743.145884:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0458281800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1780340743.145888:0:71335:0:(genops.c:906:class_export_put()) final put ffff8c0351be9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340743.145889:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0351be9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1780340743.145893:0:71335:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340743.145916:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c034a94f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1780340743.145921:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047b19c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1780340743.146840:0:86716:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1780340743.146855:0:86716:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1780340743.146859:0:86716:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1780340743.146865:0:86716:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1780340743.146910:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340743.146919:0:86716:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340743.146946:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340743.146949:0:86716:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340743.146953:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c0442c0f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340743.146957:0:86716:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0442c0f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1780340743.146962:0:86716:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340743.147033:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773ddb 00000020:00000080:0.0:1780340743.147039:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c0470f6d800/lustre-MDD0000_UUID 00000020:01000000:0.0:1780340743.147053:0:86716:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1780340743.147057:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780340743.147061:0:86716:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1780340743.147064:0:86716:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8c047ac719c0) has no exports 00000020:00000080:0.0:1780340743.147084:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340743.147087:0:86716:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1780340743.147090:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773de2 00000020:00000080:0.0:1780340743.147093:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c0470f6f800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1780340743.147099:0:86716:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0351bee800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1780340743.147102:0:86716:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c0351bee800 3 00000020:01000004:0.0:1780340743.147105:0:86716:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c0351bee800 from lustre-MDT0000 00000020:00000080:0.0:1780340743.147120:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340743.147123:0:86716:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1780340743.147125:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c0475491000/lustre-MDT0000_UUID 00000020:00000080:0.0:1780340743.147127:0:86716:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0475491000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1780340743.147132:0:86716:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1780340743.147159:0:86716:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1780340743.147162:0:86716:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1780340743.147165:0:86716:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1780340743.147167:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780340743.147174:0:86716:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1780340743.147180:0:86716:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8c047a959800 f26f7947-2bb0-4491-8dd4-005fa8e64f3a 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1780340743.147188:0:86716:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8c046b968000 ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4 192.168.203.16@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1780340743.147191:0:86716:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8c047658b380) has exports, disconnecting them 00000020:00080000:0.0:1780340743.147195:0:86716:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8c047a959800), last request at 1780340700 00000020:00000080:0.0:1780340743.147214:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773d87 00000020:00010000:0.0:1780340743.147218:0:86716:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c047a959800: total 2 00000100:00080000:0.0:1780340743.147221:0:86716:0:(import.c:65:import_set_state_nolock()) ffff8c047a95a000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1780340743.147233:0:86716:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c047a959800): rc 0 00000020:00080000:0.0:1780340743.147235:0:86716:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.16@tcp (ffff8c046b968000), last request at 1780340699 00000020:00000080:0.0:1780340743.147272:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773d64 00000020:00010000:0.0:1780340743.147275:0:86716:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c046b968000: total 2 00000100:00080000:0.0:1780340743.147277:0:86716:0:(import.c:65:import_set_state_nolock()) ffff8c046b96f000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1780340743.147285:0:86716:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.16@tcp (ffff8c046b968000): rc 0 00000020:00080000:0.0:1780340743.147289:0:86716:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8c047658b380) has no exports 00000100:00100000:0.0:1780340743.147336:0:85466:0:(service.c:3186:ptlrpc_main()) ll_mgs_0000: service thread [ffff8c0349963400:85466] 0 exiting: rc = 1 00000100:00100000:0.0:1780340743.147407:0:85474:0:(service.c:3186:ptlrpc_main()) ll_mgs_0003: service thread [ffff8c044961ae00:85474] 3 exiting: rc = 0 00000100:00100000:0.0:1780340743.147466:0:85467:0:(service.c:3186:ptlrpc_main()) ll_mgs_0001: service thread [ffff8c0349963e00:85467] 1 exiting: rc = 0 00000020:00000080:1.0:1780340743.147648:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047b19c800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1780340743.147655:0:71335:0:(genops.c:906:class_export_put()) final put ffff8c04480af800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780340743.147658:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04480af800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1780340743.147667:0:71335:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780340743.147715:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0470f6d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1780340743.147719:0:71335:0:(genops.c:906:class_export_put()) final put ffff8c0475492800/lustre-MDD0000_UUID 00000020:00000080:1.0:1780340743.147721:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0475492800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1780340743.147724:0:71335:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1780340743.147743:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0470f6f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1780340743.150842:0:6505:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c047a959800: total 0 00010000:00010000:0.0:1780340743.150903:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c047a959800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1780340743.150934:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f8c00/0xa24651432773f39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773f32 expref: 14 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340743.150952:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0440030e00/0xa24651432773ec9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773ec2 expref: 13 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340743.150962:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5e00/0xa24651432773f47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773f40 expref: 12 pid: 85467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340743.150989:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453123000/0xa24651432773ed7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773ed0 expref: 11 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340743.150999:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04722aec00/0xa24651432773f63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773f5c expref: 10 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340743.151009:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa4400/0xa24651432773ef3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773eec expref: 9 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340743.151018:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5c00/0xa24651432773f55 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773f4e expref: 8 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340743.151031:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453123c00/0xa24651432773ee5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773ede expref: 7 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340743.151053:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0440031800/0xa24651432773f01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773efa expref: 6 pid: 85467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340743.151066:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453122a00/0xa24651432773f0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773f08 expref: 5 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340743.151076:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f8200/0xa24651432773f1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773f16 expref: 4 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340743.151086:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5800/0xa24651432773f2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773f24 expref: 3 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340743.151095:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa4200/0xa24651432773ebb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432773eb4 expref: 2 pid: 85466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340743.151114:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c047a959800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1780340743.151131:0:6505:0:(genops.c:906:class_export_put()) final put ffff8c047a959800/f26f7947-2bb0-4491-8dd4-005fa8e64f3a 00000020:00010000:0.0:1780340743.151150:0:6505:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c046b968000: total 1 00010000:00010000:0.0:1780340743.151166:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c046b968000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1780340743.151183:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0440031400/0xa24651432773d79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2313 expref: 5 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340743.151195:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0440030200/0xa24651432773e9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2321 expref: 4 pid: 85474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340743.151206:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0440031000/0xa24651432773d80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced231a expref: 3 pid: 85468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340743.151215:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04722ae800/0xa24651432773d72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced230c expref: 2 pid: 85467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340743.151224:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c046b968000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1780340743.151232:0:6505:0:(genops.c:906:class_export_put()) final put ffff8c046b968000/ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4 00010000:00010000:0.0:1780340743.151237:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340743.151239:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340743.151241:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340743.151248:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1780340743.151347:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047a959800/f26f7947-2bb0-4491-8dd4-005fa8e64f3a for MGS 00000020:00000080:1.0:1780340743.151386:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b968000/ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4 for MGS 00000020:00000080:1.0:1780340743.151397:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047a95a000 for MGS 00000020:00000080:1.0:1780340743.151403:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c046b96f000 for MGS 00000100:00100000:0.0:1780340743.154882:0:85468:0:(service.c:3186:ptlrpc_main()) ll_mgs_0002: service thread [ffff8c0347500c00:85468] 2 exiting: rc = 0 00000100:00100000:1.0:1780340743.155057:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155067:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155072:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155079:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155084:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155090:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155095:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155100:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155107:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155114:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155119:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155123:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155128:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155135:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155153:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155158:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155163:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155168:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155174:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155179:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155184:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155188:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155193:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155197:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155204:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155209:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155215:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155220:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155226:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155231:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155237:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155242:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155246:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155252:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155258:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155262:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155268:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155273:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155277:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155283:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155288:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155292:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155296:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155300:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155305:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155309:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155314:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155319:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155324:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155337:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155344:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155350:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155357:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155363:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155369:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155376:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155382:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155388:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155394:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155400:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155405:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155411:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155427:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340743.155433:0:86716:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1780340743.156217:0:86716:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c0341082ae0 - data ffff8c044d052bd0/ffff8c0346f31800 00000020:01000000:1.0:1780340743.156332:0:86716:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c0341082d80 - data ffff8c044d103d80/ffff8c0476ed4800 00000020:00000080:1.0:1780340743.156732:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773d5d 00000020:00000080:1.0:1780340743.156741:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c04530a2000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1780340743.156779:0:86716:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0351bee800 from MGS, refs=2 00000020:01000004:1.0:1780340743.156783:0:86716:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c0351bee800 2 00000020:01000004:1.0:1780340743.156786:0:86716:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c0351bee800 from MGS 00000020:00000080:1.0:1780340743.156806:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340743.156812:0:86716:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1780340743.156815:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c0447db0000/MGS 00000020:00000080:1.0:1780340743.156817:0:86716:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0447db0000/MGS for MGS 00000020:01000000:1.0:1780340743.156824:0:86716:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1780340743.156891:0:86716:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1780340743.156896:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340743.156901:0:86716:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1780340743.156907:0:86716:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8c046b90d000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780340743.156913:0:86716:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff8c0476588000) has exports, disconnecting them 00000020:00080000:1.0:1780340743.156918:0:86716:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8c046b90d000), last request at 1780340700 00000020:00000080:1.0:1780340743.156932:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773e91 00000020:00080000:1.0:1780340743.156941:0:86716:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c046b90d000): rc 0 00000020:00000080:1.0:1780340743.156945:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c046b90d000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1780340743.157565:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04530a2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780340743.157574:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b90d000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1780340743.170670:0:86716:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1780340743.170679:0:86716:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1780340743.170683:0:86716:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1780340743.170690:0:86716:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1780340743.170828:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0345f1c800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1780340743.170978:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340743.170987:0:86716:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1780340743.170992:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c0345f1b000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1780340743.170996:0:86716:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0345f1b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1780340743.171007:0:86716:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1780340743.171084:0:86716:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c0351bee800 1 00000020:00000080:1.0:1780340743.171090:0:86716:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432773d4f 00000020:00000080:1.0:1780340743.171096:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c0447db6800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1780340743.171137:0:86716:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1780340743.171142:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340743.171146:0:86716:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1780340743.171149:0:86716:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8c0445ba19c0) has no exports 00000020:00000080:0.0:1780340743.173928:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0447db6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1780340743.211712:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340743.211747:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000400:00000100:3.0:1780340743.211804:0:3653:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940425472 offset 0 length 224: 4 00000100:00100000:1.0:1780340743.211806:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940425856 00000100:00100000:1.0:1780340743.211816:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940425856 00000100:00100000:3.0:1780340743.211824:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340743.211853:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340743.211870:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940425984 00000100:00100000:3.0:1780340743.211873:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940425600 00000100:00100000:1.0:1780340743.211873:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940425984 00000100:00100000:3.0:1780340743.211876:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940425600 00000100:00100000:3.0:1780340743.211897:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940425728 00000100:00100000:1.0:1780340743.211897:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2498 00000100:00100000:3.0:1780340743.211899:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940425728 00000100:00100000:1.0:1780340743.211906:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2408:x1866818940425856:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340743.211938:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1266 00000100:00100000:3.0:1780340743.211944:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940425728:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340743.211975:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2408:x1866818940425856:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 69us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340743.211982:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2498 00000100:00100000:1.0:1780340743.211999:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2499 00000100:00100000:1.0:1780340743.212013:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2408:x1866818940425984:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340743.212027:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1240 00000100:00100000:0.0:1780340743.212040:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2408:x1866818940425600:12345-192.168.203.16@tcp:400:kworker.0 00000020:00080000:0.0:1780340743.212047:0:70100:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.16@tcp 00000100:00100000:3.0:1780340743.213349:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940425728:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 1397us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340743.213361:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1266 00000100:00100000:1.0:1780340743.218708:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2408:x1866818940425984:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 6685us (6843us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340743.218723:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2499 00000100:00080000:1.0:1780340743.218778:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780340743.218783:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340743.218786:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340743.220545:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2408:x1866818940425600:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 8485us (8825us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780340743.220559:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1240 00000100:00100000:1.0:1780340743.266822:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340743.267004:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940426112 00000100:00100000:0.0:1780340743.267014:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940426112 00000100:00100000:0.0:1780340743.267056:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1241 00000100:00100000:0.0:1780340743.267064:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1866818940426112:12345-192.168.203.16@tcp:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1780340743.267086:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340743.267153:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1866818940426112:12345-192.168.203.16@tcp:38:ptlrpcd_00_01.0 Request processed in 88us (340us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340743.267160:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1241 00000020:00000080:1.0:1780340743.334458:0:86716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340743.334470:0:86716:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1780340743.334475:0:86716:0:(genops.c:906:class_export_put()) final put ffff8c0351bec800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780340743.334480:0:86716:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0351bec800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1780340743.334491:0:86716:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1780340743.338216:0:86716:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8c0351bea800 00000020:02000400:1.0:1780340743.338287:0:86716:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1780340743.725045:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340743.725081:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340743.725107:0:24179:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940426240 00000100:00100000:2.0:1780340743.725115:0:24179:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940426240 00002000:00100000:2.0:1780340743.725155:0:24179:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x302:0x0] (1048576->2097151) req@ffff8c0349087800 x1866818940426240/t0(0) o4->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:169/0 lens 488/0 e 0 to 0 dl 1780340754 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1780340743.725166:0:24179:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0349087800 with x1866818940426240 ext(1048576->2097151) 00002000:00010000:2.0:1780340743.725172:0:24179:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0349087800 00000100:00100000:2.0:1780340743.725199:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1004 00000100:00100000:2.0:1780340743.725207:0:24179:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2408:x1866818940426240:12345-192.168.203.16@tcp:4:md5sum.0 00000100:00100000:2.0:1780340743.746046:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940426368 00000100:00100000:2.0:1780340743.746057:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940426368 00000100:00100000:2.0:1780340743.746112:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5895 00000100:00100000:2.0:1780340743.746123:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:2408:x1866818940426368:12345-192.168.203.16@tcp:16:kworker.0 00000001:00100000:2.0:1780340743.767600:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780340743.767610:0:8395:0:(genops.c:906:class_export_put()) final put ffff8c04858fc800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1780340743.767636:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969452 is committed 00000020:00000080:1.0:1780340743.767686:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04858fc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1780340743.767734:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c04858fb800 for lustre-OST0000 00000100:00100000:3.0:1780340743.768487:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2408:x1866818940426368:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 22361us (43398us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340743.768499:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5895 00000100:00100000:2.0:1780340743.786673:0:24179:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2408:x1866818940426240:12345-192.168.203.16@tcp:4:md5sum.0 Request processed in 61456us (61626us total) trans 4294969453 rc 0/0 00000100:00100000:2.0:1780340743.786693:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1004 00002000:00100000:2.0:1780340743.786707:0:24179:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x302:0x0] (1048576->2097151) req@ffff8c0349087800 x1866818940426240/t4294969453(0) o4->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:169/0 lens 488/448 e 0 to 0 dl 1780340754 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1780340743.786717:0:24179:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0349087800 with x1866818940426240 ext(1048576->2097151) 00002000:00010000:2.0:1780340743.786723:0:24179:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0349087800 00010000:00010000:3.0:1780340744.076433:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340745.101921:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340745.609873:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780340745.609900:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961116544:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340745.609974:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340745.610001:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961116544 00000100:00100000:3.0:1780340745.610007:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961116544 00000100:00100000:3.0:1780340745.610055:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032 00000100:00100000:3.0:1780340745.610063:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961116544:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340745.610086:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17088320 pending 1073152 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780340745.610130:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961116544:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340745.610134:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032 00000100:00100000:2.0:1780340745.610175:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961116544:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1780340745.610270:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340745.610925:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340745.610938:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961116672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340745.610976:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340745.611153:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961116672 00000100:00100000:2.0:1780340745.611159:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961116672 00000100:00100000:2.0:1780340745.611212:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:2.0:1780340745.611222:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961116672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340745.611244:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340745.611289:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349339f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961116672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340745.611297:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000100:00100000:3.0:1780340745.611323:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961116672:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1780340745.611350:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1780340746.121939:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1780340746.125798:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780340746.125809:0:9462:0:(genops.c:906:class_export_put()) final put ffff8c0447db0800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1780340746.125900:0:9462:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969452 is committed 00000020:00000080:3.0:1780340746.125998:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0447db0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1780340746.126191:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047a28a000 for lustre-OST0001 00010000:00010000:0.0:1780340747.146652:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340747.149705:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961116800:0@lo:400:kworker.0 00000400:00000100:0.0:1780340747.149842:0:3662:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961116800 offset 0 length 224: 4 00000100:00100000:1.0:1780340747.150898:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0477585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961117184:0@lo:400:kworker.0 00000100:00100000:1.0:1780340747.150944:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340747.150992:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961117184 00000100:00100000:1.0:1780340747.151000:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961117184 00000100:00100000:1.0:1780340747.151050:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:1.0:1780340747.151057:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1866818961117184:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1780340747.151080:0:63711:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780340747.151120:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3661:x1866818961117184:12345-0@lo:400:kworker.0 Request processed in 61us (174us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780340747.151127:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00080000:1.0:1780340747.151166:0:3661:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1780340747.151171:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1780340747.151174:0:3661:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1780340747.151179:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340747.151182:0:3661:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3486 00000100:00080000:1.0:1780340747.151187:0:3661:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340747.151207:0:3661:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0348a69c00 x1866818961117312/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340747.151244:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0477585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961117184:0@lo:400:kworker.0 00000100:00100000:1.0:1780340747.151283:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961117056:0@lo:400:kworker.0 00000100:00100000:1.0:1780340747.151306:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340747.151325:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780340747.151330:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818961116928:0@lo:400:kworker.0 00000100:00100000:1.0:1780340747.151347:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340747.151370:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961117056 00000100:00100000:1.0:1780340747.151373:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961117056 00000100:00100000:1.0:1780340747.151420:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961116928 00000100:00100000:1.0:1780340747.151423:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961116928 00000100:00100000:1.0:1780340747.151434:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:1.0:1780340747.151440:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961117056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340747.151489:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961117056:12345-0@lo:400:kworker.0 Request processed in 49us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340747.151502:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:1.0:1780340747.151522:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:1.0:1780340747.151526:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3660:x1866818961116928:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1780340747.151531:0:70100:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780340747.151556:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3660:x1866818961116928:12345-0@lo:400:kworker.0 Request processed in 29us (207us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780340747.151561:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00080000:1.0:1780340747.151574:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780340747.151589:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1780340747.151592:0:3660:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1780340747.151595:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1780340747.151598:0:3660:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340747.151601:0:3660:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3486 00000100:00080000:1.0:1780340747.151605:0:3660:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340747.151618:0:3660:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a845880 x1866818961117440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340747.151628:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818961116928:0@lo:400:kworker.0 00000100:00100000:1.0:1780340747.151641:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961117056:0@lo:400:kworker.0 00000100:00100000:1.0:1780340747.151678:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961117312:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1780340747.151700:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340747.151714:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961117440:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1780340747.151731:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340747.151751:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961117312 00000100:00100000:1.0:1780340747.151781:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961117312 00000100:00100000:1.0:1780340747.151799:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961117440 00000100:00100000:1.0:1780340747.151802:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961117440 00000100:00100000:1.0:1780340747.151812:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:1.0:1780340747.151817:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961117312:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1780340747.151834:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340747.151866:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961117312:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 48us (164us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340747.151871:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:1.0:1780340747.151882:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:1.0:1780340747.151885:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961117440:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1780340747.151893:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340747.151912:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961117440:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 26us (181us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340747.151923:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00080000:1.0:1780340747.151945:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340747.151949:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340747.151952:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961117312:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1780340747.151958:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340747.151961:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340747.151964:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961117440:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1780340747.156262:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0477587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961117568:0@lo:400:kworker.0 00000100:00100000:0.0:1780340747.156331:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340747.156617:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961117568 00000100:00100000:1.0:1780340747.156628:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961117568 00000100:00100000:1.0:1780340747.156702:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1780340747.156711:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961117568:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1780340747.156828:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340747.157487:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961117952:0@lo:400:kworker.0 00000100:00100000:2.0:1780340747.157540:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340747.157578:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961117952 00000100:00100000:2.0:1780340747.157582:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961117952 00000100:00100000:2.0:1780340747.157621:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2500 00000100:00100000:2.0:1780340747.157628:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961117952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340747.157673:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961117952:12345-0@lo:400:kworker.0 Request processed in 45us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340747.157680:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2500 00000100:00080000:2.0:1780340747.157702:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340747.157712:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0477585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961117696:0@lo:400:kworker.0 00000100:00100000:2.0:1780340747.157737:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340747.157776:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780340747.157782:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961117824:0@lo:400:kworker.0 00000100:00100000:2.0:1780340747.157812:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340747.157842:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961117696 00000100:00100000:2.0:1780340747.157846:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961117696 00000100:00100000:2.0:1780340747.157871:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3824 00000100:00100000:2.0:1780340747.157876:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3659:x1866818961117696:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1780340747.157882:0:26074:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1780340747.157927:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3659:x1866818961117696:12345-0@lo:400:kworker.0 Request processed in 49us (188us total) trans 0 rc -107/-107 00000100:00100000:2.0:1780340747.157933:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3824 00000100:00100000:2.0:1780340747.157950:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961117824 00000100:00100000:2.0:1780340747.157953:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961117824 00000100:00100000:2.0:1780340747.157982:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2501 00000100:00100000:2.0:1780340747.157988:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961117824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340747.158017:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961117824:12345-0@lo:400:kworker.0 Request processed in 29us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340747.158023:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2501 00000100:00080000:2.0:1780340747.158210:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340747.158250:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961117952:0@lo:400:kworker.0 00000100:00100000:2.0:1780340747.158279:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961117824:0@lo:400:kworker.0 00000100:00080000:2.0:1780340747.158296:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1780340747.158300:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1780340747.158304:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1780340747.158309:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340747.158312:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3486 00000100:00080000:2.0:1780340747.158318:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340747.158341:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155c380 x1866818961118080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340747.158361:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0477585500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961117696:0@lo:400:kworker.0 00000100:00100000:2.0:1780340747.158395:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961118080:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1780340747.158418:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340747.158470:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961118080 00000100:00100000:2.0:1780340747.158474:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961118080 00000100:00100000:2.0:1780340747.158493:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825 00000100:00100000:2.0:1780340747.158499:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961118080:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1780340747.158524:0:22660:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340747.158554:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961118080:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 55us (136us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340747.158561:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825 00000100:00080000:2.0:1780340747.158582:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340747.158586:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340747.158589:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961118080:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1780340747.159842:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961117568:12345-0@lo:400:kworker.0 Request processed in 3125us (3504us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340747.159853:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:0.0:1780340747.161795:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0477587480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961117568:0@lo:400:kworker.0 00000100:00100000:0.0:1780340747.163625:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961118208:0@lo:400:kworker.0 00000100:00100000:0.0:1780340747.163686:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340747.163964:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961118208 00000100:00100000:3.0:1780340747.163972:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961118208 00000100:00100000:3.0:1780340747.164014:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:3.0:1780340747.164043:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3662:x1866818961118208:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1780340747.164051:0:63711:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1780340747.164096:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3662:x1866818961118208:12345-0@lo:400:kworker.0 Request processed in 54us (410us total) trans 0 rc -107/-107 00000100:00100000:3.0:1780340747.164103:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00080000:0.0:1780340747.164409:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1780340747.164414:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1780340747.164422:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1780340747.164428:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340747.164431:0:3662:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3486 00000100:00080000:0.0:1780340747.164437:0:3662:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340747.164622:0:3662:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0471570e00 x1866818961118336/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340747.164650:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961118208:0@lo:400:kworker.0 00000100:00100000:3.0:1780340747.165575:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961118336:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1780340747.165622:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340747.165697:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961118336 00000100:00100000:2.0:1780340747.165709:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961118336 00000100:00100000:2.0:1780340747.165741:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:2.0:1780340747.165747:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961118336:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1780340747.165788:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340747.165830:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961118336:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 82us (207us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340747.165836:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00080000:3.0:1780340747.165926:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340747.165930:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340747.165934:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471570e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961118336:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:0.0:1780340748.169895:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340748.328861:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000400:00000100:3.0:1780340748.328965:0:3652:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940426496 offset 0 length 224: 4 00000100:00100000:1.0:1780340748.329729:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940426624 00000100:00100000:1.0:1780340748.329749:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940426624 00000100:00100000:1.0:1780340748.329856:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1248 00000100:00100000:1.0:1780340748.329867:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940426624:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:1.0:1780340748.329892:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340748.330051:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940426624:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 185us (1202us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340748.330057:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1248 00000100:00100000:1.0:1780340748.336666:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340748.336710:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340748.336801:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340748.336969:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940426752 00000100:00100000:0.0:1780340748.336979:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940426752 00000100:00100000:0.0:1780340748.337052:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1269 00000100:00100000:3.0:1780340748.337062:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940427008 00000100:00100000:0.0:1780340748.337063:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940426752:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340748.337068:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940427008 00000100:00100000:3.0:1780340748.337104:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940426880 00000100:00100000:3.0:1780340748.337108:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940426880 00000100:00100000:3.0:1780340748.337132:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2502 00000100:00100000:0.0:1780340748.337144:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940426752:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 81us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340748.337145:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2410:x1866818940427008:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340748.337158:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1269 00000100:00100000:3.0:1780340748.337190:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2410:x1866818940427008:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 50us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340748.337198:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2502 00000100:00100000:3.0:1780340748.337215:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2503 00000100:00100000:3.0:1780340748.337223:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2410:x1866818940426880:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340748.337254:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2410:x1866818940426880:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 27us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340748.337273:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2503 00000100:00080000:1.0:1780340748.337932:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780340748.337938:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340748.337941:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1780340749.194451:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1780340749.196324:0:72681:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1780340749.196339:0:72681:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378734 is committed 00000020:00000080:1.0:1780340749.196345:0:72681:0:(genops.c:906:class_export_put()) final put ffff8c0458280800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780340749.196416:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0458280800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1780340749.196474:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0458287000 for lustre-MDT0001 00010000:00010000:2.0:1780340750.220252:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1780340750.237323:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969453 is committed 00000100:00100000:2.0:1780340750.730158:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961118464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340750.730230:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340750.730330:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961118464 00000100:00100000:0.0:1780340750.730338:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961118464 00000100:00100000:0.0:1780340750.730406:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034 00000100:00100000:0.0:1780340750.730416:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961118464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340750.730442:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340750.730493:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961118464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340750.730499:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034 00000100:00080000:2.0:1780340750.730725:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340750.730779:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961118464:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340750.731365:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961118592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340750.731410:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340750.732041:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961118592 00000100:00100000:1.0:1780340750.732048:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961118592 00000100:00100000:1.0:1780340750.732110:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:1.0:1780340750.732119:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961118592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340750.732143:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340750.732193:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961118592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340750.732217:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00100000:1.0:1780340750.732258:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961118592:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1780340750.732628:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1780340751.242692:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340752.266017:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1780340752.266307:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340752.266312:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340752.266317:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340752.266324:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3527 00000100:00080000:3.0:1780340752.266330:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1780340752.266336:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340752.266356:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c048583f480 x1866818961118848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340752.266394:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340752.266398:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340752.266399:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340752.266403:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3527 00000100:00080000:3.0:1780340752.266406:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1780340752.266409:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340752.266419:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c048583ca80 x1866818961119104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340752.266446:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340752.266449:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340752.266451:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340752.266455:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3527 00000100:00080000:3.0:1780340752.266457:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1780340752.266461:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340752.266499:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c048583d880 x1866818961119360/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340752.266519:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340752.266522:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340752.266524:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340752.266538:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3527 00000100:00080000:3.0:1780340752.266541:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1780340752.266544:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340752.266554:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c048583c700 x1866818961119744/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340752.266581:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961119488:0@lo:400:kworker.0 00000100:00100000:3.0:1780340752.266639:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340752.266674:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340752.266680:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961119232:0@lo:400:kworker.0 00000100:00100000:3.0:1780340752.266703:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340752.266743:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961119488 00000100:00100000:3.0:1780340752.266749:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961119488 00000100:00100000:3.0:1780340752.266820:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2504 00000100:00100000:3.0:1780340752.266828:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961119488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340752.266884:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961119488:12345-0@lo:400:kworker.0 Request processed in 57us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340752.266891:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2504 00000100:00100000:3.0:1780340752.266911:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961119232 00000100:00100000:3.0:1780340752.266915:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961119232 00000100:00100000:3.0:1780340752.266939:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:3.0:1780340752.266945:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961119232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340752.266995:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961119232:12345-0@lo:400:kworker.0 Request processed in 50us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340752.267002:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:3.0:1780340752.267039:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961119232:0@lo:400:kworker.0 00000100:00100000:3.0:1780340752.267050:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961119488:0@lo:400:kworker.0 00000100:00080000:2.0:1780340752.267149:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340752.267154:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340752.267165:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961118848:0@lo:38:kworker.0 00000100:00100000:2.0:1780340752.267193:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340752.267218:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961119104:0@lo:38:kworker.0 00000100:00100000:2.0:1780340752.267236:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340752.267249:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961119360:0@lo:38:kworker.0 00000100:00100000:2.0:1780340752.267272:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340752.267287:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961119744:0@lo:38:kworker.0 00000100:00100000:2.0:1780340752.267313:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340752.267340:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961119360 00000100:00100000:2.0:1780340752.267343:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961119360 00000100:00100000:2.0:1780340752.267363:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3826 00000100:00100000:2.0:1780340752.267367:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961119360:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340752.267384:0:26074:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340752.267412:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961119360:12345-0@lo:38:kworker.0 Request processed in 44us (139us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340752.267418:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3826 00000100:00100000:2.0:1780340752.267435:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961118848 00000100:00100000:2.0:1780340752.267438:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961118848 00000100:00100000:2.0:1780340752.267451:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961119104 00000100:00100000:2.0:1780340752.267453:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961119104 00000100:00100000:2.0:1780340752.267462:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961119744 00000100:00100000:2.0:1780340752.267464:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961119744 00000100:00100000:2.0:1780340752.267486:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:2.0:1780340752.267489:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961118848:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340752.267499:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340752.267523:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961118848:12345-0@lo:38:kworker.0 Request processed in 33us (329us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340752.267529:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:2.0:1780340752.267540:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:2.0:1780340752.267544:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961119104:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340752.267553:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340752.267576:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961119104:12345-0@lo:38:kworker.0 Request processed in 30us (338us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340752.267581:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:2.0:1780340752.267599:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:2.0:1780340752.267603:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961119744:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340752.267611:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340752.267631:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961119744:12345-0@lo:38:kworker.0 Request processed in 27us (317us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340752.267636:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00080000:2.0:1780340752.267662:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340752.267666:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340752.267670:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961118848:0@lo:38:kworker.0 00000100:00080000:2.0:1780340752.267676:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340752.267679:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340752.267682:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961119104:0@lo:38:kworker.0 00000100:00080000:2.0:1780340752.267687:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340752.267690:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340752.267692:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961119360:0@lo:38:kworker.0 00000100:00080000:2.0:1780340752.267699:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340752.267702:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340752.267704:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961119744:0@lo:38:kworker.0 00000100:00100000:0.0:1780340752.268384:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961118976:0@lo:400:kworker.0 00000100:00100000:0.0:1780340752.268419:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340752.268446:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1780340752.268452:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961118720:0@lo:400:kworker.0 00000400:00000100:0.0:1780340752.268483:0:3662:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961118720 offset 0 length 224: 4 00000100:00100000:0.0:1780340752.268504:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961119616:0@lo:400:kworker.0 00000100:00100000:0.0:1780340752.268522:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340752.268562:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961118976 00000100:00100000:0.0:1780340752.268567:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961118976 00000100:00100000:0.0:1780340752.268599:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:0.0:1780340752.268604:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961118976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340752.268640:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961118976:12345-0@lo:400:kworker.0 Request processed in 36us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340752.268646:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:0.0:1780340752.268667:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961119616 00000100:00100000:0.0:1780340752.268671:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961119616 00000100:00100000:0.0:1780340752.268697:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2505 00000100:00100000:0.0:1780340752.268703:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961119616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340752.268731:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961119616:12345-0@lo:400:kworker.0 Request processed in 28us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340752.268736:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2505 00000100:00080000:0.0:1780340752.268753:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340752.268756:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340752.268797:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961119616:0@lo:400:kworker.0 00000100:00100000:0.0:1780340752.268805:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961118976:0@lo:400:kworker.0 00010000:00010000:0.0:1780340753.289938:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340753.454916:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000400:00000100:0.0:1780340753.454957:0:3652:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940427136 offset 0 length 224: 4 00000100:00100000:0.0:1780340753.454979:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340753.455005:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340753.455036:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340753.455376:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940427648 00000100:00100000:3.0:1780340753.455387:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940427648 00000100:00100000:3.0:1780340753.455442:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940427520 00000100:00100000:3.0:1780340753.455445:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940427520 00000100:00100000:3.0:1780340753.455477:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2506 00000100:00100000:3.0:1780340753.455487:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2407:x1866818940427648:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340753.455554:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2407:x1866818940427648:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 69us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340753.455560:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2506 00000100:00100000:3.0:1780340753.455574:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2507 00000100:00100000:3.0:1780340753.455580:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940427520:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340753.455601:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940427520:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 22us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340753.455607:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2507 00000100:00100000:2.0:1780340753.455883:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940427392 00000100:00100000:2.0:1780340753.455888:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940427392 00000100:00100000:2.0:1780340753.455925:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940427264 00000100:00100000:2.0:1780340753.455928:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940427264 00000100:00100000:2.0:1780340753.455944:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1272 00000100:00100000:2.0:1780340753.455952:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940427392:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340753.455984:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940427392:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 33us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340753.456002:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1272 00000100:00100000:2.0:1780340753.456016:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1252 00000100:00100000:2.0:1780340753.456021:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2406:x1866818940427264:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:2.0:1780340753.456040:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340753.456064:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2406:x1866818940427264:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 42us (1027us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340753.456070:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1252 00000100:00080000:0.0:1780340753.458947:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340753.458957:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340753.458960:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1780340754.314139:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340755.339778:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340755.850515:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961119872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340755.850581:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340755.850735:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961119872 00000100:00100000:3.0:1780340755.850744:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961119872 00000100:00100000:3.0:1780340755.850830:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:3.0:1780340755.850839:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961119872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340755.850880:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1780340755.851494:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340755.856317:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03484f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961120000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340755.856390:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340755.856478:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961120000 00000100:00100000:0.0:1780340755.856485:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961120000 00000100:00100000:0.0:1780340755.856531:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037 00000100:00100000:0.0:1780340755.856549:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961120000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340755.856575:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780340755.862875:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961119872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 12028us (12284us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340755.862890:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00080000:3.0:1780340755.862957:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340755.863905:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961119872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340755.873875:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961120000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 17324us (17474us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340755.873889:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037 00000100:00100000:1.0:1780340755.884902:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03484f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961120000:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1780340756.362224:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780340757.386832:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340757.386839:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340757.386843:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340757.386850:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3532 00000100:00080000:2.0:1780340757.386855:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780340757.386861:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340757.386880:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155d180 x1866818961120256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340757.386913:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340757.386916:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340757.386918:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340757.386931:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3532 00000100:00080000:2.0:1780340757.386934:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00100000:3.0:1780340757.387216:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961120128:0@lo:400:kworker.0 00000400:00000100:3.0:1780340757.387262:0:3660:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961120128 offset 0 length 224: 4 00000100:00080000:2.0:1780340757.387566:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340757.387584:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155e300 x1866818961120512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340757.387601:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340757.387604:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340757.387605:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340757.387609:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3532 00000100:00080000:2.0:1780340757.387612:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780340757.387615:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340757.387624:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155dc00 x1866818961120768/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340757.387655:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340757.387658:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340757.387660:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340757.387663:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3532 00000100:00080000:2.0:1780340757.387666:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1780340757.387669:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340757.387680:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155ea00 x1866818961121152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340757.387701:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961120256:0@lo:38:kworker.0 00000100:00100000:2.0:1780340757.387738:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340757.387783:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961120512:0@lo:38:kworker.0 00000100:00100000:2.0:1780340757.387814:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340757.387831:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961120768:0@lo:38:kworker.0 00000100:00100000:2.0:1780340757.387853:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340757.387868:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961121152:0@lo:38:kworker.0 00000100:00100000:2.0:1780340757.387898:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340757.387926:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961120384:0@lo:400:kworker.0 00000100:00100000:1.0:1780340757.388090:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961120896:0@lo:400:kworker.0 00000100:00100000:1.0:1780340757.388121:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340757.388143:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340757.388149:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961121024:0@lo:400:kworker.0 00000100:00100000:1.0:1780340757.388169:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340757.388193:0:25497:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961120896 00000100:00100000:1.0:1780340757.388200:0:25497:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961120896 00000100:00100000:1.0:1780340757.388242:0:25497:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961121024 00000100:00100000:1.0:1780340757.388245:0:25497:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961121024 00000100:00100000:1.0:1780340757.388267:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2508 00000100:00100000:1.0:1780340757.388275:0:25497:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961120896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340757.388328:0:25497:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961120896:12345-0@lo:400:kworker.0 Request processed in 55us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340757.388335:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2508 00000100:00100000:1.0:1780340757.388349:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2509 00000100:00100000:1.0:1780340757.388354:0:25497:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961121024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340757.388377:0:25497:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961121024:12345-0@lo:400:kworker.0 Request processed in 23us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340757.388383:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2509 00000100:00100000:1.0:1780340757.388428:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961121024:0@lo:400:kworker.0 00000100:00100000:1.0:1780340757.388454:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961120896:0@lo:400:kworker.0 00000100:00100000:2.0:1780340757.388559:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340757.388586:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780340757.388592:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961120640:0@lo:400:kworker.0 00000100:00100000:2.0:1780340757.388612:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340757.388640:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961120256 00000100:00100000:2.0:1780340757.388644:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961120256 00000100:00100000:2.0:1780340757.388659:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961120512 00000100:00100000:2.0:1780340757.388661:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961120512 00000100:00100000:2.0:1780340757.388668:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961121152 00000100:00100000:2.0:1780340757.388670:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961121152 00000100:00100000:2.0:1780340757.388676:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961120384 00000100:00100000:2.0:1780340757.388678:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961120384 00000100:00100000:2.0:1780340757.388694:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961120640 00000100:00100000:2.0:1780340757.388697:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961120640 00000100:00100000:2.0:1780340757.388710:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:2.0:1780340757.388716:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961120384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340757.388750:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961120384:12345-0@lo:400:kworker.0 Request processed in 33us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340757.388756:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:2.0:1780340757.388796:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:2.0:1780340757.388803:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961120640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340757.388841:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961120640:12345-0@lo:400:kworker.0 Request processed in 39us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340757.388847:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:2.0:1780340757.388860:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:2.0:1780340757.388865:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961120256:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340757.388881:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340757.388912:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961120256:12345-0@lo:38:kworker.0 Request processed in 46us (1174us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340757.388918:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00100000:2.0:1780340757.388928:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:2.0:1780340757.388932:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961120512:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1780340757.389155:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:3.0:1780340757.389161:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961121152:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780340757.389172:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340757.389204:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961121152:12345-0@lo:38:kworker.0 Request processed in 43us (1305us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340757.389209:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00080000:3.0:1780340757.389230:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780340757.389233:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340757.389235:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00020000:2.0:1780340757.389495:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340757.389522:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961120512:12345-0@lo:38:kworker.0 Request processed in 589us (1708us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340757.389528:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:2.0:1780340757.389548:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961120768 00000100:00100000:2.0:1780340757.389552:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961120768 00000100:00100000:2.0:1780340757.389580:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3827 00000100:00100000:2.0:1780340757.389584:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961120768:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340757.389592:0:8410:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340757.389616:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961120768:12345-0@lo:38:kworker.0 Request processed in 31us (1763us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340757.389621:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3827 00000100:00100000:2.0:1780340757.389650:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961120640:0@lo:400:kworker.0 00000100:00100000:2.0:1780340757.389669:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961120384:0@lo:400:kworker.0 00000100:00080000:2.0:1780340757.389693:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340757.389697:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340757.389700:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961120256:0@lo:38:kworker.0 00000100:00080000:2.0:1780340757.389707:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340757.389710:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340757.389713:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961120512:0@lo:38:kworker.0 00000100:00080000:2.0:1780340757.389719:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340757.389722:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340757.389724:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961120768:0@lo:38:kworker.0 00000100:00080000:2.0:1780340757.389730:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340757.389732:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340757.389735:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961121152:0@lo:38:kworker.0 00010000:00010000:3.0:1780340757.392598:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340758.412556:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340758.584309:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340758.585275:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000400:00000100:0.0:1780340758.585310:0:3653:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940427776 offset 0 length 224: 4 00000100:00100000:0.0:1780340758.585331:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340758.585370:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340758.585404:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940428032 00000100:00100000:0.0:1780340758.585414:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940428032 00000100:00100000:0.0:1780340758.585487:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940427904 00000100:00100000:0.0:1780340758.585490:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940427904 00000100:00100000:0.0:1780340758.585511:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1275 00000100:00100000:0.0:1780340758.585532:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940428032:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340758.585598:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940428032:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 68us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340758.585606:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1275 00000100:00100000:2.0:1780340758.585807:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940428288 00000100:00100000:2.0:1780340758.585812:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940428288 00000100:00100000:2.0:1780340758.585844:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940428160 00000100:00100000:2.0:1780340758.585847:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940428160 00000100:00100000:2.0:1780340758.585866:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2510 00000100:00100000:2.0:1780340758.585873:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2407:x1866818940428288:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340758.585901:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2407:x1866818940428288:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 29us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340758.585906:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2510 00000100:00100000:2.0:1780340758.585919:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2511 00000100:00100000:2.0:1780340758.585924:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940428160:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340758.585955:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940428160:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 31us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340758.585961:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2511 00000100:00100000:0.0:1780340758.586294:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1256 00000100:00100000:0.0:1780340758.586299:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1866818940427904:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:0.0:1780340758.586320:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340758.586347:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1866818940427904:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 47us (976us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340758.586354:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1256 00000100:00080000:0.0:1780340758.586371:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340758.586375:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340758.586377:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1780340759.434179:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1780340759.643724:0:3654:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940428416 offset 0 length 520: 4 00000100:00100000:2.0:1780340759.643783:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340759.643825:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340759.643850:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340759.643893:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340759.643942:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940428800 00000100:00100000:2.0:1780340759.643952:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940428800 00000100:00100000:2.0:1780340759.644008:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940428928 00000100:00100000:3.0:1780340759.644013:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940428544 00000100:00100000:3.0:1780340759.644018:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940428544 00000100:00100000:2.0:1780340759.644039:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940428928 00000100:00100000:3.0:1780340759.644049:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940428672 00000100:00100000:3.0:1780340759.644059:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940428672 00000100:00100000:2.0:1780340759.644074:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2512 00000100:00100000:2.0:1780340759.644086:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940428800:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340759.644097:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1276 00000100:00100000:3.0:1780340759.644108:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940428672:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340759.644161:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940428800:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 77us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340759.644162:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940428672:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 56us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340759.644177:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2512 00000100:00100000:3.0:1780340759.644178:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1276 00000100:00100000:2.0:1780340759.644198:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2513 00000100:00100000:2.0:1780340759.644205:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2407:x1866818940428928:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340759.644210:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1257 00000100:00100000:3.0:1780340759.644216:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1866818940428544:12345-192.168.203.16@tcp:38:kworker.0 00000100:00100000:2.0:1780340759.644234:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2407:x1866818940428928:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 30us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340759.644244:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2513 00010000:00020000:3.0:1780340759.644264:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340759.644321:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1866818940428544:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 97us (532us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340759.644328:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1257 00010000:00010000:2.0:1780340760.464517:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340760.970022:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961121280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340760.970097:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340760.970177:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961121280 00000100:00100000:1.0:1780340760.970185:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961121280 00000100:00100000:1.0:1780340760.970260:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038 00000100:00100000:1.0:1780340760.970269:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961121280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340760.970304:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340760.970352:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961121280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340760.970360:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038 00000100:00080000:2.0:1780340760.970424:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340760.970465:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961121280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340760.970905:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961121408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340760.970939:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340760.971008:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961121408 00000100:00100000:1.0:1780340760.971013:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961121408 00000100:00100000:1.0:1780340760.971058:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00100000:1.0:1780340760.971065:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961121408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780340760.971084:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780340760.971119:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961121408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340760.971125:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00080000:2.0:1780340760.971173:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340760.971197:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961121408:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1780340761.481935:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340762.506973:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1780340762.507431:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340762.507438:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340762.507443:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340762.507452:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3537 00000100:00080000:1.0:1780340762.507459:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1780340762.507468:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340762.507498:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03498ed880 x1866818961121664/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340762.507541:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340762.507544:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340762.507546:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340762.507550:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3537 00000100:00080000:1.0:1780340762.507553:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1780340762.507556:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340762.507569:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155ea00 x1866818961121920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340762.507606:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340762.507610:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340762.507612:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340762.507615:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3537 00000100:00080000:1.0:1780340762.507618:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1780340762.507623:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340762.507635:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155e300 x1866818961122176/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340762.507657:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340762.507661:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340762.507662:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340762.507666:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3537 00000100:00080000:1.0:1780340762.507669:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1780340762.507672:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340762.507683:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155ca80 x1866818961122560/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340762.507982:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961121792:0@lo:400:kworker.0 00000100:00100000:3.0:1780340762.508058:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340762.508105:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1780340762.508112:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961121536:0@lo:400:kworker.0 00000400:00000100:3.0:1780340762.508132:0:3660:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961121536 offset 0 length 224: 4 00000100:00100000:3.0:1780340762.508152:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961122432:0@lo:400:kworker.0 00000100:00100000:3.0:1780340762.508172:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340762.508198:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961122048:0@lo:400:kworker.0 00000100:00100000:3.0:1780340762.508218:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340762.508235:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340762.508240:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961122304:0@lo:400:kworker.0 00000100:00100000:3.0:1780340762.508273:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340762.508311:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961121792 00000100:00100000:3.0:1780340762.508318:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961121792 00000100:00100000:3.0:1780340762.508369:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961122048 00000100:00100000:3.0:1780340762.508373:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961122048 00000100:00100000:3.0:1780340762.508407:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1780340762.508415:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961121792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340762.508466:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961121792:12345-0@lo:400:kworker.0 Request processed in 51us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340762.508483:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1780340762.508500:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:3.0:1780340762.508506:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961122048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340762.508536:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961122048:12345-0@lo:400:kworker.0 Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340762.508541:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:3.0:1780340762.508594:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961121792:0@lo:400:kworker.0 00000100:00100000:3.0:1780340762.508625:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961122048:0@lo:400:kworker.0 00000100:00100000:0.0:1780340762.508853:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961122432 00000100:00100000:0.0:1780340762.508867:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961122432 00000100:00100000:0.0:1780340762.508900:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961122304 00000100:00100000:0.0:1780340762.508902:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961122304 00000100:00100000:0.0:1780340762.508928:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2514 00000100:00100000:0.0:1780340762.508935:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961122432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340762.508974:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961122432:12345-0@lo:400:kworker.0 Request processed in 40us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340762.508980:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2514 00000100:00100000:0.0:1780340762.508993:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2515 00000100:00100000:0.0:1780340762.508998:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961122304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340762.509026:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961122304:12345-0@lo:400:kworker.0 Request processed in 29us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340762.509041:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2515 00000100:00100000:0.0:1780340762.509085:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961122432:0@lo:400:kworker.0 00000100:00100000:0.0:1780340762.509105:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961122304:0@lo:400:kworker.0 00000100:00100000:3.0:1780340762.510809:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961121664:0@lo:38:kworker.0 00000100:00100000:3.0:1780340762.510884:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340762.510921:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961121920:0@lo:38:kworker.0 00000100:00100000:3.0:1780340762.510944:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340762.510975:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961122176:0@lo:38:kworker.0 00000100:00100000:3.0:1780340762.510998:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340762.511016:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961122560:0@lo:38:kworker.0 00000100:00100000:3.0:1780340762.511047:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1780340762.512731:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340762.512740:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340762.512744:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340762.512779:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961122176 00000100:00100000:2.0:1780340762.512792:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961122176 00000100:00100000:2.0:1780340762.512863:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828 00000100:00100000:2.0:1780340762.512873:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961122176:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340762.512900:0:8411:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340762.512991:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961122176:12345-0@lo:38:kworker.0 Request processed in 118us (1991us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340762.512998:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828 00000100:00080000:2.0:1780340762.513054:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340762.513059:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340762.513063:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961122176:0@lo:38:kworker.0 00000100:00100000:0.0:1780340762.513609:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961121664 00000100:00100000:0.0:1780340762.513615:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961121664 00000100:00100000:0.0:1780340762.513643:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961121920 00000100:00100000:0.0:1780340762.513647:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961121920 00000100:00100000:0.0:1780340762.513665:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961122560 00000100:00100000:0.0:1780340762.513668:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961122560 00000100:00100000:0.0:1780340762.513680:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:0.0:1780340762.513685:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961121664:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340762.513698:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340762.513741:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961121664:12345-0@lo:38:kworker.0 Request processed in 54us (2857us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340762.513746:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:0.0:1780340762.513783:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:0.0:1780340762.513787:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961121920:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340762.513796:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340762.513820:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961121920:12345-0@lo:38:kworker.0 Request processed in 32us (2876us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340762.513826:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:0.0:1780340762.513836:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1780340762.513840:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961122560:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340762.513849:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340762.513882:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961122560:12345-0@lo:38:kworker.0 Request processed in 40us (2835us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340762.513888:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00080000:0.0:1780340762.513917:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340762.513922:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340762.513925:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961121664:0@lo:38:kworker.0 00000100:00080000:0.0:1780340762.513934:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340762.513937:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340762.513940:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961121920:0@lo:38:kworker.0 00000100:00080000:0.0:1780340762.513948:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340762.513952:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340762.513955:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961122560:0@lo:38:kworker.0 00000100:00000400:3.0:1780340763.001854:0:3662:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780340747/real 1780340747] req@ffff8c034933aa00 x1866818961116800/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780340763 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340763.001884:0:3662:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8c034933aa00 x1866818961116800/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780340763 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780340763.001892:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1780340763.001906:0:3662:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1780340763.001910:0:3662:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.116@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1780340763.001921:0:3662:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1780340763.001926:0:3662:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c034933aa00 x1866818961116800/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780340763 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340763.001933:0:3662:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c048583d180 x1866818961118720/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340768 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340763.001941:0:3662:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c047155ed80 x1866818961120128/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340773 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340763.001950:0:3662:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c03498ee680 x1866818961121536/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340778 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1780340763.001958:0:3662:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1780340763.001961:0:3662:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1780340763.001962:0:3662:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1780340763.001974:0:3662:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:3.0:1780340763.002017:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961118720:0@lo:400:kworker.0 00000100:00100000:3.0:1780340763.002024:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961116800:0@lo:400:kworker.0 00000100:00100000:0.0:1780340763.002168:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961121536:0@lo:400:kworker.0 00000100:00100000:0.0:1780340763.002176:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961120128:0@lo:400:kworker.0 00000100:00080000:1.0:1780340763.002403:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340763.002408:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1780340763.002410:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340763.002415:0:71335:0:(import.c:512:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 3480 00000100:00080000:1.0:1780340763.002422:0:71335:0:(import.c:626:import_select_connection()) MGC192.168.203.116@tcp: import ffff8c0475490800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340763.002448:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155d880 x1866818961122688/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340763.003066:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961122688:0@lo:250:kworker.0 00000400:00000100:0.0:1780340763.003113:0:3658:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961122688 offset 0 length 520: 4 00010000:00010000:0.0:1780340763.529865:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340764.554013:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340764.713000:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340764.713075:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340764.713110:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340764.713214:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340764.713249:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940429440 00000100:00100000:0.0:1780340764.713259:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940429440 00000100:00100000:2.0:1780340764.713373:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940429056 00000100:00100000:2.0:1780340764.713387:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940429056 00000100:00100000:2.0:1780340764.713436:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940429184 00000100:00100000:2.0:1780340764.713440:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940429184 00000100:00100000:1.0:1780340764.713538:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1261 00000100:00100000:1.0:1780340764.713548:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940429056:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:1.0:1780340764.713573:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340764.713636:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940429056:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 88us (649us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340764.713643:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1261 00000100:00100000:3.0:1780340764.713832:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940429312 00000100:00100000:3.0:1780340764.713837:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940429312 00000100:00100000:0.0:1780340764.715299:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2516 00000100:00100000:0.0:1780340764.715331:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2409:x1866818940429440:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340764.715417:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2409:x1866818940429440:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 92us (2306us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340764.715425:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2516 00000100:00100000:2.0:1780340764.723718:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1279 00000100:00100000:2.0:1780340764.723739:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940429184:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340764.723839:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940429184:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 109us (10763us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340764.723847:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1279 00000100:00100000:3.0:1780340764.725027:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2517 00000100:00100000:3.0:1780340764.725041:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940429312:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340764.725116:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940429312:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 79us (11901us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340764.725124:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2517 00000100:00080000:1.0:1780340764.728551:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780340764.728561:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780340764.728564:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1780340765.578137:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340766.091349:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961122816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340766.091436:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340766.091527:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961122816 00000100:00100000:1.0:1780340766.091535:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961122816 00000100:00100000:1.0:1780340766.091609:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040 00000100:00100000:1.0:1780340766.091618:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961122816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780340766.091646:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780340766.091695:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961122816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340766.091702:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040 00000100:00100000:1.0:1780340766.091745:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961122816:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1780340766.092066:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340766.092744:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780340766.092793:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961122944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340766.092850:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340766.093256:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961122944 00000100:00100000:3.0:1780340766.093265:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961122944 00000100:00100000:3.0:1780340766.093325:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041 00000100:00100000:3.0:1780340766.093336:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961122944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340766.093361:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340766.093432:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961122944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340766.093439:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041 00000100:00100000:3.0:1780340766.093496:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961122944:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1780340766.093752:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1780340766.602871:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340767.631973:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780340768.138592:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340768.138604:0:80497:0:(pinger.c:249:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1780340768.138607:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340768.138611:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340768.138615:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340768.138624:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3542 00000100:00080000:2.0:1780340768.138629:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340768.138637:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340768.138674:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047218df80 x1866818961123072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340768.138717:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340768.138732:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340768.138734:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340768.138738:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3542 00000100:00080000:2.0:1780340768.138740:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340768.138743:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340768.138755:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047218ce00 x1866818961123328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340768.138799:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340768.138802:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340768.138803:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340768.138807:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3542 00000100:00080000:2.0:1780340768.138809:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340768.138813:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340768.138824:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047218d180 x1866818961123584/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340768.140230:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780340768.140253:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961123200:0@lo:400:kworker.0 00000100:00100000:1.0:1780340768.140321:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961123072:0@lo:38:kworker.0 00000100:00100000:3.0:1780340768.140743:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961123456:0@lo:400:kworker.0 00000100:00100000:3.0:1780340768.140827:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1780340768.142082:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1780340768.142371:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961123712:0@lo:400:kworker.0 00000100:00080000:2.0:1780340768.142616:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340768.142620:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340768.142626:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3542 00000100:00080000:2.0:1780340768.142630:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340768.142638:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340768.142695:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0485a28e00 x1866818961123968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340768.143098:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340768.143999:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961123712 00000100:00100000:2.0:1780340768.144023:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961123712 00000100:00100000:2.0:1780340768.144112:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2518 00000100:00100000:2.0:1780340768.144123:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961123712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340768.144197:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961123712:12345-0@lo:400:kworker.0 Request processed in 76us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340768.144205:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2518 00000100:00100000:3.0:1780340768.144553:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780340768.144600:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340768.144645:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961123712:0@lo:400:kworker.0 00000100:00100000:0.0:1780340768.149048:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961123456 00000100:00100000:0.0:1780340768.149068:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961123456 00000100:00100000:0.0:1780340768.149174:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:0.0:1780340768.149187:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961123456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340768.149306:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961123456:12345-0@lo:400:kworker.0 Request processed in 122us (8478us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340768.149314:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00080000:2.0:1780340768.149507:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340768.149631:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961123328:0@lo:38:kworker.0 00000100:00100000:3.0:1780340768.149674:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340768.150031:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961123584:0@lo:38:kworker.0 00000100:00100000:3.0:1780340768.150074:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340768.150096:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961123968:0@lo:38:kworker.0 00000100:00100000:3.0:1780340768.150119:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340768.158233:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961123072 00000100:00100000:0.0:1780340768.158250:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961123072 00000100:00100000:0.0:1780340768.158312:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961123328 00000100:00100000:0.0:1780340768.158316:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961123328 00000100:00100000:0.0:1780340768.158340:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1780340768.158360:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961123072:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340768.158385:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340768.158484:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961123072:12345-0@lo:38:kworker.0 Request processed in 133us (13930us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340768.158491:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:0.0:1780340768.158508:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:0.0:1780340768.158513:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961123328:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340768.158530:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340768.158561:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961123328:12345-0@lo:38:kworker.0 Request processed in 46us (8887us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340768.158566:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00080000:3.0:1780340768.159059:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340768.159068:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340768.159072:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961123072:0@lo:38:kworker.0 00000100:00080000:3.0:1780340768.159086:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340768.159090:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340768.159092:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961123328:0@lo:38:kworker.0 00000100:00100000:0.0:1780340768.159241:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961123968 00000100:00100000:0.0:1780340768.159247:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961123968 00000100:00100000:0.0:1780340768.159279:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1780340768.159284:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961123968:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340768.159296:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340768.159365:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961123584 00000100:00100000:3.0:1780340768.159369:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961123584 00000100:00100000:3.0:1780340768.159400:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3829 00000100:00100000:3.0:1780340768.159416:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961123584:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780340768.159427:0:8410:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340768.162009:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961123968:12345-0@lo:38:kworker.0 Request processed in 2714us (11879us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340768.162023:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:3.0:1780340768.162266:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961123584:12345-0@lo:38:kworker.0 Request processed in 2858us (12189us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340768.162274:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3829 00000100:00100000:3.0:1780340768.162302:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340768.162317:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961123840:0@lo:400:kworker.0 00000100:00100000:3.0:1780340768.162382:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340768.162427:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961123840 00000100:00100000:3.0:1780340768.162433:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961123840 00000100:00100000:3.0:1780340768.162480:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2519 00000100:00100000:3.0:1780340768.162488:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961123840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340768.162539:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961123840:12345-0@lo:400:kworker.0 Request processed in 52us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340768.162545:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2519 00000100:00100000:3.0:1780340768.162582:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961123840:0@lo:400:kworker.0 00000100:00100000:3.0:1780340768.162728:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1780340768.162757:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340768.162877:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961123456:0@lo:400:kworker.0 00000100:00100000:0.0:1780340768.163322:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961123200 00000100:00100000:0.0:1780340768.163328:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961123200 00000100:00100000:0.0:1780340768.163388:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:0.0:1780340768.163395:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961123200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340768.163505:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961123200:12345-0@lo:400:kworker.0 Request processed in 110us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340768.163512:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:3.0:1780340768.163709:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961123200:0@lo:400:kworker.0 00000100:00080000:3.0:1780340768.163732:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340768.172752:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340768.174041:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340768.174048:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961123584:0@lo:38:kworker.0 00000100:00080000:2.0:1780340768.174078:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340768.174081:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340768.174084:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961123968:0@lo:38:kworker.0 00000020:01000004:0.0:1780340768.417252:0:87334:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1780340768.417257:0:87334:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1780340768.417259:0:87334:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1780340768.417381:0:87334:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8c046b9ae000 00000020:01000004:0.0:1780340768.417398:0:87334:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1780340768.417485:0:87334:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1780340768.417499:0:87334:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8c0471d54d40) 00000020:00000080:0.0:1780340768.417516:0:87334:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1780340768.546499:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1780340768.548149:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1780340768.554625:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1780340768.555148:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1780340768.560269:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1780340768.561140:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1780340768.561597:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1780340768.561965:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1780340768.562219:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1780340768.562914:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1780340768.563679:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1780340768.564712:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1780340768.565177:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1780340768.565604:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1780340768.565986:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1780340768.566240:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1780340768.566928:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1780340768.567597:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1780340768.568497:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1780340768.569545:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1780340768.569993:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1780340768.570251:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1780340768.570653:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1780340768.571097:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1780340768.571576:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1780340768.571932:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1780340768.572128:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1780340768.572631:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1780340768.573820:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1780340768.574861:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1780340768.576061:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1780340768.576531:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1780340768.576951:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1780340768.577343:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1780340768.584188:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1780340768.584966:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1780340768.585173:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1780340768.585642:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1780340768.586195:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1780340768.586576:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1780340768.587049:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1780340768.587580:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1780340768.588131:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1780340768.590569:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1780340768.592057:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1780340768.593317:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1780340768.593787:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1780340768.595704:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1780340768.597405:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1780340768.597718:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1780340768.598445:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1780340768.598709:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1780340768.599443:0:87334:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:1.0:1780340768.601092:0:87334:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1780340768.601728:0:87334:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1780340768.601737:0:87334:0:(osd_handler.c:8933:osd_obd_connect()) connect #0 00000020:00000080:1.0:1780340768.602103:0:87334:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2465143277435a 00000020:01000004:1.0:1780340768.602112:0:87334:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1780340768.602124:0:87334:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1780340768.602130:0:87334:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c046b9ae000 from MGS 00000020:01000004:1.0:1780340768.602134:0:87334:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1780340768.602144:0:87334:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8c0445ba19c0) 00000020:00000080:1.0:1780340768.602157:0:87334:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1780340768.602223:0:87334:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c046b9ae000 from MGS, refs=2 00080000:01000000:1.0:1780340768.602238:0:87334:0:(osd_handler.c:8933:osd_obd_connect()) connect #1 00000020:00000080:1.0:1780340768.602245:0:87334:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432774368 00010000:00010000:1.0:1780340768.602731:0:87334:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1780340768.613359:0:87334:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1780340768.617486:0:87338:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1780340768.617618:0:87334:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1780340768.617678:0:87334:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1780340768.618582:0:87334:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1780340768.619045:0:87334:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1780340768.619205:0:87334:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1780340768.619211:0:87334:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1780340768.620827:0:87334:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1780340768.620836:0:87334:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1780340768.624631:0:87334:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1780340768.624644:0:87334:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1780340768.625309:0:87334:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1780340768.625333:0:87334:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1780340768.625340:0:87334:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.116@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1780340768.625344:0:87334:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.116@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1780340768.625359:0:87334:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8c0475490800 already not connected (conn 62, was 0): CONNECTING 00000100:00100000:2.0:1780340768.625364:0:87334:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00010000:00010000:0.0:1780340768.650011:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340768.808331:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340768.808380:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340768.808412:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340768.808478:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940429824 00000100:00100000:2.0:1780340768.808488:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940429824 00000100:00100000:2.0:1780340768.808555:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1282 00000100:00100000:2.0:1780340768.808564:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940429824:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340768.808650:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940429824:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 86us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340768.808658:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1282 00000100:00080000:2.0:1780340768.808681:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340768.809208:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340768.809241:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340768.809298:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940429696 00000100:00100000:0.0:1780340768.809303:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940429696 00000100:00100000:0.0:1780340768.809334:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1265 00000100:00100000:0.0:1780340768.809340:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1866818940429696:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:0.0:1780340768.809370:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340768.809404:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1866818940429696:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 63us (162us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340768.809411:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1265 00000100:00100000:0.0:1780340768.809452:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940429568 00000100:00100000:0.0:1780340768.809456:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940429568 00000100:00100000:0.0:1780340768.809475:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:0.0:1780340768.809480:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044dad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2406:x1866818940429568:12345-192.168.203.16@tcp:250:kworker.0 00010000:00080000:0.0:1780340768.809494:0:87339:0:(ldlm_lib.c:1430:target_handle_connect()) MGS: connection from ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4@192.168.203.16@tcp t0 exp 0000000000000000 cur 3548 last 0 00000020:00000080:0.0:1780340768.809518:0:87339:0:(genops.c:1406:class_connect()) connect: client ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4, cookie 0xa2465143277436f 00000100:00080000:0.0:1780340768.809641:0:87339:0:(import.c:65:import_set_state_nolock()) ffff8c046b9ac000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340768.809675:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044dad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+4:2406:x1866818940429568:12345-192.168.203.16@tcp:250:kworker.0 Request processed in 193us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340768.809681:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 0 00000100:00100000:3.0:1780340768.819325:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940430080 00000100:00100000:3.0:1780340768.819341:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940430080 00000100:00080000:0.0:1780340768.819633:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340768.820641:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940429952 00000100:00100000:3.0:1780340768.820653:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940429952 00000100:00100000:0.0:1780340768.822663:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2520 00000100:00100000:0.0:1780340768.822686:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2410:x1866818940430080:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340768.823268:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2521 00000100:00100000:1.0:1780340768.823282:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940429952:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340768.823316:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940429952:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 39us (14904us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340768.823324:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2521 00000100:00080000:1.0:1780340768.823384:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340768.825608:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2410:x1866818940430080:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 103us (14397us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340768.825631:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2520 00010000:00010000:2.0:1780340769.674475:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340770.600412:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340770.600793:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940430208 00000100:00100000:3.0:1780340770.600808:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940430208 00000100:00100000:3.0:1780340770.600880:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:3.0:1780340770.600893:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044dad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+4:41995:x1866818940430208:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340770.600933:0:87342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340770.600961:0:87342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f8600/0xa24651432774376 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced23c2 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340770.600998:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f8600/0xa24651432774376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23c2 expref: 5 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340770.601010:0:87342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f8600/0xa24651432774376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23c2 expref: 5 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340770.601021:0:87342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8600, rc 0) 00000100:00100000:3.0:1780340770.601096:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044dad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+5:41995:x1866818940430208:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 206us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340770.601103:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1 00000100:00100000:2.0:1780340770.610519:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340770.611977:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940430336 00000100:00100000:3.0:1780340770.611995:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940430336 00000100:00100000:3.0:1780340770.612061:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:3.0:1780340770.612073:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044dad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+5:41995:x1866818940430336:12345-192.168.203.16@tcp:256:ll_cfg_requeue.0 00000100:00100000:3.0:1780340770.612225:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044dad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+5:41995:x1866818940430336:12345-192.168.203.16@tcp:256:ll_cfg_requeue.0 Request processed in 153us (1718us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780340770.612234:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2 00000100:00100000:2.0:1780340770.628569:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340770.628993:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940430464 00000100:00100000:0.0:1780340770.629003:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940430464 00000100:00100000:0.0:1780340770.629055:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:0.0:1780340770.629065:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044dad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+5:41995:x1866818940430464:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340770.629081:0:87339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340770.629107:0:87339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04497b6e00/0xa2465143277437d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced23c9 expref: -99 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340770.629136:0:87339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04497b6e00/0xa2465143277437d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23c9 expref: 6 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340770.629146:0:87339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04497b6e00/0xa2465143277437d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23c9 expref: 6 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340770.629156:0:87339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04497b6e00, rc 0) 00000100:00100000:0.0:1780340770.629222:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044dad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+6:41995:x1866818940430464:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 158us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340770.629230:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 3 00000100:00100000:0.0:1780340770.632306:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340770.632441:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940430592 00000100:00100000:1.0:1780340770.632454:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940430592 00000100:00100000:1.0:1780340770.632518:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:1.0:1780340770.632538:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044dad7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+6:41995:x1866818940430592:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 10000000:01000000:3.0:1780340770.633175:0:87343:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1780340770.633287:0:87342:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 112 20000000:01000000:1.0:1780340770.637970:0:87344:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1780340770.637978:0:87344:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1780340770.637981:0:87344:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1780340770.637983:0:87344:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1780340770.640551:0:87344:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1780340770.640959:0:87342:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1780340770.641037:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044dad7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+7:41995:x1866818940430592:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 8504us (8735us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340770.641047:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 4 00000100:00100000:2.0:1780340770.643618:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340770.644153:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940430720 00000100:00100000:0.0:1780340770.644175:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940430720 00000100:00100000:0.0:1780340770.644229:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:0.0:1780340770.644239:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+7:41995:x1866818940430720:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340770.644386:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+7:41995:x1866818940430720:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 148us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340770.644394:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5 00000100:00100000:2.0:1780340770.649811:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340770.649936:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940430848 00000100:00100000:3.0:1780340770.649960:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940430848 00000100:00100000:3.0:1780340770.650006:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:3.0:1780340770.650015:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+7:41995:x1866818940430848:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340770.650037:0:87342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340770.650056:0:87342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f9e00/0xa24651432774384 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced23d0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340770.650086:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f9e00/0xa24651432774384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23d0 expref: 8 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340770.650098:0:87342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f9e00/0xa24651432774384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23d0 expref: 8 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340770.650106:0:87342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9e00, rc 0) 00000100:00100000:3.0:1780340770.650166:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940430848:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 151us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340770.650173:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6 00000100:00100000:1.0:1780340770.654574:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340770.654735:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940430976 00000100:00100000:2.0:1780340770.654749:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940430976 00000100:00100000:2.0:1780340770.654853:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:2.0:1780340770.654865:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940430976:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340770.655073:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940430976:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 210us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340770.655081:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 7 00000100:00100000:2.0:1780340770.656964:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340770.659821:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940431104 00000100:00100000:0.0:1780340770.660638:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940431104 00000100:00100000:0.0:1780340770.660750:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:0.0:1780340770.660802:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940431104:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340770.661025:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940431104:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 264us (4074us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340770.661034:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 8 00000100:00100000:0.0:1780340770.666687:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340770.666811:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940431232 00000100:00100000:3.0:1780340770.666825:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940431232 00000100:00100000:3.0:1780340770.666907:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:3.0:1780340770.666920:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0470f48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940431232:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340770.666941:0:87342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340770.666964:0:87342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f9600/0xa2465143277438b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced23d7 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340770.667004:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f9600/0xa2465143277438b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23d7 expref: 9 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340770.667016:0:87342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f9600/0xa2465143277438b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23d7 expref: 9 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340770.667046:0:87342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9600, rc 0) 00000100:00100000:3.0:1780340770.667125:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0470f48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:41995:x1866818940431232:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 208us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340770.667132:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 9 00000100:00100000:1.0:1780340770.670316:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340770.670695:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940431360 00000100:00100000:2.0:1780340770.670708:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940431360 00000100:00100000:2.0:1780340770.670801:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 10 00000100:00100000:2.0:1780340770.670813:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0470f4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:41995:x1866818940431360:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340770.670984:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0470f4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:41995:x1866818940431360:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 173us (681us total) trans 0 rc -2/-2 00000100:00100000:2.0:1780340770.670994:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 10 00010000:00010000:2.0:1780340770.698562:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340771.210096:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780340771.210395:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961124096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340771.210502:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340771.211269:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340771.211283:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961124224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340771.211325:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340771.220227:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961124096 00000100:00100000:1.0:1780340771.220255:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961124096 00000100:00100000:1.0:1780340771.220354:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961124224 00000100:00100000:1.0:1780340771.220358:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961124224 00000100:00100000:1.0:1780340771.220398:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:1.0:1780340771.220410:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961124096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780340771.220457:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780340771.220551:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961124096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 145us (10050us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340771.220560:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00000100:00100000:1.0:1780340771.220578:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2043 00000100:00100000:1.0:1780340771.220584:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961124224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340771.220603:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340771.220634:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961124224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (9308us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340771.220640:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2043 00000100:00100000:1.0:1780340771.220702:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961124096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340771.220774:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961124224:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1780340771.223905:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340771.223919:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1780340771.722204:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340772.746906:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1780340773.261559:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340773.261573:0:80497:0:(pinger.c:249:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1780340773.261577:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340773.261582:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340773.261587:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340773.261623:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3548 00000100:00080000:1.0:1780340773.261628:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340773.261640:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340773.261782:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155ed80 x1866818961124352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340773.261868:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961124352:0@lo:38:kworker.0 00000100:00100000:2.0:1780340773.261981:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340773.262114:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961124352 00000100:00100000:0.0:1780340773.262125:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961124352 00000100:00100000:0.0:1780340773.262177:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1780340773.262186:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961124352:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340773.262214:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1780340773.262388:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340773.262393:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340773.262396:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340773.262401:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3548 00000100:00080000:1.0:1780340773.262403:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340773.262408:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340773.262423:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155ea00 x1866818961124608/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340773.262580:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961124608:0@lo:38:kworker.0 00000100:00100000:2.0:1780340773.262623:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340773.262689:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961124352:12345-0@lo:38:kworker.0 Request processed in 502us (708us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340773.262699:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:0.0:1780340773.262718:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961124608 00000100:00100000:0.0:1780340773.262722:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961124608 00000100:00100000:0.0:1780340773.262746:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:0.0:1780340773.262754:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961124608:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340773.262802:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340773.262833:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961124608:12345-0@lo:38:kworker.0 Request processed in 79us (210us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340773.262839:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:0.0:1780340773.262894:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961124480:0@lo:400:kworker.0 00000100:00100000:0.0:1780340773.262943:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340773.262984:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961124480 00000100:00100000:0.0:1780340773.262988:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961124480 00000100:00100000:0.0:1780340773.263036:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:0.0:1780340773.263044:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961124480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340773.263096:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961124480:12345-0@lo:400:kworker.0 Request processed in 53us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340773.263104:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00080000:0.0:1780340773.263123:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340773.263169:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961124480:0@lo:400:kworker.0 00000100:00080000:1.0:1780340773.264582:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340773.264590:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340773.264594:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340773.264604:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3548 00000100:00080000:1.0:1780340773.264613:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340773.264625:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340773.264840:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961124736:0@lo:400:kworker.0 00000100:00100000:0.0:1780340773.264940:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340773.265016:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961124736 00000100:00100000:0.0:1780340773.265024:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961124736 00000100:00100000:0.0:1780340773.265111:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:0.0:1780340773.265120:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961124736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340773.265182:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961124736:12345-0@lo:400:kworker.0 Request processed in 63us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340773.265191:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00080000:0.0:1780340773.265216:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340773.265890:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961124736:0@lo:400:kworker.0 00000100:00100000:1.0:1780340773.267731:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155d180 x1866818961124864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340773.267865:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340773.267871:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340773.267874:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340773.267898:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3548 00000100:00080000:1.0:1780340773.267905:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340773.267914:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340773.267954:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155e300 x1866818961125248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340773.268002:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961125120:0@lo:400:kworker.0 00000100:00100000:1.0:1780340773.268105:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340773.268112:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340773.268230:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961124992:0@lo:400:kworker.0 00000100:00100000:3.0:1780340773.268582:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340773.268797:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961125120 00000100:00100000:1.0:1780340773.268810:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961125120 00000100:00100000:1.0:1780340773.268894:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961124992 00000100:00100000:1.0:1780340773.268898:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961124992 00000100:00100000:1.0:1780340773.268943:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2522 00000100:00100000:1.0:1780340773.268954:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961125120:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1780340773.268982:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340773.268989:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340773.269039:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961125120:12345-0@lo:400:kworker.0 Request processed in 82us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340773.269040:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2523 00000100:00100000:1.0:1780340773.269057:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2522 00000100:00100000:3.0:1780340773.269064:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961124992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340773.269118:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961125120:0@lo:400:kworker.0 00000100:00080000:2.0:1780340773.269519:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340773.269527:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340773.269532:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961124352:0@lo:38:kworker.0 00000100:00100000:2.0:1780340773.269559:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961124864:0@lo:38:kworker.0 00000100:00100000:2.0:1780340773.269610:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340773.269652:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961125248:0@lo:38:kworker.0 00000100:00100000:2.0:1780340773.269780:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340773.269840:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961124864 00000100:00100000:1.0:1780340773.269846:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961124864 00000100:00100000:1.0:1780340773.269875:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3830 00000100:00100000:1.0:1780340773.269883:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961124864:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340773.269908:0:8411:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340773.269961:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961124864:12345-0@lo:38:kworker.0 Request processed in 78us (352us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340773.269967:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3830 00000100:00080000:2.0:1780340773.270543:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340773.270551:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340773.270554:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961124608:0@lo:38:kworker.0 00000100:00080000:2.0:1780340773.270579:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340773.270604:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340773.270608:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961124864:0@lo:38:kworker.0 00000100:00100000:0.0:1780340773.270728:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961125248 00000100:00100000:0.0:1780340773.270734:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961125248 00000100:00100000:0.0:1780340773.270893:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:0.0:1780340773.270900:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961125248:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340773.271013:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340773.271127:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961125248:12345-0@lo:38:kworker.0 Request processed in 226us (1366us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340773.271135:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:3.0:1780340773.271593:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961124992:12345-0@lo:400:kworker.0 Request processed in 2529us (3004us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340773.271607:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2523 00000100:00100000:1.0:1780340773.271822:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961124992:0@lo:400:kworker.0 00000100:00080000:2.0:1780340773.273111:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340773.273122:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340773.273127:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961125248:0@lo:38:kworker.0 00010000:00010000:0.0:1780340773.771749:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340773.934361:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340773.934406:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340773.934446:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340773.934476:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340773.934549:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940431872 00000100:00100000:1.0:1780340773.934567:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940431872 00000100:00100000:3.0:1780340773.934596:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940431488 00000100:00100000:3.0:1780340773.934608:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940431488 00000100:00100000:3.0:1780340773.934673:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:1.0:1780340773.934679:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2524 00000100:00100000:3.0:1780340773.934686:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0470f49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2409:x1866818940431488:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340773.934697:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940431872:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340773.934795:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0470f49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2409:x1866818940431488:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 112us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340773.934804:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 11 00000100:00100000:1.0:1780340773.934827:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940431872:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 134us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340773.934837:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2524 00000100:00080000:1.0:1780340773.934867:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340773.935455:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340773.935516:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940431744 00000100:00100000:2.0:1780340773.935521:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940431744 00000100:00100000:0.0:1780340773.935551:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940431616 00000100:00100000:0.0:1780340773.935560:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940431616 00000100:00100000:0.0:1780340773.935614:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1269 00000100:00100000:0.0:1780340773.935625:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940431616:12345-192.168.203.16@tcp:38:kworker.0 00000100:00100000:1.0:1780340773.935628:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940432000 00000100:00100000:1.0:1780340773.935636:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940432000 00000100:00100000:2.0:1780340773.935693:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1285 00000100:00100000:2.0:1780340773.935701:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940431744:12345-192.168.203.16@tcp:400:kworker.0 00010000:00020000:0.0:1780340773.935721:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340773.935754:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940431744:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 52us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340773.935800:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1285 00000100:00100000:0.0:1780340773.935803:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940431616:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 174us (1448us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340773.935815:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1269 00000100:00080000:3.0:1780340773.938848:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340773.940467:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340773.941219:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2525 00000100:00100000:1.0:1780340773.941233:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2409:x1866818940432000:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340773.941336:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2409:x1866818940432000:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 107us (5885us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340773.941344:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2525 00000100:00100000:3.0:1780340774.282630:0:3658:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780340763/real 1780340763] req@ffff8c047155d880 x1866818961122688/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780340773 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340774.282707:0:3658:0:(client.c:2511:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c047155d880 x1866818961122688/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780340773 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780340774.282734:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340774.282816:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1780340774.282840:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961122688:0@lo:250:kworker.0 00000100:00080000:1.0:1780340774.282908:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340774.282916:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1780340774.282920:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340774.282929:0:80497:0:(import.c:512:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 3542 00000100:00080000:1.0:1780340774.282934:0:80497:0:(import.c:591:import_select_connection()) MGC192.168.203.116@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1780340774.282941:0:80497:0:(import.c:626:import_select_connection()) MGC192.168.203.116@tcp: import ffff8c0475490800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340774.282983:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155f480 x1866818961125376/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340774.283016:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340774.283022:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 10000000:01000000:2.0:1780340774.283033:0:87334:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:1.0:1780340774.283042:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340774.283048:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3553 00000100:00080000:1.0:1780340774.283051:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340774.283056:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00010000:00010000:2.0:1780340774.283060:0:87334:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432773f4e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773f55 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340774.283075:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155dc00 x1866818961125504/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:00010000:2.0:1780340774.283077:0:87334:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432773f4e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773f55 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340774.283092:0:87334:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1780340774.283120:0:87334:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:1.0:1780340774.283138:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340774.283142:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00010000:00010000:2.0:1780340774.283144:0:87334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432773f4e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773f55 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1780340774.283144:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340774.283152:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3553 00000100:00080000:1.0:1780340774.283158:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340774.283175:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00010000:00010000:2.0:1780340774.283180:0:87334:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432773eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773ebb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340774.283190:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155e300 x1866818961125760/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:00010000:2.0:1780340774.283192:0:87334:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432773eb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773ebb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340774.283222:0:87334:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340774.283241:0:87334:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340774.283246:0:87334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432773eb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773ebb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.283259:0:87334:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0453122400/0xa24651432773ed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773ed7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1780340774.283262:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 10000000:00010000:2.0:1780340774.283274:0:87334:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0453122400/0xa24651432773ed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773ed7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1780340774.283275:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340774.283279:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340774.283289:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3553 10000000:01000000:2.0:1780340774.283297:0:87334:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:1.0:1780340774.283297:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340774.283315:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00010000:00010000:2.0:1780340774.283317:0:87334:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340774.283323:0:87334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0453122400/0xa24651432773ed0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773ed7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340774.283330:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155ea00 x1866818961126016/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1780340774.283339:0:87334:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa24651432773efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773f01 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340774.283351:0:87334:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa24651432773efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773f01 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1780340774.283365:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 10000000:01000000:2.0:1780340774.283374:0:87334:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:1.0:1780340774.283375:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340774.283384:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340774.283390:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3553 00010000:00010000:2.0:1780340774.283398:0:87334:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:1.0:1780340774.283398:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00010000:00010000:2.0:1780340774.283408:0:87334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5600/0xa24651432773efa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773f01 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1780340774.283408:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00010000:00010000:2.0:1780340774.283429:0:87334:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773f08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773f0f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340774.283431:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047218c000 x1866818961126400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:00010000:2.0:1780340774.283466:0:87334:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773f08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773f0f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340774.283476:0:87334:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340774.283480:0:87334:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340774.283485:0:87334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4a00/0xa24651432773f08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773f0f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.283497:0:87334:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432773f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773f2b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340774.283497:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961126272:0@lo:400:kworker.0 10000000:00010000:2.0:1780340774.283515:0:87334:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432773f24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773f2b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340774.283522:0:87334:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340774.283527:0:87334:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340774.283531:0:87334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432773f24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773f2b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.283543:0:87334:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4e00/0xa24651432773f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773f39 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340774.283550:0:87334:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4e00/0xa24651432773f32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773f39 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340774.283566:0:87334:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340774.283573:0:87334:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:1.0:1780340774.283578:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1780340774.283582:0:87334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4e00/0xa24651432773f32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773f39 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.283596:0:87334:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432773f5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773f63 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340774.283603:0:87334:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432773f5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773f63 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340774.283608:0:87334:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340774.283613:0:87334:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340774.283617:0:87334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432773f5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773f63 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340774.283620:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340774.283633:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961125632:0@lo:400:kworker.0 00010000:00010000:2.0:1780340774.283638:0:87334:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432773ec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773ec9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340774.283648:0:87334:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432773ec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773ec9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340774.283655:0:87334:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340774.283660:0:87334:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340774.283665:0:87334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432773ec2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773ec9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340774.283672:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1780340774.283701:0:87334:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04722ae400/0xa24651432773ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773ee5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340774.283722:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961126144:0@lo:400:kworker.0 10000000:00010000:2.0:1780340774.283725:0:87334:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04722ae400/0xa24651432773ede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773ee5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340774.283741:0:87334:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340774.283746:0:87334:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340774.283752:0:87334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04722ae400/0xa24651432773ede lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773ee5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340774.283789:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340774.283822:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1780340774.283828:0:87334:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04722afa00/0xa24651432773eec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773ef3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340774.283833:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961125888:0@lo:400:kworker.0 10000000:00010000:2.0:1780340774.283853:0:87334:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04722afa00/0xa24651432773eec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773ef3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340774.283859:0:87334:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1780340774.283866:0:87334:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340774.283871:0:87334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04722afa00/0xa24651432773eec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773ef3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340774.283883:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1780340774.283897:0:87334:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0453122200/0xa24651432773f16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773f1d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340774.283905:0:87334:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0453122200/0xa24651432773f16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773f1d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340774.283911:0:87334:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1780340774.283917:0:87334:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340774.283921:0:87334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0453122200/0xa24651432773f16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773f1d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.283946:0:87334:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0453123800/0xa24651432773f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432773f47 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340774.283954:0:87334:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0453123800/0xa24651432773f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432773f47 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340774.283958:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961126272 10000000:01000000:2.0:1780340774.283962:0:87334:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1780340774.283968:0:87334:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00100000:1.0:1780340774.283969:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961126272 00010000:00010000:2.0:1780340774.283973:0:87334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0453123800/0xa24651432773f40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432773f47 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1780340774.284003:0:87334:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8c0475490800 already not connected (conn 63, was 0): CONNECTING 00000100:00080000:2.0:1780340774.284009:0:87334:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:1.0:1780340774.284026:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961126144 00000100:00100000:1.0:1780340774.284032:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961126144 00000100:00100000:2.0:1780340774.284046:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961125632 00000100:00100000:2.0:1780340774.284055:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961125632 00000100:00100000:1.0:1780340774.284065:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2526 00000100:00100000:1.0:1780340774.284077:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961126272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340774.284118:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961125888 00000100:00100000:2.0:1780340774.284123:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961125888 00000100:00100000:1.0:1780340774.284144:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961126272:12345-0@lo:400:kworker.0 Request processed in 65us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340774.284157:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2526 00000100:00100000:2.0:1780340774.284163:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:2.0:1780340774.284176:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961125632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340774.284186:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527 00000100:00100000:1.0:1780340774.284197:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961126144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340774.284328:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:0.0:1780340774.284340:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961125888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340774.284680:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961125376:0@lo:250:kworker.0 00000100:00100000:1.0:1780340774.288608:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961126144:12345-0@lo:400:kworker.0 Request processed in 4406us (4810us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340774.288621:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527 00000100:00100000:1.0:1780340774.288695:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961126144:0@lo:400:kworker.0 00000100:00100000:1.0:1780340774.288733:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961126272:0@lo:400:kworker.0 00000100:00100000:2.0:1780340774.294871:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961125632:12345-0@lo:400:kworker.0 Request processed in 10685us (11191us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340774.294892:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00100000:2.0:1780340774.294990:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961125632:0@lo:400:kworker.0 00000100:00100000:3.0:1780340774.304617:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340774.304697:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961125504:0@lo:38:kworker.0 00000100:00100000:3.0:1780340774.304755:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340774.304802:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961125760:0@lo:38:kworker.0 00000100:00100000:3.0:1780340774.304826:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340774.304871:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961125504 00000100:00100000:3.0:1780340774.304881:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961125504 00000100:00100000:3.0:1780340774.304927:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961125760 00000100:00100000:3.0:1780340774.304930:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961125760 00000100:00100000:3.0:1780340774.304958:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:3.0:1780340774.304968:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961125504:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1780340774.304977:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:2.0:1780340774.304986:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961125760:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780340774.304999:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:2.0:1780340774.305002:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340774.305055:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961125504:12345-0@lo:38:kworker.0 Request processed in 86us (297us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340774.305063:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:2.0:1780340774.305068:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961125760:12345-0@lo:38:kworker.0 Request processed in 81us (240us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340774.305077:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00080000:3.0:1780340774.305122:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340774.305128:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340774.305132:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961125760:0@lo:38:kworker.0 00000100:00100000:3.0:1780340774.305146:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961126016:0@lo:38:kworker.0 00000100:00100000:3.0:1780340774.305192:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340774.305224:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961126400:0@lo:38:kworker.0 00000100:00100000:3.0:1780340774.305252:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340774.305256:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961126016 00000100:00100000:2.0:1780340774.305262:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961126016 00000100:00100000:3.0:1780340774.305275:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961126400 00000100:00100000:3.0:1780340774.305279:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961126400 00000100:00100000:2.0:1780340774.305296:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3831 00000100:00100000:3.0:1780340774.305316:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:2.0:1780340774.305321:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961126016:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1780340774.305328:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961126400:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780340774.305341:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:2.0:1780340774.305348:0:8410:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340774.305508:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961125376 00000100:00100000:1.0:1780340774.305513:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961125376 00000100:00100000:1.0:1780340774.305539:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1780340774.305545:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444a90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3658:x1866818961125376:12345-0@lo:250:kworker.0 00010000:00080000:1.0:1780340774.305563:0:87342:0:(ldlm_lib.c:1430:target_handle_connect()) MGS: connection from f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo t0 exp 0000000000000000 cur 3554 last 0 00000020:00000080:1.0:1780340774.305598:0:87342:0:(genops.c:1406:class_connect()) connect: client f26f7947-2bb0-4491-8dd4-005fa8e64f3a, cookie 0xa24651432774392 00000100:00080000:1.0:1780340774.305778:0:87342:0:(import.c:65:import_set_state_nolock()) ffff8c046b968000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340774.310723:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961126016:12345-0@lo:38:kworker.0 Request processed in 5382us (5508us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340774.310745:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3831 00000100:00100000:1.0:1780340774.311095:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444a90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:3658:x1866818961125376:12345-0@lo:250:kworker.0 Request processed in 5545us (6489us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340774.311108:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1780340774.311120:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.116@tcp: connect to target with instance 0 10000000:01000000:2.0:1780340774.311137:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:02000400:2.0:1780340774.311144:0:3658:0:(import.c:1286:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0xa24651432774392 00000100:00100000:3.0:1780340774.317652:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961126400:12345-0@lo:38:kworker.0 Request processed in 12310us (12384us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340774.317671:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:0.0:1780340774.318541:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961125888:12345-0@lo:400:kworker.0 Request processed in 34198us (34661us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340774.318553:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00080000:2.0:1780340774.321060:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:2.0:1780340774.321080:0:3658:0:(import.c:1675:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:2.0:1780340774.321693:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961125376:0@lo:250:kworker.0 00000100:00080000:2.0:1780340774.321721:0:87334:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished EVICTED, rc = 0 00000020:01000004:2.0:1780340774.321743:0:87334:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1780340774.321852:0:87334:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1780340774.321860:0:87334:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1780340774.322009:0:87334:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1780340774.322056:0:87334:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.116@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1780340774.322061:0:87334:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1780340774.322063:0:87334:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1780340774.322065:0:87334:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340774.322066:0:87334:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340774.322067:0:87334:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340774.322072:0:87334:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340774.322073:0:87334:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780340774.322074:0:87334:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1780340774.322076:0:87334:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340774.322078:0:87334:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1780340774.322080:0:87334:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1780340774.322083:0:87334:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1780340774.322084:0:87334:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1780340774.322085:0:87334:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340774.322086:0:87334:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340774.322087:0:87334:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340774.322088:0:87334:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340774.322089:0:87334:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780340774.322090:0:87334:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1780340774.322090:0:87334:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340774.322091:0:87334:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1780340774.322126:0:87334:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1780340774.322146:0:87334:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04438bc780 going to sleep for 0 seconds 00000100:00100000:2.0:1780340774.322153:0:87334:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961126528:0@lo:253:mount.lustre.0 00000020:00080000:2.0:1780340774.322171:0:87334:0:(tgt_mount.c:1425:server_register_target()) lustre-MDT0000: error registering with the MGS: rc = -108 (not fatal) 00000020:01000004:2.0:1780340774.322184:0:87334:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c046b9ae000 from lustre-MDT0000 10000000:01000000:2.0:1780340774.322222:0:87334:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1780340774.322225:0:87334:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1780340774.322244:0:87334:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c046b9ae000 10000000:01000000:2.0:1780340774.322250:0:87334:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1780340774.322254:0:87334:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c046b9ae000 10000000:01000000:2.0:1780340774.322257:0:87334:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1780340774.322261:0:87334:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8c046b9ae000 from 1 10000000:01000000:2.0:1780340774.322264:0:87334:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1780340774.322296:0:87334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774399 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.322316:0:87334:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774399 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.322338:0:87334:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774399 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340774.322349:0:87334:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acd8300 going to sleep for 0 seconds 00000100:00100000:2.0:1780340774.322353:0:87334:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961126656:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780340774.322364:0:87334:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774399 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.322372:0:87334:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774399 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.322380:0:87334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774399 lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.322388:0:87334:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774399 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.322397:0:87334:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774399 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.322405:0:87334:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a200 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:2.0:1780340774.322409:0:87334:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774399 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.322417:0:87334:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774399 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120e400000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340774.322424:0:87334:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774399 lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120f400000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340774.322436:0:87334:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340774.322440:0:87334:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1780340774.322447:0:87334:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774399 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.322456:0:87334:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774399 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340774.322478:0:87334:0:(mgc_request.c:1816:mgc_process_log()) Can't get cfg lock: -108 00000100:00080000:2.0:1780340774.322482:0:87334:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:EVICTED 00000100:00080000:2.0:1780340774.322553:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340774.322559:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340774.322563:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961125504:0@lo:38:kworker.0 00000100:00080000:2.0:1780340774.322575:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340774.322578:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340774.322581:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961126016:0@lo:38:kworker.0 00000100:00080000:2.0:1780340774.322593:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340774.322597:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340774.322600:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961126400:0@lo:38:kworker.0 00000100:00080000:2.0:1780340774.322638:0:87346:0:(import.c:1599:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.203.116@tcp to MGS@0@lo 00000100:00100000:2.0:1780340774.322642:0:87346:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1780340774.322645:0:87346:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000100:00080000:2.0:1780340774.322658:0:87346:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:2.0:1780340774.322663:0:87346:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from RECOVER to FULL 10000000:01000000:2.0:1780340774.322665:0:87346:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 10000000:01000000:2.0:1780340774.322690:0:87334:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8c046b9ae000 from 1 10000000:01000000:2.0:1780340774.322698:0:87334:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1780340774.322714:0:87334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa246514327743a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.322722:0:87334:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa246514327743a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.322730:0:87334:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa246514327743a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340774.322745:0:87334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961126784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780340774.322853:0:87334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340774.322891:0:87334:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acd8300 going to sleep for 11 seconds 00000100:00080000:2.0:1780340774.322909:0:87346:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:2.0:1780340774.322912:0:87346:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) MGC192.168.203.116@tcp: Connection restored to 0@lo (at 0@lo) 00000020:01000000:2.0:1780340774.323318:0:80497:0:(tgt_mount.c:1581:tgt_import_update()) NID #0: 192.168.203.116@tcp 10000000:01000000:2.0:1780340774.323334:0:80497:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1780340774.323337:0:80497:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1780340774.323339:0:80497:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1780340774.323340:0:80497:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340774.323342:0:80497:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340774.323343:0:80497:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340774.323344:0:80497:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340774.323345:0:80497:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780340774.323347:0:80497:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340774.323348:0:80497:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1780340774.323371:0:80497:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1780340774.323378:0:80497:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1780340774.323381:0:80497:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1780340774.323382:0:80497:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1780340774.323383:0:80497:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340774.323385:0:80497:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340774.323386:0:80497:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340774.323387:0:80497:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340774.323388:0:80497:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780340774.323398:0:80497:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340774.323399:0:80497:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1780340774.323412:0:80497:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1780340774.323418:0:80497:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1780340774.323419:0:80497:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1780340774.323421:0:80497:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1780340774.323422:0:80497:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340774.323423:0:80497:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340774.323424:0:80497:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340774.323425:0:80497:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340774.323427:0:80497:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780340774.323428:0:80497:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340774.323429:0:80497:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1780340774.323440:0:80497:0:(tgt_mount.c:1592:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1780340774.323465:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961127296:0@lo:253:kworker.0 00000100:00100000:2.0:1780340774.323507:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340774.323529:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780340774.323535:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961126912:0@lo:400:kworker.0 00000100:00100000:2.0:1780340774.323557:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340774.323596:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961127040:0@lo:253:kworker.0 00000100:00100000:2.0:1780340774.323622:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340774.323632:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780340774.323637:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961127168:0@lo:253:kworker.0 00000100:00100000:2.0:1780340774.323661:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340774.323682:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961126784 00000100:00100000:2.0:1780340774.323690:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961126784 00000100:00100000:2.0:1780340774.323730:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961127296 00000100:00100000:2.0:1780340774.323733:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961127296 00000100:00100000:2.0:1780340774.323742:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961126912 00000100:00100000:2.0:1780340774.323744:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961126912 00000100:00100000:2.0:1780340774.323752:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961127040 00000100:00100000:2.0:1780340774.323755:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961127040 00000100:00100000:2.0:1780340774.323798:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961127168 00000100:00100000:2.0:1780340774.323806:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961127168 00000100:00100000:2.0:1780340774.323824:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1780340774.323832:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444a91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:87334:x1866818961126784:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780340774.323847:0:87342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340774.323866:0:87342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a32ae00/0xa246514327743a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327743a0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.323894:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a32ae00/0xa246514327743a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327743a0 expref: 9 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.323905:0:87342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a32ae00/0xa246514327743a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327743a0 expref: 9 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.323914:0:87342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32ae00, rc 0) 00000100:00100000:2.0:1780340774.323955:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444a91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:87334:x1866818961126784:12345-0@lo:101:mount.lustre.0 Request processed in 123us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340774.323962:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1780340774.324005:0:87334:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961126784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780340774.324018:0:87334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa246514327743a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327743a7 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.324027:0:87334:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa246514327743a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327743a7 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340774.324039:0:87334:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1780340774.324043:0:87334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa246514327743a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327743a7 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.324050:0:87334:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa246514327743a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327743a7 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340774.324064:0:87334:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1780340774.324068:0:87334:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1780340774.324074:0:87334:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c046b9ae000 10000000:01000000:2.0:1780340774.324076:0:87334:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1780340774.324080:0:87334:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1780340774.324082:0:87334:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1780340774.324098:0:87334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32a800/0xa246514327743ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.324106:0:87334:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a32a800/0xa246514327743ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.324113:0:87334:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a32a800/0xa246514327743ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340774.324125:0:87334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961127424:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780340774.324149:0:87334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340774.324164:0:87334:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acd8300 going to sleep for 11 seconds 00000100:00100000:2.0:1780340774.324184:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961127424 00000100:00100000:2.0:1780340774.324187:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961127424 00000100:00100000:2.0:1780340774.324202:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1780340774.324207:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444a91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:3659:x1866818961127296:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1780340774.324230:0:87342:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1780340774.324248:0:87342:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1780340774.327569:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1780340774.327601:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0453169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:3659:x1866818961126912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340774.327737:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0453169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:3659:x1866818961126912:12345-0@lo:400:kworker.0 Request processed in 155us (4178us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340774.327746:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1780340774.327829:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1780340774.327836:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:3661:x1866818961127040:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1780340774.327874:0:87341:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:3.0:1780340774.327926:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961126912:0@lo:400:kworker.0 00000100:00100000:1.0:1780340774.334282:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961125888:0@lo:400:kworker.0 20000000:01000000:2.0:1780340774.336158:0:87342:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1780340774.336185:0:87342:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1780340774.336369:0:87341:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1780340774.337210:0:87343:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1780340774.337219:0:87343:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1780340774.337250:0:87343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c047a8b3000/0xa246514327743b5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.337283:0:87343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c03476f8600/0xa24651432774376 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23c2 expref: 8 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.337293:0:87343:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c047a8b3000/0xa246514327743b5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.337401:0:87343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c03476f8600/0xa24651432774376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23c2 expref: 8 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.337419:0:87343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c03476f8600/0xa24651432774376 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23c2 expref: 8 pid: 87342 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340774.337446:0:87343:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87343:1866818961127552:192.168.203.16@tcp:104: 00000100:00100000:0.0:1780340774.337749:0:87343:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0447b68e40 going to sleep for 11 seconds 00000100:00100000:2.0:1780340774.341756:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444a91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:3659:x1866818961127296:12345-0@lo:253:kworker.0 Request processed in 17534us (18234us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340774.341830:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1780340774.341894:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1780340774.341909:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3661:x1866818961127168:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1780340774.341951:0:87342:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:3.0:1780340774.342113:0:3659:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1780340774.342117:0:3659:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1780340774.342118:0:3659:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780340774.342125:0:3659:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780340774.342127:0:3659:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780340774.342129:0:3659:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780340774.342130:0:3659:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780340774.342132:0:3659:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780340774.342134:0:3659:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1780340774.342138:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961127296:0@lo:253:kworker.0 20000000:01000000:0.0:1780340774.343653:0:87341:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1780340774.343662:0:87341:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1780340774.343985:0:87342:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1780340774.344580:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3661:x1866818961127040:12345-0@lo:253:kworker.0 Request processed in 16737us (20950us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340774.344594:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1780340774.344651:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1780340774.344663:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:87334:x1866818961127424:12345-0@lo:101:mount.lustre.0 00000020:01000004:2.0:1780340774.344675:0:3661:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1780340774.344679:0:3661:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1780340774.344680:0:3661:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00010000:00010000:0.0:1780340774.344680:0:87341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:01000004:2.0:1780340774.344681:0:3661:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340774.344683:0:3661:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340774.344684:0:3661:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340774.344685:0:3661:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780340774.344688:0:3661:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340774.344689:0:3661:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1780340774.344692:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961127040:0@lo:253:kworker.0 00010000:00010000:0.0:1780340774.344701:0:87341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04497b7000/0xa246514327743bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327743ae expref: -99 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.344734:0:87341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04497b7000/0xa246514327743bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327743ae expref: 7 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.344747:0:87341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04497b7000/0xa246514327743bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327743ae expref: 7 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.344776:0:87341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04497b7000, rc 0) 00000100:00100000:0.0:1780340774.344815:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:87334:x1866818961127424:12345-0@lo:101:mount.lustre.0 Request processed in 156us (20665us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340774.344821:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1780340774.345247:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340774.346659:0:87334:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961127424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780340774.346689:0:87334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c047a32a800/0xa246514327743ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327743bc expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.346704:0:87334:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c047a32a800/0xa246514327743ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327743bc expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340774.348139:0:25499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940432128 00000100:00100000:0.0:1780340774.348157:0:25499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940432128 00010000:00010000:0.0:1780340774.348210:0:25499:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c03476f8600/0xa24651432774376 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23c2 expref: 9 pid: 87342 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340774.348278:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2547 00000100:00100000:0.0:1780340774.348288:0:25499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940432128:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780340774.348315:0:25499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340774.348321:0:25499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c03476f8600/0xa24651432774376 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23c2 expref: 9 pid: 87342 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.348337:0:25499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c03476f8600/0xa24651432774376 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23c2 expref: 9 pid: 87342 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.348377:0:25499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c047a8b3000/0xa246514327743b5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.348386:0:25499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a8b3000/0xa246514327743b5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1780340774.348406:0:25499:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011188519s 00010000:00010000:0.0:1780340774.348411:0:25499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c047a8b3000/0xa246514327743b5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.348419:0:25499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c047a8b3000/0xa246514327743b5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.348427:0:25499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c047a8b3000/0xa246514327743b5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.348434:0:25499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c047a8b3000/0xa246514327743b5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.348440:0:25499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b3000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340774.348450:0:25499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c047a8b3000/0xa246514327743b5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.348461:0:25499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c047a8b3000/0xa246514327743b5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.348470:0:25499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c047a8b3000/0xa246514327743b5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.348480:0:25499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340774.348543:0:25499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940432128:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 256us (3299us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340774.348551:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2547 00000100:00100000:2.0:1780340774.351519:0:87334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961127680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780340774.352337:0:87334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340774.352401:0:87334:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acd8300 going to sleep for 11 seconds 00000100:00100000:2.0:1780340774.352442:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961127680 00000100:00100000:2.0:1780340774.352452:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961127680 00000100:00100000:2.0:1780340774.352525:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1780340774.352667:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:87334:x1866818961127680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780340774.353159:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:87334:x1866818961127680:12345-0@lo:501:mount.lustre.0 Request processed in 493us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340774.353168:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1780340774.354428:0:87334:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961127680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780340774.354518:0:87334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961127808:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780340774.354598:0:87334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340774.354637:0:87334:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acd8300 going to sleep for 11 seconds 00000100:00100000:2.0:1780340774.354656:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961127808 00000100:00100000:2.0:1780340774.354662:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961127808 00000100:00100000:2.0:1780340774.354697:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1780340774.354705:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:87334:x1866818961127808:12345-0@lo:503:mount.lustre.0 00010000:00010000:0.0:1780340774.356218:0:87343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f8600/0xa24651432774376 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23c2 expref: 8 pid: 87342 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340774.356242:0:87343:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87343:1866818961127552:192.168.203.16@tcp:104: 00010000:00010000:0.0:1780340774.356263:0:87343:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c047a8b3000/0xa246514327743b5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.356285:0:87343:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c047a8b3000/0xa246514327743b5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.356292:0:87343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c047a8b3000/0xa246514327743b5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.356298:0:87343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a8b3000/0xa246514327743b5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1780340774.357920:0:87342:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1780340774.357937:0:87342:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1780340774.358223:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:3661:x1866818961127168:12345-0@lo:253:kworker.0 Request processed in 16316us (34555us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340774.358455:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:87334:x1866818961127808:12345-0@lo:503:mount.lustre.0 Request processed in 3749us (3856us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340774.358478:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1780340774.358574:0:87334:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961127808:0@lo:503:mount.lustre.0 20000000:01000000:0.0:1780340774.358740:0:87343:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1780340774.358747:0:87343:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1780340774.358789:0:87343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c04497b7c00/0xa246514327743c3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.358808:0:87343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04497b7c00/0xa246514327743c3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1780340774.358941:0:3661:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1780340774.358944:0:3661:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1780340774.358946:0:3661:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780340774.358947:0:3661:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780340774.358949:0:3661:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780340774.358950:0:3661:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780340774.358952:0:3661:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780340774.358954:0:3661:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780340774.358955:0:3661:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1780340774.358959:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961127168:0@lo:253:kworker.0 00000100:00100000:2.0:1780340774.359046:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 20000000:01000000:0.0:1780340774.359937:0:87343:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011188519s 00010000:00010000:0.0:1780340774.359947:0:87343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c04497b7c00/0xa246514327743c3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.359960:0:87343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c04497b7c00/0xa246514327743c3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.359968:0:87343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c04497b7c00/0xa246514327743c3 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.359978:0:87343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c04497b7c00/0xa246514327743c3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.359986:0:87343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04497b7c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340774.359992:0:87343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c04497b7c00/0xa246514327743c3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.360002:0:87343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c04497b7c00/0xa246514327743c3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.360045:0:87343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c04497b7c00/0xa246514327743c3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.360054:0:87343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c04497b7c00/0xa246514327743c3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.360062:0:87343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04497b7c00/0xa246514327743c3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340774.360731:0:87347:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87347:1866818961127936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340774.361076:0:87347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340774.361158:0:87347:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acd8240 going to sleep for 11 seconds 00000100:00100000:2.0:1780340774.364169:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961127936 00000100:00100000:2.0:1780340774.364200:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961127936 00000100:00100000:2.0:1780340774.364285:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1780340774.364298:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:87347:x1866818961127936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340774.373062:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:87347:x1866818961127936:12345-0@lo:502:llog_process_th.0 Request processed in 8755us (11975us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340774.373079:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1780340774.373229:0:87347:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87347:1866818961127936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1780340774.373280:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780340774.373295:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340774.373298:0:87347:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1780340774.373314:0:87347:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1780340774.373319:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1780340774.373341:0:87347:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8c0471d519c0) 00000020:00000080:0.0:1780340774.373372:0:87347:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:0.0:1780340774.373378:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1780340774.373508:0:87347:0:(osd_handler.c:8933:osd_obd_connect()) connect #2 00000020:00000080:0.0:1780340774.373516:0:87347:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa246514327743d1 00000020:00000080:0.0:1780340774.373854:0:87347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1780340774.373859:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780340774.373863:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340774.373865:0:87347:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1780340774.373868:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780340774.373871:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340774.373881:0:87347:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1780340774.373885:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1780340774.373895:0:87347:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8c0471d53380) 00000020:00000080:0.0:1780340774.373910:0:87347:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:0.0:1780340774.373914:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1780340774.373917:0:87347:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1780340774.373921:0:87347:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1780340774.373930:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1780340774.374214:0:87347:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c046b9ae000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1780340774.374234:0:87347:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8c047ac73380) 00000020:00000080:2.0:1780340774.374247:0:87347:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:2.0:1780340774.374343:0:87347:0:(lod_dev.c:2290:lod_obd_connect()) connect #0 00000020:00000080:2.0:1780340774.374351:0:87347:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa246514327743e6 00000020:00000080:2.0:1780340774.374488:0:87347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1780340774.374496:0:87347:0:(mdd_device.c:1668:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1780340774.374502:0:87347:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa246514327743ed 00080000:01000000:2.0:1780340774.374508:0:87347:0:(osd_handler.c:8933:osd_obd_connect()) connect #3 00000020:00000080:2.0:1780340774.374513:0:87347:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa246514327743f4 00010000:00010000:1.0:1780340774.558319:0:87347:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:1.0:1780340774.558544:0:87347:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: e06e5cf1-1986-4ba7-9630-fad7efb74eca idx: 0 lr: 103079215115 srv lr: 107374182400 lx: 0 gen 22 00000001:00080000:1.0:1780340774.558605:0:87347:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 107374182400 lx: 0 gen 21 00000001:00000004:1.0:1780340774.558631:0:87347:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 107374182400 00000001:00080000:1.0:1780340774.558798:0:87347:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:1.0:1780340774.558888:0:87347:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8c0447b683c0: xid 1866818940419200, transno 107374182407, client gen 22, slot idx 0 00000001:00080000:1.0:1780340774.558900:0:87347:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8c0447b68e40: xid 1866818940418944, transno 107374182406, client gen 22, slot idx 1 00000020:00000080:1.0:1780340774.559487:0:87347:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8c0445ba3380) 00000020:00000080:1.0:1780340774.559515:0:87347:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:1.0:1780340774.559629:0:87347:0:(osd_handler.c:8933:osd_obd_connect()) connect #4 00000020:00000080:1.0:1780340774.559637:0:87347:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432774410 00000020:00000080:1.0:1780340774.575128:0:87347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1780340774.586484:0:87347:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa24651432774417 00000020:00000080:0.0:1780340774.591254:0:87347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1780340774.591274:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780340774.591286:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340774.591289:0:87347:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1780340774.591293:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1780340774.591297:0:87347:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1780340774.591299:0:87347:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1780340774.591301:0:87347:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1780340774.591581:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1780340774.591587:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340774.591589:0:87347:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1780340774.591592:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780340774.591599:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340774.591600:0:87347:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1780340774.591606:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1780340774.591683:0:87347:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1780340774.591706:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780340774.591709:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340774.591711:0:87347:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1780340774.591713:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780340774.591716:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340774.591718:0:87347:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1780340774.591720:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1780340774.591727:0:87347:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:00000080:0.0:1780340774.592474:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1780340774.592517:0:87347:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8c03482b4d40) 00000020:00000080:0.0:1780340774.592547:0:87347:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1780340774.592554:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1780340774.592662:0:87347:0:(osp_dev.c:1197:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1780340774.592669:0:87347:0:(osd_handler.c:8933:osd_obd_connect()) connect #5 00000020:00000080:0.0:1780340774.592677:0:87347:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432774425 00010000:00080000:0.0:1780340774.592726:0:87347:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c034a94d800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:0.0:1780340774.597602:0:87347:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1780340774.603649:0:87347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780340774.603670:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1780340774.603727:0:87347:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1780340774.603752:0:87347:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2465143277442c 00000100:00080000:1.0:1780340774.603804:0:87347:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1780340774.603874:0:87347:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c034a94d800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340774.603926:0:87347:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047218d180 x1866818961128064/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340774.603970:0:87347:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1780340774.604189:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340774.604194:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340774.604197:0:87347:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1780340774.604200:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1780340774.604203:0:87347:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1780340774.604205:0:87347:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780340774.604207:0:87347:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780340774.604209:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1780340774.604211:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340774.604212:0:87347:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1780340774.604215:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1780340774.604221:0:87347:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1780340774.604224:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340774.604226:0:87347:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1780340774.604228:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1780340774.604233:0:87347:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:01000000:1.0:1780340774.604262:0:87347:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1780340774.604264:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780340774.604282:0:87347:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c0445ba0000) 00000100:00100000:2.0:1780340774.604312:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961128064:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1780340774.604313:0:87347:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1780340774.604319:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1780340774.604410:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1780340774.604410:0:87347:0:(osp_dev.c:1197:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1780340774.604416:0:87347:0:(osd_handler.c:8933:osd_obd_connect()) connect #6 00000020:00000080:1.0:1780340774.604422:0:87347:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2465143277443a 00010000:00080000:1.0:1780340774.604459:0:87347:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c044d43a000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:1.0:1780340774.604688:0:87347:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1780340774.606031:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961128064 00000100:00100000:0.0:1780340774.606047:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961128064 00000100:00100000:0.0:1780340774.606102:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3832 00000100:00100000:0.0:1780340774.606113:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961128064:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1780340774.606151:0:8411:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3554 last 0 00000020:00000080:0.0:1780340774.606201:0:8411:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432774441 00000004:00100000:0.0:1780340774.606224:0:8411:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1780340774.606364:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8c0475491800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340774.606466:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1866818961128064:12345-0@lo:38:llog_process_th.0 Request processed in 353us (2055us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340774.606474:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3832 00000100:00100000:2.0:1780340774.607587:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780340774.607603:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:2.0:1780340774.607614:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1780340774.607621:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1780340774.607625:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a94d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1780340774.607639:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961128064:0@lo:38:llog_process_th.0 00000040:01000000:1.0:1780340774.612169:0:87347:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1780340774.612219:0:87347:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1780340774.612321:0:87347:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000100:00100000:3.0:1780340774.613096:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340774.613125:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961128192:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780340774.613601:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340774.613654:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961128192 00000100:00100000:2.0:1780340774.613668:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961128192 00000100:00100000:3.0:1780340774.616209:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833 00000100:00100000:3.0:1780340774.616227:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961128192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780340774.616284:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:3.0:1780340774.616399:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961128192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 177us (2799us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340774.616407:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833 00000100:00100000:3.0:1780340774.623451:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961128192:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1780340774.623839:0:87347:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1780340774.623884:0:87347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].26, 64 off9856 00000040:00080000:3.0:1780340774.624097:0:87347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x68:0x0].1, 64 off8256 00000040:00080000:3.0:1780340774.625469:0:87353:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:3.0:1780340774.625480:0:87353:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1780340774.625723:0:87353:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:3.0:1780340774.626073:0:87353:0:(llog_cat.c:1250:llog_cat_cleanup()) cancel plain log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1780340774.626387:0:87353:0:(llog.c:800:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:3.0:1780340774.626392:0:87353:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1780340774.627086:0:87347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780340774.627099:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1780340774.627145:0:87347:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1780340774.627164:0:87347:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432774448 00000100:00080000:2.0:1780340774.627175:0:87347:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1780340774.627181:0:87347:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c044d43a000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340774.627241:0:87347:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0485a2a680 x1866818961128320/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340774.627282:0:87347:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1780340774.627342:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961128320:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1780340774.627373:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340774.627379:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340774.627380:0:87347:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1780340774.627389:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1780340774.627392:0:87347:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1780340774.627394:0:87347:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1780340774.627395:0:87347:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1780340774.627397:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1780340774.627399:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340774.627400:0:87347:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1780340774.627402:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1780340774.627407:0:87347:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1780340774.627410:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340774.627411:0:87347:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1780340774.627414:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1780340774.627419:0:87347:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000100:00100000:0.0:1780340774.627434:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1780340774.627443:0:87347:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1780340774.627445:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1780340774.627459:0:87347:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c047ac719c0) 00000020:00000080:2.0:1780340774.627478:0:87347:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:2.0:1780340774.627482:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1780340774.627555:0:87347:0:(osp_dev.c:1197:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1780340774.627561:0:87347:0:(osd_handler.c:8933:osd_obd_connect()) connect #7 00000100:00100000:3.0:1780340774.627562:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961128320 00000020:00000080:2.0:1780340774.627568:0:87347:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432774456 00000100:00100000:3.0:1780340774.627570:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961128320 00010000:00080000:2.0:1780340774.627608:0:87347:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c04506d1000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.116@tcp at head 00000100:00100000:3.0:1780340774.627613:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5896 00000100:00100000:3.0:1780340774.627623:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3658:x1866818961128320:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1780340774.627658:0:25488:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3554 last 0 00000020:00000080:3.0:1780340774.627691:0:25488:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2465143277445d 00002000:00100000:3.0:1780340774.627710:0:25488:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c0450113000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211351c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1780340774.627714:0:25488:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1780340774.627717:0:25488:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:2.0:1780340774.627865:0:87347:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1780340774.627954:0:87347:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1780340774.627971:0:87347:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00002000:00080000:3.0:1780340774.634477:0:25488:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1780340774.634532:0:25488:0:(import.c:65:import_set_state_nolock()) ffff8c045310e800 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1780340774.634591:0:87347:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000100:00100000:3.0:1780340774.634648:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3658:x1866818961128320:12345-0@lo:8:llog_process_th.0 Request processed in 7022us (7210us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340774.634659:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5896 00000100:00100000:0.0:1780340774.635433:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1780340774.635446:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1780340774.635456:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1780340774.635463:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1780340774.635467:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c044d43a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1780340774.635496:0:3658:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:0.0:1780340774.635504:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961128320:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1780340774.635625:0:87353:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1780340774.635684:0:87353:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3554624923756ns, next at 0ns, rc = 0 00080000:00080000:3.0:1780340774.635691:0:87353:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1780340774.635994:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961128448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340774.636066:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340774.636319:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961128448 00000100:00100000:2.0:1780340774.636329:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961128448 00000100:00100000:2.0:1780340774.636426:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044 00000100:00100000:2.0:1780340774.636436:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961128448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780340774.636474:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780340774.636536:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961128448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340774.636544:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044 00000100:00080000:3.0:1780340774.637398:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340774.637451:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961128448:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1780340774.637782:0:87347:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1780340774.637819:0:87347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].26, 64 off9856 00000040:00080000:2.0:1780340774.638006:0:87347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6a:0x0].1, 64 off8256 00000004:00080000:0.0:1780340774.639006:0:87335:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:2.0:1780340774.641879:0:87355:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:2.0:1780340774.641887:0:87355:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1780340774.642119:0:87355:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000040:00080000:2.0:1780340774.642145:0:87355:0:(llog_cat.c:1250:llog_cat_cleanup()) cancel plain log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1780340774.642312:0:87355:0:(llog.c:800:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:2.0:1780340774.642316:0:87355:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1780340774.643293:0:87347:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780340774.643318:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1780340774.643373:0:87347:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1780340774.643395:0:87347:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432774464 00000100:00080000:2.0:1780340774.643407:0:87347:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1780340774.643414:0:87347:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c04506d1000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340774.643456:0:87347:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0485a28000 x1866818961128576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340774.643488:0:87347:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1780340774.643573:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961128576:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1780340774.643665:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340774.643843:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961128576 00000100:00100000:1.0:1780340774.643860:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961128576 00000100:00100000:1.0:1780340774.643907:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5897 00000100:00100000:1.0:1780340774.643916:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3658:x1866818961128576:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1780340774.643953:0:25494:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3554 last 0 00000020:00000080:1.0:1780340774.643986:0:25494:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2465143277446b 00002000:00100000:1.0:1780340774.644003:0:25494:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c044d439800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211351c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1780340774.644007:0:25494:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1780340774.644011:0:25494:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1780340774.644095:0:25494:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1780340774.644124:0:25494:0:(import.c:65:import_set_state_nolock()) ffff8c044d43c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780340774.644191:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3658:x1866818961128576:12345-0@lo:8:llog_process_th.0 Request processed in 274us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340774.644199:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5897 00000100:00100000:1.0:1780340774.644243:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1780340774.644251:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1780340774.644259:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1780340774.644265:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1780340774.644267:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c04506d1000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1780340774.644282:0:3658:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:1.0:1780340774.644288:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961128576:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1780340774.644565:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340774.644572:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340774.644574:0:87347:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1780340774.644577:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340774.644582:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340774.644583:0:87347:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1780340774.644586:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1780340774.644588:0:87347:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1780340774.644589:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340774.644600:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340774.644601:0:87347:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1780340774.644604:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340774.644607:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340774.644608:0:87347:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1780340774.644612:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1780340774.644649:0:87347:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87347:1866818961128704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340774.644702:0:87347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340774.644726:0:87347:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0448106240 going to sleep for 11 seconds 00000100:00100000:2.0:1780340774.644744:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961128704 00000100:00100000:2.0:1780340774.644748:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961128704 00000100:00100000:2.0:1780340774.644794:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1780340774.644802:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:87347:x1866818961128704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340774.644910:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:87347:x1866818961128704:12345-0@lo:502:llog_process_th.0 Request processed in 108us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340774.644917:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1780340774.644966:0:87347:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a28000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87347:1866818961128704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780340774.645001:0:87347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340774.645004:0:87347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340774.645006:0:87347:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1780340774.645009:0:87347:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1780340774.645260:0:87334:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1780340774.645285:0:87334:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1780340774.645299:0:87334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32a800/0xa246514327743ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327743bc expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.645323:0:87334:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c047a32a800/0xa246514327743ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327743bc expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340774.645342:0:87334:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c046b9ae000 from 1 10000000:01000000:2.0:1780340774.645345:0:87334:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1780340774.645567:0:87334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.645576:0:87334:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340774.645585:0:87334:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774472 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340774.645599:0:87334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a28000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961128832:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780340774.645631:0:87334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340774.645664:0:87334:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0448106240 going to sleep for 11 seconds 00000004:00080000:2.0:1780340774.645685:0:87355:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1780340774.645750:0:87355:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3554634989612ns, next at 0ns, rc = 0 00080000:00080000:2.0:1780340774.645756:0:87355:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1780340774.645859:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961128832 00000100:00100000:0.0:1780340774.645865:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961128832 00000100:00100000:0.0:1780340774.645898:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1780340774.645906:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:87334:x1866818961128832:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340774.645918:0:87341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340774.645934:0:87341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04497b7c00/0xa24651432774479 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774472 expref: -99 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.645960:0:87341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04497b7c00/0xa24651432774479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774472 expref: 8 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.645970:0:87341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04497b7c00/0xa24651432774479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774472 expref: 8 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.645980:0:87341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04497b7c00, rc 0) 00000100:00100000:0.0:1780340774.646015:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:87334:x1866818961128832:12345-0@lo:101:mount.lustre.0 Request processed in 110us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340774.646022:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1780340774.646061:0:87334:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a28000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961128832:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340774.646075:0:87334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774472 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774479 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.646083:0:87334:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774472 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774479 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340774.646692:0:87334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961128960:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1780340774.646737:0:87334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340774.646789:0:87334:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c044947d300 going to sleep for 11 seconds 00000100:00100000:0.0:1780340774.646812:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961128960 00000100:00100000:0.0:1780340774.646817:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961128960 00000100:00100000:0.0:1780340774.646845:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1780340774.646853:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:87334:x1866818961128960:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1780340774.646871:0:87339:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1780340774.646891:0:87339:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1780340774.646895:0:87339:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1780340774.646899:0:87339:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1780340774.646901:0:87339:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 115 00000100:00100000:0.0:1780340774.646985:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:87334:x1866818961128960:12345-0@lo:256:mount.lustre.0 Request processed in 132us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340774.646992:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1780340774.647032:0:87334:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961128960:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1780340774.647669:0:87334:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1780340774.647680:0:87334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774472 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774479 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.647693:0:87334:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774479 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340774.647702:0:87334:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c046b9ae000 from 1 10000000:01000000:0.0:1780340774.647705:0:87334:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1780340774.647737:0:87334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04497b7400/0xa24651432774480 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.647751:0:87334:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04497b7400/0xa24651432774480 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.647790:0:87334:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04497b7400/0xa24651432774480 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340774.647808:0:87334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961129088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1780340774.647846:0:87334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340774.647865:0:87334:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c044947d300 going to sleep for 11 seconds 00000100:00100000:0.0:1780340774.647888:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961129088 00000100:00100000:0.0:1780340774.647893:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961129088 00000100:00100000:0.0:1780340774.647924:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1780340774.647931:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:87334:x1866818961129088:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340774.647943:0:87342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340774.647956:0:87342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04497b6200/0xa24651432774487 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774480 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.647977:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04497b6200/0xa24651432774487 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774480 expref: 9 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.647987:0:87342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04497b6200/0xa24651432774487 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774480 expref: 9 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.647996:0:87342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04497b6200, rc 0) 00000100:00100000:0.0:1780340774.648024:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:87334:x1866818961129088:12345-0@lo:101:mount.lustre.0 Request processed in 93us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340774.648029:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1780340774.648083:0:87334:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961129088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340774.648096:0:87334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04497b7400/0xa24651432774480 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774487 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.648105:0:87334:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04497b7400/0xa24651432774480 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774487 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340774.648162:0:87334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961129216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780340774.648184:0:87334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340774.648196:0:87334:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c044947d300 going to sleep for 11 seconds 00000100:00100000:0.0:1780340774.648209:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961129216 00000100:00100000:0.0:1780340774.648212:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961129216 00000100:00100000:0.0:1780340774.648232:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1780340774.648237:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:87334:x1866818961129216:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780340774.648361:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:87334:x1866818961129216:12345-0@lo:501:mount.lustre.0 Request processed in 123us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340774.648369:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1780340774.648397:0:87334:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961129216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780340774.648424:0:87334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961129344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780340774.648461:0:87334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340774.648472:0:87334:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1780340774.648483:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961129344 00000100:00100000:0.0:1780340774.648486:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961129344 00000100:00100000:0.0:1780340774.648504:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1780340774.648509:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:87334:x1866818961129344:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780340774.648579:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:87334:x1866818961129344:12345-0@lo:503:mount.lustre.0 Request processed in 69us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340774.648591:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1780340774.648627:0:87334:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961129344:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780340774.649388:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340774.649405:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961129472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340774.649459:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340774.649508:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961129472 00000100:00100000:3.0:1780340774.649514:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961129472 00000100:00100000:3.0:1780340774.649565:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045 00000100:00100000:3.0:1780340774.649573:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961129472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340774.649602:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340774.649643:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961129472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340774.649649:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045 00000100:00080000:3.0:1780340774.649668:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340774.649704:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961129472:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1780340774.653363:0:87335:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1780340774.658601:0:87357:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87357:1866818961129600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340774.658722:0:87357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340774.658989:0:87357:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8840 going to sleep for 11 seconds 00000100:00100000:2.0:1780340774.659064:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961129600 00000100:00100000:2.0:1780340774.659075:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961129600 00000100:00100000:2.0:1780340774.659142:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1780340774.659154:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:87357:x1866818961129600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340774.659736:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:87357:x1866818961129600:12345-0@lo:502:llog_process_th.0 Request processed in 583us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340774.659745:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1780340774.660001:0:87357:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87357:1866818961129600:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780340774.660041:0:87357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780340774.660053:0:87357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340774.660056:0:87357:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1780340774.660065:0:87357:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c046b9ae000 00000020:00000080:1.0:1780340774.660068:0:87357:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1780340774.660085:0:87357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340774.660088:0:87357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340774.660089:0:87357:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1780340774.660092:0:87357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780340774.660094:0:87357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340774.660096:0:87357:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1780340774.660099:0:87357:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c046b9ae000 00000020:00000080:1.0:1780340774.660101:0:87357:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1780340774.663097:0:87357:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87357:1866818961129728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340774.663379:0:87357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340774.663436:0:87357:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0448106780 going to sleep for 11 seconds 00000100:00100000:0.0:1780340774.664444:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961129728 00000100:00100000:0.0:1780340774.664457:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961129728 00000100:00100000:0.0:1780340774.664519:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1780340774.664528:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:87357:x1866818961129728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340774.664693:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:87357:x1866818961129728:12345-0@lo:502:llog_process_th.0 Request processed in 165us (1314us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340774.664701:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1780340774.664991:0:87357:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87357:1866818961129728:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780340774.665033:0:87357:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340774.665044:0:87357:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340774.665046:0:87357:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1780340774.665052:0:87357:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1780340774.666013:0:87334:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1780340774.666053:0:87334:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1780340774.666077:0:87334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04497b7400/0xa24651432774480 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774487 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.666094:0:87334:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04497b7400/0xa24651432774480 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774487 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340774.666163:0:87334:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1780340774.666167:0:87334:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c046b9ae000 10000000:01000000:0.0:1780340774.666170:0:87334:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c046b9ae000 10000000:01000000:0.0:1780340774.666175:0:87334:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1780340774.667444:0:87334:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c046b9ae000 from 1 10000000:01000000:0.0:1780340774.667456:0:87334:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780340774.667516:0:87334:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04497b6400/0xa2465143277448e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.667546:0:87334:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04497b6400/0xa2465143277448e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.667563:0:87334:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04497b6400/0xa2465143277448e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340774.667595:0:87334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961129856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1780340774.667682:0:87334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340774.667732:0:87334:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1780340774.668402:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961129856 00000100:00100000:0.0:1780340774.668416:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961129856 00000100:00100000:0.0:1780340774.668489:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1780340774.668500:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:87334:x1866818961129856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340774.668517:0:87339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340774.668532:0:87339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04497b7e00/0xa24651432774495 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277448e expref: -99 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.668562:0:87339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04497b7e00/0xa24651432774495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277448e expref: 10 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.668575:0:87339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04497b7e00/0xa24651432774495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277448e expref: 10 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.668585:0:87339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04497b7e00, rc 0) 00000100:00100000:0.0:1780340774.668644:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:87334:x1866818961129856:12345-0@lo:101:mount.lustre.0 Request processed in 146us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340774.668652:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1780340774.668721:0:87334:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961129856:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340774.668736:0:87334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04497b6400/0xa2465143277448e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774495 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.668746:0:87334:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04497b6400/0xa2465143277448e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774495 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340774.670360:0:87334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961129984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780340774.670432:0:87334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340774.670480:0:87334:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8840 going to sleep for 11 seconds 00000100:00100000:3.0:1780340774.670943:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961129984 00000100:00100000:3.0:1780340774.670956:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961129984 00000100:00100000:3.0:1780340774.671010:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1780340774.671021:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:87334:x1866818961129984:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780340774.671974:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:87334:x1866818961129984:12345-0@lo:501:mount.lustre.0 Request processed in 949us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340774.671987:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1780340774.673405:0:87334:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961129984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780340774.673487:0:87334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961130112:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780340774.673566:0:87334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340774.673619:0:87334:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8840 going to sleep for 11 seconds 00000100:00100000:1.0:1780340774.673693:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961130112 00000100:00100000:1.0:1780340774.673701:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961130112 00000100:00100000:1.0:1780340774.673787:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1780340774.673808:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:87334:x1866818961130112:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780340774.673948:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:87334:x1866818961130112:12345-0@lo:503:mount.lustre.0 Request processed in 151us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340774.673957:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1780340774.676228:0:87334:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961130112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780340774.689916:0:87360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87360:1866818961130240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340774.690045:0:87360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340774.690103:0:87360:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04754c20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340774.690346:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961130240 00000100:00100000:1.0:1780340774.690356:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961130240 00000100:00100000:1.0:1780340774.693413:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1780340774.693437:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:87360:x1866818961130240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340774.693651:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:87360:x1866818961130240:12345-0@lo:502:llog_process_th.0 Request processed in 224us (3606us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340774.693660:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1780340774.694601:0:87360:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87360:1866818961130240:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1780340774.694686:0:87360:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1780340774.694705:0:87360:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8c0476588000) 00000020:00000080:3.0:1780340774.694736:0:87360:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1780340774.694999:0:87360:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c046b9ae000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1780340774.695004:0:87360:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c046b9ae000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1780340774.695006:0:87360:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c046b9ae000 4 00010000:00080000:3.0:1780340774.695052:0:87360:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c047b1fb800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:0.0:1780340774.700605:0:87360:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1780340774.700791:0:87360:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1780340774.700863:0:87360:0:(lwp_dev.c:494:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1780340774.700881:0:87360:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa246514327744a3 00000100:00080000:0.0:1780340774.700895:0:87360:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1780340774.700903:0:87360:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c047b1fb800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340774.700952:0:87360:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c045ecbc700 x1866818961130368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340774.700977:0:87360:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1780340774.701898:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961130368:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1780340774.702000:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340774.704419:0:87360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87360:1866818961130496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340774.706262:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961130368 00000100:00100000:2.0:1780340774.706283:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961130368 00000100:00100000:2.0:1780340774.706355:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:2.0:1780340774.706367:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961130368:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1780340774.706510:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961130368:12345-0@lo:38:llog_process_th.0 Request processed in 144us (4509us total) trans 0 rc -11/-11 00000100:00100000:2.0:1780340774.706518:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:1.0:1780340774.707380:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1780340774.707399:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c047b1fb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340774.707407:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1780340774.707413:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961130368:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1780340774.708398:0:87360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340774.708445:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961130496 00000100:00100000:0.0:1780340774.708465:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961130496 00000100:00100000:0.0:1780340774.709349:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1780340774.709362:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:87360:x1866818961130496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340774.709631:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:87360:x1866818961130496:12345-0@lo:502:llog_process_th.0 Request processed in 271us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340774.709640:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1780340774.709712:0:87360:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340774.709742:0:87360:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87360:1866818961130496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340774.709841:0:87360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87360:1866818961130624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340774.709885:0:87360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340774.709907:0:87360:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1780340774.710024:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961130624 00000100:00100000:2.0:1780340774.710031:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961130624 00000100:00100000:2.0:1780340774.710074:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1780340774.710083:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:87360:x1866818961130624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340774.710177:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:87360:x1866818961130624:12345-0@lo:502:llog_process_th.0 Request processed in 95us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340774.710262:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1780340774.710726:0:87360:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87360:1866818961130624:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1780340774.710922:0:87360:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1780340774.711614:0:87334:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1780340774.711666:0:87334:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1780340774.711696:0:87334:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04497b6400/0xa2465143277448e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774495 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.711710:0:87334:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04497b6400/0xa2465143277448e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774495 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1780340774.712626:0:87334:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1780340774.712629:0:87334:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780340774.712630:0:87334:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780340774.712632:0:87334:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780340774.712633:0:87334:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780340774.712636:0:87334:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780340774.712637:0:87334:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780340774.712639:0:87334:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780340774.712641:0:87334:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780340774.712643:0:87334:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1780340774.712648:0:87334:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1780340774.712651:0:87334:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1780340774.712652:0:87334:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780340774.712653:0:87334:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780340774.712654:0:87334:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780340774.712655:0:87334:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780340774.712656:0:87334:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780340774.712657:0:87334:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780340774.712659:0:87334:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780340774.712660:0:87334:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780340774.712661:0:87334:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1780340774.712696:0:87334:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1780340774.712720:0:87334:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961130752:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1780340774.712888:0:87334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340774.712943:0:87334:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348220cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340774.712972:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961130752 00000100:00100000:3.0:1780340774.712988:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961130752 00000100:00100000:3.0:1780340774.713078:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1780340774.713091:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:87334:x1866818961130752:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1780340774.713139:0:87341:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1780340774.713159:0:87341:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1780340774.722732:0:87341:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1780340774.722853:0:87341:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1780340774.724426:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:87334:x1866818961130752:12345-0@lo:253:mount.lustre.0 Request processed in 11329us (11529us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340774.724441:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1780340774.725835:0:87334:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:87334:1866818961130752:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1780340774.725888:0:87334:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1780340774.725891:0:87334:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1780340774.725894:0:87334:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780340774.725895:0:87334:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780340774.725897:0:87334:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780340774.725898:0:87334:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780340774.725899:0:87334:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780340774.725901:0:87334:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780340774.725902:0:87334:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780340774.725905:0:87334:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780340774.725907:0:87334:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1780340774.725939:0:87334:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1780340774.726290:0:87343:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1780340774.726300:0:87343:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1780340774.726338:0:87343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c04497b7600/0xa246514327744aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.726359:0:87343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c04497b7c00/0xa24651432774479 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774472 expref: 9 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.726368:0:87343:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c04497b7600/0xa246514327744aa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.726414:0:87343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c04497b7c00/0xa24651432774479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774472 expref: 9 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340774.726434:0:87343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c04497b7c00/0xa24651432774479 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774472 expref: 9 pid: 87341 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340774.726450:0:87343:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87343:1866818961130880:0@lo:104: 00000100:00100000:0.0:1780340774.726886:0:87343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340774.726962:0:87343:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1780340774.727250:0:6499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961130880 00000100:00100000:1.0:1780340774.727263:0:6499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961130880 00000100:00100000:1.0:1780340774.727343:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1780340774.727356:0:6499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:87343:x1866818961130880:12345-0@lo:104: 00010000:00010000:1.0:1780340774.727377:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774479 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.727474:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1780340774.727480:0:6499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:87343:x1866818961130880:12345-0@lo:104: Request processed in 128us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340774.727489:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00010000:00010000:1.0:1780340774.727513:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340774.727520:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774479 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.727529:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a200 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340774.727533:0:41205:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774472 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774479 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.727543:0:41205:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774479 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340774.727558:0:41205:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774479 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340774.727565:0:41205:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340774.727603:0:41205:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774472 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774479 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.727610:0:41205:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340774.727633:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774472 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774479 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.727641:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c047a32a200/0xa24651432774472 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774479 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.727659:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340774.727661:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340774.727663:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340774.727686:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961131008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340774.727720:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340774.727781:0:7443:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961131008 00000100:00100000:1.0:1780340774.727784:0:7443:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961131008 00010000:00010000:1.0:1780340774.727814:0:7443:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c04497b7c00/0xa24651432774479 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774472 expref: 10 pid: 87341 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340774.727839:0:7443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548 00000100:00100000:1.0:1780340774.727845:0:7443:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:3659:x1866818961131008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340774.727858:0:7443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340774.727863:0:7443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c04497b7c00/0xa24651432774479 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774472 expref: 10 pid: 87341 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.727883:0:7443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c04497b7c00/0xa24651432774479 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774472 expref: 10 pid: 87341 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.727904:0:7443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c04497b7600/0xa246514327744aa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.727913:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04497b7600/0xa246514327744aa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1780340774.727934:0:7443:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011188519s 00010000:00010000:1.0:1780340774.727938:0:7443:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c04497b7600/0xa246514327744aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.727946:0:7443:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c04497b7600/0xa246514327744aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.727952:0:7443:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c04497b7600/0xa246514327744aa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.727958:0:7443:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c04497b7600/0xa246514327744aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.727963:0:7443:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04497b7600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340774.727967:0:7443:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c04497b7600/0xa246514327744aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.727974:0:7443:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c04497b7600/0xa246514327744aa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.727982:0:7443:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c04497b7600/0xa246514327744aa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340774.728003:0:7443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340774.728033:0:7443:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:3659:x1866818961131008:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340774.728040:0:7443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548 00000100:00100000:1.0:1780340774.728080:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961131008:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340774.728409:0:87343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04497b7c00/0xa24651432774479 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774472 expref: 9 pid: 87341 timeout: 3654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340774.728430:0:87343:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87343:1866818961130880:0@lo:104: 00010000:00010000:3.0:1780340774.728453:0:87343:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c04497b7600/0xa246514327744aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340774.728480:0:87343:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c04497b7600/0xa246514327744aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340774.728494:0:87343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c04497b7600/0xa246514327744aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340774.728500:0:87343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04497b7600/0xa246514327744aa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1780340774.742440:0:87334:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444069 00000040:01000000:2.0:1780340774.743848:0:87334:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1780340774.743849:0:87364:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444069 00000020:00080000:0.0:1780340774.743859:0:87364:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444069 00000040:01000000:2.0:1780340774.744265:0:87365:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1780340774.744341:0:87334:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1780340774.745051:0:87366:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a29f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87366:1866818961131136:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1780340774.745155:0:87366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340774.745207:0:87366:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047a8b9240 going to sleep for 11 seconds 00000100:00100000:1.0:1780340774.745232:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961131136 00000100:00100000:1.0:1780340774.745245:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961131136 00000100:00100000:1.0:1780340774.745311:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834 00000100:00100000:1.0:1780340774.745322:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87366:x1866818961131136:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780340774.745504:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87366:x1866818961131136:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 185us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340774.745512:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834 00000100:00100000:2.0:1780340774.745519:0:87366:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a29f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87366:1866818961131136:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1780340774.745562:0:87366:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1780340774.745591:0:87366:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a29f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87366:1866818961131264:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1780340774.745639:0:87366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340774.745664:0:87366:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047a8b9240 going to sleep for 11 seconds 00000100:00100000:1.0:1780340774.745727:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961131264 00000100:00100000:1.0:1780340774.745734:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961131264 00000100:00100000:1.0:1780340774.745818:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835 00000100:00100000:1.0:1780340774.745827:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87366:x1866818961131264:12345-0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1780340774.745850:0:87365:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1780340774.745972:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87366:x1866818961131264:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 146us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340774.745978:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835 00000040:01000000:0.0:1780340774.748679:0:87334:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1780340774.748723:0:87334:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1780340774.749159:0:87334:0:(mdd_device.c:556:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1780340774.749167:0:87334:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1780340774.749200:0:87334:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1780340774.750240:0:87334:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1780340774.750747:0:87366:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a29f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87366:1866818961131264:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1780340774.750853:0:87334:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1780340774.750898:0:87334:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00100000:2.0:1780340774.750965:0:87366:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a29f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87366:1866818961131392:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1780340774.751015:0:87334:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1780340774.751064:0:87366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340774.751126:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961131392 00000100:00100000:2.0:1780340774.751141:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961131392 00000100:00100000:2.0:1780340774.751229:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836 00000100:00100000:2.0:1780340774.751240:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87366:x1866818961131392:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1780340774.751344:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87366:x1866818961131392:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 107us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340774.751352:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836 00000100:00100000:2.0:1780340774.751379:0:87366:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047a8b9240 going to sleep for 11 seconds 00000100:00100000:2.0:1780340774.751398:0:87366:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a29f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87366:1866818961131392:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1780340774.751450:0:87366:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1780340774.754132:0:87365:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1780340774.754252:0:87365:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1780340774.757154:0:87366:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00080000:10000000:0.0:1780340774.757706:0:87334:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4d:0x0] (8/32) registered 00000004:00080000:2.0:1780340774.758522:0:87366:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1780340774.758531:0:87366:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1780340774.766214:0:87334:0:(ldlm_lib.c:3035:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 107374182407 00010000:00080000:3.0:1780340774.770941:0:87367:0:(ldlm_lib.c:2838:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 87367 00010000:02000000:3.0:1780340774.770963:0:87367:0:(ldlm_lib.c:2320:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1780340774.770967:0:87367:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1780340774.770971:0:87367:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1780340774.771661:0:87334:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1780340774.771695:0:87334:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1780340774.771721:0:87334:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=47 00000080:00000004:0.0:1780340774.771749:0:87334:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1780340774.777349:0:87334:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1780340774.778243:0:87334:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1780340774.800849:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340775.529290:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340775.529391:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940432256 00000100:00100000:2.0:1780340775.529403:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940432256 00000100:00100000:2.0:1780340775.529481:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 37 00000100:00100000:2.0:1780340775.529490:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:41995:x1866818940432256:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340775.529515:0:87339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340775.529533:0:87339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a32ba00/0xa246514327744b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced23de expref: -99 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340775.529582:0:87339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a32ba00/0xa246514327744b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23de expref: 9 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340775.529593:0:87339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a32ba00/0xa246514327744b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23de expref: 9 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340775.529602:0:87339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32ba00, rc 0) 00000100:00100000:2.0:1780340775.529661:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:41995:x1866818940432256:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 173us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340775.529668:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 37 00000100:00100000:1.0:1780340775.532324:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340775.532410:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940432384 00000100:00100000:3.0:1780340775.532421:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940432384 00000100:00100000:3.0:1780340775.532479:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 38 00000100:00100000:3.0:1780340775.532490:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:41995:x1866818940432384:12345-192.168.203.16@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1780340775.532523:0:87341:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1780340775.532557:0:87341:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1780340775.532561:0:87341:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1780340775.532564:0:87341:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1780340775.532566:0:87341:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1780340775.532569:0:87341:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:1.0:1780340775.536954:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:41995:x1866818940432384:12345-192.168.203.16@tcp:256:ll_cfg_requeue.0 Request processed in 4451us (4625us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340775.536972:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 38 00000100:00100000:3.0:1780340775.542670:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340775.542815:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940432512 00000100:00100000:2.0:1780340775.542828:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940432512 00000100:00100000:2.0:1780340775.542883:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1274 00000100:00100000:2.0:1780340775.542895:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1866818940432512:12345-192.168.203.16@tcp:38:ll_cfg_requeue.0 00010000:00080000:2.0:1780340775.542931:0:64454:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'e06e5cf1-1986-4ba7-9630-fad7efb74eca' at ffff8c04530a7800, cookie 0xa246514327743fb 00010000:00080000:2.0:1780340775.542952:0:64454:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp recovering/t107374182408 exp ffff8c04530a7800 cur 3555 last 1780340774 00010000:02000400:2.0:1780340775.542963:0:64454:0:(ldlm_lib.c:2021:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1780340775.552162:0:64454:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1780340775.552250:0:64454:0:(mdt_handler.c:7301:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1780340775.552418:0:64454:0:(import.c:65:import_set_state_nolock()) ffff8c045aab6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340775.552529:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940432512:12345-192.168.203.16@tcp:38:ll_cfg_requeue.0 Request processed in 9634us (9871us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340775.554626:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1274 00000100:00100000:0.0:1780340775.557171:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340775.557366:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940420096 00000100:00100000:2.0:1780340775.557376:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940420096 00000100:00100000:2.0:1780340775.557485:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1275 00000100:00100000:2.0:1780340775.557497:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940420096:12345-192.168.203.16@tcp:36:mcreate.0 00010000:00080000:2.0:1780340775.557519:0:63711:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 107374182408, current: 107374182408, replaying 00000100:00100000:2.0:1780340775.557591:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940420096:12345-192.168.203.16@tcp:36:mcreate.0 Request processed in 97us (430us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340775.557600:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1275 00010000:00080000:3.0:1780340775.557732:0:87367:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:2.0:1780340775.817990:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1780340776.267819:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1780340776.267827:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c046b9ae000 from 116 10000000:01000000:1.0:1780340776.267850:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1780340776.267894:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa246514327744b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.267907:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa246514327744b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.267918:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa246514327744b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340776.267944:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961131520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340776.268011:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340776.268059:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a89fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1780340776.268185:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961131520 00000100:00100000:0.0:1780340776.268193:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961131520 00000100:00100000:0.0:1780340776.268250:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1780340776.268260:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:6514:x1866818961131520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340776.268275:0:87339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340776.268305:0:87339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04497b7800/0xa246514327744bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327744b8 expref: -99 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.268332:0:87339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04497b7800/0xa246514327744bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327744b8 expref: 10 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.268343:0:87339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04497b7800/0xa246514327744bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327744b8 expref: 10 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.268351:0:87339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04497b7800, rc 0) 00000100:00100000:0.0:1780340776.268410:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961131520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340776.268417:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1780340776.268636:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961131520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340776.268652:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa246514327744b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327744bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.268660:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa246514327744b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327744bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340776.268723:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961131648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1780340776.268756:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340776.268829:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04754c2240 going to sleep for 11 seconds 00000100:00100000:0.0:1780340776.268940:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961131648 00000100:00100000:0.0:1780340776.268945:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961131648 00000100:00100000:0.0:1780340776.269020:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1780340776.269029:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961131648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1780340776.269047:0:87341:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1780340776.269064:0:87341:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1780340776.269067:0:87341:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 116 00000100:00100000:0.0:1780340776.269154:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961131648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340776.269161:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1780340776.276061:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961131648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1780340776.276136:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1780340776.276147:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa246514327744b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327744bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.276160:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa246514327744b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327744bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340776.277278:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1780340776.277283:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c045f0c4800 from 52 10000000:01000000:3.0:1780340776.277288:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1780340776.277337:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa246514327744c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.277346:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa246514327744c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.277355:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa246514327744c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340776.277462:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961131776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340776.277532:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340776.277580:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04754c2240 going to sleep for 11 seconds 00000100:00100000:1.0:1780340776.277706:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961131776 00000100:00100000:1.0:1780340776.277715:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961131776 00000100:00100000:1.0:1780340776.277779:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1780340776.277789:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961131776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340776.277812:0:87342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340776.277825:0:87342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a8b2400/0xa246514327744cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327744c6 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.277848:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a8b2400/0xa246514327744cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327744c6 expref: 11 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.277858:0:87342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a8b2400/0xa246514327744cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327744c6 expref: 11 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.277867:0:87342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a8b2400, rc 0) 00000100:00100000:1.0:1780340776.277904:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961131776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340776.277920:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1780340776.278561:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961131776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340776.278580:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa246514327744c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327744cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.278590:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa246514327744c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327744cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340776.278665:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961131904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340776.278700:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340776.278732:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04754c2240 going to sleep for 11 seconds 00000100:00100000:0.0:1780340776.279184:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961131904 00000100:00100000:0.0:1780340776.279191:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961131904 00000100:00100000:0.0:1780340776.279232:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1780340776.279240:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961131904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340776.279376:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961131904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340776.279919:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1780340776.280942:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961131904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340776.280998:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961132032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340776.281059:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340776.281090:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04754c2240 going to sleep for 11 seconds 00000100:00100000:3.0:1780340776.281107:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961132032 00000100:00100000:3.0:1780340776.281112:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961132032 00000100:00100000:3.0:1780340776.281147:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1780340776.281154:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961132032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340776.282033:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961132032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 876us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340776.282043:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1780340776.282345:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961132032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780340776.285596:0:87431:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1780340776.285719:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1780340776.285750:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780340776.285793:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa246514327744c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327744cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.285816:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa246514327744c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327744cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340776.285827:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1780340776.285830:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c045f0c4800 from 113 10000000:01000000:0.0:1780340776.285834:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1780340776.285874:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04497b6000/0xa246514327744d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.285881:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04497b6000/0xa246514327744d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.285892:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04497b6000/0xa246514327744d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340776.285916:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961132160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340776.285988:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340776.286028:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c046b899c00 going to sleep for 11 seconds 00000100:00100000:2.0:1780340776.286475:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961132160 00000100:00100000:2.0:1780340776.286483:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961132160 00000100:00100000:2.0:1780340776.286536:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1780340776.286544:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961132160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340776.286558:0:87342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340776.286570:0:87342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a32a200/0xa246514327744db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327744d4 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.286594:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a32a200/0xa246514327744db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327744d4 expref: 12 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.286605:0:87342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a32a200/0xa246514327744db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327744d4 expref: 12 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.286613:0:87342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32a200, rc 0) 00000100:00100000:2.0:1780340776.286658:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961132160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340776.286665:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1780340776.286949:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961132160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340776.286964:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04497b6000/0xa246514327744d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327744db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.286973:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04497b6000/0xa246514327744d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327744db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340776.287034:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961132288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1780340776.287067:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340776.287100:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c046b899c00 going to sleep for 11 seconds 00000100:00100000:2.0:1780340776.287153:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961132288 00000100:00100000:2.0:1780340776.287158:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961132288 00000100:00100000:2.0:1780340776.287197:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1780340776.287210:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961132288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1780340776.287224:0:87341:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1780340776.287240:0:87341:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1780340776.287244:0:87341:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1780340776.287247:0:87341:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1780340776.287250:0:87341:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1780340776.287252:0:87341:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:2.0:1780340776.287335:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961132288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340776.287342:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1780340776.287525:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961132288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1780340776.287611:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1780340776.287621:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04497b6000/0xa246514327744d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327744db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.287628:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04497b6000/0xa246514327744d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327744db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340776.287636:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1780340776.287639:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1780340776.287641:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1780340776.287661:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04497b7600/0xa246514327744e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.287668:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04497b7600/0xa246514327744e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.287677:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04497b7600/0xa246514327744e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340776.287692:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961132416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340776.287725:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340776.287749:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c046b899c00 going to sleep for 11 seconds 00000100:00100000:2.0:1780340776.287924:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961132416 00000100:00100000:2.0:1780340776.287929:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961132416 00000100:00100000:2.0:1780340776.287958:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1780340776.287966:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961132416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340776.287975:0:87339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340776.287986:0:87339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a32b000/0xa246514327744e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327744e2 expref: -99 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.288005:0:87339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a32b000/0xa246514327744e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327744e2 expref: 13 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.288014:0:87339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a32b000/0xa246514327744e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327744e2 expref: 13 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.288022:0:87339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32b000, rc 0) 00000100:00100000:2.0:1780340776.288048:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961132416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340776.288054:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1780340776.288123:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961132416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340776.288140:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04497b7600/0xa246514327744e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327744e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.288148:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04497b7600/0xa246514327744e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327744e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340776.288267:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961132544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340776.288304:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340776.288368:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c046b899c00 going to sleep for 11 seconds 00000100:00100000:2.0:1780340776.292350:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961132544 00000100:00100000:2.0:1780340776.292375:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961132544 00000100:00100000:2.0:1780340776.293042:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1780340776.293056:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961132544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.293928:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961132544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 872us (5619us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340776.293939:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1780340776.294074:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961132544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340776.294152:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961132672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340776.294270:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340776.294316:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c046b899c00 going to sleep for 11 seconds 00000100:00100000:2.0:1780340776.294368:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961132672 00000100:00100000:2.0:1780340776.294375:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961132672 00000100:00100000:2.0:1780340776.294830:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1780340776.294841:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961132672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.298697:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961132672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3846us (4415us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340776.298713:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1780340776.300972:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961132672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780340776.304161:0:87433:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:2.0:1780340776.304316:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:2.0:1780340776.304345:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1780340776.304359:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04497b7600/0xa246514327744e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327744e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.304372:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04497b7600/0xa246514327744e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327744e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340776.304389:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:2.0:1780340776.304392:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8c045f0c4800 from 1 10000000:01000000:2.0:1780340776.304394:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1780340776.304429:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32aa00/0xa246514327744f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.304437:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a32aa00/0xa246514327744f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.304460:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a32aa00/0xa246514327744f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340776.304489:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961132800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.304554:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340776.304594:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445310780 going to sleep for 11 seconds 00000100:00100000:3.0:1780340776.304735:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961132800 00000100:00100000:3.0:1780340776.304743:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961132800 00000100:00100000:3.0:1780340776.304873:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1780340776.304884:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961132800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340776.304897:0:87342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340776.304909:0:87342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f8600/0xa246514327744f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327744f0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.304933:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f8600/0xa246514327744f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327744f0 expref: 14 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.304944:0:87342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f8600/0xa246514327744f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327744f0 expref: 14 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.304952:0:87342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8600, rc 0) 00000100:00100000:3.0:1780340776.304994:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:6514:x1866818961132800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340776.305001:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1780340776.305055:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a29f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961132800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340776.305070:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c047a32aa00/0xa246514327744f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327744f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.305078:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c047a32aa00/0xa246514327744f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327744f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340776.305107:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1780340776.305110:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32aa00/0xa246514327744f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327744f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.305116:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c047a32aa00/0xa246514327744f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327744f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340776.305122:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1780340776.305124:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c045f0c4800 from 7 10000000:01000000:3.0:1780340776.305126:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1780340776.305142:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa246514327744fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.305148:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa246514327744fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.305155:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa246514327744fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340776.305232:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961132928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340776.305260:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340776.305274:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04754c2240 going to sleep for 11 seconds 00000100:00100000:3.0:1780340776.305287:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961132928 00000100:00100000:3.0:1780340776.305303:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961132928 00000100:00100000:3.0:1780340776.305330:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1780340776.305337:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:6514:x1866818961132928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340776.305344:0:87342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340776.305353:0:87342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f8c00/0xa24651432774505 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327744fe expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.305375:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f8c00/0xa24651432774505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327744fe expref: 15 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.305451:0:87342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f8c00/0xa24651432774505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327744fe expref: 15 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.305461:0:87342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8c00, rc 0) 00000100:00100000:3.0:1780340776.305491:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961132928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340776.305497:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1780340776.305528:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961132928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340776.305537:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa246514327744fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.305545:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa246514327744fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340776.305597:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961133056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340776.305622:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340776.305635:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04754c2240 going to sleep for 11 seconds 00000100:00100000:3.0:1780340776.305646:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961133056 00000100:00100000:3.0:1780340776.305649:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961133056 00000100:00100000:3.0:1780340776.305671:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1780340776.305677:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961133056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340776.306080:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961133056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 402us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340776.306098:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1780340776.306471:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961133056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.306510:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961133184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.306554:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340776.306620:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445310300 going to sleep for 11 seconds 00000100:00100000:0.0:1780340776.306974:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961133184 00000100:00100000:0.0:1780340776.306982:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961133184 00000100:00100000:0.0:1780340776.307055:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1780340776.307064:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961133184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340776.307267:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961133184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340776.307274:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1780340776.307504:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961133184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340776.308371:0:87434:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1780340776.308917:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1780340776.308950:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1780340776.308964:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa246514327744fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.308978:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa246514327744fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340776.308989:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1780340776.308993:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c04773ad000 from 52 10000000:01000000:3.0:1780340776.308996:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1780340776.309041:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f9a00/0xa2465143277450c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.309050:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c03476f9a00/0xa2465143277450c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.309060:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c03476f9a00/0xa2465143277450c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340776.309090:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961133312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340776.309222:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340776.309269:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04754c23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340776.309325:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961133312 00000100:00100000:2.0:1780340776.309334:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961133312 00000100:00100000:2.0:1780340776.309458:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1780340776.309468:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961133312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340776.309483:0:87341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340776.309496:0:87341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a32b800/0xa24651432774513 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277450c expref: -99 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.309519:0:87341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a32b800/0xa24651432774513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277450c expref: 16 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.309530:0:87341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a32b800/0xa24651432774513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277450c expref: 16 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.309555:0:87341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32b800, rc 0) 00000100:00100000:2.0:1780340776.309594:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961133312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340776.309602:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1780340776.309683:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961133312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340776.309695:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c03476f9a00/0xa2465143277450c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774513 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.309702:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c03476f9a00/0xa2465143277450c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774513 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340776.309790:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961133440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340776.309915:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340776.309942:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04754c23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340776.309980:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961133440 00000100:00100000:2.0:1780340776.309985:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961133440 00000100:00100000:2.0:1780340776.310012:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1780340776.310019:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961133440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.310125:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961133440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340776.310132:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1780340776.310248:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961133440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340776.310278:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961133568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340776.310327:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340776.310381:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04754c23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340776.310512:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961133568 00000100:00100000:0.0:1780340776.310516:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961133568 00000100:00100000:0.0:1780340776.310550:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1780340776.310556:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961133568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340776.310630:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961133568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340776.310646:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1780340776.311022:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961133568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780340776.312014:0:87435:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1780340776.318683:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1780340776.318739:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780340776.318755:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f9a00/0xa2465143277450c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774513 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.318785:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c03476f9a00/0xa2465143277450c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774513 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340776.318808:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1780340776.318812:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1780340776.318815:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1780340776.318871:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04497b7c00/0xa2465143277451a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.318879:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04497b7c00/0xa2465143277451a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.318892:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04497b7c00/0xa2465143277451a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340776.318927:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961133696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340776.319023:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340776.319089:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c046b899c00 going to sleep for 11 seconds 00000100:00100000:0.0:1780340776.319125:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961133696 00000100:00100000:0.0:1780340776.319133:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961133696 00000100:00100000:0.0:1780340776.319489:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1780340776.319501:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961133696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340776.319517:0:87342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340776.319545:0:87342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04497b6800/0xa24651432774521 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277451a expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.319574:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04497b6800/0xa24651432774521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277451a expref: 17 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.319586:0:87342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04497b6800/0xa24651432774521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277451a expref: 17 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.319597:0:87342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04497b6800, rc 0) 00000100:00100000:0.0:1780340776.319649:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961133696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340776.319656:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1780340776.319710:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961133696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340776.319724:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04497b7c00/0xa2465143277451a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774521 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.319732:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04497b7c00/0xa2465143277451a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774521 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340776.319890:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961133824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340776.319919:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340776.319944:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c046b899c00 going to sleep for 11 seconds 00000100:00100000:0.0:1780340776.319958:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961133824 00000100:00100000:0.0:1780340776.319962:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961133824 00000100:00100000:0.0:1780340776.319989:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1780340776.319995:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476322050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961133824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340776.320153:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476322050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961133824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340776.320235:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1780340776.320273:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961133824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340776.320313:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961133952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340776.320354:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340776.320368:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acd8840 going to sleep for 11 seconds 00000100:00100000:0.0:1780340776.320379:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961133952 00000100:00100000:0.0:1780340776.320383:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961133952 00000100:00100000:0.0:1780340776.320897:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1780340776.320904:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476323c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961133952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340776.322645:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476323c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961133952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1735us (2283us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340776.322657:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1780340776.322737:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961133952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340776.330557:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961134208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340776.330637:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340776.330688:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340776.330695:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961134080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340776.330720:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340776.330748:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961134208 00000100:00100000:1.0:1780340776.330755:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961134208 00000100:00100000:1.0:1780340776.331268:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961134080 00000100:00100000:1.0:1780340776.331274:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961134080 00000100:00100000:1.0:1780340776.331313:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2046 00000100:00100000:1.0:1780340776.331323:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961134208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340776.331363:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340776.331473:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047 00000100:00100000:2.0:1780340776.331482:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961134080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340776.331498:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780340776.331545:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961134080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340776.331552:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047 00000100:00100000:1.0:1780340776.331666:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961134208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 345us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340776.331673:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2046 00000100:00080000:1.0:1780340776.331694:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780340776.331697:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340776.331755:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961134080:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1780340776.333130:0:87437:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1780340776.334986:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1780340776.335042:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1780340776.335056:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04497b7c00/0xa2465143277451a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774521 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.335074:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04497b7c00/0xa2465143277451a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774521 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340776.335086:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1780340776.335089:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c04773ad000 from 7 10000000:01000000:3.0:1780340776.335092:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1780340776.335141:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f8a00/0xa24651432774528 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.335150:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c03476f8a00/0xa24651432774528 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.335246:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c03476f8a00/0xa24651432774528 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340776.335279:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961134336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340776.335369:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340776.335518:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04754c2300 going to sleep for 11 seconds 00000100:00100000:2.0:1780340776.337341:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961134208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340776.339102:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961134336 00000100:00100000:1.0:1780340776.339119:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961134336 00000100:00100000:1.0:1780340776.340541:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1780340776.340560:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476320450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961134336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340776.340580:0:87342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340776.340608:0:87342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a8b2a00/0xa2465143277452f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774528 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.340651:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a8b2a00/0xa2465143277452f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774528 expref: 18 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.340664:0:87342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a8b2a00/0xa2465143277452f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774528 expref: 18 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.340674:0:87342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a8b2a00, rc 0) 00000100:00100000:1.0:1780340776.340788:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476320450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961134336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 236us (5419us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340776.340806:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1780340776.340942:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961134336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340776.340965:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c03476f8a00/0xa24651432774528 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277452f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.340974:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c03476f8a00/0xa24651432774528 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277452f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340776.341061:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961134464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340776.341103:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340776.342711:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04754c2300 going to sleep for 11 seconds 00000100:00100000:2.0:1780340776.346677:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961134464 00000100:00100000:2.0:1780340776.346695:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961134464 00000100:00100000:2.0:1780340776.346773:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1780340776.346784:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476321450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961134464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.346988:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476321450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961134464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (5883us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340776.347015:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1780340776.347072:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961134464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.347137:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961134592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.347324:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340776.347347:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445310300 going to sleep for 11 seconds 00000100:00100000:2.0:1780340776.347370:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961134592 00000100:00100000:2.0:1780340776.347374:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961134592 00000100:00100000:2.0:1780340776.347407:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1780340776.347418:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961134592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.347507:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961134592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340776.347513:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1780340776.347548:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961134592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780340776.352622:0:87439:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1780340776.352954:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1780340776.352986:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1780340776.353000:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f8a00/0xa24651432774528 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277452f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.353014:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c03476f8a00/0xa24651432774528 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277452f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340776.353024:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1780340776.353027:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c047b065000 from 52 10000000:01000000:2.0:1780340776.353030:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780340776.353071:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32a600/0xa24651432774536 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.353099:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a32a600/0xa24651432774536 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.353112:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a32a600/0xa24651432774536 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340776.353143:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961134720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.353222:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340776.353269:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034accf600 going to sleep for 11 seconds 00000100:00100000:1.0:1780340776.353369:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961134720 00000100:00100000:1.0:1780340776.353377:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961134720 00000100:00100000:1.0:1780340776.353433:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1780340776.353443:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961134720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340776.353459:0:87339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340776.353473:0:87339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a8b3e00/0xa2465143277453d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774536 expref: -99 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.353497:0:87339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a8b3e00/0xa2465143277453d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774536 expref: 19 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.353507:0:87339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a8b3e00/0xa2465143277453d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774536 expref: 19 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.353516:0:87339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a8b3e00, rc 0) 00000100:00100000:1.0:1780340776.353558:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b60850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961134720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340776.353572:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1780340776.354449:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961134720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340776.354469:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c047a32a600/0xa24651432774536 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277453d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.354480:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c047a32a600/0xa24651432774536 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277453d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340776.354556:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961134848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.354607:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340776.354641:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034accf600 going to sleep for 11 seconds 00000100:00100000:1.0:1780340776.356071:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961134848 00000100:00100000:1.0:1780340776.356084:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961134848 00000100:00100000:1.0:1780340776.356144:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1780340776.356154:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961134848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340776.356321:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961134848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340776.356328:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1780340776.356890:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961134848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.356947:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961134976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.357001:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340776.357037:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034accf600 going to sleep for 11 seconds 00000100:00100000:3.0:1780340776.357235:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961134976 00000100:00100000:3.0:1780340776.357240:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961134976 00000100:00100000:3.0:1780340776.357279:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1780340776.357287:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044dad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961134976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340776.357391:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044dad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961134976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340776.357398:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1780340776.357980:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961134976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340776.359509:0:87440:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1780340776.367121:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1780340776.367176:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1780340776.367191:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32a600/0xa24651432774536 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277453d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.367206:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c047a32a600/0xa24651432774536 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277453d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340776.367276:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1780340776.367281:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1780340776.367284:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1780340776.367361:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa24651432774544 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.367370:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa24651432774544 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340776.367383:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa24651432774544 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340776.367416:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961135104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340776.367513:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340776.367559:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04754c2300 going to sleep for 11 seconds 00000100:00100000:1.0:1780340776.367983:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961135104 00000100:00100000:1.0:1780340776.367992:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961135104 00000100:00100000:1.0:1780340776.368052:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1780340776.368062:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044dad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961135104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340776.368078:0:87342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340776.368093:0:87342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a8b3400/0xa2465143277454b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774544 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.368123:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a8b3400/0xa2465143277454b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774544 expref: 20 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.368135:0:87342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a8b3400/0xa2465143277454b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774544 expref: 20 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.368155:0:87342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a8b3400, rc 0) 00000100:00100000:1.0:1780340776.368247:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044dad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961135104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340776.368254:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1780340776.370705:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961135104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340776.370739:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa24651432774544 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277454b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.370754:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa24651432774544 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277454b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340776.372333:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961135232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340776.372421:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340776.372467:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a89fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1780340776.372519:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961135232 00000100:00100000:0.0:1780340776.372527:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961135232 00000100:00100000:0.0:1780340776.372577:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1780340776.372587:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044dad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961135232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340776.373008:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044dad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961135232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 421us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340776.373017:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1780340776.373837:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961135232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340776.373896:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961135360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340776.373976:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340776.374068:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a89fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1780340776.374230:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961135360 00000100:00100000:2.0:1780340776.374238:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961135360 00000100:00100000:2.0:1780340776.374329:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1780340776.374339:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044dad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961135360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.375405:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044dad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961135360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1062us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340776.375417:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1780340776.375517:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961135360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780340776.376668:0:87441:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1780340776.377030:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1780340776.377062:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1780340776.377075:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa24651432774544 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277454b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.377089:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa24651432774544 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277454b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340776.377234:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1780340776.377238:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c047b065000 from 7 10000000:01000000:2.0:1780340776.377241:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1780340776.377299:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa24651432774552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.377308:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa24651432774552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.377319:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa24651432774552 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340776.377346:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961135488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.377414:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340776.377492:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034accf840 going to sleep for 11 seconds 00000100:00100000:0.0:1780340776.377540:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961135488 00000100:00100000:0.0:1780340776.377548:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961135488 00000100:00100000:0.0:1780340776.377640:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1780340776.377652:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044dad7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961135488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340776.377668:0:87341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340776.377683:0:87341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04497b7200/0xa24651432774559 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774552 expref: -99 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.377711:0:87341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04497b7200/0xa24651432774559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774552 expref: 21 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.377722:0:87341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04497b7200/0xa24651432774559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774552 expref: 21 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340776.377731:0:87341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04497b7200, rc 0) 00000100:00100000:0.0:1780340776.377862:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044dad7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961135488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340776.377889:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1780340776.377967:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961135488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340776.377982:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa24651432774552 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774559 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.377991:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa24651432774552 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774559 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340776.378079:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961135616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.378107:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340776.378505:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034accf840 going to sleep for 11 seconds 00000100:00100000:1.0:1780340776.378581:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961135616 00000100:00100000:1.0:1780340776.378587:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961135616 00000100:00100000:1.0:1780340776.378618:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1780340776.378627:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961135616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340776.378790:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961135616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340776.378797:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1780340776.378881:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961135616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.378915:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961135744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340776.378959:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340776.378986:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034accf840 going to sleep for 11 seconds 00000100:00100000:1.0:1780340776.379028:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961135744 00000100:00100000:1.0:1780340776.379032:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961135744 00000100:00100000:1.0:1780340776.379050:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1780340776.379056:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961135744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340776.379150:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961135744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340776.379165:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1780340776.379304:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a2bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961135744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340776.380501:0:87442:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1780340776.380652:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1780340776.380672:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1780340776.380681:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa24651432774552 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774559 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.380692:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa24651432774552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774559 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340776.380701:0:6514:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1780340776.380703:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8c0471e119c0 from 1 10000000:01000000:1.0:1780340776.380706:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1780340776.380737:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2200/0xa24651432774560 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.380745:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2200/0xa24651432774560 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.380754:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2200/0xa24651432774560 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340776.380807:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961135872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340776.380857:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340776.380883:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a89f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340776.380946:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961135872 00000100:00100000:2.0:1780340776.380952:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961135872 00000100:00100000:2.0:1780340776.380983:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1780340776.380991:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961135872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340776.381002:0:87342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340776.381015:0:87342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a32b600/0xa24651432774567 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774560 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.381035:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a32b600/0xa24651432774567 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774560 expref: 22 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.381044:0:87342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a32b600/0xa24651432774567 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774560 expref: 22 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.381052:0:87342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32b600, rc 0) 00000100:00100000:2.0:1780340776.381127:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961135872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340776.381146:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1780340776.381479:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961135872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340776.381493:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2200/0xa24651432774560 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774567 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.381501:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2200/0xa24651432774560 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774567 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340776.381526:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1780340776.381531:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2200/0xa24651432774560 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774567 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.381538:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2200/0xa24651432774560 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774567 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340776.381544:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1780340776.381546:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8c0471e119c0 from 1 10000000:01000000:1.0:1780340776.381548:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1780340776.381565:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2800/0xa2465143277456e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.381572:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2800/0xa2465143277456e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.381579:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2800/0xa2465143277456e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340776.381593:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961136000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340776.381623:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340776.381684:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a89f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340776.381717:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961136000 00000100:00100000:2.0:1780340776.381722:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961136000 00000100:00100000:2.0:1780340776.381904:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1780340776.381913:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961136000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340776.381923:0:87342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340776.381932:0:87342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a32bc00/0xa24651432774575 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277456e expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.381946:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a32bc00/0xa24651432774575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277456e expref: 23 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.381954:0:87342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a32bc00/0xa24651432774575 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277456e expref: 23 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.381961:0:87342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a32bc00, rc 0) 00000100:00100000:2.0:1780340776.381998:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961136000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340776.382004:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1780340776.382056:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961136000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340776.382066:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2800/0xa2465143277456e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774575 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.382073:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2800/0xa2465143277456e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774575 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340776.382137:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961136128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340776.382162:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340776.385491:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a89f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340776.385608:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961136128 00000100:00100000:3.0:1780340776.385619:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961136128 00000100:00100000:3.0:1780340776.385677:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1780340776.385686:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0470f48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961136128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340776.385846:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0470f48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961136128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (3682us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780340776.385853:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1780340776.385996:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961136128:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1780340776.386042:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1780340776.386052:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2800/0xa2465143277456e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774575 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340776.386064:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2800/0xa2465143277456e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774575 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340776.843019:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340777.867075:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340778.901321:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340779.053355:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340779.053398:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340779.053426:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340779.053452:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340779.053490:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940432768 00000100:00100000:1.0:1780340779.053500:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940432768 00000100:00100000:1.0:1780340779.053549:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1288 00000100:00100000:1.0:1780340779.053558:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940432768:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340779.053622:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940432768:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 65us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340779.053629:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1288 00000100:00100000:1.0:1780340779.053652:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940432896 00000100:00100000:1.0:1780340779.053655:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940432896 00000100:00100000:1.0:1780340779.053686:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940433024 00000100:00100000:1.0:1780340779.053689:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940433024 00000100:00100000:1.0:1780340779.053704:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2528 00000100:00100000:1.0:1780340779.053710:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940432896:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340779.053736:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2408:x1866818940432896:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 26us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340779.053742:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2528 00000100:00100000:1.0:1780340779.053753:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2529 00000100:00100000:1.0:1780340779.053782:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04776c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2407:x1866818940433024:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340779.053807:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04776c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2407:x1866818940433024:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 49us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340779.053813:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2529 00000100:00100000:3.0:1780340779.054548:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940432640 00000100:00100000:3.0:1780340779.054555:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940432640 00000100:00080000:1.0:1780340779.054711:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340779.054716:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780340779.054719:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340779.055332:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 74 00000100:00100000:3.0:1780340779.055345:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0470f4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940432640:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340779.055411:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0470f4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2408:x1866818940432640:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 70us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340779.055435:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 74 00000001:02000400:2.0:1780340779.245625:0:87601:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1780340779.921683:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961136256:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340779.921852:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340779.921979:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961136256 00000100:00100000:1.0:1780340779.921988:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961136256 00000100:00100000:1.0:1780340779.922048:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837 00000100:00100000:1.0:1780340779.922057:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961136256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780340779.922101:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:1.0:1780340779.922154:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961136256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340779.922162:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837 00000100:00100000:1.0:1780340779.922217:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961136256:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1780340779.923147:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340779.923152:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340779.923156:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340779.923162:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3554 00000100:00080000:1.0:1780340779.923167:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340779.923173:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340779.923199:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155ca80 x1866818961136512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340779.923226:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340779.923229:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340779.923232:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340779.923235:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3554 00000100:00080000:1.0:1780340779.923238:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340779.923241:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340779.923252:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155d880 x1866818961136768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340779.923282:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340779.923285:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340779.923286:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340779.923289:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3554 00000100:00080000:1.0:1780340779.923292:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340779.923295:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340779.923308:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047155dc00 x1866818961137024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340779.923347:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340779.923350:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340779.923352:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340779.923355:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3554 00000100:00080000:1.0:1780340779.923368:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340779.923372:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340779.923387:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c04529d5f80 x1866818961137408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340779.923407:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1780340779.923409:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340779.923411:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c047b1fb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340779.923416:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c047b1fb800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340779.923425:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034933bb80 x1866818961137792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340779.923455:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961136512:0@lo:38:kworker.0 00000100:00100000:1.0:1780340779.923504:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340779.923528:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961136768:0@lo:38:kworker.0 00000100:00100000:1.0:1780340779.927964:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340779.928403:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961136512 00000100:00100000:1.0:1780340779.928416:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961136512 00000100:00100000:1.0:1780340779.928474:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961136768 00000100:00100000:1.0:1780340779.928477:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961136768 00000100:00100000:1.0:1780340779.928500:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:1.0:1780340779.928508:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961136512:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780340779.928988:0:63710:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3559 last 0 00000020:00000080:1.0:1780340779.929030:0:63710:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa2465143277457c 00000004:00100000:1.0:1780340779.929050:0:63710:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1780340779.929299:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961136384:0@lo:400:kworker.0 00000100:00100000:3.0:1780340779.929382:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340779.929436:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a07ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961137280:0@lo:400:kworker.0 00000100:00100000:3.0:1780340779.929464:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340779.929494:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1780340779.929501:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961136640:0@lo:400:kworker.0 00000100:00100000:3.0:1780340779.929525:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340779.929557:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961137536:0@lo:400:kworker.0 00000100:00100000:3.0:1780340779.929579:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340779.929628:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961137280 00000100:00100000:3.0:1780340779.929635:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961137280 00000100:00100000:3.0:1780340779.929703:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961137536 00000100:00100000:3.0:1780340779.929706:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961137536 00000100:00100000:3.0:1780340779.929730:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530 00000100:00100000:3.0:1780340779.929740:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961137280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340779.930171:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961137280:12345-0@lo:400:kworker.0 Request processed in 431us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340779.930180:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530 00000100:00100000:3.0:1780340779.930199:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531 00000100:00100000:3.0:1780340779.930206:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961137536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340779.930234:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961137536:12345-0@lo:400:kworker.0 Request processed in 30us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340779.930240:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531 00000100:00100000:3.0:1780340779.930272:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961136640 00000100:00100000:3.0:1780340779.930287:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961136640 00000100:00100000:3.0:1780340779.930314:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:3.0:1780340779.930320:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961136640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340779.930353:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961136640:12345-0@lo:400:kworker.0 Request processed in 33us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340779.930372:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00100000:3.0:1780340779.930385:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1780340779.930389:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961136768:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1780340779.930410:0:63712:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3559 last 0 00000020:00000080:3.0:1780340779.930448:0:63712:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa24651432774583 00000004:00100000:3.0:1780340779.930463:0:63712:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1780340779.930500:0:63712:0:(import.c:65:import_set_state_nolock()) ffff8c0458281800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340779.930537:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1866818961136768:12345-0@lo:38:kworker.0 Request processed in 146us (2785us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340779.930555:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00080000:3.0:1780340779.930578:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780340779.930582:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340779.930584:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340779.930620:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961136640:0@lo:400:kworker.0 00000100:00100000:3.0:1780340779.930633:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961137536:0@lo:400:kworker.0 00000100:00100000:3.0:1780340779.930645:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a07ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961137280:0@lo:400:kworker.0 00000100:00080000:1.0:1780340779.931217:0:63710:0:(import.c:65:import_set_state_nolock()) ffff8c047a95c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780340779.931278:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1866818961136512:12345-0@lo:38:kworker.0 Request processed in 2769us (7772us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340779.931285:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:1.0:1780340779.931324:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961137152:0@lo:400:kworker.0 00000100:00100000:1.0:1780340779.931374:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340779.931416:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1780340779.931425:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961136896:0@lo:400:kworker.0 00000100:00100000:1.0:1780340779.931453:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340779.931472:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961137664:0@lo:400:kworker.0 00000100:00100000:1.0:1780340779.931502:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340779.931534:0:25497:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961137152 00000100:00100000:1.0:1780340779.931539:0:25497:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961137152 00000100:00100000:3.0:1780340779.931836:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961137664 00000100:00100000:3.0:1780340779.931841:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961137664 00000100:00100000:3.0:1780340779.931894:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532 00000100:00100000:3.0:1780340779.931902:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961137664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340779.932124:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349085c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961137664:12345-0@lo:400:kworker.0 Request processed in 222us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340779.932130:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532 00000100:00100000:3.0:1780340779.932164:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961136896 00000100:00100000:3.0:1780340779.932168:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961136896 00000100:00100000:3.0:1780340779.932196:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:3.0:1780340779.932202:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961136896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340779.932233:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961136896:12345-0@lo:400:kworker.0 Request processed in 31us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340779.932239:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00080000:3.0:1780340779.932258:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780340779.932271:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340779.932305:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961136896:0@lo:400:kworker.0 00000100:00100000:3.0:1780340779.932318:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961137664:0@lo:400:kworker.0 00000100:00100000:1.0:1780340779.932540:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533 00000100:00100000:1.0:1780340779.932618:0:25497:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961137152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340779.932657:0:25497:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961137152:12345-0@lo:400:kworker.0 Request processed in 42us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340779.932663:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533 00010000:00010000:2.0:1780340779.933239:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340779.933276:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961136384 00000100:00100000:2.0:1780340779.933282:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961136384 00000100:00100000:2.0:1780340779.933317:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1780340779.933325:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0470f49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961136384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340779.934058:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0470f49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961136384:12345-0@lo:400:kworker.0 Request processed in 731us (4673us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340779.934075:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1780340779.935442:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340779.935513:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961136384:0@lo:400:kworker.0 00000100:00100000:3.0:1780340779.935647:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961137152:0@lo:400:kworker.0 00010000:00080000:1.0:1780340779.936090:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c047155d880 x1866818961136768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340779.936108:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 26 00000001:00100000:3.0:1780340779.936719:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1780340779.939485:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:1.0:1780340779.942324:0:3658:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8c047155d880 x1866818961136768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340804 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340779.942354:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1780340779.945526:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1780340779.945539:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1780340779.945612:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961136768:0@lo:38:kworker.0 00000100:00100000:1.0:1780340779.948380:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961137024:0@lo:38:kworker.0 00000100:00100000:1.0:1780340779.948478:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340779.948524:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961137408:0@lo:38:kworker.0 00000100:00100000:1.0:1780340779.948557:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340779.948578:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961137792:0@lo:38:kworker.0 00000100:00100000:1.0:1780340779.948602:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1780340779.948671:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c047155ca80 x1866818961136512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340779.948694:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 26 00000100:00100000:3.0:1780340779.949681:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961137408 00000100:00100000:3.0:1780340779.949692:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961137408 00000100:00100000:3.0:1780340779.949734:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961137792 00000100:00100000:3.0:1780340779.949737:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961137792 00000100:00100000:3.0:1780340779.949790:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:3.0:1780340779.949798:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961137408:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1780340779.949825:0:63712:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3559 last 0 00000020:00000080:3.0:1780340779.949879:0:63712:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa2465143277458a 00000004:00100000:3.0:1780340779.949895:0:63712:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1780340779.949942:0:63712:0:(import.c:65:import_set_state_nolock()) ffff8c045f0c0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340779.950006:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1866818961137408:12345-0@lo:38:kworker.0 Request processed in 207us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340779.950013:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:3.0:1780340779.950031:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:3.0:1780340779.950036:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04468f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961137792:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1780340779.950051:0:63712:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3559 last 0 00000020:00000080:3.0:1780340779.950073:0:63712:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa24651432774591 00000004:00100000:3.0:1780340779.950080:0:63712:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1780340779.950093:0:63712:0:(import.c:65:import_set_state_nolock()) ffff8c0471e4d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340779.950126:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04468f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1866818961137792:12345-0@lo:38:kworker.0 Request processed in 88us (1522us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340779.950132:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00080000:1.0:1780340779.950818:0:3658:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8c047155ca80 x1866818961136512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340804 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340779.950829:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1780340779.950834:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1780340779.950838:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1780340779.950843:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961136512:0@lo:38:kworker.0 00010000:00080000:1.0:1780340779.950875:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c04529d5f80 x1866818961137408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340779.950890:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 26 00000100:00080000:1.0:1780340779.951740:0:3658:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8c04529d5f80 x1866818961137408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340804 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340779.951751:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1780340779.951755:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1780340779.951790:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1780340779.951795:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961137408:0@lo:38:kworker.0 00010000:00080000:1.0:1780340779.951819:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c034933bb80 x1866818961137792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340779.951830:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 26 00000100:00080000:1.0:1780340779.951836:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1780340779.951840:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1780340779.951842:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c047b1fb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1780340779.951847:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961137792:0@lo:38:kworker.0 00000100:00100000:1.0:1780340779.951911:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961137024 00000100:00100000:1.0:1780340779.951918:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961137024 00000100:00100000:1.0:1780340779.951961:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3838 00000100:00100000:1.0:1780340779.951968:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03484f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961137024:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780340779.951993:0:22660:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8c047a1ec800, cookie 0xa24651432774402 00010000:00080000:1.0:1780340779.951998:0:22660:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff8c047a1ec800 cur 3559 last 1780340774 00000004:00100000:1.0:1780340779.952016:0:22660:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780340779.952046:0:22660:0:(import.c:65:import_set_state_nolock()) ffff8c047a959800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780340779.952137:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03484f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818961137024:12345-0@lo:38:kworker.0 Request processed in 167us (3659us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340779.952144:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3838 00000100:00080000:1.0:1780340779.952192:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 26 00000100:00080000:1.0:1780340779.952201:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1780340779.952205:0:3658:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1780340779.952208:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:1.0:1780340779.952212:0:3658:0:(recover.c:53:ptlrpc_replay_next()) import ffff8c034a39c800 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:1.0:1780340779.952214:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1780340779.952387:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961137024:0@lo:38:kworker.0 00010000:00080000:1.0:1780340779.952423:0:87627:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1780340779.952427:0:87627:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1780340779.952432:0:87627:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1780340779.952854:0:87627:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1780340779.952897:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961137920:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1780340779.952943:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340779.952984:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961137920 00000100:00100000:1.0:1780340779.952988:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961137920 00000100:00100000:1.0:1780340779.953022:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3839 00000100:00100000:1.0:1780340779.953030:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818961137920:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1780340779.953046:0:8410:0:(ldlm_lib.c:3119:target_queue_recovery_request()) @@@ queue final req req@ffff8c0471570e00 x1866818961137920/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:205/0 lens 224/0 e 0 to 0 dl 1780340790 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340779.953056:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818961137920:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 28us (114us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780340779.953062:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3839 00000001:00100000:0.0:1780340779.953837:0:72681:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:3.0:1780340779.954359:0:87367:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1780340779.954367:0:87367:0:(ldlm_lib.c:2668:replay_request_or_update()) Waiting for transno 107374182408 00000020:00080000:3.0:1780340779.954373:0:87367:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340779.954377:0:87367:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182408, next_transno: 107374182408 00010000:00080000:3.0:1780340779.954381:0:87367:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (107374182408) 00000020:00080000:3.0:1780340779.954383:0:87367:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340779.954395:0:87367:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940420096 t107374182408 from 192.168.203.16@tcp req@ffff8c045ecbc700 x1866818940420096/t0(107374182408) o36->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:201/0 lens 528/0 e 0 to 0 dl 1780340786 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1780340779.962114:0:87367:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 7654us 00010000:00010000:3.0:1780340780.003068:0:87367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774598 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.003097:0:87367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774598 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.003113:0:87367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774598 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.003128:0:87367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277459f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.003136:0:87367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277459f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.003211:0:87367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277459f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.003600:0:87367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774598 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.003609:0:87367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774598 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.003616:0:87367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774598 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.003621:0:87367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340780.003626:0:87367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774598 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.003633:0:87367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774598 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.003645:0:87367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c047a68b400) 00010000:00010000:3.0:1780340780.003654:0:87367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340780.003659:0:87367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774598 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.003666:0:87367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432774598 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340780.003683:0:87367:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009431cc84 reply state 000000004c4eb193 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277459f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.003693:0:87367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277459f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.003699:0:87367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c047a68b600) 00010000:00010000:3.0:1780340780.003701:0:87367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340780.003704:0:87367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1780340780.005706:0:87367:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:3.0:1780340780.005730:0:87367:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340780.005733:0:87367:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000020:00080000:3.0:1780340780.005736:0:87367:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340780.005738:0:87367:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000001:00080000:0.0:1780340780.010218:0:87335:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182408 is committed 00010000:00010000:3.0:1780340780.011303:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277459f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.011318:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277459f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.011325:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277459f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.011331:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340780.011349:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277459f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.011358:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277459f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.011374:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c047a68b600) 00010000:00010000:3.0:1780340780.011378:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340780.011383:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277459f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.011390:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277459f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340780.011550:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340780.011618:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940420608 00000100:00100000:3.0:1780340780.011628:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940420608 00000100:00100000:3.0:1780340780.011684:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1280 00000100:00100000:3.0:1780340780.011694:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940420608:12345-192.168.203.16@tcp:36:rm.0 00010000:00080000:3.0:1780340780.011712:0:64454:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 107374182409, current: 107374182409, replaying 00000100:00100000:3.0:1780340780.011735:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940420608:12345-192.168.203.16@tcp:36:rm.0 Request processed in 44us (190us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340780.011741:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1280 00000020:00080000:2.0:1780340780.011889:0:87367:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340780.011894:0:87367:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182409, next_transno: 107374182409 00010000:00080000:2.0:1780340780.011899:0:87367:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (107374182409) 00000020:00080000:2.0:1780340780.011902:0:87367:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340780.011912:0:87367:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940420608 t107374182409 from 192.168.203.16@tcp req@ffff8c0348a69c00 x1866818940420608/t0(107374182409) o36->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:206/0 lens 512/0 e 0 to 0 dl 1780340791 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1780340780.012002:0:87367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327745a6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.012030:0:87367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327745a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.012044:0:87367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327745a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.012056:0:87367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32ac00/0xa246514327745ad lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.012063:0:87367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32ac00/0xa246514327745ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.012070:0:87367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32ac00/0xa246514327745ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.012152:0:87367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa246514327745b4 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.012160:0:87367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa246514327745b4 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.013302:0:87367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa246514327745b4 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.013724:0:87367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa246514327745b4 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.013733:0:87367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa246514327745b4 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.013740:0:87367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa246514327745b4 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.013745:0:87367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340780.013748:0:87367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa246514327745b4 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.013755:0:87367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa246514327745b4 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.013853:0:87367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff8c0455c3b300) 00010000:00010000:2.0:1780340780.013856:0:87367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1780340780.013861:0:87367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa246514327745b4 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.013867:0:87367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa246514327745b4 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.013888:0:87367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327745a6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.013893:0:87367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327745a6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.013909:0:87367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327745a6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.013915:0:87367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340780.013918:0:87367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327745a6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.013924:0:87367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327745a6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.013931:0:87367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455c3bc00) 00010000:00010000:2.0:1780340780.013934:0:87367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340780.013937:0:87367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327745a6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.013942:0:87367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32a000/0xa246514327745a6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340780.013953:0:87367:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002f6af859 reply state 00000000aa8b6379 transno 107374182409 ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32ac00/0xa246514327745ad lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.013980:0:87367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32ac00/0xa246514327745ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.013986:0:87367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c0455c3b000) 00010000:00010000:2.0:1780340780.013988:0:87367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340780.013991:0:87367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1780340780.014522:0:87367:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1780340780.014861:0:87367:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340780.014865:0:87367:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182410 00000020:00080000:2.0:1780340780.014876:0:87367:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340780.014878:0:87367:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182410 00000100:00100000:2.0:1780340780.018939:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340780.019517:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940422656 00000100:00100000:2.0:1780340780.019526:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940422656 00000100:00100000:2.0:1780340780.019645:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1281 00000100:00100000:2.0:1780340780.019655:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2406:x1866818940422656:12345-192.168.203.16@tcp:36:dd.0 00010000:00080000:2.0:1780340780.019742:0:63711:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 107374182410, current: 107374182412, replaying 00000100:00100000:2.0:1780340780.019847:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2406:x1866818940422656:12345-192.168.203.16@tcp:36:dd.0 Request processed in 104us (827us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340780.019855:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1281 00000020:00080000:2.0:1780340780.019875:0:87367:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340780.019878:0:87367:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182412, next_transno: 107374182410 00010000:00080000:2.0:1780340780.019882:0:87367:0:(ldlm_lib.c:2243:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 107374182410, ql: 1, comp: 1, conn: 2, next: 107374182412, next_update 0 last_committed: 107374182408) 00000020:00080000:2.0:1780340780.019887:0:87367:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340780.019895:0:87367:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940422656 t107374182412 from 192.168.203.16@tcp req@ffff8c0485a2bb80 x1866818940422656/t0(107374182412) o36->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:206/0 lens 488/0 e 0 to 0 dl 1780340791 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1780340780.020728:0:87367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa246514327745bb lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.020749:0:87367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa246514327745bb lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.020801:0:87367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa246514327745bb lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780340780.020845:0:87367:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 107374182412 00000004:00010000:2.0:1780340780.020879:0:87367:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005bcc5cde reply state 000000003c044433 transno 107374182412 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa246514327745bb lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.020890:0:87367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa246514327745bb lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.020898:0:87367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c0455c3b500) 00010000:00010000:2.0:1780340780.020901:0:87367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340780.020905:0:87367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1780340780.021040:0:87367:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1780340780.021050:0:87367:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00080000:2.0:1780340780.021060:0:87367:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340780.021063:0:87367:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182413 00000020:00080000:2.0:1780340780.021066:0:87367:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340780.021068:0:87367:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182413 00000100:00100000:1.0:1780340780.027468:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340780.027537:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940423040 00000100:00100000:3.0:1780340780.027547:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940423040 00000100:00100000:3.0:1780340780.027605:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1282 00000100:00100000:3.0:1780340780.027616:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:2406:x1866818940423040:12345-192.168.203.16@tcp:101:dd.0 00010000:00080000:3.0:1780340780.027635:0:70100:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 107374182413, current: 107374182413, replaying 00000100:00100000:3.0:1780340780.027692:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:2406:x1866818940423040:12345-192.168.203.16@tcp:101:dd.0 Request processed in 78us (233us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340780.027712:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1282 00000020:00080000:1.0:1780340780.028360:0:87367:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340780.028372:0:87367:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182413, next_transno: 107374182413 00010000:00080000:1.0:1780340780.028377:0:87367:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (107374182413) 00000020:00080000:1.0:1780340780.028380:0:87367:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340780.028389:0:87367:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940423040 t107374182413 from 192.168.203.16@tcp req@ffff8c03476f2300 x1866818940423040/t0(107374182413) o101->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:206/0 lens 640/0 e 0 to 0 dl 1780340791 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1780340780.028465:0:87367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340780.028487:0:87367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6a00/0xa246514327745c2 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2391 expref: -99 pid: 87367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.028543:0:87367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6600/0xa246514327745c9 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.028557:0:87367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6600/0xa246514327745c9 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.028569:0:87367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6600/0xa246514327745c9 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780340780.028693:0:87367:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x283:0x0], count =127 00000004:00080000:0.0:1780340780.028698:0:87367:0:(osp_object.c:1640:osp_create()) Writing gap [0x280000401:0x283:0x0]+127 in llog 00000004:00080000:0.0:1780340780.028732:0:87367:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x302:0x0], index 0: 0 00000004:00080000:0.0:1780340780.028740:0:87367:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x303:0x0], index 1: 0 00010000:00010000:0.0:1780340780.030127:0:87367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6600/0xa246514327745c9 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2391 expref: 14 pid: 87367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.030210:0:87367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c0455c3b500) 00010000:00010000:0.0:1780340780.030214:0:87367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1780340780.030235:0:87367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6a00/0xa246514327745c2 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2391 expref: 14 pid: 87367 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.030251:0:87367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6600/0xa246514327745c9 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2391 expref: 13 pid: 87367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.030313:0:87367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c0455c3b500) 00010000:00010000:0.0:1780340780.030316:0:87367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1780340780.030318:0:87367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04497b6600, rc 0) 00010000:00080000:0.0:1780340780.030442:0:87367:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1780340780.030463:0:87367:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780340780.030466:0:87367:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182414 00000020:00080000:0.0:1780340780.030470:0:87367:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780340780.030472:0:87367:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182414 00000100:00100000:2.0:1780340780.064484:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340780.064572:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940433152 00000100:00100000:1.0:1780340780.064583:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940433152 00000100:00100000:1.0:1780340780.064644:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1291 00000100:00100000:1.0:1780340780.064654:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:2406:x1866818940433152:12345-192.168.203.16@tcp:400:ldlm_lock_repla.0 00010000:00080000:1.0:1780340780.064680:0:63712:0:(ldlm_lib.c:3119:target_queue_recovery_request()) @@@ queue final req req@ffff8c0485a28380 x1866818940433152/t0(0) o400->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:206/0 lens 224/0 e 0 to 0 dl 1780340791 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340780.064707:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:2406:x1866818940433152:12345-192.168.203.16@tcp:400:ldlm_lock_repla.0 Request processed in 55us (232us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780340780.064715:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1291 00000020:00080000:3.0:1780340780.064784:0:87367:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340780.064789:0:87367:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 107374182414 00010000:00080000:3.0:1780340780.064792:0:87367:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1780340780.064794:0:87367:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1780340780.064801:0:87367:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1780340780.064804:0:87367:0:(ldlm_lib.c:2270:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1780340780.064986:0:87367:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149696 00000100:00100000:1.0:1780340780.072957:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340780.072998:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340780.073034:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340780.073095:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340780.073128:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940433664 00000100:00100000:1.0:1780340780.073138:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940433664 00000100:00100000:3.0:1780340780.073323:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940433536 00000100:00100000:3.0:1780340780.073328:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940433536 00000100:00100000:1.0:1780340780.073376:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2534 00000100:00100000:1.0:1780340780.073389:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2407:x1866818940433664:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340780.073465:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2407:x1866818940433664:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 80us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340780.073473:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2534 00000100:00100000:3.0:1780340780.073591:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2535 00000100:00100000:3.0:1780340780.073599:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940433536:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340780.073636:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940433536:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 37us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340780.073642:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2535 00000100:00100000:3.0:1780340780.073661:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940433280 00000100:00100000:3.0:1780340780.073664:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940433280 00000100:00100000:3.0:1780340780.073688:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 76 00000100:00100000:3.0:1780340780.073694:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444a90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940433280:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340780.073722:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444a90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940433280:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 27us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340780.073728:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 76 00000100:00100000:2.0:1780340780.073944:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940433408 00000100:00100000:2.0:1780340780.073949:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940433408 00000100:00100000:2.0:1780340780.073982:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1292 00000100:00100000:2.0:1780340780.073990:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940433408:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340780.074034:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940433408:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 45us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340780.074040:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1292 00000001:00100000:1.0:1780340780.076050:0:87335:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000001:00100000:1.0:1780340780.076060:0:87335:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:1.0:1780340780.076082:0:87335:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182413 is committed 00000001:00080000:3.0:1780340780.076173:0:87367:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1780340780.076214:0:87367:0:(ldlm_lib.c:1981:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1780340780.076227:0:87367:0:(ldlm_lib.c:2922:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8c0471570e00 x1866818961137920/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:205/0 lens 224/0 e 0 to 0 dl 1780340790 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1780340780.076363:0:87367:0:(ldlm_lib.c:2922:target_recovery_thread()) @@@ processing final ping from 192.168.203.16@tcp: req@ffff8c0485a28380 x1866818940433152/t0(0) o400->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:206/0 lens 224/0 e 0 to 0 dl 1780340791 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1780340780.076417:0:87367:0:(ldlm_lib.c:1853:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:05, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1780340780.079381:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1780340780.079396:0:3658:0:(client.c:3224:ptlrpc_resend_req()) @@@ going to resend req@ffff8c04468f5880 x1866818961137920/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340795 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340780.079408:0:3658:0:(client.c:3233:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8c04468f5880 x1866818961137920/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340795 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340780.079415:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1780340780.079436:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1780340780.079441:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961137920:0@lo:400:ldlm_lock_repla.0 00010000:00010000:2.0:1780340780.079908:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32ac00/0xa246514327745ad lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.079920:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32ac00/0xa246514327745ad lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.079928:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32ac00/0xa246514327745ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.079942:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32ac00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340780.079946:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32ac00/0xa246514327745ad lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.079954:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32ac00/0xa246514327745ad lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.079972:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c0455c3b000) 00010000:00010000:2.0:1780340780.079976:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340780.079980:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32ac00/0xa246514327745ad lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.079987:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c047a32ac00/0xa246514327745ad lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.080015:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa246514327745bb lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.080021:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa246514327745bb lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.080027:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa246514327745bb lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.080032:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440030200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340780.080035:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa246514327745bb lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.080040:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa246514327745bb lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.080059:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c0455c3b500) 00010000:00010000:2.0:1780340780.080061:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340780.080065:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa246514327745bb lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.080070:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa246514327745bb lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340780.086002:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780340780.086028:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961138048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340780.086103:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340780.086160:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961138048 00000100:00100000:2.0:1780340780.086168:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961138048 00000100:00100000:2.0:1780340780.086220:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840 00000100:00100000:2.0:1780340780.086228:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961138048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780340780.086274:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445232640 avail 1298993152 00000100:00100000:2.0:1780340780.086321:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961138048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340780.086328:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840 00000100:00100000:2.0:1780340780.086376:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961138048:0@lo:41:osp-pre-0-1.0 00000004:00000080:2.0:1780340780.131986:0:87367:0:(mdd_device.c:2374:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9927472afe10 00100000:10000000:2.0:1780340780.132002:0:87367:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1780340780.132976:0:87356:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x303:0x0] 00000100:00100000:3.0:1780340780.133019:0:87356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87356:1866818961138176:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1780340780.133082:0:87356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340780.133119:0:87356:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443afbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340780.133233:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961138176 00000100:00100000:0.0:1780340780.133242:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961138176 00000100:00100000:0.0:1780340780.133298:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5898 00000100:00100000:0.0:1780340780.133307:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:87356:x1866818961138176:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1780340780.133334:0:25494:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 801 -> diff = -30 00002000:02000040:0.0:1780340780.133338:0:25494:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:772 to 0x2c0000401:801) 00000004:00080000:2.0:1780340780.137533:0:87354:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x302:0x0] 00000100:00100000:2.0:1780340780.137588:0:87354:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a2ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87354:1866818961138304:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1780340780.137659:0:87354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340780.137692:0:87354:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034accf900 going to sleep for 11 seconds 00000100:00100000:2.0:1780340780.137729:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961138304 00000100:00100000:2.0:1780340780.137735:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961138304 00000100:00100000:2.0:1780340780.137797:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5899 00000100:00100000:2.0:1780340780.137807:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:87354:x1866818961138304:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1780340780.137835:0:23157:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 801 -> diff = -31 00002000:02000040:2.0:1780340780.137840:0:23157:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:771 to 0x280000401:801) 00002000:00010000:0.0:1780340780.151545:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x321:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.151559:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea156519/0xa246514327745d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.151576:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.151578:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.151583:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea156519/0xa246514327745d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.151601:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea156519/0xa246514327745d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.151627:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea156519/0xa246514327745d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.151635:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea156519/0xa246514327745d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.151654:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340780.151790:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x320:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.151795:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016a815a8/0xa246514327745d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.151804:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.151805:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.151808:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016a815a8/0xa246514327745d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.151817:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016a815a8/0xa246514327745d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.151824:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016a815a8/0xa246514327745d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.151830:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016a815a8/0xa246514327745d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.151844:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1780340780.151886:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x31f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.151891:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa246514327745de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.151898:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.151899:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.151901:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa246514327745de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.151910:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa246514327745de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.151917:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa246514327745de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.151924:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa246514327745de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.151935:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1780340780.151973:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x31e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.151977:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa246514327745e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.151985:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.151986:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.151989:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa246514327745e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.151996:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa246514327745e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.152009:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa246514327745e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.152016:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa246514327745e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.152031:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1780340780.152041:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1780340780.152046:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea156519/0xa246514327745d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.152053:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04497b6a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.152057:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea156519/0xa246514327745d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.152065:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea156519/0xa246514327745d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.152080:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea156519/0xa246514327745d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.152088:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea156519/0xa246514327745d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.152107:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1780340780.152116:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016a815a8/0xa246514327745d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.152123:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.152126:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016a815a8/0xa246514327745d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.152134:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016a815a8/0xa246514327745d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.153509:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340780.153521:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa246514327745de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.153532:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.153536:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa246514327745de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.153545:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa246514327745de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.153563:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa246514327745de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.153570:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000377071fc/0xa246514327745de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.153597:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340780.153615:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa246514327745e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.153621:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.153624:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa246514327745e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.153630:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa246514327745e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.153640:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa246514327745e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.153647:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c155dc1/0xa246514327745e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.153662:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.153664:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.153666:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.153974:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.158631:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.158897:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016a815a8/0xa246514327745d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.158917:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016a815a8/0xa246514327745d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.158946:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.158948:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.158950:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340780.159090:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x31d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.159097:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a95b224/0xa246514327745ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159111:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.159113:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.159119:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a95b224/0xa246514327745ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159162:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a95b224/0xa246514327745ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159173:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a95b224/0xa246514327745ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159181:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a95b224/0xa246514327745ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159210:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340780.159251:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x31c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.159256:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d176b62/0xa246514327745f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159273:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.159275:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.159278:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d176b62/0xa246514327745f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159286:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d176b62/0xa246514327745f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159293:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d176b62/0xa246514327745f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159299:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d176b62/0xa246514327745f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159317:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1780340780.159357:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x31b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.159363:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f7173b1/0xa246514327745fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159370:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.159371:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.159374:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f7173b1/0xa246514327745fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159382:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f7173b1/0xa246514327745fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159388:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f7173b1/0xa246514327745fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159395:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f7173b1/0xa246514327745fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159406:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1780340780.159443:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x31a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.159447:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432774601 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159454:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.159455:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.159463:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432774601 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159472:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432774601 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159480:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432774601 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159487:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432774601 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159498:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1780340780.159534:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x319:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.159539:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058c9e19e/0xa24651432774608 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159546:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.159548:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.159551:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058c9e19e/0xa24651432774608 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159558:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058c9e19e/0xa24651432774608 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159565:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058c9e19e/0xa24651432774608 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159583:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058c9e19e/0xa24651432774608 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159598:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1780340780.159608:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1780340780.159612:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a95b224/0xa246514327745ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159619:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.159623:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a95b224/0xa246514327745ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159631:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a95b224/0xa246514327745ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159643:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a95b224/0xa246514327745ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159651:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a95b224/0xa246514327745ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159665:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1780340780.159668:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d176b62/0xa246514327745f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159685:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.159688:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d176b62/0xa246514327745f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159695:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d176b62/0xa246514327745f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159706:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d176b62/0xa246514327745f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159712:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d176b62/0xa246514327745f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159726:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1780340780.159730:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f7173b1/0xa246514327745fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159736:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.159739:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f7173b1/0xa246514327745fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159745:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f7173b1/0xa246514327745fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159754:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f7173b1/0xa246514327745fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159793:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f7173b1/0xa246514327745fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159806:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780340780.159809:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432774601 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159815:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.159818:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432774601 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159825:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432774601 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159835:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432774601 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159842:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021ecff19/0xa24651432774601 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159853:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340780.159856:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058c9e19e/0xa24651432774608 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159862:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.159871:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058c9e19e/0xa24651432774608 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159878:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058c9e19e/0xa24651432774608 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159888:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058c9e19e/0xa24651432774608 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159893:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058c9e19e/0xa24651432774608 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159906:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.159908:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.159910:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340780.159948:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x318:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.159953:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa2465143277460f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159960:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.159961:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.159964:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa2465143277460f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159972:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa2465143277460f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159980:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa2465143277460f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.159993:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa2465143277460f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160005:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340780.160012:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340780.160015:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa2465143277460f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160022:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.160025:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa2465143277460f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160032:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa2465143277460f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160042:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa2465143277460f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160049:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e60d15f/0xa2465143277460f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160061:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.160063:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.160065:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340780.160102:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x317:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.160114:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e3987f1/0xa24651432774616 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160121:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.160123:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.160126:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e3987f1/0xa24651432774616 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160134:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e3987f1/0xa24651432774616 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160142:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e3987f1/0xa24651432774616 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160149:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e3987f1/0xa24651432774616 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160161:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340780.160168:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340780.160171:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e3987f1/0xa24651432774616 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160177:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.160180:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e3987f1/0xa24651432774616 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160187:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e3987f1/0xa24651432774616 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160208:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e3987f1/0xa24651432774616 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160214:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e3987f1/0xa24651432774616 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160228:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.160230:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.160232:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340780.160287:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x316:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.160292:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f5c2c60/0xa2465143277461d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160299:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.160301:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.160303:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f5c2c60/0xa2465143277461d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160311:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f5c2c60/0xa2465143277461d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160318:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f5c2c60/0xa2465143277461d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160325:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f5c2c60/0xa2465143277461d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160346:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340780.160353:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340780.160356:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f5c2c60/0xa2465143277461d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160363:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.160366:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f5c2c60/0xa2465143277461d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160373:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f5c2c60/0xa2465143277461d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160383:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f5c2c60/0xa2465143277461d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160391:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f5c2c60/0xa2465143277461d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160404:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.160405:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.160407:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340780.160443:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x315:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.160448:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774624 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160456:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.160463:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.160466:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774624 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160475:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774624 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160482:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774624 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160488:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774624 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160500:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340780.160505:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340780.160508:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774624 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160515:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.160518:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774624 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160525:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774624 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160534:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774624 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160551:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a917c1b/0xa24651432774624 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160566:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.160567:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.160569:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340780.160606:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x314:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.160611:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa2465143277462b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160618:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.160620:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.160622:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa2465143277462b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160630:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa2465143277462b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160637:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa2465143277462b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160644:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa2465143277462b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160656:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340780.160663:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340780.160672:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa2465143277462b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160678:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.160681:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa2465143277462b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160689:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa2465143277462b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160700:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa2465143277462b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160706:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d15f133/0xa2465143277462b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160720:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.160722:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.160723:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340780.160787:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x313:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.160793:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774632 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160800:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.160802:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.160804:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774632 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160824:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774632 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160831:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774632 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160838:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774632 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160849:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340780.160856:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340780.160859:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774632 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160866:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.160869:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774632 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160875:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774632 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160885:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774632 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160892:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed57d1c5/0xa24651432774632 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160912:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.160914:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.160915:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340780.160956:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x312:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.160961:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774639 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160968:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.160970:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.160973:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774639 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160980:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774639 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160988:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774639 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.160994:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774639 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161005:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340780.161011:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340780.161014:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774639 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161031:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.161034:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774639 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161041:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774639 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161051:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774639 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161057:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001da160a4/0xa24651432774639 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161072:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.161074:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.161075:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340780.161115:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x311:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.161120:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432774640 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161127:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.161129:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.161132:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432774640 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161140:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432774640 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161154:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432774640 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161161:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432774640 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161174:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340780.161181:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340780.161184:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432774640 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161190:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.161193:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432774640 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161200:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432774640 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161210:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432774640 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161217:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d19bb453/0xa24651432774640 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161229:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.161236:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.161238:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340780.161289:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x310:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.161294:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432774647 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161301:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.161303:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.161305:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432774647 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161314:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432774647 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161321:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432774647 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161328:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432774647 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161339:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340780.161345:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340780.161348:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432774647 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161354:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.161357:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432774647 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161375:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432774647 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161385:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432774647 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161391:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009a59c6d/0xa24651432774647 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161403:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.161404:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.161406:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340780.161441:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x30f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.161446:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa2465143277464e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161453:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.161454:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.161457:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa2465143277464e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161464:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa2465143277464e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161471:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa2465143277464e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161488:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa2465143277464e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161500:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340780.161508:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340780.161511:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa2465143277464e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161516:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.161519:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa2465143277464e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161525:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa2465143277464e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161534:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa2465143277464e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161542:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa2465143277464e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161553:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.161555:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.161556:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340780.161595:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x30e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.161607:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774655 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161614:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.161615:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.161618:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774655 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161627:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774655 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161634:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774655 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161640:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774655 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161652:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340780.161659:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340780.161662:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774655 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161669:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.161672:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774655 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161679:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774655 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161700:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774655 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161707:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774655 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161719:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.161721:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.161723:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1780340780.161784:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x30d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340780.161789:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa2465143277465c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161796:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.161797:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340780.161799:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa2465143277465c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161808:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa2465143277465c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161815:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa2465143277465c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161823:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa2465143277465c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161845:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340780.161852:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340780.161856:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa2465143277465c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161863:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.161865:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa2465143277465c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161873:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa2465143277465c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161883:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa2465143277465c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.161890:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d51038d/0xa2465143277465c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.162050:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.162057:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.162062:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.162067:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1780340780.170320:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x30c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340780.170333:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee52454d/0xa24651432774663 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170351:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340780.170353:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340780.170358:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee52454d/0xa24651432774663 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170371:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee52454d/0xa24651432774663 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170380:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee52454d/0xa24651432774663 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170386:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee52454d/0xa24651432774663 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170429:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1780340780.170468:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x30b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340780.170473:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cdabb58/0xa2465143277466a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170481:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340780.170482:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340780.170485:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cdabb58/0xa2465143277466a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170494:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cdabb58/0xa2465143277466a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170501:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cdabb58/0xa2465143277466a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170509:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cdabb58/0xa2465143277466a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170522:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1780340780.170557:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x30a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340780.170561:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094894bb9/0xa24651432774671 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170568:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340780.170569:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340780.170577:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094894bb9/0xa24651432774671 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170587:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094894bb9/0xa24651432774671 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170596:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094894bb9/0xa24651432774671 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170602:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094894bb9/0xa24651432774671 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170616:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1780340780.170652:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x309:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340780.170656:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8631c51/0xa24651432774678 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170663:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340780.170664:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340780.170667:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8631c51/0xa24651432774678 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170676:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8631c51/0xa24651432774678 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170682:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8631c51/0xa24651432774678 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170700:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8631c51/0xa24651432774678 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170711:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1780340780.170749:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x308:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340780.170753:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcbe6e02/0xa2465143277467f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170788:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340780.170789:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340780.170792:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcbe6e02/0xa2465143277467f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170801:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcbe6e02/0xa2465143277467f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170808:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcbe6e02/0xa2465143277467f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170815:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcbe6e02/0xa2465143277467f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170824:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1780340780.170859:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x307:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340780.170864:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028914cf5/0xa24651432774686 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170881:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340780.170882:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340780.170885:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028914cf5/0xa24651432774686 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170893:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028914cf5/0xa24651432774686 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170901:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028914cf5/0xa24651432774686 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170908:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028914cf5/0xa24651432774686 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170917:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1780340780.170957:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x306:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340780.170962:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c654df7/0xa2465143277468d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170969:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340780.170970:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340780.170973:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c654df7/0xa2465143277468d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.170981:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c654df7/0xa2465143277468d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.171000:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c654df7/0xa2465143277468d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.171006:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c654df7/0xa2465143277468d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.171015:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1780340780.171051:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x305:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340780.171055:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000025963d3/0xa24651432774694 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.171063:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340780.171064:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340780.171067:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000025963d3/0xa24651432774694 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.171076:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000025963d3/0xa24651432774694 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.171083:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000025963d3/0xa24651432774694 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.171090:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000025963d3/0xa24651432774694 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.171098:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:1.0:1780340780.171141:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x304:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1780340780.171145:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa2465143277469b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.171153:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340780.171154:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340780.171157:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa2465143277469b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.171165:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa2465143277469b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.171171:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa2465143277469b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.171178:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa2465143277469b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340780.171187:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00080000:1.0:1780340780.171212:0:25494:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:771 00000100:00100000:1.0:1780340780.171319:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:87356:x1866818961138176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 38009us (38233us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340780.171329:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5898 00010000:00010000:3.0:1780340780.171442:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1780340780.171450:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee52454d/0xa24651432774663 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171471:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b3a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.171475:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee52454d/0xa24651432774663 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171483:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee52454d/0xa24651432774663 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171500:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee52454d/0xa24651432774663 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171507:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee52454d/0xa24651432774663 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171527:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1780340780.171531:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cdabb58/0xa2465143277466a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171537:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b2000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.171540:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cdabb58/0xa2465143277466a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171548:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cdabb58/0xa2465143277466a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171557:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cdabb58/0xa2465143277466a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171570:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cdabb58/0xa2465143277466a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171583:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1780340780.171586:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094894bb9/0xa24651432774671 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171592:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b3600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.171594:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094894bb9/0xa24651432774671 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171601:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094894bb9/0xa24651432774671 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171610:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094894bb9/0xa24651432774671 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171617:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094894bb9/0xa24651432774671 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171627:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1780340780.171630:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8631c51/0xa24651432774678 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171635:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b3200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.171644:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8631c51/0xa24651432774678 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171652:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8631c51/0xa24651432774678 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171662:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8631c51/0xa24651432774678 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171668:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8631c51/0xa24651432774678 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171680:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1780340780.171683:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcbe6e02/0xa2465143277467f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171689:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b3800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.171691:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcbe6e02/0xa2465143277467f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171698:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcbe6e02/0xa2465143277467f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171706:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcbe6e02/0xa2465143277467f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171712:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcbe6e02/0xa2465143277467f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171732:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780340780.171734:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028914cf5/0xa24651432774686 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171740:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b2e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.171743:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028914cf5/0xa24651432774686 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171750:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028914cf5/0xa24651432774686 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171789:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028914cf5/0xa24651432774686 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171796:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028914cf5/0xa24651432774686 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171808:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780340780.171811:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c654df7/0xa2465143277468d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171818:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b3000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.171821:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c654df7/0xa2465143277468d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171841:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c654df7/0xa2465143277468d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171851:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c654df7/0xa2465143277468d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171858:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c654df7/0xa2465143277468d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171871:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340780.171874:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000025963d3/0xa24651432774694 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171880:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b2600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.171883:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000025963d3/0xa24651432774694 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171890:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000025963d3/0xa24651432774694 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171899:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000025963d3/0xa24651432774694 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171905:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000025963d3/0xa24651432774694 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171927:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340780.171930:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa2465143277469b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171937:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.171939:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa2465143277469b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171947:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa2465143277469b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171957:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa2465143277469b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171964:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003842f191/0xa2465143277469b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.171975:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.171976:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.171978:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.171986:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.171991:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.171996:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340780.172036:0:87356:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87356:1866818961138176:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1780340780.172051:0:87356:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x321:0x0] from OST, last_created [0x2c0000401:0x321:0x0]last_used is [0x2c0000401:0x303:0x0] 00000100:00100000:3.0:1780340780.172140:0:87356:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87356:1866818961138560:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1780340780.172182:0:87356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340780.172206:0:87356:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443afbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1780340780.172221:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340780.172231:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961138432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340780.172255:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340780.172296:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961138560 00000100:00100000:3.0:1780340780.172302:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961138560 00000100:00100000:3.0:1780340780.172337:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5900 00000100:00100000:3.0:1780340780.172345:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:87356:x1866818961138560:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1780340780.172382:0:25489:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 802 00000100:00100000:3.0:1780340780.173694:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:87356:x1866818961138560:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1347us (1509us total) trans 4294969453 rc 0/0 00000100:00100000:3.0:1780340780.173703:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5900 00000100:00100000:3.0:1780340780.173739:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961138432 00000100:00100000:3.0:1780340780.173744:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961138432 00000100:00100000:3.0:1780340780.173801:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:3.0:1780340780.173810:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961138432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340780.173828:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340780.173862:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961138432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340780.173868:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00000100:00100000:3.0:1780340780.173914:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961138432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340780.173945:0:87356:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87356:1866818961138560:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1780340780.173954:0:87356:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x321:0x0]-[0x2c0000401:0x341:0x0] 00010000:00010000:0.0:1780340780.174289:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.174293:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.174295:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340780.177185:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x321:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.177201:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa246514327746a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177221:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.177223:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.177229:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa246514327746a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177245:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa246514327746a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177256:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa246514327746a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177273:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa246514327746a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177298:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340780.177419:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x320:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.177425:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa246514327746a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177450:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.177451:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.177454:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa246514327746a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177463:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa246514327746a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177470:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa246514327746a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177477:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa246514327746a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177499:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1780340780.177539:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x31f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.177544:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa246514327746b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177551:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.177553:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.177555:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa246514327746b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177563:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa246514327746b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177581:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa246514327746b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177588:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa246514327746b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177601:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1780340780.177641:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x31e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.177646:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa246514327746b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177653:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.177654:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.177656:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa246514327746b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177665:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa246514327746b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177672:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa246514327746b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177679:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa246514327746b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177690:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1780340780.177733:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x31d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.177738:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa246514327746be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177745:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.177746:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.177749:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa246514327746be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177756:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa246514327746be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177790:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa246514327746be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177797:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa246514327746be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177809:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1780340780.177843:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x31c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.177847:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa246514327746c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177855:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.177856:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.177859:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa246514327746c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177867:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa246514327746c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177883:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa246514327746c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177890:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa246514327746c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177899:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1780340780.177935:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x31b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.177939:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa246514327746cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177946:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.177947:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.177950:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa246514327746cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177957:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa246514327746cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177965:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa246514327746cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177972:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa246514327746cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.177981:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1780340780.178023:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x31a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.178027:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa246514327746d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178035:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178036:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178039:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa246514327746d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178048:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa246514327746d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178055:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa246514327746d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178062:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa246514327746d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178070:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1780340780.178102:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x319:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.178107:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa246514327746da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178114:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178116:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178118:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa246514327746da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178126:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa246514327746da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178140:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa246514327746da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178146:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa246514327746da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178155:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1780340780.178190:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x318:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.178195:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000566b0733/0xa246514327746e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178202:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178203:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178206:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000566b0733/0xa246514327746e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178214:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000566b0733/0xa246514327746e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178221:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000566b0733/0xa246514327746e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178228:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000566b0733/0xa246514327746e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178236:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1780340780.178294:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x317:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.178299:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7befbc0/0xa246514327746e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178307:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178308:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178311:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7befbc0/0xa246514327746e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178320:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7befbc0/0xa246514327746e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178327:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7befbc0/0xa246514327746e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178334:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7befbc0/0xa246514327746e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178342:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:2.0:1780340780.178378:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x316:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.178382:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003af7b3bf/0xa246514327746ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178388:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178390:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178392:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003af7b3bf/0xa246514327746ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178400:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003af7b3bf/0xa246514327746ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178414:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003af7b3bf/0xa246514327746ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178421:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003af7b3bf/0xa246514327746ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178429:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:2.0:1780340780.178463:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x315:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.178468:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa246514327746f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178474:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178476:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178478:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa246514327746f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178486:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa246514327746f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178491:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa246514327746f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178498:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa246514327746f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178506:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:2.0:1780340780.178547:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x314:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.178551:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327746fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178559:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178560:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178563:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327746fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178570:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327746fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178577:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327746fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178584:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327746fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178592:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:2.0:1780340780.178622:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x313:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.178627:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa24651432774704 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178634:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178635:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178637:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa24651432774704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178644:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa24651432774704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178657:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa24651432774704 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178663:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa24651432774704 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178671:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:2.0:1780340780.178705:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x312:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.178709:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa2465143277470b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178716:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178718:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178721:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa2465143277470b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178729:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa2465143277470b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178736:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa2465143277470b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178743:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa2465143277470b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178750:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:2.0:1780340780.178816:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x311:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.178820:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432774712 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178828:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178829:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178831:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432774712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178839:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432774712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178845:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432774712 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178852:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432774712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178860:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:2.0:1780340780.178892:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x310:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.178896:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa24651432774719 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178903:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178904:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178906:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa24651432774719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178915:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa24651432774719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178927:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa24651432774719 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178934:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa24651432774719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178943:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:2.0:1780340780.178977:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x30f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.178982:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432774720 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.178989:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178991:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.178994:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432774720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.179002:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432774720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.179009:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432774720 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.179017:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432774720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.179026:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:2.0:1780340780.179070:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x30e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.179075:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432774727 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.179083:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.179084:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.179087:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432774727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.179095:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432774727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.179103:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432774727 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.179110:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432774727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.179117:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:2.0:1780340780.179149:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x30d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.179154:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277472e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.179161:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.179162:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.179165:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277472e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.179174:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277472e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.179188:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277472e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.179195:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277472e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.179203:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:2.0:1780340780.179237:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x30c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340780.179241:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774735 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.179249:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.179250:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340780.179252:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179421:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:0.0:1780340780.179430:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa246514327746a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179439:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440030200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.179449:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa246514327746a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179459:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa246514327746a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179477:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa246514327746a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179484:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000badc0708/0xa246514327746a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179506:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:0.0:1780340780.179510:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa246514327746a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179516:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.179519:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa246514327746a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179525:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa246514327746a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179534:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa246514327746a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179541:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000576864b9/0xa246514327746a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179563:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:0.0:1780340780.179566:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa246514327746b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179573:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440030e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.179576:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa246514327746b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179583:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa246514327746b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179592:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa246514327746b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179599:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010ff8653/0xa246514327746b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179611:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:0.0:1780340780.179614:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa246514327746b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179620:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440030800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.179623:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa246514327746b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179640:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa246514327746b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179651:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa246514327746b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179657:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b031c8df/0xa246514327746b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179670:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:0.0:1780340780.179673:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa246514327746be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179680:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.179682:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa246514327746be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179688:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa246514327746be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179697:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa246514327746be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179703:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa246514327746be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179726:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:0.0:1780340780.179730:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa246514327746c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179735:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.179738:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa246514327746c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179745:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa246514327746c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179755:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa246514327746c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179780:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa246514327746c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179793:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1780340780.179796:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa246514327746cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179802:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.179805:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa246514327746cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179823:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa246514327746cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179833:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa246514327746cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179839:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000236f9084/0xa246514327746cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179851:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1780340780.179855:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa246514327746d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179861:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.179864:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa246514327746d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179871:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa246514327746d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179880:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa246514327746d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179887:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa246514327746d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179910:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1780340780.179914:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa246514327746da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179920:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32ac00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.179923:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa246514327746da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179929:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa246514327746da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179938:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa246514327746da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179944:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008491f401/0xa246514327746da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179955:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1780340780.179959:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000566b0733/0xa246514327746e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179965:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.179968:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000566b0733/0xa246514327746e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179987:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000566b0733/0xa246514327746e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.179997:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000566b0733/0xa246514327746e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180003:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000566b0733/0xa246514327746e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180017:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1780340780.180020:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7befbc0/0xa246514327746e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180026:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6ce00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.180029:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7befbc0/0xa246514327746e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180035:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7befbc0/0xa246514327746e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180043:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7befbc0/0xa246514327746e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180049:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7befbc0/0xa246514327746e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180072:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1780340780.180076:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003af7b3bf/0xa246514327746ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180082:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6d200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.180085:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003af7b3bf/0xa246514327746ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180093:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003af7b3bf/0xa246514327746ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180102:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003af7b3bf/0xa246514327746ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180108:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003af7b3bf/0xa246514327746ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180119:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1780340780.180122:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa246514327746f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180129:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6dc00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.180132:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa246514327746f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180234:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa246514327746f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180245:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa246514327746f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180251:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006eac0d47/0xa246514327746f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180276:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1780340780.180280:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327746fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180286:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6d000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.180289:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327746fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180296:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327746fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180305:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327746fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180310:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004da309a2/0xa246514327746fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180331:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1780340780.180334:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa24651432774704 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180341:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6cc00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.180344:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa24651432774704 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180351:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa24651432774704 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180361:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa24651432774704 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180368:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e32d6b86/0xa24651432774704 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180379:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1780340780.180382:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa2465143277470b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180388:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6d800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.180390:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa2465143277470b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180408:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa2465143277470b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180418:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa2465143277470b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180426:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e384f17/0xa2465143277470b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180439:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1780340780.180443:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432774712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180448:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6da00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.180451:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432774712 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180457:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432774712 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180466:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432774712 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180473:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c6e0867/0xa24651432774712 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180496:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1780340780.180499:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa24651432774719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180505:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6d400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.180508:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa24651432774719 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180516:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa24651432774719 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180526:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa24651432774719 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180532:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6e74ce/0xa24651432774719 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180545:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1780340780.180548:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432774720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180555:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6d600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.180557:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432774720 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180574:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432774720 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180585:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432774720 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180592:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053c66587/0xa24651432774720 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180605:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780340780.180608:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432774727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180614:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6de00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.180617:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432774727 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180624:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432774727 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180633:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432774727 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180639:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000298eb156/0xa24651432774727 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180665:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340780.180668:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277472e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180675:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6c200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.180679:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277472e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180686:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277472e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180695:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277472e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180702:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097d27c30/0xa2465143277472e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.180713:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.180715:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.180717:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.180732:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.180926:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.180932:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.180937:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340780.185867:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.185903:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774735 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340780.185913:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186031:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780340780.186191:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x30b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340780.186198:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277473c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186212:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340780.186214:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340780.186220:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277473c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186234:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277473c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186242:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277473c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186248:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277473c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186270:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1780340780.186308:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x30a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340780.186312:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b6e5d20/0xa24651432774743 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186319:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340780.186333:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340780.186336:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b6e5d20/0xa24651432774743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186345:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b6e5d20/0xa24651432774743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186353:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005b6e5d20/0xa24651432774743 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186360:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005b6e5d20/0xa24651432774743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186376:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1780340780.186387:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780340780.186393:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186402:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6ca00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.186406:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774735 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186416:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774735 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186434:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774735 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186451:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774735 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186480:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340780.186483:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277473c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186489:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.186492:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277473c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186499:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277473c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186510:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277473c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186516:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277473c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186528:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340780.186531:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005b6e5d20/0xa24651432774743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186537:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.186548:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005b6e5d20/0xa24651432774743 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186556:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005b6e5d20/0xa24651432774743 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186564:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005b6e5d20/0xa24651432774743 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186571:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b6e5d20/0xa24651432774743 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186583:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.186584:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.186586:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340780.186628:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x309:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340780.186633:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa2465143277474a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186641:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340780.186643:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340780.186646:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa2465143277474a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186655:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa2465143277474a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186663:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa2465143277474a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186675:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa2465143277474a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186690:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340780.186698:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340780.186702:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa2465143277474a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186709:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.186711:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa2465143277474a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186719:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa2465143277474a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186731:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa2465143277474a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186737:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa2465143277474a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186749:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.186750:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.186752:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340780.186823:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x308:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340780.186834:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774751 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186841:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340780.186843:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340780.186845:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186853:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186861:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774751 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186868:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186881:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340780.186889:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340780.186893:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186900:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.186903:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774751 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186911:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774751 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186932:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774751 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186939:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432774751 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.186951:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.186953:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.186955:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340780.186996:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x307:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340780.187001:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774758 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187009:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340780.187010:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340780.187013:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187022:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187029:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774758 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187037:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187059:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340780.187066:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340780.187069:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187075:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.187079:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774758 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187086:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774758 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187098:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774758 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187104:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa24651432774758 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187117:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.187118:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.187120:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340780.187164:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x306:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340780.187168:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa2465143277475f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187175:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340780.187182:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340780.187185:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa2465143277475f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187194:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa2465143277475f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187200:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa2465143277475f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187206:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa2465143277475f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187219:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340780.187225:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340780.187228:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa2465143277475f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187234:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.187237:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa2465143277475f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187243:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa2465143277475f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187253:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa2465143277475f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187281:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa2465143277475f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187295:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.187297:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.187298:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340780.187340:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x305:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340780.187344:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa24651432774766 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187352:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340780.187353:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340780.187356:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa24651432774766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187364:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa24651432774766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187372:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa24651432774766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187378:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa24651432774766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187390:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340780.187396:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340780.187407:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa24651432774766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187414:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.187417:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa24651432774766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187425:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa24651432774766 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187435:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa24651432774766 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187441:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa24651432774766 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187454:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.187456:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.187457:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340780.187502:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x304:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340780.187507:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa2465143277476d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187515:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340780.187516:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340780.187518:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa2465143277476d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187536:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa2465143277476d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187543:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa2465143277476d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187551:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa2465143277476d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187563:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340780.187569:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340780.187572:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa2465143277476d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187578:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722afa00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340780.187581:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa2465143277476d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187587:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa2465143277476d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187597:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa2465143277476d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187604:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a02e3a4d/0xa2465143277476d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187622:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.187623:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340780.187625:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.187643:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340780.187660:0:23157:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x303:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340780.187665:0:23157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa24651432774774 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187673:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340780.187674:0:23157:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340780.187677:0:23157:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa24651432774774 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187684:0:23157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa24651432774774 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187691:0:23157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa24651432774774 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187697:0:23157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa24651432774774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340780.187717:0:23157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340780.187733:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340780.187738:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa24651432774774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1780340780.187742:0:23157:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:770 00010000:00010000:0.0:1780340780.187754:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340780.187840:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa24651432774774 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.187849:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa24651432774774 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.187861:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa24651432774774 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.187867:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2d9b6c9/0xa24651432774774 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 23157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340780.187880:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.187883:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340780.187885:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340780.187890:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:87354:x1866818961138304:12345-0@lo:5:osp-pre-0-0.0 Request processed in 50079us (50226us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340780.187901:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5899 00000100:00100000:3.0:1780340780.187974:0:87354:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a2ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87354:1866818961138304:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1780340780.187991:0:87354:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x321:0x0] from OST, last_created [0x280000401:0x321:0x0]last_used is [0x280000401:0x302:0x0] 00000100:00100000:3.0:1780340780.188086:0:87354:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87354:1866818961138816:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1780340780.188125:0:87354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340780.188149:0:87354:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443afb900 going to sleep for 11 seconds 00000100:00100000:3.0:1780340780.188161:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340780.188173:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961138688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340780.188196:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340780.188223:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961138816 00000100:00100000:3.0:1780340780.188230:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961138816 00000100:00100000:3.0:1780340780.188275:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5901 00000100:00100000:3.0:1780340780.188284:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:87354:x1866818961138816:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1780340780.188320:0:25486:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 802 00010000:00010000:2.0:1780340780.191694:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340780.192282:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961138688 00000100:00100000:2.0:1780340780.192294:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961138688 00000100:00100000:2.0:1780340780.192348:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049 00000100:00100000:2.0:1780340780.192359:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961138688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780340780.192385:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 896 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780340780.192468:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961138688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (4270us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340780.192475:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049 00000100:00100000:3.0:1780340780.195131:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961138688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340780.198521:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:87354:x1866818961138816:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10230us (10388us total) trans 4294969454 rc 0/0 00000100:00100000:3.0:1780340780.198533:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5901 00000100:00100000:2.0:1780340780.199353:0:87354:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87354:1866818961138816:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1780340780.199372:0:87354:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x321:0x0]-[0x280000401:0x341:0x0] 00000020:00000004:1.0:1780340780.568127:0:87656:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1780340780.568607:0:87656:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1780340780.939438:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340781.450078:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340781.456917:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961138944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340781.457007:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340781.457049:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961138944 00000100:00100000:0.0:1780340781.457059:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961138944 00000100:00100000:0.0:1780340781.457116:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2050 00000100:00100000:0.0:1780340781.457127:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961138944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340781.457168:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340781.457211:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961138944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340781.457231:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2050 00000100:00080000:0.0:1780340781.457262:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340781.457305:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961138944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340781.457328:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961139072:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340781.457352:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340781.461396:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961139072 00000100:00100000:2.0:1780340781.461411:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961139072 00000100:00100000:2.0:1780340781.461479:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2051 00000100:00100000:2.0:1780340781.461493:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961139072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340781.461524:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780340781.461622:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961139072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (4268us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340781.461629:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2051 00000100:00080000:2.0:1780340781.461661:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340781.461719:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961139072:0@lo:13:osp-pre-0-1.0 00000020:00000004:1.0:1780340781.610317:0:87706:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1780340781.610624:0:87706:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1780340781.962104:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340782.985936:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340783.631386:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340783.631985:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940433792 00000100:00100000:3.0:1780340783.632011:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940433792 00000100:00080000:2.0:1780340783.632179:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780340783.633108:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1283 00000100:00100000:3.0:1780340783.633136:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:69182:x1866818940433792:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1780340783.633167:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340783.633202:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa2465143277477b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced23e5 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340783.633300:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432774782 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340783.633317:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432774782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340783.633330:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432774782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340783.633383:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1780340783.633387:0:64454:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780340783.633878:0:64454:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432774782 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340783.633912:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa2465143277477b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23e5 expref: 9 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340783.633931:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432774782 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23e5 expref: 8 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340783.633940:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455e5c900) 00010000:00010000:3.0:1780340783.633943:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1780340783.633946:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722ae600, rc 0) 00000100:00100000:3.0:1780340783.634163:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:69182:x1866818940433792:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1043us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340783.634171:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1283 00000100:00100000:2.0:1780340783.652095:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340783.652275:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940433920 00000100:00100000:3.0:1780340783.652287:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940433920 00000100:00100000:3.0:1780340783.652368:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1284 00000100:00100000:3.0:1780340783.652378:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:69182:x1866818940433920:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:3.0:1780340783.652418:0:63711:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445232640 avail 1298993152 00000100:00100000:3.0:1780340783.652508:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:69182:x1866818940433920:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 131us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340783.652517:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1284 00000100:00100000:2.0:1780340783.655321:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340783.658961:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940434048 00000100:00100000:3.0:1780340783.658974:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940434048 00000100:00100000:3.0:1780340783.659071:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1285 00000100:00100000:3.0:1780340783.659084:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:69182:x1866818940434048:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:3.0:1780340783.659123:0:63710:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:3.0:1780340783.659208:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:69182:x1866818940434048:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 127us (3893us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340783.659217:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1285 00000100:00080000:2.0:1780340783.660010:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340783.665102:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340783.665394:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940434176 00000100:00100000:0.0:1780340783.665412:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940434176 00000100:00100000:0.0:1780340783.665516:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2052 00000100:00100000:0.0:1780340783.665532:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:69182:x1866818940434176:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:0.0:1780340783.665580:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340783.665687:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:69182:x1866818940434176:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 160us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340783.665695:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2052 00000100:00080000:2.0:1780340783.666508:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340783.677586:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340783.682457:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940434304 00000100:00100000:2.0:1780340783.682501:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940434304 00000100:00100000:2.0:1780340783.682604:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2053 00000100:00100000:2.0:1780340783.682621:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:69182:x1866818940434304:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:2.0:1780340783.682664:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340783.682788:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:69182:x1866818940434304:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 172us (5217us total) trans 0 rc 0/0 00000100:00080000:0.0:1780340783.682982:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340783.683296:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2053 00010000:00010000:0.0:1780340784.012840:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340785.042372:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961139200:0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.042499:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340785.042562:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961139712:0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.042597:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340785.042620:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961140224:0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.042643:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340785.042663:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961140736:0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.042687:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340785.042714:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1780340785.042721:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961139328:0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.042746:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340785.043213:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961139840:0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.043255:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340785.043275:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961140352:0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.043299:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340785.043333:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961139584:0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.043360:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340785.043379:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961140096:0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.043404:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340785.043423:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961140608:0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.043446:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340785.043469:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1780340785.043475:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961139456:0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.043500:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340785.043512:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961139968:0@lo:400:kworker.0 00000100:00100000:0.0:1780340785.043919:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961140864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340785.043957:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340785.044001:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961139840 00000100:00100000:0.0:1780340785.044011:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961139840 00000100:00100000:0.0:1780340785.044065:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961140352 00000100:00100000:0.0:1780340785.044069:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961140352 00000100:00100000:0.0:1780340785.044080:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961140864 00000100:00100000:0.0:1780340785.044083:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961140864 00000100:00100000:1.0:1780340785.044211:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340785.044244:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961140480:0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.044273:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340785.044308:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961139712 00000100:00100000:1.0:1780340785.044313:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961139712 00000100:00100000:1.0:1780340785.044358:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961140224 00000100:00100000:1.0:1780340785.044362:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961140224 00000100:00100000:1.0:1780340785.044379:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961140736 00000100:00100000:1.0:1780340785.044382:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961140736 00000100:00100000:1.0:1780340785.044394:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961139328 00000100:00100000:1.0:1780340785.044397:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961139328 00000100:00100000:1.0:1780340785.044412:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961139584 00000100:00100000:1.0:1780340785.044415:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961139584 00000100:00100000:1.0:1780340785.044429:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961139456 00000100:00100000:1.0:1780340785.044432:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961139456 00000100:00100000:1.0:1780340785.044449:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:1.0:1780340785.044459:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961139712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.044520:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a127800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961139712:12345-0@lo:400:kworker.0 Request processed in 63us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340785.044711:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841 00000100:00100000:0.0:1780340785.044720:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961139840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340785.044798:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a210000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961139840:12345-0@lo:400:kworker.0 Request processed in 80us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340785.044805:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841 00000100:00100000:0.0:1780340785.044828:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3842 00000100:00100000:0.0:1780340785.044836:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961140352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340785.044867:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a212300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961140352:12345-0@lo:400:kworker.0 Request processed in 33us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340785.044874:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3842 00000100:00100000:0.0:1780340785.044887:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843 00000100:00100000:0.0:1780340785.044893:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961140864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780340785.044928:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:0.0:1780340785.044971:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961140864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340785.044978:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843 00000100:00080000:0.0:1780340785.045004:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780340785.045009:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340785.045057:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961140864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340785.045101:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961139840:0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.045271:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:1.0:1780340785.045293:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:1.0:1780340785.045302:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961140224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.045342:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a127100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961140224:12345-0@lo:400:kworker.0 Request processed in 42us (2698us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340785.045349:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:1.0:1780340785.045362:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:1.0:1780340785.045370:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961140736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.045398:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961140736:12345-0@lo:400:kworker.0 Request processed in 30us (2710us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340785.045419:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:1.0:1780340785.045433:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:1.0:1780340785.045439:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961139328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.045472:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a210700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961139328:12345-0@lo:400:kworker.0 Request processed in 34us (2726us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340785.045479:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:1.0:1780340785.045492:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:1.0:1780340785.045499:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961139584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.045550:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a213800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961139584:12345-0@lo:400:kworker.0 Request processed in 51us (2189us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340785.045556:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00100000:1.0:1780340785.045568:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:1.0:1780340785.045575:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961139456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.045610:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961139456:12345-0@lo:400:kworker.0 Request processed in 36us (2110us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340785.045617:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:1.0:1780340785.045674:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961140096 00000100:00100000:1.0:1780340785.045681:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961140096 00000100:00100000:1.0:1780340785.045724:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961140608 00000100:00100000:1.0:1780340785.045727:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961140608 00000100:00100000:0.0:1780340785.045855:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961140352:0@lo:400:kworker.0 00000100:00100000:0.0:1780340785.045872:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961139712:0@lo:400:kworker.0 00000100:00100000:0.0:1780340785.045885:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961140224:0@lo:400:kworker.0 00000100:00100000:0.0:1780340785.045907:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961140736:0@lo:400:kworker.0 00000100:00100000:0.0:1780340785.045950:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961139328:0@lo:400:kworker.0 00000100:00080000:0.0:1780340785.045973:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1780340785.046129:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340785.046156:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961139200 00000100:00100000:2.0:1780340785.046161:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961139200 00000100:00100000:2.0:1780340785.046211:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1780340785.046218:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444a91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961139200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340785.046281:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444a91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961139200:12345-0@lo:400:kworker.0 Request processed in 63us (3782us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340785.046289:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1780340785.046503:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961139200:0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.048089:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961139968 00000100:00100000:1.0:1780340785.048101:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961139968 00000100:00100000:1.0:1780340785.048855:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961140480 00000100:00100000:1.0:1780340785.048862:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961140480 00000100:00080000:0.0:1780340785.053490:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340785.053944:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2536 00000100:00100000:2.0:1780340785.053970:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961140096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340785.054127:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961140096:12345-0@lo:400:kworker.0 Request processed in 170us (10720us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340785.054137:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2536 00000100:00100000:2.0:1780340785.054170:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537 00000100:00100000:2.0:1780340785.054178:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961140608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340785.054216:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961140608:12345-0@lo:400:kworker.0 Request processed in 39us (10769us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340785.054222:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537 00000100:00100000:2.0:1780340785.054247:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:2.0:1780340785.054271:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961139968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340785.054309:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961139968:12345-0@lo:400:kworker.0 Request processed in 40us (10097us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340785.054316:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:2.0:1780340785.054387:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961139456:0@lo:400:kworker.0 00000100:00100000:2.0:1780340785.054403:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961139968:0@lo:400:kworker.0 00000100:00100000:2.0:1780340785.054418:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961139584:0@lo:400:kworker.0 00000100:00100000:2.0:1780340785.054431:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961140096:0@lo:400:kworker.0 00000100:00100000:2.0:1780340785.054453:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961140608:0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.055561:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2539 00000100:00100000:1.0:1780340785.055574:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961140480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340785.055670:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961140480:12345-0@lo:400:kworker.0 Request processed in 98us (11394us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340785.055678:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2539 00000100:00100000:1.0:1780340785.055722:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961140480:0@lo:400:kworker.0 00000100:00100000:0.0:1780340785.198283:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340785.198329:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340785.198353:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340785.198439:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340785.198518:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340785.198551:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940434560 00000100:00100000:0.0:1780340785.198564:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940434560 00000100:00100000:0.0:1780340785.198641:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940434688 00000100:00100000:0.0:1780340785.198719:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940434688 00000100:00100000:0.0:1780340785.198856:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1299 00000100:00100000:0.0:1780340785.198868:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2410:x1866818940434560:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340785.198967:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2410:x1866818940434560:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 101us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340785.198976:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1299 00000100:00100000:0.0:1780340785.198998:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1300 00000100:00100000:0.0:1780340785.199005:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940434688:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340785.199031:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940434688:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 27us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340785.199038:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1300 00000100:00100000:0.0:1780340785.199064:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940434944 00000100:00100000:0.0:1780340785.199068:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940434944 00000100:00100000:0.0:1780340785.199119:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940434816 00000100:00100000:0.0:1780340785.199123:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940434816 00000100:00100000:0.0:1780340785.199146:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2540 00000100:00100000:0.0:1780340785.199152:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2409:x1866818940434944:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340785.199180:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2409:x1866818940434944:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 28us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340785.199186:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2540 00000100:00100000:0.0:1780340785.199199:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2541 00000100:00100000:0.0:1780340785.199204:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940434816:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340785.199240:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2410:x1866818940434816:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 36us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340785.199247:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2541 00000100:00080000:0.0:1780340785.199270:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340785.199274:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340785.199277:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340785.199279:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780340785.203139:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940434432 00000100:00100000:3.0:1780340785.203159:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940434432 00000100:00100000:3.0:1780340785.203240:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 78 00000100:00100000:3.0:1780340785.203252:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0453169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2409:x1866818940434432:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340785.203340:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0453169450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2409:x1866818940434432:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 91us (5071us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340785.203348:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 78 00000100:00100000:3.0:1780340785.553390:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961140992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340785.553499:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340785.553556:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340785.553564:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ec40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961141120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340785.553618:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340785.553667:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961140992 00000100:00100000:3.0:1780340785.553689:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961140992 00000100:00100000:3.0:1780340785.553782:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844 00000100:00100000:3.0:1780340785.553792:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961140992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340785.553844:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445232640 avail 1298993152 00000100:00100000:3.0:1780340785.553893:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961140992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340785.553900:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844 00000100:00100000:3.0:1780340785.553924:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961141120 00000100:00100000:3.0:1780340785.553928:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961141120 00000100:00100000:3.0:1780340785.553952:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054 00000100:00100000:3.0:1780340785.553958:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961141120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340785.553984:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340785.554011:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349339500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961141120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340785.554017:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054 00000100:00100000:3.0:1780340785.554093:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ec40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961141120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340785.554106:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961140992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340785.555232:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340785.555250:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ac7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961141248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340785.555307:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340785.559289:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961141248 00000100:00100000:2.0:1780340785.559311:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961141248 00000100:00100000:2.0:1780340785.559399:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055 00000100:00100000:2.0:1780340785.559411:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961141248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780340785.559463:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780340785.559592:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961141248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (4283us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340785.559601:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055 00000100:00100000:3.0:1780340785.559878:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ac7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961141248:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1780340786.060676:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1780340786.064192:0:9462:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969453 is committed 00000001:00080000:0.0:1780340786.065606:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969454 is committed 00000100:00100000:1.0:1780340786.570405:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340786.570441:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961141504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340786.570541:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340786.570596:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340786.570607:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ac7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961141376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340786.570638:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340786.570831:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961141504 00000100:00100000:2.0:1780340786.570843:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961141504 00000100:00100000:2.0:1780340786.570910:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961141376 00000100:00100000:2.0:1780340786.570914:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961141376 00000100:00100000:2.0:1780340786.570946:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056 00000100:00100000:2.0:1780340786.570956:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961141504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340786.570988:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780340786.571077:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961141504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340786.571086:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056 00000100:00100000:2.0:1780340786.571108:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00100000:2.0:1780340786.571115:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961141376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340786.571127:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340786.571159:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479d8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961141376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340786.571165:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00100000:2.0:1780340786.571228:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ac7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961141376:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340786.571264:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961141504:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1780340787.082251:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340788.105934:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1780340788.202985:0:87803:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:0.0:1780340789.130085:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1780340790.122485:0:87851:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:1.0:1780340790.155899:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961141632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340790.155991:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340790.156062:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961141632 00000100:00100000:1.0:1780340790.156082:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961141632 00000100:00100000:1.0:1780340790.156139:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845 00000100:00100000:1.0:1780340790.156148:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961141632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780340790.156201:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:1.0:1780340790.156246:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961141632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340790.156253:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845 00000100:00100000:1.0:1780340790.156303:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961141632:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1780340790.156603:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340790.157127:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961141760:0@lo:400:kworker.0 00000100:00100000:0.0:1780340790.157173:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340790.157213:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961142272:0@lo:400:kworker.0 00000100:00100000:0.0:1780340790.157242:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340790.157258:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961142784:0@lo:400:kworker.0 00000100:00100000:0.0:1780340790.157281:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340790.157300:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1780340790.157319:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961141888:0@lo:400:kworker.0 00000100:00100000:0.0:1780340790.157365:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340790.157386:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961142400:0@lo:400:kworker.0 00000100:00100000:0.0:1780340790.157408:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340790.157421:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961142912:0@lo:400:kworker.0 00000100:00100000:0.0:1780340790.157441:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340790.157472:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961141760 00000100:00100000:0.0:1780340790.157477:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961141760 00000100:00100000:0.0:1780340790.157517:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1780340790.157525:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444a91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961141760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340790.157570:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444a91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961141760:12345-0@lo:400:kworker.0 Request processed in 45us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340790.157577:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1780340790.157618:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961142272 00000100:00100000:0.0:1780340790.157622:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961142272 00000100:00100000:0.0:1780340790.157659:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961142784 00000100:00100000:0.0:1780340790.157662:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961142784 00000100:00100000:0.0:1780340790.157680:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961141888 00000100:00100000:0.0:1780340790.157682:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961141888 00000100:00100000:0.0:1780340790.157699:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:0.0:1780340790.157705:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961142272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340790.157735:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961142272:12345-0@lo:400:kworker.0 Request processed in 31us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340790.157741:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:0.0:1780340790.157751:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:0.0:1780340790.157782:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961142784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340790.157811:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961142784:12345-0@lo:400:kworker.0 Request processed in 54us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340790.157824:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:0.0:1780340790.157837:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:0.0:1780340790.157843:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961141888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340790.157872:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961141888:12345-0@lo:400:kworker.0 Request processed in 30us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340790.157877:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00080000:0.0:1780340790.157900:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780340790.157904:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340790.157937:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961141888:0@lo:400:kworker.0 00000100:00100000:0.0:1780340790.157945:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961141760:0@lo:400:kworker.0 00000100:00100000:0.0:1780340790.157953:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a125180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961142272:0@lo:400:kworker.0 00000100:00100000:0.0:1780340790.157962:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961142784:0@lo:400:kworker.0 00000100:00100000:3.0:1780340790.158308:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961142400 00000100:00100000:3.0:1780340790.158313:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961142400 00000100:00100000:3.0:1780340790.158366:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3846 00000100:00100000:3.0:1780340790.158374:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961142400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340790.158421:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961142400:12345-0@lo:400:kworker.0 Request processed in 48us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340790.158427:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3846 00000100:00100000:3.0:1780340790.158461:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961142400:0@lo:400:kworker.0 00000100:00100000:1.0:1780340790.158549:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961142912 00000100:00100000:1.0:1780340790.158554:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961142912 00000100:00100000:1.0:1780340790.158607:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542 00000100:00100000:1.0:1780340790.158614:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961142912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340790.158653:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961142912:12345-0@lo:400:kworker.0 Request processed in 40us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340790.158659:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542 00000100:00100000:1.0:1780340790.158682:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961142016:0@lo:400:kworker.0 00000100:00100000:1.0:1780340790.158716:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340790.158741:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961142528:0@lo:400:kworker.0 00000100:00100000:1.0:1780340790.158804:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340790.158824:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961143040:0@lo:400:kworker.0 00000100:00100000:1.0:1780340790.158849:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340790.158880:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1780340790.158887:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961142144:0@lo:400:kworker.0 00000100:00100000:1.0:1780340790.158911:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340790.158930:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961142656:0@lo:400:kworker.0 00000100:00100000:1.0:1780340790.158952:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340790.158969:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961143168:0@lo:400:kworker.0 00000100:00100000:1.0:1780340790.158991:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340790.159019:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961142016 00000100:00100000:1.0:1780340790.159023:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961142016 00000100:00100000:1.0:1780340790.159049:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961142144 00000100:00100000:1.0:1780340790.159052:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961142144 00000100:00100000:1.0:1780340790.159067:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961143168 00000100:00100000:1.0:1780340790.159069:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961143168 00000100:00100000:1.0:1780340790.159097:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:1.0:1780340790.159103:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961142016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340790.159151:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961142016:12345-0@lo:400:kworker.0 Request processed in 48us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340790.159157:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:1.0:1780340790.159170:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:1.0:1780340790.159176:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961142144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340790.159211:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961142144:12345-0@lo:400:kworker.0 Request processed in 36us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340790.159217:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00100000:1.0:1780340790.159229:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:1.0:1780340790.159234:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961143168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340790.159262:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961143168:12345-0@lo:400:kworker.0 Request processed in 27us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340790.159267:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00100000:1.0:1780340790.159309:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a126680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961142144:0@lo:400:kworker.0 00000100:00100000:1.0:1780340790.159319:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961143168:0@lo:400:kworker.0 00000100:00100000:1.0:1780340790.159328:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961142016:0@lo:400:kworker.0 00000100:00100000:3.0:1780340790.161371:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961142528 00000100:00100000:3.0:1780340790.161387:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961142528 00000100:00100000:3.0:1780340790.161470:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961143040 00000100:00100000:3.0:1780340790.161474:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961143040 00000100:00100000:3.0:1780340790.161502:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961142656 00000100:00100000:3.0:1780340790.161505:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961142656 00000100:00100000:3.0:1780340790.161531:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543 00000100:00100000:3.0:1780340790.161541:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961142528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340790.161651:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961142528:12345-0@lo:400:kworker.0 Request processed in 112us (2846us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340790.161658:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543 00000100:00100000:3.0:1780340790.161676:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:3.0:1780340790.161683:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961143040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340790.161712:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961143040:12345-0@lo:400:kworker.0 Request processed in 30us (2863us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340790.161717:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00000100:00100000:3.0:1780340790.161728:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545 00000100:00100000:3.0:1780340790.161749:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961142656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340790.161808:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961142656:12345-0@lo:400:kworker.0 Request processed in 61us (2855us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340790.161814:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545 00000100:00080000:3.0:1780340790.161848:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340790.161854:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780340790.161857:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780340790.161860:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340790.161902:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961142656:0@lo:400:kworker.0 00000100:00100000:3.0:1780340790.161917:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961142528:0@lo:400:kworker.0 00000100:00100000:3.0:1780340790.161927:0:3661:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 2 00000100:00100000:3.0:1780340790.161946:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961143040:0@lo:400:kworker.0 00000100:00100000:3.0:1780340790.161988:0:3659:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 2 00000100:00100000:3.0:1780340790.162000:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961142912:0@lo:400:kworker.0 00000100:00100000:0.0:1780340790.318696:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340790.318854:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340790.318925:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340790.318957:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340790.320393:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940435456 00000100:00100000:3.0:1780340790.320413:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940435456 00000100:00100000:3.0:1780340790.320515:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2546 00000100:00100000:3.0:1780340790.320526:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940435456:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340790.320626:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940435456:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 101us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340790.320634:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2546 00000100:00080000:2.0:1780340790.321098:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340790.322354:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340790.322393:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940435072 00000100:00100000:0.0:1780340790.322403:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940435072 00000100:00100000:0.0:1780340790.322456:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 80 00000100:00100000:0.0:1780340790.322466:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940435072:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340790.322540:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940435072:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 76us (3614us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340790.322547:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 80 00000100:00100000:3.0:1780340790.325436:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940435584 00000100:00100000:3.0:1780340790.325453:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940435584 00000100:00100000:3.0:1780340790.325539:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2547 00000100:00100000:3.0:1780340790.325548:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2407:x1866818940435584:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340790.325658:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2407:x1866818940435584:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 110us (3311us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340790.325666:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2547 00000100:00080000:3.0:1780340790.325863:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340790.325949:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940435200 00000100:00100000:1.0:1780340790.325954:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940435200 00000100:00100000:1.0:1780340790.326001:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940435328 00000100:00100000:1.0:1780340790.326005:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940435328 00000100:00100000:1.0:1780340790.326030:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1307 00000100:00100000:1.0:1780340790.326037:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2407:x1866818940435200:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340790.326080:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2407:x1866818940435200:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 43us (7403us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340790.326111:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1307 00000100:00100000:1.0:1780340790.326125:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1308 00000100:00100000:1.0:1780340790.326132:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940435328:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340790.326160:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940435328:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 29us (7202us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340790.326167:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1308 00000100:00080000:3.0:1780340790.327367:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780340790.327378:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340790.666417:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04754d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961143296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340790.666543:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340790.666745:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961143296 00000100:00100000:3.0:1780340790.666782:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961143296 00000100:00100000:3.0:1780340790.666856:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3847 00000100:00100000:3.0:1780340790.666869:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961143296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340790.666936:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445232640 avail 1298993152 00000100:00100000:2.0:1780340790.667178:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961143424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340790.667231:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340790.667274:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961143424 00000100:00100000:2.0:1780340790.667278:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961143424 00000100:00100000:2.0:1780340790.667311:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00100000:2.0:1780340790.667319:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961143424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780340790.667345:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340790.667386:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961143424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340790.667394:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000100:00100000:2.0:1780340790.667457:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961143424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340790.667495:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ac7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961143552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340790.667525:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340790.668112:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961143296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1244us (1568us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340790.668120:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3847 00000100:00100000:3.0:1780340790.668155:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961143552 00000100:00100000:3.0:1780340790.668159:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961143552 00000100:00100000:3.0:1780340790.668199:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059 00000100:00100000:3.0:1780340790.668206:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961143552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780340790.668225:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780340790.668267:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961143552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340790.668274:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059 00000100:00100000:2.0:1780340790.668426:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ac7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961143552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340790.669584:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04754d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961143296:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1780340791.181162:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340791.692212:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340791.692247:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961143808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340791.692340:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340791.692425:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961143808 00000100:00100000:0.0:1780340791.692436:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961143808 00000100:00100000:0.0:1780340791.692507:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060 00000100:00100000:0.0:1780340791.692517:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961143808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340791.692554:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340791.692611:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961143808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340791.692621:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060 00000100:00100000:0.0:1780340791.692692:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961143808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340791.692791:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340791.692805:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ac7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961143680:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340791.692845:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340791.694422:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961143680 00000100:00100000:0.0:1780340791.694442:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961143680 00000100:00100000:0.0:1780340791.694536:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061 00000100:00100000:0.0:1780340791.694547:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961143680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340791.694582:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340791.694686:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961143680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 140us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340791.694694:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061 00000100:00100000:1.0:1780340791.694842:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ac7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961143680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340791.951910:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340791.952078:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940435712 00000100:00100000:1.0:1780340791.952092:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940435712 00000100:00100000:1.0:1780340791.952184:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1286 00000100:00100000:1.0:1780340791.952197:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:69629:x1866818940435712:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:1.0:1780340791.952249:0:64454:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445232640 avail 1298993152 00000100:00100000:1.0:1780340791.952347:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:69629:x1866818940435712:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 153us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340791.952356:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1286 00000100:00100000:3.0:1780340791.955988:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340791.956102:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940435840 00000100:00100000:1.0:1780340791.956632:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940435840 00000100:00100000:1.0:1780340791.956715:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1287 00000100:00100000:1.0:1780340791.956728:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:69629:x1866818940435840:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:1.0:1780340791.957973:0:63710:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:1.0:1780340791.964719:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:69629:x1866818940435840:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 7975us (8728us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340791.964739:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1287 00000100:00100000:2.0:1780340791.973612:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340791.974320:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940435968 00000100:00100000:0.0:1780340791.974337:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940435968 00000100:00100000:0.0:1780340791.975027:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2062 00000100:00100000:0.0:1780340791.975042:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:69629:x1866818940435968:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:0.0:1780340791.975508:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340791.975722:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:69629:x1866818940435968:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 682us (2121us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340791.975732:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2062 00000100:00100000:0.0:1780340791.992756:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340792.000248:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940436096 00000100:00100000:3.0:1780340792.000269:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940436096 00000100:00100000:3.0:1780340792.000454:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2063 00000100:00100000:3.0:1780340792.000471:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:69629:x1866818940436096:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:3.0:1780340792.000523:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340792.000624:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:69629:x1866818940436096:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 159us (7888us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340792.000633:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2063 00000100:00080000:0.0:1780340792.001224:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340792.065449:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340792.066826:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940436352 00000100:00100000:1.0:1780340792.066845:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940436352 00000100:00100000:1.0:1780340792.066964:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1288 00000100:00100000:1.0:1780340792.066981:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04754d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:69646:x1866818940436352:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1780340792.067010:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340792.067043:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa24651432774789 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced23ec expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067150:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432774790 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067170:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432774790 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067197:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432774790 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067217:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432774797 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067224:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432774797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067265:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432774797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067669:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432774790 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067679:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432774790 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067687:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432774790 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067694:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432774790 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067701:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340792.067706:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432774790 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067714:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432774790 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067739:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455e5c900) 00010000:00010000:1.0:1780340792.067743:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340792.067749:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432774790 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067756:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432774790 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067827:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432774797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067839:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432774797 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067845:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432774797 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067849:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340792.067852:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432774797 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.067858:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432774797 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.068523:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8c047a3b5300) 00010000:00010000:1.0:1780340792.068528:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340792.068532:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432774797 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.068540:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa24651432774797 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.068595:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa24651432774789 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23ec expref: 9 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.068608:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455e5c900) 00010000:00010000:1.0:1780340792.068611:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1780340792.068615:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa24651432774789 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23ec expref: 9 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.068625:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122e00, rc 0) 00000100:00100000:1.0:1780340792.068749:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04754d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:69646:x1866818940436352:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 1772us (3424us total) trans 0 rc 301/301 00000100:00080000:0.0:1780340792.070001:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340792.070268:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1288 00000100:00100000:2.0:1780340792.075791:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340792.075836:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940436480 00000100:00100000:1.0:1780340792.075852:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940436480 00000100:00100000:1.0:1780340792.075945:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1289 00000100:00100000:1.0:1780340792.075956:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03474c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:69646:x1866818940436480:12345-192.168.203.16@tcp:34:lfs.0 00010000:00010000:1.0:1780340792.076056:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa2465143277479e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076079:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa2465143277479e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076093:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa2465143277479e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076122:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076131:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076137:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076244:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747ac lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076253:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747ac lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076261:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747ac lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340792.076355:0:70100:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00000004:00200000:1.0:1780340792.076361:0:70100:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780340792.076377:0:70100:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747ac lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076403:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa2465143277479e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076411:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa2465143277479e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076418:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa2465143277479e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076425:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340792.076430:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa2465143277479e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076439:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa2465143277479e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076453:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455e5c900) 00010000:00010000:1.0:1780340792.076456:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340792.076463:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa2465143277479e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076469:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa2465143277479e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076484:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076500:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076506:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076512:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340792.076515:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076521:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076529:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8c047a3b5900) 00010000:00010000:1.0:1780340792.076531:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340792.076534:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076540:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076556:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747ac lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076563:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747ac lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076570:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747ac lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076574:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340792.076583:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747ac lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076590:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747ac lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076597:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c0455c3b500) 00010000:00010000:1.0:1780340792.076600:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340792.076604:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747ac lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.076609:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747ac lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340792.076710:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03474c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:69646:x1866818940436480:12345-192.168.203.16@tcp:34:lfs.0 Request processed in 754us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340792.076719:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1289 00000100:00100000:3.0:1780340792.109933:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340792.110087:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940436736 00000100:00100000:1.0:1780340792.110102:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940436736 00000100:00100000:1.0:1780340792.110195:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1290 00000100:00100000:1.0:1780340792.110209:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ec40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:69650:x1866818940436736:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1780340792.110240:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340792.110268:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced23f3 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110386:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110407:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110446:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110467:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa246514327747c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110475:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa246514327747c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110481:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa246514327747c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110587:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747ba lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110595:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747ba lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110602:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110609:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110614:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340792.110619:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110626:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747ba lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110639:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455e5c900) 00010000:00010000:1.0:1780340792.110648:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340792.110654:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747ba lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110660:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327747ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110676:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa246514327747c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110683:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa246514327747c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110689:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa246514327747c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110694:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340792.110697:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa246514327747c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110704:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa246514327747c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110711:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8c047a3b5900) 00010000:00010000:1.0:1780340792.110714:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340792.110717:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa246514327747c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110721:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa246514327747c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110795:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23f3 expref: 9 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110818:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455e5c900) 00010000:00010000:1.0:1780340792.110820:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1780340792.110824:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23f3 expref: 9 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.110834:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123e00, rc 0) 00000100:00100000:1.0:1780340792.110935:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ec40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:69650:x1866818940436736:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 728us (1014us total) trans 0 rc 301/301 00000100:00100000:1.0:1780340792.110943:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1290 00000100:00100000:3.0:1780340792.114341:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340792.114533:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940436864 00000100:00100000:1.0:1780340792.114548:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940436864 00000100:00100000:1.0:1780340792.114630:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1291 00000100:00100000:1.0:1780340792.114642:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:69650:x1866818940436864:12345-192.168.203.16@tcp:34:lfs.0 00010000:00010000:1.0:1780340792.114756:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.114803:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.114818:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.114837:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.114844:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.114875:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.114970:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa246514327747d6 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.114979:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa246514327747d6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.114987:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa246514327747d6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340792.115039:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00000004:00200000:1.0:1780340792.115045:0:63712:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780340792.115075:0:63712:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa246514327747d6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115091:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747c8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115099:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747c8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115105:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115112:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115118:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340792.115123:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115139:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747c8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115154:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455e5c900) 00010000:00010000:1.0:1780340792.115158:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340792.115166:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747c8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115182:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115200:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115207:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115213:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115219:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340792.115221:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115227:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115234:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8c047a3b5300) 00010000:00010000:1.0:1780340792.115237:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340792.115240:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115256:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115273:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa246514327747d6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115278:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa246514327747d6 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115285:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa246514327747d6 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115290:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340792.115293:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa246514327747d6 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115299:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa246514327747d6 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115307:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c0455c3b500) 00010000:00010000:1.0:1780340792.115309:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340792.115312:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa246514327747d6 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.115318:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa246514327747d6 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340792.115420:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:69650:x1866818940436864:12345-192.168.203.16@tcp:34:lfs.0 Request processed in 779us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340792.115430:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1291 00000100:00100000:3.0:1780340792.172752:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340792.172953:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940437120 00000100:00100000:1.0:1780340792.172970:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940437120 00000100:00100000:1.0:1780340792.173073:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1292 00000100:00100000:1.0:1780340792.173085:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:69657:x1866818940437120:12345-192.168.203.16@tcp:101:md5sum.0 00010000:00010000:1.0:1780340792.173116:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340792.173144:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa246514327747dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced23fa expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173270:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747e4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173293:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173310:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173329:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173337:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173344:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173502:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747f2 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173512:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747f2 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173543:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747f2 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340792.173557:0:70100:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00010000:00010000:1.0:1780340792.173697:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747e4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173706:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747e4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173715:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173723:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340792.173729:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747e4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173738:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747e4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173753:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455e5c900) 00010000:00010000:1.0:1780340792.173756:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340792.173799:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173806:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa246514327747e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173823:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173829:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747eb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173842:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173848:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340792.173850:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173858:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747eb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173866:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff8c047a3b5300) 00010000:00010000:1.0:1780340792.173869:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340792.173872:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747eb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173878:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa246514327747eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173973:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa246514327747dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23fa expref: 11 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173989:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747f2 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23fa expref: 10 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340792.173996:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c0455c3b500) 00010000:00010000:1.0:1780340792.173998:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780340792.174001:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123e00, rc 0) 00000100:00100000:1.0:1780340792.174090:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:69657:x1866818940437120:12345-192.168.203.16@tcp:101:md5sum.0 Request processed in 1008us (1353us total) trans 111669149697 rc 0/0 00000100:00100000:1.0:1780340792.174107:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1292 00000100:00100000:3.0:1780340792.199438:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340792.199571:0:24754:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940437248 00000100:00100000:0.0:1780340792.199585:0:24754:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940437248 00002000:00100000:0.0:1780340792.199645:0:24754:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x302:0x0] (0->32767) req@ffff8c04529d7b80 x1866818940437248/t0(0) o3->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1780340803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780340792.199659:0:24754:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c04529d7b80 with x1866818940437248 ext(0->32767) 00002000:00010000:0.0:1780340792.199666:0:24754:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c04529d7b80 00000100:00100000:0.0:1780340792.199710:0:24754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1005 00000100:00100000:0.0:1780340792.199719:0:24754:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2410:x1866818940437248:12345-192.168.203.16@tcp:3:md5sum.0 00000100:00100000:0.0:1780340792.201506:0:24754:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2410:x1866818940437248:12345-192.168.203.16@tcp:3:md5sum.0 Request processed in 1771us (2070us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340792.201524:0:24754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1005 00002000:00100000:0.0:1780340792.201537:0:24754:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x302:0x0] (0->32767) req@ffff8c04529d7b80 x1866818940437248/t0(0) o3->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:218/0 lens 488/440 e 0 to 0 dl 1780340803 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780340792.201548:0:24754:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c04529d7b80 with x1866818940437248 ext(0->32767) 00002000:00010000:0.0:1780340792.201554:0:24754:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c04529d7b80 00010000:00010000:3.0:1780340792.202411:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340792.217598:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340792.217649:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340792.217803:0:24191:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940437376 00000100:00100000:1.0:1780340792.217818:0:24191:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940437376 00002000:00100000:1.0:1780340792.217882:0:24191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x302:0x0] (32768->1048575) req@ffff8c047155dc00 x1866818940437376/t0(0) o3->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1780340803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780340792.217896:0:24191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c047155dc00 with x1866818940437376 ext(32768->1048575) 00002000:00010000:1.0:1780340792.217903:0:24191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c047155dc00 00000100:00100000:1.0:1780340792.217930:0:24191:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940437504 00000100:00100000:1.0:1780340792.217933:0:24191:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940437504 00002000:00100000:1.0:1780340792.217965:0:24191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x302:0x0] (1048576->2097151) req@ffff8c047155ca80 x1866818940437504/t0(0) o3->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:218/0 lens 488/0 e 0 to 0 dl 1780340803 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780340792.217974:0:24191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c047155ca80 with x1866818940437504 ext(1048576->2097151) 00002000:00010000:1.0:1780340792.217978:0:24191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c047155ca80 00000100:00100000:1.0:1780340792.218002:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1006 00000100:00100000:1.0:1780340792.218013:0:24191:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2409:x1866818940437376:12345-192.168.203.16@tcp:3:md5sum.0 00000100:00100000:1.0:1780340792.218316:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1007 00000100:00100000:1.0:1780340792.218324:0:24174:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940437504:12345-192.168.203.16@tcp:3:md5sum.0 00000100:00080000:3.0:1780340792.219246:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340792.231218:0:24191:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2409:x1866818940437376:12345-192.168.203.16@tcp:3:md5sum.0 Request processed in 13188us (13618us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340792.231236:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1006 00002000:00100000:1.0:1780340792.231256:0:24191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x302:0x0] (32768->1048575) req@ffff8c047155dc00 x1866818940437376/t0(0) o3->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:218/0 lens 488/440 e 0 to 0 dl 1780340803 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780340792.231269:0:24191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c047155dc00 with x1866818940437376 ext(32768->1048575) 00002000:00010000:1.0:1780340792.231298:0:24191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8c047155dc00 00000100:00100000:1.0:1780340792.260184:0:24174:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940437504:12345-192.168.203.16@tcp:3:md5sum.0 Request processed in 41843us (42517us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1780340792.260198:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1007 00002000:00100000:1.0:1780340792.260211:0:24174:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x302:0x0] (1048576->2097151) req@ffff8c047155ca80 x1866818940437504/t0(0) o3->e06e5cf1-1986-4ba7-9630-fad7efb74eca@192.168.203.16@tcp:218/0 lens 488/440 e 0 to 0 dl 1780340803 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780340792.260221:0:24174:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c047155ca80 with x1866818940437504 ext(1048576->2097151) 00002000:00010000:1.0:1780340792.260226:0:24174:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c047155ca80 00000100:00100000:2.0:1780340792.276243:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340792.276731:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940437760 00000100:00100000:0.0:1780340792.276749:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940437760 00000100:00100000:0.0:1780340792.276847:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 231 00000100:00100000:0.0:1780340792.276859:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:69657:x1866818940437760:12345-192.168.203.16@tcp:35:md5sum.0 00000001:00080000:0.0:1780340792.277102:0:63713:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 111669149698 00000100:00100000:0.0:1780340792.277225:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:69657:x1866818940437760:12345-192.168.203.16@tcp:35:md5sum.0 Request processed in 368us (996us total) trans 111669149699 rc 0/0 00000100:00100000:0.0:1780340792.277233:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 231 00000020:00080000:0.0:1780340792.277239:0:63713:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1780340793.227249:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340794.257680:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340795.274247:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340795.274291:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340795.274319:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961144320:0@lo:400:kworker.0 00000100:00100000:3.0:1780340795.274416:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340795.274438:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961144192:0@lo:400:kworker.0 00000100:00100000:3.0:1780340795.274463:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961143936:0@lo:400:kworker.0 00000100:00100000:2.0:1780340795.274561:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961144448:0@lo:400:kworker.0 00000100:00100000:1.0:1780340795.274624:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961144064:0@lo:400:kworker.0 00000100:00100000:0.0:1780340795.277817:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340795.277888:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961144704:0@lo:400:kworker.0 00000100:00100000:0.0:1780340795.277945:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340795.277969:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961145216:0@lo:400:kworker.0 00000100:00100000:0.0:1780340795.277996:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340795.278059:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961144704 00000100:00100000:0.0:1780340795.278069:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961144704 00000100:00100000:0.0:1780340795.278126:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961145216 00000100:00100000:0.0:1780340795.278129:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961145216 00000100:00100000:0.0:1780340795.278164:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548 00000100:00100000:0.0:1780340795.278173:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961144704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340795.278310:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a125180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961144704:12345-0@lo:400:kworker.0 Request processed in 137us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340795.278319:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548 00000100:00100000:0.0:1780340795.278339:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:0.0:1780340795.278345:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961145216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340795.278639:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961145216:12345-0@lo:400:kworker.0 Request processed in 294us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340795.278666:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00000100:00080000:0.0:1780340795.278690:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340795.278735:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961144704:0@lo:400:kworker.0 00000100:00100000:0.0:1780340795.278746:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961145216:0@lo:400:kworker.0 00000100:00100000:0.0:1780340795.278867:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340795.278877:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961145600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340795.278907:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340795.278948:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961144320 00000100:00100000:0.0:1780340795.278953:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961144320 00000100:00100000:0.0:1780340795.278995:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961144192 00000100:00100000:0.0:1780340795.278998:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961144192 00000100:00100000:0.0:1780340795.279027:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:0.0:1780340795.279034:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961144320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340795.279074:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961144320:12345-0@lo:400:kworker.0 Request processed in 40us (4659us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340795.279080:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:0.0:1780340795.279092:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:0.0:1780340795.279098:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961144192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340795.279129:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a126680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961144192:12345-0@lo:400:kworker.0 Request processed in 32us (1319us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340795.279136:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00080000:0.0:1780340795.279161:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340795.279164:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780340795.279182:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961144192:0@lo:400:kworker.0 00000100:00100000:3.0:1780340795.281478:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340795.281602:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961144832:0@lo:400:kworker.0 00000100:00100000:3.0:1780340795.281677:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340795.281705:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961145344:0@lo:400:kworker.0 00000100:00100000:3.0:1780340795.281739:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340795.281799:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961144320:0@lo:400:kworker.0 00000100:00100000:3.0:1780340795.281840:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961145600 00000100:00100000:3.0:1780340795.281858:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961145600 00000100:00100000:3.0:1780340795.282848:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3848 00000100:00100000:3.0:1780340795.282867:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961145600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780340795.282919:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:3.0:1780340795.283011:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961145600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (4101us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340795.283018:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3848 00000100:00100000:3.0:1780340795.283181:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961143936 00000100:00100000:3.0:1780340795.283186:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961143936 00000100:00100000:3.0:1780340795.283215:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1780340795.283221:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961143936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340795.283262:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961143936:12345-0@lo:400:kworker.0 Request processed in 41us (6116us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340795.283268:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1780340795.283297:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961144832 00000100:00100000:3.0:1780340795.283301:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961144832 00000100:00100000:3.0:1780340795.283333:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961145344 00000100:00100000:3.0:1780340795.283335:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961145344 00000100:00100000:3.0:1780340795.283352:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:3.0:1780340795.283357:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961144832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340795.283385:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961144832:12345-0@lo:400:kworker.0 Request processed in 28us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340795.283390:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:3.0:1780340795.283399:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:3.0:1780340795.283404:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961145344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340795.283425:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961145344:12345-0@lo:400:kworker.0 Request processed in 21us (1686us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340795.283443:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00100000:3.0:1780340795.283492:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961145600:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1780340795.283519:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340795.283624:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961144832:0@lo:400:kworker.0 00000100:00100000:3.0:1780340795.283634:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961145344:0@lo:400:kworker.0 00000100:00100000:3.0:1780340795.283641:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961143936:0@lo:400:kworker.0 00000100:00100000:2.0:1780340795.287604:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340795.287752:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961144960:0@lo:400:kworker.0 00000100:00100000:2.0:1780340795.287840:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340795.287885:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961144448 00000100:00100000:2.0:1780340795.287893:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961144448 00000100:00100000:2.0:1780340795.288073:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961144960 00000100:00100000:2.0:1780340795.288078:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961144960 00000100:00100000:2.0:1780340795.288105:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1780340795.288115:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961144448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340795.288183:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961144448:12345-0@lo:400:kworker.0 Request processed in 69us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340795.288190:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1780340795.288206:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:2.0:1780340795.288213:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048527e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961144960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340795.288288:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340795.288342:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961144576:0@lo:400:kworker.0 00000100:00100000:2.0:1780340795.288360:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048527e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961144960:12345-0@lo:400:kworker.0 Request processed in 144us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340795.288369:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:2.0:1780340795.288388:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961144064 00000100:00100000:2.0:1780340795.288392:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961144064 00000100:00100000:1.0:1780340795.288399:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340795.288426:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:2.0:1780340795.288435:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961144064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340795.288456:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961144576 00000100:00100000:1.0:1780340795.288465:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961144576 00000100:00100000:2.0:1780340795.288509:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961144064:12345-0@lo:400:kworker.0 Request processed in 74us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340795.288517:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:1.0:1780340795.288524:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849 00000100:00100000:1.0:1780340795.288533:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961144576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340795.288590:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961144576:12345-0@lo:400:kworker.0 Request processed in 58us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340795.288597:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849 00000100:00100000:1.0:1780340795.288677:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961144576:0@lo:400:kworker.0 00000100:00100000:1.0:1780340795.288688:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961145088:0@lo:400:kworker.0 00000100:00100000:2.0:1780340795.288755:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961144960:0@lo:400:kworker.0 00000100:00100000:2.0:1780340795.288816:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1866818961145472:0@lo:400:kworker.0 00000100:00100000:2.0:1780340795.288877:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340795.289030:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961145472 00000100:00100000:2.0:1780340795.289036:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961145472 00000100:00100000:2.0:1780340795.289073:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:2.0:1780340795.289086:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1866818961145472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340795.289134:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1866818961145472:12345-0@lo:400:kworker.0 Request processed in 54us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340795.289140:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00080000:3.0:1780340795.289174:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780340795.289179:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340795.289180:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1866818961145472:0@lo:400:kworker.0 00000100:00100000:2.0:1780340795.289209:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961144448:0@lo:400:kworker.0 00000100:00100000:1.0:1780340795.289904:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340795.289981:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961144064:0@lo:400:kworker.0 00000100:00100000:3.0:1780340795.290023:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961145088 00000100:00100000:3.0:1780340795.290042:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961145088 00000100:00100000:3.0:1780340795.290105:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850 00000100:00100000:3.0:1780340795.290123:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961145088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340795.290202:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961145088:12345-0@lo:400:kworker.0 Request processed in 89us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340795.290209:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850 00000100:00100000:2.0:1780340795.291647:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961145088:0@lo:400:kworker.0 00000100:00100000:3.0:1780340795.433049:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340795.433089:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340795.433119:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340795.433141:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340795.433179:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340795.433213:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940438400 00000100:00100000:3.0:1780340795.433224:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940438400 00000100:00100000:3.0:1780340795.433276:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940438272 00000100:00100000:3.0:1780340795.433279:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940438272 00000100:00100000:3.0:1780340795.433302:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2552 00000100:00100000:3.0:1780340795.433311:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2409:x1866818940438400:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340795.433404:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2409:x1866818940438400:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 93us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340795.433412:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2552 00000100:00100000:3.0:1780340795.433429:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2553 00000100:00100000:3.0:1780340795.433436:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940438272:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340795.433460:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940438272:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 26us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340795.433465:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2553 00000100:00100000:3.0:1780340795.433482:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940438144 00000100:00100000:3.0:1780340795.433485:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940438144 00000100:00100000:3.0:1780340795.433515:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940438016 00000100:00100000:3.0:1780340795.433518:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940438016 00000100:00100000:3.0:1780340795.433541:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1315 00000100:00100000:3.0:1780340795.433547:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940438144:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340795.433573:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2409:x1866818940438144:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 28us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340795.433590:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1315 00000100:00100000:3.0:1780340795.433600:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1316 00000100:00100000:3.0:1780340795.433606:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:2409:x1866818940438016:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340795.433629:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:2409:x1866818940438016:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340795.433635:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1316 00000100:00080000:3.0:1780340795.433653:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780340795.433657:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780340795.433659:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340795.433667:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340795.434072:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940437888 00000100:00100000:0.0:1780340795.434085:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940437888 00000100:00100000:0.0:1780340795.434123:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 82 00000100:00100000:0.0:1780340795.434131:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2409:x1866818940437888:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340795.434181:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2409:x1866818940437888:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 51us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340795.434188:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 82 00000100:00100000:2.0:1780340795.789424:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780340795.789447:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961145728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340795.789519:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340795.789559:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340795.789567:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961145856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340795.789591:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340795.789624:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961145728 00000100:00100000:2.0:1780340795.791238:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961145728 00000100:00100000:2.0:1780340795.791298:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961145856 00000100:00100000:2.0:1780340795.791302:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961145856 00000100:00100000:2.0:1780340795.791323:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:2.0:1780340795.791333:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961145728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780340795.791365:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780340795.791432:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961145728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1911us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340795.791440:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00000100:00100000:2.0:1780340795.791457:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065 00000100:00100000:2.0:1780340795.791464:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961145856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780340795.791479:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340795.791509:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961145856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (1917us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340795.791515:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065 00000100:00100000:2.0:1780340795.791562:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961145728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340795.791596:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961145856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340795.793084:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340795.793117:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961145984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340795.793188:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340795.793784:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961145984 00000100:00100000:3.0:1780340795.793792:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961145984 00000100:00100000:3.0:1780340795.793844:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851 00000100:00100000:3.0:1780340795.794047:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961145984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340795.794083:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445232640 avail 1298993152 00000100:00100000:3.0:1780340795.794205:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961145984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 354us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340795.794213:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851 00000100:00100000:3.0:1780340795.794267:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047218c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961145984:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1780340796.300480:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340796.810051:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340796.813851:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961146240:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340796.813951:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340796.814006:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961146112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340796.814063:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340796.814208:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961146240 00000100:00100000:1.0:1780340796.814220:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961146240 00000100:00100000:1.0:1780340796.814278:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961146112 00000100:00100000:1.0:1780340796.814282:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961146112 00000100:00100000:1.0:1780340796.814312:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2066 00000100:00100000:1.0:1780340796.814322:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047218c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961146240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340796.814354:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340796.814364:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067 00000100:00100000:3.0:1780340796.814377:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961146112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340796.814392:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780340796.814416:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047218c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961146240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340796.814425:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2066 00000100:00100000:3.0:1780340796.814435:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961146112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340796.814480:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961146240:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340796.814496:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961146112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340796.814636:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067 00010000:00010000:3.0:1780340797.331552:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1780340797.853595:0:87335:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149699 is committed 00010000:00010000:0.0:1780340798.348823:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340799.370260:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340800.394223:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340800.394518:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961146368:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.394623:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.394677:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961146880:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.394709:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.394730:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04468f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961147392:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.394751:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.394799:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961147904:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.394821:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.394847:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1780340800.394853:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961146496:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.395219:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.395248:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961147008:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.395278:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.395312:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961147520:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.395334:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.395371:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961146624:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.395395:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.395412:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961147136:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.395547:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.395567:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961147648:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.395591:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.395612:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1780340800.395619:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961146752:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.395642:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.395654:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961147264:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.395677:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.395696:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961147776:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.395718:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.395802:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961146368 00000100:00100000:1.0:1780340800.395814:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961146368 00000100:00100000:1.0:1780340800.396018:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1780340800.396029:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961146368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.396093:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961146368:12345-0@lo:400:kworker.0 Request processed in 66us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340800.396101:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1780340800.396151:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961146880 00000100:00100000:1.0:1780340800.396155:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961146880 00000100:00100000:1.0:1780340800.396191:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961147392 00000100:00100000:1.0:1780340800.396194:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961147392 00000100:00100000:1.0:1780340800.396219:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961147904 00000100:00100000:1.0:1780340800.396222:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961147904 00000100:00100000:1.0:1780340800.396233:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961146496 00000100:00100000:1.0:1780340800.396236:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961146496 00000100:00100000:1.0:1780340800.396248:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961146624 00000100:00100000:1.0:1780340800.396250:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961146624 00000100:00100000:1.0:1780340800.396260:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961146752 00000100:00100000:1.0:1780340800.396263:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961146752 00000100:00100000:1.0:1780340800.396276:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:1.0:1780340800.396282:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961146880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340800.396786:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961147136 00000100:00100000:0.0:1780340800.396791:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961147136 00000100:00100000:0.0:1780340800.396834:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961147648 00000100:00100000:0.0:1780340800.396837:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961147648 00000100:00100000:0.0:1780340800.396857:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961147264 00000100:00100000:0.0:1780340800.396859:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961147264 00000100:00100000:0.0:1780340800.396943:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961147776 00000100:00100000:0.0:1780340800.396946:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961147776 00000100:00100000:0.0:1780340800.396969:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:0.0:1780340800.396976:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961147136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340800.397036:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961147136:12345-0@lo:400:kworker.0 Request processed in 61us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340800.397043:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00100000:0.0:1780340800.397055:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:0.0:1780340800.397060:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961147648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340800.397081:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961147648:12345-0@lo:400:kworker.0 Request processed in 22us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340800.397087:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:0.0:1780340800.397095:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:0.0:1780340800.397100:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961147264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340800.397150:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961147264:12345-0@lo:400:kworker.0 Request processed in 50us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340800.397157:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:0.0:1780340800.397167:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:0.0:1780340800.397173:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961147776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340800.397199:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961147776:12345-0@lo:400:kworker.0 Request processed in 27us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340800.397205:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00100000:0.0:1780340800.397275:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961147264:0@lo:400:kworker.0 00000100:00100000:0.0:1780340800.397289:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961147776:0@lo:400:kworker.0 00000100:00100000:0.0:1780340800.397300:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961147136:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.397554:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961146880:12345-0@lo:400:kworker.0 Request processed in 1270us (2842us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340800.397564:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:1.0:1780340800.397582:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:1.0:1780340800.397589:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961147392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.397618:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961147392:12345-0@lo:400:kworker.0 Request processed in 31us (2866us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340800.397624:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:1.0:1780340800.397633:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1780340800.397639:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961147904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.397663:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961147904:12345-0@lo:400:kworker.0 Request processed in 25us (2842us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340800.397669:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1780340800.397680:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:1.0:1780340800.397687:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961146496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.397716:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961146496:12345-0@lo:400:kworker.0 Request processed in 30us (2843us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340800.397732:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:1.0:1780340800.397744:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:1.0:1780340800.397750:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961146624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.397799:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961146624:12345-0@lo:400:kworker.0 Request processed in 50us (2403us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340800.397805:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:1.0:1780340800.397814:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:1.0:1780340800.397820:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961146752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.397844:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961146752:12345-0@lo:400:kworker.0 Request processed in 24us (2201us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340800.397850:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:0.0:1780340800.397971:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961147648:0@lo:400:kworker.0 00000100:00100000:0.0:1780340800.398005:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961146752:0@lo:400:kworker.0 00000100:00100000:0.0:1780340800.398016:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961146624:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.399058:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961147008 00000100:00100000:1.0:1780340800.399071:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961147008 00000100:00100000:1.0:1780340800.399154:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961147520 00000100:00100000:1.0:1780340800.399157:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961147520 00000100:00100000:0.0:1780340800.402677:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961148032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340800.402803:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.404234:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961148032 00000100:00100000:1.0:1780340800.404252:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961148032 00000100:00100000:1.0:1780340800.404328:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852 00000100:00100000:1.0:1780340800.404341:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961147008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.404595:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961147008:12345-0@lo:400:kworker.0 Request processed in 257us (9314us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340800.404603:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852 00000100:00100000:1.0:1780340800.404625:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853 00000100:00100000:1.0:1780340800.404633:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961147520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.404668:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961147520:12345-0@lo:400:kworker.0 Request processed in 36us (9333us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340800.404697:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853 00000100:00100000:1.0:1780340800.404712:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3854 00000100:00100000:1.0:1780340800.404718:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961148032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780340800.404750:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445478400 avail 1299238912 00000100:00100000:1.0:1780340800.404825:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961148032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340800.404832:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3854 00000100:00100000:1.0:1780340800.404926:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961146496:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.404940:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961147008:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.404951:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961147520:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.404963:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961146368:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.404977:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961146880:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.404991:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04468f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961147392:0@lo:400:kworker.0 00000100:00100000:1.0:1780340800.405006:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961147904:0@lo:400:kworker.0 00000100:00080000:1.0:1780340800.405053:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340800.405061:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780340800.405065:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780340800.405068:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340800.406395:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961148032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780340800.553820:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340800.553873:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340800.553995:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340800.554046:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340800.554075:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340800.554128:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940439040 00000100:00100000:0.0:1780340800.554143:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940439040 00000100:00100000:0.0:1780340800.554227:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940438912 00000100:00100000:0.0:1780340800.554231:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940438912 00000100:00100000:0.0:1780340800.554256:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2558 00000100:00100000:0.0:1780340800.554266:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2407:x1866818940439040:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340800.554493:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2407:x1866818940439040:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 228us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340800.554502:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2558 00000100:00100000:0.0:1780340800.554522:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2559 00000100:00100000:0.0:1780340800.554529:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940438912:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340800.554557:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940438912:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 28us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340800.554563:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2559 00000100:00100000:1.0:1780340800.554681:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940438528 00000100:00100000:1.0:1780340800.554687:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940438528 00000100:00100000:1.0:1780340800.554720:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 84 00000100:00100000:1.0:1780340800.554727:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940438528:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340800.554789:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940438528:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 62us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340800.554797:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 84 00000100:00100000:1.0:1780340800.554834:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940438784 00000100:00100000:1.0:1780340800.554838:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940438784 00000100:00100000:1.0:1780340800.554885:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940438656 00000100:00100000:1.0:1780340800.554889:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940438656 00000100:00100000:1.0:1780340800.554917:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1323 00000100:00100000:1.0:1780340800.554924:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b9e2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940438784:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340800.554954:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b9e2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2407:x1866818940438784:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 31us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340800.554960:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1323 00000100:00100000:2.0:1780340800.557514:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1324 00000100:00100000:2.0:1780340800.557537:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:2407:x1866818940438656:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340800.557695:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:2407:x1866818940438656:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 169us (3647us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340800.557703:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1324 00000100:00080000:2.0:1780340800.557815:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780340800.557822:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340800.557827:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340800.557830:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1780340800.849173:0:88047:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 133: check resend of ongoing requests for lwp during failover ========================================================== 15:06:39 (1780340799) 00000100:00100000:1.0:1780340800.906435:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047aa68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961148160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340800.906537:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.906595:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340800.906603:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961148288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340800.906647:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340800.907082:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961148160 00000100:00100000:0.0:1780340800.907094:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961148160 00000100:00100000:0.0:1780340800.907158:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961148288 00000100:00100000:0.0:1780340800.907161:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961148288 00000100:00100000:0.0:1780340800.907182:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068 00000100:00100000:0.0:1780340800.907192:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961148160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340800.907232:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340800.907288:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961148160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340800.907295:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068 00000100:00100000:0.0:1780340800.907520:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069 00000100:00100000:0.0:1780340800.907529:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b48fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961148288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780340800.907547:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340800.907589:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b48fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961148288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340800.907604:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069 00000100:00100000:3.0:1780340800.907819:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047aa6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961148416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340800.907888:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340800.907954:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961148416 00000100:00100000:3.0:1780340800.908025:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961148416 00000100:00100000:3.0:1780340800.908086:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855 00000100:00100000:3.0:1780340800.908094:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961148416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340800.908137:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445232640 avail 1298993152 00000100:00100000:3.0:1780340800.908180:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1866818961148416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340800.908189:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855 00000100:00100000:3.0:1780340800.908242:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047aa6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961148416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340800.908265:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961148288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340800.908296:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047aa68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961148160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340800.981545:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340800.981594:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940439296 00000100:00100000:1.0:1780340800.981607:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940439296 00000100:00100000:1.0:1780340800.981676:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1293 00000100:00100000:1.0:1780340800.981689:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:70237:x1866818940439296:12345-192.168.203.16@tcp:36:mkdir.0 00000100:00100000:1.0:1780340800.981858:0:64454:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID:64454:1866818961148544:0@lo:900:mdt00_003.0 00000100:00100000:1.0:1780340800.981921:0:64454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.981954:0:64454:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04754c2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1780340800.981994:0:63721:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961148544 00000100:00100000:1.0:1780340800.981998:0:63721:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961148544 00000100:00100000:1.0:1780340800.982028:0:63721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1780340800.982035:0:63721:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446ff7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:64454:x1866818961148544:12345-0@lo:900:mdt00_003.0 00000100:00100000:1.0:1780340800.982089:0:63721:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446ff7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:64454:x1866818961148544:12345-0@lo:900:mdt00_003.0 Request processed in 53us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340800.982096:0:63721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1780340800.982489:0:64454:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID:64454:1866818961148544:0@lo:900:mdt00_003.0 00000100:00100000:1.0:1780340800.982556:0:64454:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961148672:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780340800.982596:0:64454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.982618:0:64454:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04754c2600 going to sleep for 11 seconds 00000100:00100000:1.0:1780340800.982636:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961148672 00000100:00100000:1.0:1780340800.982640:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961148672 00000100:00100000:1.0:1780340800.982674:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856 00000100:00100000:1.0:1780340800.982682:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:64454:x1866818961148672:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780340800.982751:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:64454:x1866818961148672:12345-0@lo:1000:mdt00_003.0 Request processed in 69us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340800.982785:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856 00000100:00100000:1.0:1780340800.982820:0:64454:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961148672:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780340800.982877:0:64454:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961148800:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780340800.982901:0:64454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.982917:0:64454:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0347591d80 going to sleep for 11 seconds 00000100:00100000:1.0:1780340800.982931:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961148800 00000100:00100000:1.0:1780340800.982934:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961148800 00000100:00100000:1.0:1780340800.982959:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857 00000100:00100000:1.0:1780340800.982965:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:64454:x1866818961148800:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780340800.983044:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:64454:x1866818961148800:12345-0@lo:1000:mdt00_003.0 Request processed in 79us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340800.983052:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857 00000100:00100000:1.0:1780340800.983080:0:64454:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961148800:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780340800.987284:0:64454:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961148928:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780340800.987583:0:64454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.987627:0:64454:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0347591d80 going to sleep for 11 seconds 00000100:00100000:1.0:1780340800.987663:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961148928 00000100:00100000:1.0:1780340800.987672:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961148928 00000100:00100000:1.0:1780340800.987722:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858 00000100:00100000:1.0:1780340800.987730:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:64454:x1866818961148928:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780340800.987848:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:64454:x1866818961148928:12345-0@lo:1000:mdt00_003.0 Request processed in 117us (265us total) trans 0 rc -2/-2 00000100:00100000:1.0:1780340800.987856:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858 00000100:00100000:1.0:1780340800.987906:0:64454:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961148928:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1780340800.987979:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340800.987991:0:64454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340800.988002:0:64454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340800.988014:0:64454:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961149056:0@lo:101:mdt00_003.0 00000100:00100000:1.0:1780340800.988036:0:64454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340800.988049:0:64454:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c03475910c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340800.988073:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961149056 00000100:00100000:1.0:1780340800.988077:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961149056 00000100:00100000:1.0:1780340800.990947:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859 00000100:00100000:1.0:1780340800.990968:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:64454:x1866818961149056:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1780340800.990992:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340800.991017:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774807 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa24651432774800 expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340800.991054:0:22660:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432774782 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23e5 expref: 8 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340800.991064:0:22660:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774807 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774800 expref: 7 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340800.991104:0:22660:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432774782 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23e5 expref: 8 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340800.991131:0:22660:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432774782 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23e5 expref: 8 pid: 64454 timeout: 3680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340800.991148:0:22660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16d500 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:22660:1866818961149184:192.168.203.16@tcp:104: 00000100:00100000:1.0:1780340800.991251:0:22660:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0347591d80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340800.998908:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340800.999155:0:6503:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940439424 00000100:00100000:2.0:1780340800.999170:0:6503:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940439424 00010000:00010000:2.0:1780340800.999221:0:6503:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432774782 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23e5 expref: 9 pid: 64454 timeout: 3680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340800.999276:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2549 00000100:00100000:2.0:1780340800.999288:0:6503:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04757c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:2407:x1866818940439424:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780340800.999305:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340800.999311:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432774782 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23e5 expref: 9 pid: 64454 timeout: 3680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340800.999327:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432774782 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23e5 expref: 9 pid: 64454 timeout: 3680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340800.999356:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455e5c900) 00010000:00010000:2.0:1780340800.999363:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774807 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774800 expref: 7 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340800.999375:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774807 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xa24651432774800 expref: 7 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340800.999387:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774807 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xa24651432774800 expref: 7 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340800.999429:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774807 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774800 expref: 7 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340800.999446:0:6503:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6503:1866818961149312:0@lo:105: 00000100:00100000:2.0:1780340800.999537:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340800.999594:0:6503:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a85db40 going to sleep for 11 seconds 00000100:00100000:3.0:1780340800.999610:0:9471:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961149312 00000100:00100000:3.0:1780340800.999621:0:9471:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961149312 00000100:00100000:3.0:1780340800.999688:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1780340800.999698:0:9471:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6503:x1866818961149312:12345-0@lo:105: 00010000:00010000:3.0:1780340800.999714:0:9471:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa24651432774807 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340800.999728:0:9471:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa24651432774807 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340800.999739:0:9471:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa24651432774807 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340800.999756:0:9471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa24651432774807 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340800.999810:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa24651432774807 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340800.999821:0:9471:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xa24651432774807 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340800.999842:0:9471:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8c0453123200) 00000100:00100000:3.0:1780340800.999905:0:9471:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6503:x1866818961149312:12345-0@lo:105: Request processed in 208us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340800.999914:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1780340801.000152:0:6503:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6503:1866818961149312:0@lo:105: 00010000:00010000:2.0:1780340801.000173:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340801.000242:0:6503:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04757c4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:2407:x1866818940439424:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 954us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340801.000250:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2549 00010000:00010000:1.0:1780340801.000451:0:22660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432774782 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23e5 expref: 8 pid: 64454 timeout: 3680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340801.000473:0:22660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16d500 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:22660:1866818961149184:192.168.203.16@tcp:104: 00010000:00010000:1.0:1780340801.000781:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774807 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774800 expref: 7 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.000807:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455e5c900) 00010000:00010000:1.0:1780340801.000810:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340801.000815:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123a00, rc 0) 00000100:00100000:1.0:1780340801.000883:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:64454:x1866818961149056:12345-0@lo:101:mdt00_003.0 Request processed in 9922us (12844us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340801.000891:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859 00000100:00100000:2.0:1780340801.001192:0:64454:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16d180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961149056:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1780340801.001212:0:64454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa24651432774807 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1780340801.001237:0:64454:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1780340801.001282:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6d600/0xa2465143277480e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.001290:0:64454:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6d600/0xa2465143277480e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.001300:0:64454:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6d600/0xa2465143277480e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340801.001320:0:64454:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961149440:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1780340801.001359:0:64454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340801.001387:0:64454:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a85d480 going to sleep for 11 seconds 00000100:00100000:1.0:1780340801.002146:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961149440 00000100:00100000:1.0:1780340801.002157:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961149440 00000100:00100000:1.0:1780340801.002221:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860 00000100:00100000:1.0:1780340801.002231:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:64454:x1866818961149440:12345-0@lo:101:mdt00_003.0 00010000:00010000:1.0:1780340801.002254:0:26074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340801.002279:0:26074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432774815 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa2465143277480e expref: -99 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.002313:0:26074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432774815 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277480e expref: 8 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.002329:0:26074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432774815 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277480e expref: 8 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.002338:0:26074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8c047a3b5800) 00010000:00010000:1.0:1780340801.002341:0:26074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340801.002345:0:26074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122600, rc 0) 00000100:00100000:1.0:1780340801.002416:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:64454:x1866818961149440:12345-0@lo:101:mdt00_003.0 Request processed in 187us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340801.002423:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860 00000100:00100000:0.0:1780340801.003048:0:64454:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961149440:0@lo:101:mdt00_003.0 00010000:00010000:0.0:1780340801.003074:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6d600/0xa2465143277480e lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa24651432774815 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340801.003088:0:64454:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6d600/0xa2465143277480e lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa24651432774815 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780340801.003118:0:64454:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1780340801.003171:0:64454:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961149568:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1780340801.003220:0:64454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340801.003246:0:64454:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471e66300 going to sleep for 11 seconds 00000100:00100000:1.0:1780340801.003420:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961149568 00000100:00100000:1.0:1780340801.003429:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961149568 00000100:00100000:1.0:1780340801.003486:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3861 00000100:00100000:1.0:1780340801.003495:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:64454:x1866818961149568:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780340801.004506:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:64454:x1866818961149568:12345-0@lo:1000:mdt00_003.0 Request processed in 1005us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340801.004518:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3861 00000100:00100000:0.0:1780340801.005894:0:64454:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961149568:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1780340801.005979:0:64454:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961149696:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1780340801.006032:0:64454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340801.006061:0:64454:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471e66300 going to sleep for 11 seconds 00000100:00100000:1.0:1780340801.006352:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961149696 00000100:00100000:1.0:1780340801.006366:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961149696 00000100:00100000:1.0:1780340801.006436:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862 00000100:00100000:1.0:1780340801.006448:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:64454:x1866818961149696:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1780340801.011548:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:64454:x1866818961149696:12345-0@lo:1000:mdt00_003.0 Request processed in 5079us (5492us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780340801.011568:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862 00000100:00100000:1.0:1780340801.011810:0:64454:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961149696:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780340801.012023:0:64454:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961149824:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780340801.012098:0:64454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340801.012144:0:64454:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0347591780 going to sleep for 11 seconds 00000100:00100000:0.0:1780340801.012325:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961149824 00000100:00100000:0.0:1780340801.012338:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961149824 00000100:00100000:0.0:1780340801.012395:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863 00000100:00100000:0.0:1780340801.012421:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:64454:x1866818961149824:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1780340801.012557:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:64454:x1866818961149824:12345-0@lo:1000:mdt00_003.0 Request processed in 139us (459us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780340801.012564:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863 00000100:00100000:1.0:1780340801.013184:0:64454:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961149824:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780340801.013279:0:64454:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961149952:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780340801.013339:0:64454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340801.013375:0:64454:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0347591780 going to sleep for 11 seconds 00000100:00100000:0.0:1780340801.013412:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961149952 00000100:00100000:0.0:1780340801.013420:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961149952 00000100:00100000:0.0:1780340801.013465:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864 00000100:00100000:0.0:1780340801.013474:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:64454:x1866818961149952:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1780340801.013565:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:64454:x1866818961149952:12345-0@lo:1000:mdt00_003.0 Request processed in 92us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340801.013571:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864 00000100:00100000:1.0:1780340801.013606:0:64454:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961149952:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780340801.013661:0:64454:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961150080:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780340801.013690:0:64454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340801.013713:0:64454:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0347591780 going to sleep for 11 seconds 00000100:00100000:0.0:1780340801.013830:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961150080 00000100:00100000:0.0:1780340801.013835:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961150080 00000100:00100000:0.0:1780340801.013864:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865 00000100:00100000:0.0:1780340801.013870:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:64454:x1866818961150080:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1780340801.013941:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:64454:x1866818961150080:12345-0@lo:1000:mdt00_003.0 Request processed in 71us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340801.013947:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865 00000100:00100000:1.0:1780340801.016718:0:64454:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961150080:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780340801.016866:0:64454:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961150208:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1780340801.016959:0:64454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340801.017012:0:64454:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0347591780 going to sleep for 11 seconds 00000100:00100000:0.0:1780340801.018242:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961150208 00000100:00100000:0.0:1780340801.018256:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961150208 00000100:00100000:0.0:1780340801.018336:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866 00000100:00100000:0.0:1780340801.018347:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:64454:x1866818961150208:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1780340801.018504:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:64454:x1866818961150208:12345-0@lo:1000:mdt00_003.0 Request processed in 159us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340801.018517:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866 00000100:00100000:1.0:1780340801.018558:0:64454:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64454:1866818961150208:0@lo:1000:mdt00_003.0 00000040:00080000:1.0:1780340801.019352:0:64454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].2, 1000 off35920 00000040:00080000:1.0:1780340801.019434:0:64454:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].2, 1152 off36272 00000004:00080000:1.0:1780340801.019443:0:64454:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c0347591480 with version 9 00000004:00080000:2.0:1780340801.022155:0:72687:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c034acb9780 version 9 rpc_version 9 00000020:00100000:2.0:1780340801.022224:0:72687:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1780340801.022242:0:72687:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c04497aea00 x1866818961150464/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340801.022275:0:72687:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497aea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72687:1866818961150464:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1780340801.022395:0:72687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340801.022442:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a85de40 going to sleep for 11 seconds 00000100:00100000:1.0:1780340801.022709:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961150464 00000100:00100000:1.0:1780340801.022721:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961150464 00000100:00100000:1.0:1780340801.022825:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867 00000100:00100000:1.0:1780340801.022837:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:72687:x1866818961150464:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1780340801.028000:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:72687:x1866818961150464:12345-0@lo:1000:osp_up0-1.0 Request processed in 5139us (5581us total) trans 111669149700 rc 0/0 00000100:00100000:1.0:1780340801.028017:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867 00000100:00100000:3.0:1780340801.028263:0:72687:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497aea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72687:1866818961150464:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1780340801.028468:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123c00/0xa2465143277481c lrc: 3/0,1 mode: --/PW res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.028491:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123c00/0xa2465143277481c lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.028512:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123c00/0xa2465143277481c lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340801.028536:0:64454:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007260fdda reply state 000000009a3f1e50 transno 81604378735 ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123c00/0xa2465143277481c lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.028550:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123c00/0xa2465143277481c lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.028558:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c04495cde00) 00010000:00010000:1.0:1780340801.028572:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340801.028578:0:64454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1780340801.028586:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00080000:1.0:1780340801.028596:0:64454:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1780340801.028610:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa24651432774807 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.028622:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa24651432774807 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.028630:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa24651432774807 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.028666:0:64454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1780340801.028671:0:64454:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1780340801.028679:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6d600/0xa2465143277480e lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa24651432774815 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.028687:0:64454:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6d600/0xa2465143277480e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa24651432774815 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340801.028876:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:70237:x1866818940439296:12345-192.168.203.16@tcp:36:mkdir.0 Request processed in 47187us (47338us total) trans 81604378735 rc 0/0 00000100:00100000:1.0:1780340801.028887:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1293 00010000:00010000:3.0:1780340801.029268:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340801.029276:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xa24651432774807 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.029285:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123200 already unused, calling callback (ffffffffc18205b0) 00010000:00010000:3.0:1780340801.029291:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa24651432774807 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340801.029300:0:7442:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa24651432774807 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.029352:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa24651432774807 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.029367:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340801.029404:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa24651432774807 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.029411:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453123200/0xa24651432774800 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa24651432774807 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.029437:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340801.029439:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340801.029441:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340801.029451:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340801.029469:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047aa6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961150592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340801.029536:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340801.029587:0:25499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961150592 00000100:00100000:3.0:1780340801.029594:0:25499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961150592 00000100:00100000:3.0:1780340801.029647:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1780340801.029657:0:25499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+9:3659:x1866818961150592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340801.029674:0:25499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340801.029701:0:25499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774807 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774800 expref: 9 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.029719:0:25499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0455e5c900) 00010000:00010000:3.0:1780340801.029733:0:25499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340801.029800:0:25499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+8:3659:x1866818961150592:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340801.029808:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1780340801.029862:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047aa6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961150592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780340801.076348:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340801.077584:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940439552 00000100:00100000:2.0:1780340801.077604:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940439552 00000100:00100000:2.0:1780340801.077794:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1294 00000100:00100000:2.0:1780340801.077805:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:70238:x1866818940439552:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1780340801.077831:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340801.077856:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6de00/0xa24651432774823 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2401 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.077952:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c200/0xa2465143277482a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.077972:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c200/0xa2465143277482a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.078141:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c200/0xa2465143277482a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340801.078209:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1780340801.078214:0:63711:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780340801.078244:0:63711:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c200/0xa2465143277482a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.078274:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6de00/0xa24651432774823 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2401 expref: 10 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.078292:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c200/0xa2465143277482a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2401 expref: 9 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.078316:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0451652600) 00010000:00010000:2.0:1780340801.078320:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780340801.078324:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c045ec6c200, rc 0) 00000100:00100000:2.0:1780340801.078476:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:70238:x1866818940439552:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 672us (2141us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340801.078484:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1294 00000100:00100000:3.0:1780340801.080604:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340801.081608:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940439680 00000100:00100000:1.0:1780340801.081634:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940439680 00000100:00100000:1.0:1780340801.081706:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1295 00000100:00100000:1.0:1780340801.081717:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:70238:x1866818940439680:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1780340801.081743:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340801.081794:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122a00/0xa24651432774831 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2408 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.081885:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122800/0xa24651432774838 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.081907:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122800/0xa24651432774838 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.081923:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122800/0xa24651432774838 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.081935:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122400/0xa2465143277483f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.081947:0:63710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432774815 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277480e expref: 7 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.081956:0:63710:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122400/0xa2465143277483f lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.082015:0:63710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432774815 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xa2465143277480e expref: 7 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340801.082035:0:63710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:63710:1866818961150720:0@lo:104: 00000100:00100000:1.0:1780340801.082115:0:63710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340801.082161:0:63710:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0347591180 going to sleep for 11 seconds 00000100:00100000:3.0:1780340801.082961:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961150720 00000100:00100000:3.0:1780340801.082972:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961150720 00000100:00100000:3.0:1780340801.083125:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1780340801.083135:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:63710:x1866818961150720:12345-0@lo:104: 00010000:00010000:3.0:1780340801.083154:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6d600/0xa2465143277480e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xa24651432774815 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.083243:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1780340801.083250:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:63710:x1866818961150720:12345-0@lo:104: Request processed in 117us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340801.083258:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1780340801.083327:0:63710:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:63710:1866818961150720:0@lo:104: 00010000:00010000:1.0:1780340801.083349:0:63710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122400/0xa2465143277483f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.083490:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340801.083498:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6d600/0xa2465143277480e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xa24651432774815 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.083507:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6d600 already unused, calling callback (ffffffffc18205b0) 00010000:00010000:3.0:1780340801.083514:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6d600/0xa2465143277480e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xa24651432774815 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340801.083523:0:6504:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6d600/0xa2465143277480e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xa24651432774815 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.083563:0:6504:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6d600/0xa2465143277480e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa24651432774815 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.083570:0:6504:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1780340801.083631:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047aa6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961150848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340801.083675:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340801.083737:0:7443:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961150848 00000100:00100000:2.0:1780340801.083742:0:7443:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961150848 00010000:00010000:2.0:1780340801.083864:0:7443:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432774815 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xa2465143277480e expref: 8 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340801.083893:0:7443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:2.0:1780340801.083901:0:7443:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3661:x1866818961150848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340801.083914:0:7443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340801.084323:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6d600/0xa2465143277480e lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa24651432774815 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.084341:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6d600/0xa2465143277480e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa24651432774815 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.084360:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340801.084362:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340801.084363:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1780340801.086157:0:87335:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149700 is committed 00010000:00010000:2.0:1780340801.086310:0:7443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432774815 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xa2465143277480e expref: 7 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.086333:0:7443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8c047a3b5800) 00010000:00010000:2.0:1780340801.086338:0:7443:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122400/0xa2465143277483f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.086349:0:7443:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122400/0xa2465143277483f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.086359:0:7443:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122400/0xa2465143277483f lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.086444:0:7443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340801.086546:0:7443:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961150848:12345-0@lo:103:ldlm_bl.0 Request processed in 2643us (2869us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340801.086556:0:7443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:3.0:1780340801.086705:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047aa6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961150848:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340801.086753:0:63710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122400/0xa2465143277483f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.086850:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122400/0xa2465143277483f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340801.088178:0:63710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:63710:1866818961150976:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1780340801.088256:0:63710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340801.088302:0:63710:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04754c2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340801.088721:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961150976 00000100:00100000:0.0:1780340801.088733:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961150976 00000100:00100000:0.0:1780340801.088920:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868 00000100:00100000:0.0:1780340801.088931:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0345eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63710:x1866818961150976:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1780340801.089438:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0345eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63710:x1866818961150976:12345-0@lo:1000:mdt00_000.0 Request processed in 507us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340801.089447:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868 00000100:00100000:1.0:1780340801.089562:0:63710:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:63710:1866818961150976:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1780340801.089708:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122c00/0xa24651432774846 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.089727:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122c00/0xa24651432774846 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.089742:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122c00/0xa24651432774846 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340801.090181:0:63710:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122c00/0xa24651432774846 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.090201:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122800/0xa24651432774838 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.090209:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122800/0xa24651432774838 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.090227:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122800/0xa24651432774838 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.090236:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122800/0xa24651432774838 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.090243:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340801.090247:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122800/0xa24651432774838 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.090256:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122800/0xa24651432774838 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.090271:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0451652600) 00010000:00010000:1.0:1780340801.090275:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340801.090281:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122800/0xa24651432774838 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.090289:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122800/0xa24651432774838 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.090304:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122400/0xa2465143277483f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.090311:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122400/0xa2465143277483f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.090317:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122400/0xa2465143277483f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.090323:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340801.090331:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122400/0xa2465143277483f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.090338:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122400/0xa2465143277483f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.090347:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8c047a3b5800) 00010000:00010000:1.0:1780340801.090349:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340801.090352:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122400/0xa2465143277483f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.090359:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122400/0xa2465143277483f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.090407:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122a00/0xa24651432774831 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2408 expref: 11 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.090421:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122c00/0xa24651432774846 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2408 expref: 10 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.090430:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c04495cd300) 00010000:00010000:1.0:1780340801.090432:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1780340801.090435:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122c00, rc 0) 00000100:00100000:1.0:1780340801.090515:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:70238:x1866818940439680:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 8800us (9921us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340801.090524:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1295 00000100:00100000:3.0:1780340801.093677:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340801.093744:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940439808 00000100:00100000:3.0:1780340801.093787:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940439808 00000100:00100000:3.0:1780340801.093867:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1296 00000100:00100000:3.0:1780340801.093880:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:70238:x1866818940439808:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1780340801.093918:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340801.093950:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afa00/0xa2465143277484d lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced240f expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.094229:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae400/0xa24651432774854 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.094248:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae400/0xa24651432774854 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.094261:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae400/0xa24651432774854 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340801.094331:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1780340801.094351:0:64454:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1780340801.094404:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afa00/0xa2465143277484d lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced240f expref: 10 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.094424:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae400/0xa24651432774854 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced240f expref: 9 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.094434:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c04495cde00) 00010000:00010000:3.0:1780340801.094437:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1780340801.094442:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722ae400, rc 0) 00000100:00100000:3.0:1780340801.094562:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:70238:x1866818940439808:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 684us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340801.094572:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1296 00000100:00100000:1.0:1780340801.105202:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340801.108040:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940439936 00000100:00100000:2.0:1780340801.108060:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940439936 00000100:00100000:2.0:1780340801.108143:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1297 00000100:00100000:2.0:1780340801.108155:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:70238:x1866818940439936:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1780340801.108184:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340801.108210:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6ca00/0xa2465143277485b lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2416 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108300:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c400/0xa24651432774862 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108318:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c400/0xa24651432774862 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108331:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c400/0xa24651432774862 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108347:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c000/0xa24651432774869 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108354:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c000/0xa24651432774869 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108360:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c000/0xa24651432774869 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108432:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c400/0xa24651432774862 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108440:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c400/0xa24651432774862 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108446:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c400/0xa24651432774862 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108453:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c400/0xa24651432774862 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108460:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6c400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340801.108465:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c400/0xa24651432774862 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108472:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c400/0xa24651432774862 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108487:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c04495cde00) 00010000:00010000:2.0:1780340801.108490:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340801.108495:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c400/0xa24651432774862 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108502:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c400/0xa24651432774862 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108516:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c000/0xa24651432774869 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108523:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c000/0xa24651432774869 lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108536:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c000/0xa24651432774869 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108541:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6c000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340801.108545:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c000/0xa24651432774869 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108552:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c000/0xa24651432774869 lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108560:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff8c0451652800) 00010000:00010000:2.0:1780340801.108562:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340801.108565:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c000/0xa24651432774869 lrc: 2/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108571:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c000/0xa24651432774869 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.108609:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6ca00/0xa2465143277485b lrc: 1/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2416 expref: 10 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.110116:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c04495cde00) 00010000:00010000:2.0:1780340801.110121:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340801.110132:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6ca00/0xa2465143277485b lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2416 expref: 10 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.110148:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c045ec6ca00, rc 0) 00000100:00100000:2.0:1780340801.110253:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:70238:x1866818940439936:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 2099us (5064us total) trans 0 rc 301/301 00000100:00100000:2.0:1780340801.110279:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1297 00000100:00100000:2.0:1780340801.117804:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340801.118493:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940440064 00000100:00100000:1.0:1780340801.118506:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940440064 00000100:00100000:1.0:1780340801.118576:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1298 00000100:00100000:1.0:1780340801.118596:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:70238:x1866818940440064:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1780340801.118634:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340801.118660:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122a00/0xa24651432774870 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced241d expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.118749:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122400/0xa24651432774877 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.118791:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122400/0xa24651432774877 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.118805:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122400/0xa24651432774877 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.118822:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa2465143277487e lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.118830:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa2465143277487e lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.118837:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa2465143277487e lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.118889:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122400/0xa24651432774877 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.118897:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122400/0xa24651432774877 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.118904:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122400/0xa24651432774877 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.118921:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122400/0xa24651432774877 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.118928:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340801.118933:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122400/0xa24651432774877 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.118941:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122400/0xa24651432774877 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.118955:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c04495cde00) 00010000:00010000:1.0:1780340801.118959:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340801.118964:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122400/0xa24651432774877 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.118971:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122400/0xa24651432774877 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.118983:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa2465143277487e lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.119145:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa2465143277487e lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.119153:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa2465143277487e lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.119159:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340801.119163:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa2465143277487e lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.119178:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa2465143277487e lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.119187:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff8c04495cdf00) 00010000:00010000:1.0:1780340801.119190:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340801.119193:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa2465143277487e lrc: 2/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.119199:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa2465143277487e lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.119240:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122a00/0xa24651432774870 lrc: 1/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced241d expref: 10 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.119251:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c04495cde00) 00010000:00010000:1.0:1780340801.119255:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340801.119258:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122a00/0xa24651432774870 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced241d expref: 10 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.119268:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122a00, rc 0) 00000100:00100000:1.0:1780340801.119352:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:70238:x1866818940440064:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 759us (1590us total) trans 0 rc 301/301 00000100:00100000:1.0:1780340801.119362:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1298 00000100:00100000:1.0:1780340801.122130:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340801.122177:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940440192 00000100:00100000:1.0:1780340801.122190:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940440192 00000100:00100000:1.0:1780340801.122268:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1299 00000100:00100000:1.0:1780340801.122282:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+9:70238:x1866818940440192:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1780340801.122319:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340801.122352:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123800/0xa24651432774885 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2424 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.122457:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122200/0xa2465143277488c lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.122476:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122200/0xa2465143277488c lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.122491:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122200/0xa2465143277488c lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340801.122548:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00200000:1.0:1780340801.122553:0:63712:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780340801.122577:0:63712:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122200/0xa2465143277488c lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.122610:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123800/0xa24651432774885 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2424 expref: 11 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.122650:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122200/0xa2465143277488c lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2424 expref: 10 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.122661:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c04495cde00) 00010000:00010000:1.0:1780340801.122665:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1780340801.122670:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122200, rc 0) 00000100:00100000:1.0:1780340801.122748:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:70238:x1866818940440192:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 469us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340801.122756:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1299 00000100:00100000:3.0:1780340801.128454:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340801.128537:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940440448 00000100:00100000:0.0:1780340801.128550:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940440448 00000100:00100000:0.0:1780340801.128625:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1300 00000100:00100000:0.0:1780340801.128636:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:70238:x1866818940440448:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1780340801.128663:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340801.128691:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785200/0xa24651432774893 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced242b expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340801.128861:0:70100:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1780340801.129093:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785200/0xa24651432774893 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced242b expref: 12 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340801.129121:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045a87a000) 00010000:00010000:0.0:1780340801.129125:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1780340801.129131:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785200/0xa24651432774893 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced242b expref: 12 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340801.129149:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0347785200, rc 0) 00000100:00100000:0.0:1780340801.129219:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:70238:x1866818940440448:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 584us (779us total) trans 81604378736 rc 301/301 00000100:00100000:0.0:1780340801.129236:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1300 00000100:00100000:2.0:1780340801.138352:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340801.139750:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940440704 00000100:00100000:3.0:1780340801.140858:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940440704 00000100:00100000:3.0:1780340801.140972:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1301 00000100:00100000:3.0:1780340801.140985:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:70238:x1866818940440704:12345-192.168.203.16@tcp:36:lfs.0 00010000:00010000:3.0:1780340801.141059:0:64454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340801.141092:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122200/0xa2465143277488c lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2424 expref: 11 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.141122:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c04495cde00) 00010000:00010000:3.0:1780340801.141128:0:64454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340801.141209:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afa00/0xa246514327748a1 lrc: 3/0,1 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.141226:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afa00/0xa246514327748a1 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.141261:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afa00/0xa246514327748a1 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.141279:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afe00/0xa246514327748a8 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.141286:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afe00/0xa246514327748a8 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.141293:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afe00/0xa246514327748a8 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.142006:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af200/0xa246514327748af lrc: 3/0,1 mode: --/PW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.142020:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af200/0xa246514327748af lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.142028:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af200/0xa246514327748af lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340801.142046:0:64454:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000019607714 reply state 000000006770d99d transno 81604378737 ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af200/0xa246514327748af lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.142058:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af200/0xa246514327748af lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.142065:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff8c0444f27200) 00010000:00010000:3.0:1780340801.142069:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340801.142072:0:64454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1780340801.142079:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:3.0:1780340801.142095:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afa00/0xa246514327748a1 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.142103:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afa00/0xa246514327748a1 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.142120:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afa00/0xa246514327748a1 lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.142128:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afa00/0xa246514327748a1 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.142135:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722afa00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340801.142141:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afa00/0xa246514327748a1 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.142149:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afa00/0xa246514327748a1 lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.142160:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c04495cde00) 00010000:00010000:3.0:1780340801.142162:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340801.142166:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afa00/0xa246514327748a1 lrc: 3/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.142173:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afa00/0xa246514327748a1 lrc: 0/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340801.142184:0:64454:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000019607714 reply state 000000006770d99d transno 81604378737 ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afe00/0xa246514327748a8 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.142193:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afe00/0xa246514327748a8 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.142210:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff8c0444f27c00) 00010000:00010000:3.0:1780340801.142213:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340801.142215:0:64454:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1780340801.142337:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:70238:x1866818940440704:12345-192.168.203.16@tcp:36:lfs.0 Request processed in 1352us (3997us total) trans 81604378737 rc 0/0 00000100:00100000:3.0:1780340801.142346:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1301 00000100:00100000:0.0:1780340801.151450:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340801.151597:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940440960 00000100:00100000:2.0:1780340801.151612:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940440960 00000100:00100000:2.0:1780340801.151694:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 232 00000100:00100000:2.0:1780340801.151707:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+12:70238:x1866818940440960:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1780340801.152274:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:70238:x1866818940440960:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 566us (833us total) trans 81604378738 rc 0/0 00000100:00100000:2.0:1780340801.152282:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 232 00000100:00100000:2.0:1780340801.226730:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340801.226815:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340801.226840:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340801.226943:0:6502:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940441088 00000100:00100000:0.0:1780340801.226959:0:6502:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940441088 00000100:00100000:0.0:1780340801.227031:0:6502:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940441344 00000100:00100000:0.0:1780340801.227034:0:6502:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940441344 00000100:00100000:0.0:1780340801.227051:0:6502:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940441216 00000100:00100000:0.0:1780340801.227054:0:6502:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940441216 00000100:00100000:0.0:1780340801.227081:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 705 00000100:00100000:0.0:1780340801.227093:0:6502:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+11:2407:x1866818940441088:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780340801.227122:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340801.227148:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04497b6e00/0xa2465143277437d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23c9 expref: 11 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340801.227171:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340801.227244:0:6502:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+10:2407:x1866818940441088:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 153us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340801.227254:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 705 00000100:00100000:0.0:1780340801.227274:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 706 00000100:00100000:0.0:1780340801.227281:0:6502:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+9:2407:x1866818940441344:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780340801.227289:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340801.227298:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f9e00/0xa24651432774384 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23d0 expref: 9 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340801.227308:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340801.227325:0:6502:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+8:2407:x1866818940441344:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 45us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340801.227355:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 706 00000100:00100000:0.0:1780340801.227369:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 707 00000100:00100000:0.0:1780340801.227375:0:6502:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+7:2407:x1866818940441216:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780340801.227383:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340801.227392:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a32ba00/0xa246514327744b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23de expref: 7 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340801.227401:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340801.227422:0:6502:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+6:2407:x1866818940441216:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 47us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340801.227427:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 707 00000100:00100000:0.0:1780340801.260017:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340801.260221:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940441728 00000100:00100000:3.0:1780340801.260245:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940441728 00000100:00100000:3.0:1780340801.260321:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5902 00000100:00100000:3.0:1780340801.260339:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e06e5cf1-1986-4ba7-9630-fad7efb74eca+7:2406:x1866818940441728:12345-192.168.203.16@tcp:9:umount.0 00000020:00000080:3.0:1780340801.260382:0:25494:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277418c 00000020:00010000:3.0:1780340801.260398:0:25494:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c0471e4f000: total 0 00000100:00080000:3.0:1780340801.260403:0:25494:0:(import.c:65:import_set_state_nolock()) ffff8c0471e48800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780340801.260461:0:25494:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969453 00000100:00100000:3.0:1780340801.260982:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:e06e5cf1-1986-4ba7-9630-fad7efb74eca+5:2406:x1866818940441728:12345-192.168.203.16@tcp:9:umount.0 Request processed in 641us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340801.261061:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5902 00000020:00010000:1.0:1780340801.264707:0:41205:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c0471e4f000: total 0 00010000:00010000:1.0:1780340801.264721:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340801.264894:0:41205:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c0471e4f000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1780340801.264978:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aaa2f86f/0xa246514327742dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23a6 expref: 4 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.265022:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa246514327742ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2398 expref: 3 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.266054:0:41205:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c0471e4f000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1780340801.266084:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340801.266330:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340801.266333:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340801.267451:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340801.267856:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940441984 00000100:00100000:3.0:1780340801.267870:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940441984 00000100:00100000:3.0:1780340801.267943:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5903 00000100:00100000:3.0:1780340801.267955:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e06e5cf1-1986-4ba7-9630-fad7efb74eca+6:2406:x1866818940441984:12345-192.168.203.16@tcp:9:umount.0 00000020:00000080:3.0:1780340801.267994:0:25496:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774185 00000020:00010000:3.0:1780340801.268003:0:25496:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c04514b3800: total 0 00000100:00080000:3.0:1780340801.268008:0:25496:0:(import.c:65:import_set_state_nolock()) ffff8c04514b0800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1780340801.268206:0:23160:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c04514b3800: total 0 00010000:00010000:1.0:1780340801.268456:0:23160:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c04514b3800, canceled 0 locks, left on hash table 1. 00002000:00010000:1.0:1780340801.268495:0:23160:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:1.0:1780340801.268499:0:23160:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb atime from disk: 0 -> 1780340740 00002000:00010000:1.0:1780340801.268502:0:23160:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:1.0:1780340801.268535:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000879fd871/0xa246514327742d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced239f expref: 5 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.268568:0:23160:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c04514b3800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1780340801.268580:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340801.268583:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340801.268585:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1780340801.268634:0:25496:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969454 00000100:00100000:2.0:1780340801.277722:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:e06e5cf1-1986-4ba7-9630-fad7efb74eca+2:2406:x1866818940441984:12345-192.168.203.16@tcp:9:umount.0 Request processed in 9752us (10262us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340801.277739:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5903 00000100:00100000:2.0:1780340801.312320:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340801.317900:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940442496 00000100:00100000:0.0:1780340801.317922:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940442496 00000100:00100000:0.0:1780340801.318037:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1302 00000100:00100000:0.0:1780340801.318049:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+10:2406:x1866818940442496:12345-192.168.203.16@tcp:39:umount.0 00000020:00000080:0.0:1780340801.318131:0:63711:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327743fb 00000020:00010000:0.0:1780340801.318151:0:63711:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c04530a7800: total 0 00000100:00080000:0.0:1780340801.318157:0:63711:0:(import.c:65:import_set_state_nolock()) ffff8c045aab6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1780340801.318196:0:63711:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149700 00000100:00100000:0.0:1780340801.318417:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e06e5cf1-1986-4ba7-9630-fad7efb74eca+8:2406:x1866818940442496:12345-192.168.203.16@tcp:39:umount.0 Request processed in 369us (6115us total) trans 111669149701 rc 0/0 00000100:00100000:0.0:1780340801.318424:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1302 00000020:00010000:3.0:1780340801.318996:0:6505:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c04530a7800: total 0 00010000:00010000:3.0:1780340801.319092:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c04530a7800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1780340801.319146:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0451652600) 00010000:00010000:3.0:1780340801.319152:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1780340801.319163:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c200/0xa2465143277482a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2401 expref: 7 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.319196:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c0455c3b500) 00010000:00010000:3.0:1780340801.319199:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1780340801.319203:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04497b6600/0xa246514327745c9 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2391 expref: 6 pid: 87367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.319217:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c04495cd300) 00010000:00010000:3.0:1780340801.319219:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1780340801.319224:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122c00/0xa24651432774846 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2408 expref: 5 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.319239:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff8c0455c3b500) 00010000:00010000:3.0:1780340801.319242:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780340801.319245:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa246514327747f2 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23fa expref: 4 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.319257:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c04530a7800, canceled 4 locks, left on hash table 0. 00010000:00010000:3.0:1780340801.319272:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340801.319274:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340801.319276:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340801.333272:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340801.333471:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940442752 00000100:00100000:1.0:1780340801.333486:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940442752 00000100:00100000:1.0:1780340801.333562:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1303 00000100:00100000:1.0:1780340801.333593:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+13:2406:x1866818940442752:12345-192.168.203.16@tcp:39:umount.0 00000020:00000080:1.0:1780340801.333647:0:63710:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143276f12f 00000020:00010000:1.0:1780340801.333664:0:63710:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c047a1ee000: total 0 00000100:00080000:1.0:1780340801.333669:0:63710:0:(import.c:65:import_set_state_nolock()) ffff8c0452a6a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1780340801.333725:0:63710:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378738 00000100:00100000:1.0:1780340801.333957:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e06e5cf1-1986-4ba7-9630-fad7efb74eca+11:2406:x1866818940442752:12345-192.168.203.16@tcp:39:umount.0 Request processed in 366us (701us total) trans 81604378739 rc 0/0 00000100:00100000:1.0:1780340801.333965:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1303 00010000:00010000:1.0:1780340801.333999:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afe00/0xa246514327748a8 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.334011:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afe00/0xa246514327748a8 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.334018:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afe00/0xa246514327748a8 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.334025:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722afe00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340801.334030:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afe00/0xa246514327748a8 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.334038:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afe00/0xa246514327748a8 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.334060:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff8c0444f27c00) 00010000:00010000:1.0:1780340801.334063:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340801.334070:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afe00/0xa246514327748a8 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.334077:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afe00/0xa246514327748a8 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.334324:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af200/0xa246514327748af lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.334331:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af200/0xa246514327748af lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.334337:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af200/0xa246514327748af lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.334342:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340801.334345:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af200/0xa246514327748af lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.334352:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af200/0xa246514327748af lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.334360:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff8c0444f27200) 00010000:00010000:1.0:1780340801.334363:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340801.334367:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af200/0xa246514327748af lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340801.334373:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af200/0xa246514327748af lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.334610:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123c00/0xa2465143277481c lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.334619:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123c00/0xa2465143277481c lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.334625:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123c00/0xa2465143277481c lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.334631:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340801.334642:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123c00/0xa2465143277481c lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.334648:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123c00/0xa2465143277481c lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.334658:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c04495cde00) 00010000:00010000:2.0:1780340801.334660:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340801.334664:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123c00/0xa2465143277481c lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340801.334670:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123c00/0xa2465143277481c lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00010000:3.0:1780340801.336519:0:7442:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c047a1ee000: total 0 00010000:00010000:3.0:1780340801.336619:0:7442:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c047a1ee000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1780340801.336662:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c04495cde00) 00010000:00010000:3.0:1780340801.336666:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1780340801.336697:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae400/0xa24651432774854 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced240f expref: 8 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.336725:0:7442:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c047a1ee000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1780340801.336741:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340801.336743:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340801.336746:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340801.372928:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340801.373057:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940443008 00000100:00100000:0.0:1780340801.373078:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940443008 00000100:00100000:0.0:1780340801.373149:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 85 00000100:00100000:0.0:1780340801.373160:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+6:2406:x1866818940443008:12345-192.168.203.16@tcp:251:umount.0 00000020:00000080:0.0:1780340801.373222:0:87339:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277436f 00000020:00010000:0.0:1780340801.373232:0:87339:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c046b9ad000: total 0 00000100:00080000:0.0:1780340801.373237:0:87339:0:(import.c:65:import_set_state_nolock()) ffff8c046b9ac000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1780340801.373331:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4+3:2406:x1866818940443008:12345-192.168.203.16@tcp:251:umount.0 Request processed in 172us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340801.373340:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 85 00000020:00010000:3.0:1780340801.373550:0:6504:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c046b9ad000: total 0 00010000:00010000:3.0:1780340801.373623:0:6504:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c046b9ad000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1780340801.373667:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f9600/0xa2465143277438b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced23d7 expref: 2 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340801.373683:0:6504:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c046b9ad000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1780340801.373695:0:6504:0:(genops.c:906:class_export_put()) final put ffff8c046b9ad000/ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4 00010000:00010000:3.0:1780340801.373719:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340801.373722:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340801.373724:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1780340801.374144:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b9ad000/ca5f0ce7-1f92-4bbd-924b-fee84ff2f6d4 for MGS 00000020:00000080:0.0:1780340801.374196:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c046b9ac000 for MGS 00010000:00010000:1.0:1780340801.418576:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340801.933754:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340801.933818:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961151232:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340801.933912:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340801.933976:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961151232 00000100:00100000:0.0:1780340801.933999:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961151232 00000100:00100000:0.0:1780340801.934071:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2070 00000100:00100000:0.0:1780340801.934083:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961151232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340801.934124:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340801.934174:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961151232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340801.934182:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2070 00000100:00100000:0.0:1780340801.934239:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961151232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340801.935499:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ac7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961151104:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340801.935585:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340801.935731:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961151104 00000100:00100000:0.0:1780340801.935739:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961151104 00000100:00100000:0.0:1780340801.935972:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2071 00000100:00100000:0.0:1780340801.935991:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961151104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340801.936040:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340801.936097:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961151104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340801.936119:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2071 00000100:00100000:3.0:1780340801.938720:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ac7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961151104:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1780340802.445682:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340802.786931:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340802.787348:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940443136 00000100:00100000:0.0:1780340802.787365:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940443136 00000100:00100000:0.0:1780340802.787480:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 86 00000100:00100000:0.0:1780340802.787492:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2406:x1866818940443136:12345-192.168.203.16@tcp:250:mount.lustre.0 00010000:00080000:0.0:1780340802.787531:0:87341:0:(ldlm_lib.c:1430:target_handle_connect()) MGS: connection from 540506f4-4e8e-4fb6-b537-f45d44291964@192.168.203.16@tcp t0 exp 0000000000000000 cur 3582 last 0 00000020:00000080:0.0:1780340802.787570:0:87341:0:(genops.c:1406:class_connect()) connect: client 540506f4-4e8e-4fb6-b537-f45d44291964, cookie 0xa246514327748b6 00000100:00080000:0.0:1780340802.787625:0:87341:0:(import.c:65:import_set_state_nolock()) ffff8c047b1f8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340802.787731:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+4:2406:x1866818940443136:12345-192.168.203.16@tcp:250:mount.lustre.0 Request processed in 240us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340802.787739:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 86 00000100:00100000:2.0:1780340802.797197:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340802.797273:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940443264 00000100:00100000:1.0:1780340802.797287:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940443264 00000100:00100000:1.0:1780340802.797373:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 87 00000100:00100000:1.0:1780340802.797385:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+4:70260:x1866818940443264:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:1.0:1780340802.797432:0:87342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340802.797457:0:87342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453122400/0xa246514327748bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2440 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340802.797497:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453122400/0xa246514327748bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2440 expref: 5 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340802.797511:0:87342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453122400/0xa246514327748bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2440 expref: 5 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340802.797523:0:87342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122400, rc 0) 00000100:00100000:1.0:1780340802.797605:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+5:70260:x1866818940443264:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 222us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340802.797613:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 87 00000100:00100000:1.0:1780340802.807161:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340802.809422:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940443392 00000100:00100000:0.0:1780340802.809443:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940443392 00000100:00100000:0.0:1780340802.809543:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 88 00000100:00100000:0.0:1780340802.809555:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+5:70260:x1866818940443392:12345-192.168.203.16@tcp:501:mount.lustre.0 00000100:00100000:0.0:1780340802.809811:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+5:70260:x1866818940443392:12345-192.168.203.16@tcp:501:mount.lustre.0 Request processed in 257us (2669us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780340802.809822:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 88 00000100:00100000:3.0:1780340802.817506:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340802.821148:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940443520 00000100:00100000:2.0:1780340802.821178:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940443520 00000100:00100000:2.0:1780340802.821331:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 89 00000100:00100000:2.0:1780340802.821345:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+5:70260:x1866818940443520:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:2.0:1780340802.821373:0:87339:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340802.821411:0:87339:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c045ec6de00/0xa246514327748c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2447 expref: -99 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340802.821453:0:87339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c045ec6de00/0xa246514327748c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2447 expref: 6 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340802.821468:0:87339:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c045ec6de00/0xa246514327748c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2447 expref: 6 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340802.821479:0:87339:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c045ec6de00, rc 0) 00000100:00100000:2.0:1780340802.821583:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+6:70260:x1866818940443520:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 241us (4090us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340802.821591:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 89 00000100:00100000:3.0:1780340802.823530:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340802.823833:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940443648 00000100:00100000:1.0:1780340802.823846:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940443648 00000100:00100000:1.0:1780340802.823906:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 90 00000100:00100000:1.0:1780340802.823918:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+6:70260:x1866818940443648:12345-192.168.203.16@tcp:501:mount.lustre.0 00000100:00100000:1.0:1780340802.824139:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+7:70260:x1866818940443648:12345-192.168.203.16@tcp:501:mount.lustre.0 Request processed in 222us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340802.824148:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 90 00000100:00100000:1.0:1780340802.827903:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340802.827985:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940443776 00000100:00100000:2.0:1780340802.827999:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940443776 00000100:00100000:2.0:1780340802.828085:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 91 00000100:00100000:2.0:1780340802.828108:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+7:70260:x1866818940443776:12345-192.168.203.16@tcp:503:mount.lustre.0 00000100:00100000:2.0:1780340802.828330:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+7:70260:x1866818940443776:12345-192.168.203.16@tcp:503:mount.lustre.0 Request processed in 235us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340802.828339:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 91 00000100:00100000:2.0:1780340802.831470:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340802.831616:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940443904 00000100:00100000:0.0:1780340802.831631:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940443904 00000100:00100000:0.0:1780340802.831715:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 92 00000100:00100000:0.0:1780340802.831728:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+7:70278:x1866818940443904:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1780340802.831993:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+7:70278:x1866818940443904:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 266us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340802.832002:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 92 00000100:00100000:3.0:1780340802.873577:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340802.873728:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940444032 00000100:00100000:1.0:1780340802.873742:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940444032 00000100:00100000:1.0:1780340802.873855:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 93 00000100:00100000:1.0:1780340802.873868:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+7:70278:x1866818940444032:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1780340802.874146:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+7:70278:x1866818940444032:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 279us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340802.874157:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 93 00000100:00100000:1.0:1780340802.879617:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340802.880151:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940444160 00000100:00100000:2.0:1780340802.880167:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940444160 00000100:00100000:2.0:1780340802.880256:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 94 00000100:00100000:2.0:1780340802.880270:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+7:70278:x1866818940444160:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:2.0:1780340802.880507:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b303850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+7:70278:x1866818940444160:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 240us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340802.880516:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 94 00000100:00100000:2.0:1780340802.895753:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340802.895979:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940444288 00000100:00100000:0.0:1780340802.895994:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940444288 00000100:00100000:0.0:1780340802.896074:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 95 00000100:00100000:0.0:1780340802.896085:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+7:70260:x1866818940444288:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:0.0:1780340802.896118:0:87341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340802.896146:0:87341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0347785e00/0xa246514327748cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2478 expref: -99 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340802.896187:0:87341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0347785e00/0xa246514327748cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2478 expref: 8 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340802.896212:0:87341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0347785e00/0xa246514327748cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2478 expref: 8 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340802.896224:0:87341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0347785e00, rc 0) 00000100:00100000:0.0:1780340802.896292:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b302050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:70260:x1866818940444288:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 210us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340802.896301:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 95 00000100:00100000:3.0:1780340802.904363:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340802.904517:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940444416 00000100:00100000:2.0:1780340802.904532:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940444416 00000100:00100000:2.0:1780340802.904659:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 96 00000100:00100000:2.0:1780340802.904672:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+8:70260:x1866818940444416:12345-192.168.203.16@tcp:256:mount.lustre.0 20000000:01000000:2.0:1780340802.904706:0:87339:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1780340802.904741:0:87339:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1780340802.904745:0:87339:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1780340802.904753:0:87339:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1780340802.904756:0:87339:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1780340802.905033:0:87339:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:1.0:1780340802.918714:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b301c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+8:70260:x1866818940444416:12345-192.168.203.16@tcp:256:mount.lustre.0 Request processed in 14028us (14346us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340802.918732:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 96 00000100:00100000:2.0:1780340802.926967:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340802.927663:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940444544 00000100:00100000:1.0:1780340802.927677:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940444544 00000100:00100000:1.0:1780340802.927952:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 97 00000100:00100000:1.0:1780340802.927966:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+8:70260:x1866818940444544:12345-192.168.203.16@tcp:101:mount.lustre.0 00010000:00010000:1.0:1780340802.927989:0:87342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340802.928011:0:87342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453123a00/0xa246514327748d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced247f expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340802.928052:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453123a00/0xa246514327748d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced247f expref: 9 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340802.928066:0:87342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453123a00/0xa246514327748d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced247f expref: 9 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340802.928076:0:87342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123a00, rc 0) 00000100:00100000:1.0:1780340802.928168:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b300450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:70260:x1866818940444544:12345-192.168.203.16@tcp:101:mount.lustre.0 Request processed in 205us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340802.928177:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 97 00000100:00100000:0.0:1780340802.932358:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340802.932479:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940444672 00000100:00100000:1.0:1780340802.932495:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940444672 00000100:00100000:1.0:1780340802.932610:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 98 00000100:00100000:1.0:1780340802.932622:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+9:70260:x1866818940444672:12345-192.168.203.16@tcp:501:mount.lustre.0 00000100:00100000:1.0:1780340802.932854:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349966850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+9:70260:x1866818940444672:12345-192.168.203.16@tcp:501:mount.lustre.0 Request processed in 234us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340802.932864:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 98 00000100:00100000:2.0:1780340802.935700:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340802.935844:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940444800 00000100:00100000:3.0:1780340802.935858:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940444800 00000100:00100000:3.0:1780340802.935917:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 99 00000100:00100000:3.0:1780340802.935928:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:70260:x1866818940444800:12345-192.168.203.16@tcp:503:mount.lustre.0 00000100:00100000:3.0:1780340802.936165:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349967050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:70260:x1866818940444800:12345-192.168.203.16@tcp:503:mount.lustre.0 Request processed in 238us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340802.936174:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 99 00000100:00100000:2.0:1780340802.942527:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340802.943143:0:87342:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940444928 00000100:00100000:3.0:1780340802.943158:0:87342:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940444928 00000100:00100000:3.0:1780340802.943240:0:87342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 100 00000100:00100000:3.0:1780340802.943253:0:87342:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:70286:x1866818940444928:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1780340802.943478:0:87342:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349965850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:70286:x1866818940444928:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 227us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340802.943488:0:87342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 100 00000100:00100000:2.0:1780340802.954570:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340802.954690:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940445056 00000100:00100000:1.0:1780340802.954704:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940445056 00000100:00100000:1.0:1780340802.954871:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 101 00000100:00100000:1.0:1780340802.954883:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+9:70286:x1866818940445056:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1780340802.955229:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349964450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+9:70286:x1866818940445056:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 347us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340802.955240:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 101 00000100:00100000:2.0:1780340802.977950:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340802.978008:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340802.978394:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940445184 00000100:00100000:3.0:1780340802.978416:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940445184 00000100:00100000:3.0:1780340802.978481:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940445440 00000100:00100000:3.0:1780340802.978484:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940445440 00000100:00100000:3.0:1780340802.978524:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1304 00000100:00100000:3.0:1780340802.978534:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1866818940445184:12345-192.168.203.16@tcp:38:mount.lustre.0 00000100:00100000:0.0:1780340802.978567:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1305 00000100:00100000:0.0:1780340802.978576:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940445440:12345-192.168.203.16@tcp:38:mount.lustre.0 00010000:00080000:3.0:1780340802.978580:0:64454:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from 7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp t0 exp 0000000000000000 cur 3582 last 0 00010000:00080000:0.0:1780340802.978600:0:63711:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0001: connection from 7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp t0 exp 0000000000000000 cur 3582 last 0 00000020:00000080:0.0:1780340802.978672:0:63711:0:(genops.c:1406:class_connect()) connect: client 7d14eb83-fa7c-40d9-843e-6367bec0a7b4, cookie 0xa246514327748d9 00000004:00100000:0.0:1780340802.978735:0:63711:0:(mdt_handler.c:7301:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000020:00000080:3.0:1780340802.978798:0:64454:0:(genops.c:1406:class_connect()) connect: client 7d14eb83-fa7c-40d9-843e-6367bec0a7b4, cookie 0xa246514327748e0 00000004:00100000:3.0:1780340802.978815:0:64454:0:(mdt_handler.c:7301:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1780340802.978922:0:64454:0:(import.c:65:import_set_state_nolock()) ffff8c04480a9000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1780340802.978922:0:63711:0:(import.c:65:import_set_state_nolock()) ffff8c046b9ad000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340802.979019:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2406:x1866818940445440:12345-192.168.203.16@tcp:38:mount.lustre.0 Request processed in 442us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340802.979029:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1305 00000100:00100000:3.0:1780340802.979389:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2406:x1866818940445184:12345-192.168.203.16@tcp:38:mount.lustre.0 Request processed in 854us (1455us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340802.979397:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1304 00000100:00100000:3.0:1780340802.981106:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340802.982006:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940445568 00000100:00100000:0.0:1780340802.982026:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940445568 00000100:00100000:3.0:1780340802.984229:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340802.984285:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340802.984456:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940445696 00000100:00100000:2.0:1780340802.984470:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940445696 00000100:00100000:0.0:1780340802.984614:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940445312 00000100:00100000:0.0:1780340802.984618:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940445312 00000100:00100000:0.0:1780340802.984643:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1306 00000100:00100000:0.0:1780340802.984655:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:0:x1866818940445568:12345-192.168.203.16@tcp:41:mount.lustre.0 00000004:00000024:0.0:1780340802.984708:0:63712:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:0.0:1780340802.984827:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:0:x1866818940445568:12345-192.168.203.16@tcp:41:mount.lustre.0 Request processed in 173us (3735us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340802.984835:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1306 00000100:00100000:3.0:1780340802.984862:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1307 00000100:00100000:3.0:1780340802.984873:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:0:x1866818940445312:12345-192.168.203.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1780340802.984899:0:63710:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445228544 avail 1298989056 00000100:00100000:3.0:1780340802.984946:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:0:x1866818940445312:12345-192.168.203.16@tcp:41:mount.lustre.0 Request processed in 77us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340802.984953:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1307 00000100:00080000:1.0:1780340802.993583:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780340802.993599:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340802.997564:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1308 00000100:00100000:3.0:1780340802.997591:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:70260:x1866818940445696:12345-192.168.203.16@tcp:41:mount.lustre.0 00000004:00000024:3.0:1780340802.997743:0:70100:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445228544 avail 1298989056 00000100:00100000:3.0:1780340802.997884:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:70260:x1866818940445696:12345-192.168.203.16@tcp:41:mount.lustre.0 Request processed in 306us (13666us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340802.997893:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1308 00000100:00100000:3.0:1780340803.004259:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340803.004454:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940445824 00000100:00100000:0.0:1780340803.004469:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940445824 00000100:00100000:0.0:1780340803.004551:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1309 00000100:00100000:0.0:1780340803.004563:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:70260:x1866818940445824:12345-192.168.203.16@tcp:40:mount.lustre.0 00000100:00100000:0.0:1780340803.004710:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:70260:x1866818940445824:12345-192.168.203.16@tcp:40:mount.lustre.0 Request processed in 149us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340803.004719:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1309 00000100:00100000:0.0:1780340803.014983:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340803.015662:0:63721:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940446208 00000100:00100000:1.0:1780340803.015676:0:63721:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940446208 00000100:00100000:1.0:1780340803.015811:0:63721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:1.0:1780340803.015824:0:63721:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:70260:x1866818940446208:12345-192.168.203.16@tcp:900:mount.lustre.0 00000100:00100000:1.0:1780340803.015956:0:63721:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:70260:x1866818940446208:12345-192.168.203.16@tcp:900:mount.lustre.0 Request processed in 135us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340803.015965:0:63721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 12 00000100:00100000:1.0:1780340803.024684:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340803.024752:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340803.026427:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940445952 00000100:00100000:3.0:1780340803.026450:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940445952 00000100:00100000:3.0:1780340803.026550:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940446080 00000100:00100000:3.0:1780340803.026554:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940446080 00000100:00100000:2.0:1780340803.026582:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5904 00000100:00100000:2.0:1780340803.026594:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1866818940445952:12345-192.168.203.16@tcp:8:mount.lustre.0 00010000:00080000:2.0:1780340803.026644:0:8401:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0000: connection from 7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp t0 exp 0000000000000000 cur 3583 last 0 00000020:00000080:2.0:1780340803.026687:0:8401:0:(genops.c:1406:class_connect()) connect: client 7d14eb83-fa7c-40d9-843e-6367bec0a7b4, cookie 0xa246514327748e7 00002000:00100000:2.0:1780340803.026705:0:8401:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7d14eb83-fa7c-40d9-843e-6367bec0a7b4/ffff8c0475faa800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211351c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1780340803.026727:0:8401:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1780340803.026730:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5905 00000100:00100000:3.0:1780340803.026738:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034872b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2406:x1866818940446080:12345-192.168.203.16@tcp:8:mount.lustre.0 00010000:00080000:3.0:1780340803.026798:0:25491:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0001: connection from 7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp t0 exp 0000000000000000 cur 3583 last 0 00000020:00000080:3.0:1780340803.026831:0:25491:0:(genops.c:1406:class_connect()) connect: client 7d14eb83-fa7c-40d9-843e-6367bec0a7b4, cookie 0xa246514327748ee 00002000:00100000:3.0:1780340803.026838:0:25491:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7d14eb83-fa7c-40d9-843e-6367bec0a7b4/ffff8c04480ad000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211351c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1780340803.026852:0:25491:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1780340803.026864:0:8401:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1780340803.026909:0:8401:0:(import.c:65:import_set_state_nolock()) ffff8c0475faf800 : changing import state from RECOVER to FULL 00002000:00080000:3.0:1780340803.026943:0:25491:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1780340803.026997:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2406:x1866818940445952:12345-192.168.203.16@tcp:8:mount.lustre.0 Request processed in 404us (2330us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340803.027006:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5904 00000100:00080000:3.0:1780340803.028195:0:25491:0:(import.c:65:import_set_state_nolock()) ffff8c0447db2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340803.028269:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034872b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2406:x1866818940446080:12345-192.168.203.16@tcp:8:mount.lustre.0 Request processed in 1527us (3514us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340803.028281:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5905 00000100:00100000:3.0:1780340803.031538:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340803.031812:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940446336 00000100:00100000:2.0:1780340803.031828:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940446336 00000100:00100000:2.0:1780340803.031915:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 233 00000100:00100000:2.0:1780340803.031927:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:70260:x1866818940446336:12345-192.168.203.16@tcp:33:mount.lustre.0 00000004:00200000:2.0:1780340803.032075:0:63714:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1780340803.032206:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:70260:x1866818940446336:12345-192.168.203.16@tcp:33:mount.lustre.0 Request processed in 282us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340803.032215:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 233 00010000:00010000:3.0:1780340803.466356:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340804.490448:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340805.005050:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340805.023647:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940446464 00000100:00100000:0.0:1780340805.023673:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940446464 00000100:00100000:0.0:1780340805.023822:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1310 00000100:00100000:0.0:1780340805.023837:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:70329:x1866818940446464:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1780340805.023883:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340805.023916:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784800/0xa246514327748f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced24b0 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340805.024005:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347785000/0xa246514327748fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340805.024023:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347785000/0xa246514327748fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340805.024039:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347785000/0xa246514327748fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340805.024115:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780340805.024119:0:64454:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780340805.024148:0:64454:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347785000/0xa246514327748fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340805.024183:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784800/0xa246514327748f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24b0 expref: 8 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340805.024205:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347785000/0xa246514327748fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24b0 expref: 7 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340805.024215:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045a87a000) 00010000:00010000:0.0:1780340805.024218:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780340805.024222:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0347785000, rc 0) 00000100:00080000:1.0:1780340805.026580:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780340805.027214:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:70329:x1866818940446464:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 3368us (22171us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340805.027232:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1310 00000100:00100000:1.0:1780340805.036887:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340805.036993:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940446592 00000100:00100000:3.0:1780340805.037008:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940446592 00000100:00100000:3.0:1780340805.037099:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1311 00000100:00100000:3.0:1780340805.037124:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034872ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:70329:x1866818940446592:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:3.0:1780340805.037192:0:70100:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445228544 avail 1298989056 00000100:00100000:3.0:1780340805.037330:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034872ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:70329:x1866818940446592:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 220us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340805.037340:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1311 00000100:00100000:2.0:1780340805.040655:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340805.040865:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940446720 00000100:00100000:3.0:1780340805.040880:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940446720 00000100:00100000:3.0:1780340805.040972:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1312 00000100:00100000:3.0:1780340805.040987:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:70329:x1866818940446720:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:3.0:1780340805.041038:0:63710:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:3.0:1780340805.041150:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:70329:x1866818940446720:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 167us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340805.041158:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1312 00000100:00080000:1.0:1780340805.041493:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340805.050454:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340805.050608:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940446848 00000100:00100000:0.0:1780340805.050622:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940446848 00000100:00100000:0.0:1780340805.050724:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2072 00000100:00100000:0.0:1780340805.050739:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:70329:x1866818940446848:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:0.0:1780340805.050837:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340805.050932:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:70329:x1866818940446848:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 197us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340805.050941:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2072 00000100:00080000:1.0:1780340805.051295:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340805.058921:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340805.059091:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940446976 00000100:00100000:1.0:1780340805.059107:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940446976 00000100:00100000:1.0:1780340805.059200:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2073 00000100:00100000:1.0:1780340805.059213:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:70329:x1866818940446976:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:1.0:1780340805.059262:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340805.059374:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:70329:x1866818940446976:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 163us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340805.059384:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2073 00000100:00080000:2.0:1780340805.059565:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1780340805.514144:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340805.514221:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961151360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340805.514295:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340805.514395:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961151360 00000100:00100000:3.0:1780340805.514417:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961151360 00000100:00100000:3.0:1780340805.514460:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869 00000100:00100000:3.0:1780340805.514469:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961151360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780340805.514494:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:3.0:1780340805.514546:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961151360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340805.514553:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869 00000100:00100000:2.0:1780340805.514705:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961151360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340805.514990:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961151744:0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.515019:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340805.515038:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961152256:0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.515056:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340805.515068:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961152768:0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.515098:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340805.515115:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1780340805.515120:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961151872:0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.515135:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340805.515146:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961152384:0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.515161:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340805.515173:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961152896:0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.515188:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340805.515210:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961151744 00000100:00100000:2.0:1780340805.515213:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961151744 00000100:00100000:2.0:1780340805.515259:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961151872 00000100:00100000:2.0:1780340805.515262:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961151872 00000100:00100000:2.0:1780340805.515278:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961152896 00000100:00100000:2.0:1780340805.515280:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961152896 00000100:00100000:2.0:1780340805.515291:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:2.0:1780340805.515296:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961151744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.515330:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961151744:12345-0@lo:400:kworker.0 Request processed in 33us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340805.515336:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:3.0:1780340805.515438:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961151488:0@lo:400:kworker.0 00000100:00100000:3.0:1780340805.515470:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340805.515525:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961151616:0@lo:400:kworker.0 00000100:00100000:1.0:1780340805.515552:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340805.515576:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961151616 00000100:00100000:2.0:1780340805.515579:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961151616 00000100:00100000:2.0:1780340805.518320:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:3.0:1780340805.518444:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961152000:0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.518601:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961151872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.518749:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961151872:12345-0@lo:400:kworker.0 Request processed in 338us (3542us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340805.518777:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:2.0:1780340805.518805:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:2.0:1780340805.518812:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961152896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.518843:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961152896:12345-0@lo:400:kworker.0 Request processed in 33us (3654us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340805.518850:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:2.0:1780340805.518862:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:2.0:1780340805.518868:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818961151616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.518897:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818961151616:12345-0@lo:400:kworker.0 Request processed in 30us (3345us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340805.518903:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:2.0:1780340805.518929:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961152256 00000100:00100000:2.0:1780340805.518951:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961152256 00000100:00100000:3.0:1780340805.518964:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340805.518996:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961152512:0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.518998:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961152768 00000100:00100000:2.0:1780340805.519000:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961152768 00000100:00100000:3.0:1780340805.519019:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340805.519020:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961152384 00000100:00100000:2.0:1780340805.519022:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961152384 00000100:00100000:2.0:1780340805.519042:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:2.0:1780340805.519048:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961152256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340805.519049:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961152000 00000100:00100000:3.0:1780340805.519052:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961152000 00000100:00100000:0.0:1780340805.519116:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961152512 00000100:00100000:0.0:1780340805.519121:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961152512 00000100:00100000:0.0:1780340805.519142:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:0.0:1780340805.519147:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961152512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340805.519183:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961152512:12345-0@lo:400:kworker.0 Request processed in 35us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340805.519189:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:3.0:1780340805.519223:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:3.0:1780340805.519232:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961152000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.519261:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961152256:12345-0@lo:400:kworker.0 Request processed in 213us (4203us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340805.519267:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:2.0:1780340805.519279:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:2.0:1780340805.519286:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961152768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.519314:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961152768:12345-0@lo:400:kworker.0 Request processed in 29us (4216us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340805.519319:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:2.0:1780340805.519330:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:2.0:1780340805.519335:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961152384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.519437:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961152384:12345-0@lo:400:kworker.0 Request processed in 101us (4273us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340805.519444:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00080000:2.0:1780340805.519475:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340805.519479:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340805.519482:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780340805.519484:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340805.519519:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961152000:12345-0@lo:400:kworker.0 Request processed in 219us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340805.519526:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1780340805.519532:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961151872:0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.519543:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961152384:0@lo:400:kworker.0 00000100:00100000:3.0:1780340805.519551:0:87341:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961151488 00000100:00100000:2.0:1780340805.519553:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961152896:0@lo:400:kworker.0 00000100:00100000:3.0:1780340805.519555:0:87341:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961151488 00000100:00100000:2.0:1780340805.519575:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961151744:0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.519585:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961152256:0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.519594:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961152768:0@lo:400:kworker.0 00000100:00100000:1.0:1780340805.519725:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961151616:0@lo:400:kworker.0 00000100:00100000:1.0:1780340805.519734:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961152128:0@lo:400:kworker.0 00000100:00100000:1.0:1780340805.519783:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340805.519804:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961152640:0@lo:400:kworker.0 00000100:00100000:1.0:1780340805.519828:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340805.519959:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961152128 00000100:00100000:2.0:1780340805.519963:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961152128 00000100:00100000:2.0:1780340805.519999:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870 00000100:00100000:2.0:1780340805.520006:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818961152128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.520047:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485810850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818961152128:12345-0@lo:400:kworker.0 Request processed in 41us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340805.520052:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870 00000100:00100000:2.0:1780340805.520330:0:3662:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 111669149700 gen 3 00000004:00080000:2.0:1780340805.520336:0:3662:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 111669149700 committed transno 111669149700 00000100:00100000:2.0:1780340805.520506:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961152128:0@lo:400:kworker.0 00000100:00100000:1.0:1780340805.521520:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961152640 00000100:00100000:1.0:1780340805.521529:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961152640 00000100:00100000:1.0:1780340805.521592:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:1.0:1780340805.521601:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961152640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340805.521676:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961152640:12345-0@lo:400:kworker.0 Request processed in 76us (1846us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340805.521795:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00000100:00100000:3.0:1780340805.521797:0:87341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1780340805.521807:0:87341:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961151488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340805.521846:0:87341:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349966050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961151488:12345-0@lo:400:kworker.0 Request processed in 41us (6375us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340805.521866:0:87341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1780340805.521940:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340805.521969:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961151488:0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.521983:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961152000:0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.521993:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961152512:0@lo:400:kworker.0 00000100:00100000:2.0:1780340805.522026:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961152640:0@lo:400:kworker.0 00000100:00100000:3.0:1780340806.029690:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047aa6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961153152:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340806.029832:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340806.029885:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340806.029893:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961153280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340806.029922:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340806.029974:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961153152 00000100:00100000:3.0:1780340806.029993:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961153152 00000100:00100000:1.0:1780340806.030095:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961153280 00000100:00100000:1.0:1780340806.030101:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961153280 00000100:00100000:1.0:1780340806.030154:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2074 00000100:00100000:1.0:1780340806.030163:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961153280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780340806.030204:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340806.030264:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961153280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340806.030272:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2074 00000100:00100000:1.0:1780340806.030355:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961153280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340806.030415:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871 00000100:00100000:3.0:1780340806.030424:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961153152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340806.030460:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445228544 avail 1298989056 00000100:00100000:3.0:1780340806.030507:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961153152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340806.030514:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871 00000100:00100000:1.0:1780340806.030796:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047aa6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961153152:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340806.032380:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340806.032408:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961153024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340806.032481:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340806.032781:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961153024 00000100:00100000:1.0:1780340806.032791:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961153024 00000100:00100000:1.0:1780340806.032843:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2075 00000100:00100000:1.0:1780340806.032853:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961153024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780340806.032881:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780340806.032937:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961153024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340806.032945:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2075 00000100:00100000:1.0:1780340806.032998:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961153024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340806.319276:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340806.319372:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940447104 00000100:00100000:0.0:1780340806.319389:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940447104 00000100:00100000:0.0:1780340806.319484:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1313 00000100:00100000:0.0:1780340806.319500:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:70364:x1866818940447104:12345-192.168.203.16@tcp:101:cp.0 00010000:00010000:0.0:1780340806.319635:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340806.319666:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347785800/0xa24651432774903 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced24b7 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.319826:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784600/0xa2465143277490a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.319846:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784600/0xa2465143277490a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.319864:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784600/0xa2465143277490a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.319882:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347785600/0xa24651432774911 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.319889:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347785600/0xa24651432774911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.319895:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347785600/0xa24651432774911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.319972:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784a00/0xa24651432774918 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.319980:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784a00/0xa24651432774918 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.319987:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784a00/0xa24651432774918 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340806.320037:0:64454:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784a00/0xa24651432774918 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.320056:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784600/0xa2465143277490a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.320080:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784600/0xa2465143277490a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.320088:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784600/0xa2465143277490a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.320094:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784600/0xa2465143277490a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.320101:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340806.320106:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784600/0xa2465143277490a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.320115:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784600/0xa2465143277490a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.320130:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045a87a000) 00010000:00010000:0.0:1780340806.320134:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340806.320140:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784600/0xa2465143277490a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.320146:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784600/0xa2465143277490a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.320161:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347785600/0xa24651432774911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.320168:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347785600/0xa24651432774911 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.320174:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347785600/0xa24651432774911 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.320185:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340806.320188:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347785600/0xa24651432774911 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.320194:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347785600/0xa24651432774911 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.320200:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8c045a87aa00) 00010000:00010000:0.0:1780340806.320203:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340806.320293:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347785600/0xa24651432774911 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.320301:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347785600/0xa24651432774911 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.320336:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347785800/0xa24651432774903 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24b7 expref: 9 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.320350:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784a00/0xa24651432774918 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24b7 expref: 8 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.320358:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c045a87ad00) 00010000:00010000:0.0:1780340806.320361:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1780340806.320363:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0347784a00, rc 0) 00000100:00100000:0.0:1780340806.320596:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:70364:x1866818940447104:12345-192.168.203.16@tcp:101:cp.0 Request processed in 1097us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340806.320605:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1313 00000100:00100000:3.0:1780340806.328505:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340806.328697:0:63721:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940447232 00000100:00100000:1.0:1780340806.328714:0:63721:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940447232 00000100:00100000:1.0:1780340806.328811:0:63721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:1.0:1780340806.328823:0:63721:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:70364:x1866818940447232:12345-192.168.203.16@tcp:900:cp.0 00000100:00100000:1.0:1780340806.328927:0:63721:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:70364:x1866818940447232:12345-192.168.203.16@tcp:900:cp.0 Request processed in 106us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340806.328935:0:63721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:1.0:1780340806.330701:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340806.336889:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940447360 00000100:00100000:3.0:1780340806.336910:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940447360 00000100:00100000:3.0:1780340806.337012:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1314 00000100:00100000:3.0:1780340806.337025:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:70364:x1866818940447360:12345-192.168.203.16@tcp:101:cp.0 00010000:00010000:3.0:1780340806.337051:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340806.337092:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afa00/0xa2465143277491f lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced24be expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.337174:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae400/0xa24651432774926 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.337211:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae400/0xa24651432774926 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.337226:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae400/0xa24651432774926 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340806.337287:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00200000:3.0:1780340806.337291:0:63712:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1780340806.337355:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afa00/0xa2465143277491f lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24be expref: 8 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.337374:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae400/0xa24651432774926 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24be expref: 7 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.337383:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c0444f27600) 00010000:00010000:3.0:1780340806.337386:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1780340806.337390:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722ae400, rc 0) 00000100:00100000:3.0:1780340806.338724:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:70364:x1866818940447360:12345-192.168.203.16@tcp:101:cp.0 Request processed in 1694us (8026us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340806.338734:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1314 00000100:00100000:3.0:1780340806.355140:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340806.355298:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940447488 00000100:00100000:0.0:1780340806.355330:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940447488 00000100:00100000:0.0:1780340806.355414:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1315 00000100:00100000:0.0:1780340806.355426:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:70364:x1866818940447488:12345-192.168.203.16@tcp:101:cp.0 00010000:00010000:0.0:1780340806.355456:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340806.355487:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785800/0xa2465143277492d lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced24c5 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.355711:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785600/0xa24651432774934 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.355731:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785600/0xa24651432774934 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.355744:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785600/0xa24651432774934 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.355783:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784600/0xa2465143277493b lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.355791:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784600/0xa2465143277493b lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.355798:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784600/0xa2465143277493b lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.355905:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785200/0xa24651432774942 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.355913:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785200/0xa24651432774942 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.355921:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785200/0xa24651432774942 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340806.359731:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00000004:00200000:0.0:1780340806.359743:0:63710:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780340806.359803:0:63710:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785200/0xa24651432774942 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.359831:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785600/0xa24651432774934 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.359841:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785600/0xa24651432774934 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.359848:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785600/0xa24651432774934 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.359855:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785600/0xa24651432774934 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.359861:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340806.359866:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785600/0xa24651432774934 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.359874:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785600/0xa24651432774934 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.359893:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c0444f27600) 00010000:00010000:0.0:1780340806.359896:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340806.359901:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785600/0xa24651432774934 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.359907:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785600/0xa24651432774934 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.359938:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784600/0xa2465143277493b lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.359944:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784600/0xa2465143277493b lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.365143:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784600/0xa2465143277493b lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.365155:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340806.365160:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784600/0xa2465143277493b lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.365172:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784600/0xa2465143277493b lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.365194:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff8c045a87aa00) 00010000:00010000:0.0:1780340806.365197:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340806.365203:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784600/0xa2465143277493b lrc: 2/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.365211:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784600/0xa2465143277493b lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.365299:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785800/0xa2465143277492d lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24c5 expref: 9 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.365317:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785200/0xa24651432774942 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24c5 expref: 8 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.365342:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff8c045a87a400) 00010000:00010000:0.0:1780340806.365344:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1780340806.365348:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0347785200, rc 0) 00000100:00100000:0.0:1780340806.365477:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:70364:x1866818940447488:12345-192.168.203.16@tcp:101:cp.0 Request processed in 10050us (10350us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340806.365487:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1315 00000100:00100000:1.0:1780340806.371994:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340806.372142:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940447616 00000100:00100000:0.0:1780340806.372158:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940447616 00000100:00100000:0.0:1780340806.372236:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1316 00000100:00100000:0.0:1780340806.372247:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:70364:x1866818940447616:12345-192.168.203.16@tcp:101:cp.0 00010000:00010000:0.0:1780340806.372276:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340806.372303:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784200/0xa24651432774949 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced24cc expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372406:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784000/0xa24651432774950 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372427:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784000/0xa24651432774950 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372442:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784000/0xa24651432774950 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372460:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785400/0xa24651432774957 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372468:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785400/0xa24651432774957 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372494:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785400/0xa24651432774957 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372547:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784000/0xa24651432774950 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372554:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784000/0xa24651432774950 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372561:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784000/0xa24651432774950 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372568:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784000/0xa24651432774950 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372586:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340806.372591:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784000/0xa24651432774950 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372599:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784000/0xa24651432774950 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372612:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff8c045a87a400) 00010000:00010000:0.0:1780340806.372616:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340806.372621:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784000/0xa24651432774950 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372628:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784000/0xa24651432774950 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372644:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785400/0xa24651432774957 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372656:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785400/0xa24651432774957 lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372662:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785400/0xa24651432774957 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372667:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340806.372670:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785400/0xa24651432774957 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372676:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785400/0xa24651432774957 lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372683:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff8c045a87ae00) 00010000:00010000:0.0:1780340806.372685:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340806.372688:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785400/0xa24651432774957 lrc: 2/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372694:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785400/0xa24651432774957 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372729:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784200/0xa24651432774949 lrc: 1/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24cc expref: 9 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372740:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff8c045a87a400) 00010000:00010000:0.0:1780340806.372742:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340806.372746:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347784200/0xa24651432774949 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24cc expref: 9 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340806.372756:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0347784200, rc 0) 00000100:00100000:0.0:1780340806.372869:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:70364:x1866818940447616:12345-192.168.203.16@tcp:101:cp.0 Request processed in 624us (890us total) trans 0 rc 301/301 00000100:00100000:0.0:1780340806.372877:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1316 00000100:00100000:1.0:1780340806.378247:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340806.378540:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940447744 00000100:00100000:3.0:1780340806.378554:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940447744 00000100:00100000:3.0:1780340806.378680:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1317 00000100:00100000:3.0:1780340806.378693:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:70364:x1866818940447744:12345-192.168.203.16@tcp:101:cp.0 00010000:00010000:3.0:1780340806.378724:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340806.378754:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afa00/0xa2465143277495e lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced24d3 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379129:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af000/0xa24651432774965 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379149:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af000/0xa24651432774965 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379164:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af000/0xa24651432774965 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379183:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae800/0xa2465143277496c lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379191:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae800/0xa2465143277496c lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379198:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae800/0xa2465143277496c lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379256:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af000/0xa24651432774965 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379265:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af000/0xa24651432774965 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379272:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af000/0xa24651432774965 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379471:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af000/0xa24651432774965 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379479:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340806.379491:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af000/0xa24651432774965 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379500:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af000/0xa24651432774965 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379513:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff8c045a87a400) 00010000:00010000:3.0:1780340806.379517:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340806.379523:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af000/0xa24651432774965 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379540:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722af000/0xa24651432774965 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379556:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae800/0xa2465143277496c lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379562:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae800/0xa2465143277496c lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379569:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae800/0xa2465143277496c lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379641:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340806.379644:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae800/0xa2465143277496c lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379651:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae800/0xa2465143277496c lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379659:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff8c0444f27a00) 00010000:00010000:3.0:1780340806.379661:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340806.379671:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae800/0xa2465143277496c lrc: 2/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379677:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae800/0xa2465143277496c lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379723:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afa00/0xa2465143277495e lrc: 1/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24d3 expref: 9 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379734:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff8c045a87a400) 00010000:00010000:3.0:1780340806.379736:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340806.379739:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722afa00/0xa2465143277495e lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24d3 expref: 9 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340806.379747:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722afa00, rc 0) 00000100:00100000:3.0:1780340806.380087:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:70364:x1866818940447744:12345-192.168.203.16@tcp:101:cp.0 Request processed in 1394us (1851us total) trans 0 rc 301/301 00000100:00100000:3.0:1780340806.380095:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1317 00000100:00100000:3.0:1780340806.394526:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340806.394650:0:63719:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940447872 00000100:00100000:2.0:1780340806.394663:0:63719:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940447872 00000100:00100000:2.0:1780340806.394730:0:63719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 13 00000100:00100000:2.0:1780340806.394742:0:63719:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:70364:x1866818940447872:12345-192.168.203.16@tcp:700:cp.0 00000020:02000000:2.0:1780340806.394804:0:63719:0:(tgt_handler.c:881:tgt_request_handle()) *** cfs_fail_loc=123, val=2147483648*** 00000100:00100000:2.0:1780340806.404111:0:63719:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:70364:x1866818940447872:12345-192.168.203.16@tcp:700:cp.0 Request processed in 9353us (9579us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340806.404129:0:63719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 13 00010000:00010000:3.0:1780340806.544141:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340807.051114:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961153408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340807.051220:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340807.051298:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961153408 00000100:00100000:1.0:1780340807.051309:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961153408 00000100:00100000:1.0:1780340807.051382:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2076 00000100:00100000:1.0:1780340807.051401:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961153408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780340807.051447:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780340807.051502:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961153408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340807.051510:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2076 00000100:00100000:1.0:1780340807.051571:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961153408:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1780340807.052331:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340807.053866:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961153536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340807.053965:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340807.054049:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961153536 00000100:00100000:3.0:1780340807.054061:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961153536 00000001:00100000:2.0:1780340807.056557:0:87335:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000001:00100000:2.0:1780340807.056568:0:87335:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000001:00080000:2.0:1780340807.056578:0:87335:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149701 is committed 00000020:00000080:2.0:1780340807.056583:0:87335:0:(genops.c:906:class_export_put()) final put ffff8c04530a7800/e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000100:00100000:3.0:1780340807.056608:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077 00000100:00080000:2.0:1780340807.056618:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340807.056620:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961153536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340807.056665:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000020:00000080:1.0:1780340807.056901:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04530a7800/e06e5cf1-1986-4ba7-9630-fad7efb74eca for lustre-MDT0000 00000020:00000080:1.0:1780340807.056987:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c045aab6000 for lustre-MDT0000 00000100:00100000:3.0:1780340807.059336:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961153536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2706us (5359us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340807.059368:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077 00000100:00100000:1.0:1780340807.059599:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961153536:0@lo:13:osp-pre-1-1.0 00000001:00100000:3.0:1780340807.061234:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000001:00100000:3.0:1780340807.061251:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000020:00000080:3.0:1780340807.061255:0:8395:0:(genops.c:906:class_export_put()) final put ffff8c04514b3800/e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000001:00100000:0.0:1780340807.061541:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000001:00100000:0.0:1780340807.061550:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000020:00000080:0.0:1780340807.061553:0:9462:0:(genops.c:906:class_export_put()) final put ffff8c0471e4f000/e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000020:00000080:1.0:1780340807.061862:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04514b3800/e06e5cf1-1986-4ba7-9630-fad7efb74eca for lustre-OST0000 00000020:00000080:1.0:1780340807.061924:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0471e4f000/e06e5cf1-1986-4ba7-9630-fad7efb74eca for lustre-OST0001 00000020:00000080:1.0:1780340807.061947:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c04514b0800 for lustre-OST0000 00000020:00000080:1.0:1780340807.061959:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0471e48800 for lustre-OST0001 00000001:00100000:0.0:1780340807.067128:0:72681:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000001:00100000:0.0:1780340807.067150:0:72681:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000001:00080000:0.0:1780340807.067161:0:72681:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378739 is committed 00000020:00000080:0.0:1780340807.067194:0:72681:0:(genops.c:906:class_export_put()) final put ffff8c047a1ee000/e06e5cf1-1986-4ba7-9630-fad7efb74eca 00000020:00080000:0.0:1780340807.067235:0:72681:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8c0347591780 refcount 2 committed 0 result 0 batchid 77309411386 00000020:00080000:0.0:1780340807.067246:0:72681:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c034686f600 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8c0347591480 00000020:00080000:0.0:1780340807.067250:0:72681:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].2 00000020:00080000:0.0:1780340807.067253:0:72681:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c034686fa00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c045f122e00 00000020:00080000:0.0:1780340807.067256:0:72681:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].2 00000020:00080000:1.0:1780340807.068981:0:72701:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411386 committed batchid 77309411385 00000020:00080000:1.0:1780340807.069124:0:72701:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411385 00000020:00000080:2.0:1780340807.069838:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047a1ee000/e06e5cf1-1986-4ba7-9630-fad7efb74eca for lustre-MDT0001 00000020:00000080:2.0:1780340807.069955:0:49688:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0452a6a000 for lustre-MDT0001 00010000:00010000:0.0:1780340807.564536:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340808.233438:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340808.233810:0:87339:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940448000 00000100:00100000:0.0:1780340808.233824:0:87339:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940448000 00000100:00100000:0.0:1780340808.233904:0:87339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 103 00000100:00100000:0.0:1780340808.233918:0:87339:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0347cd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940448000:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340808.234036:0:87339:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0347cd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940448000:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 120us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340808.234044:0:87339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 103 00000100:00100000:3.0:1780340808.240211:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340808.240679:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940448128 00000100:00100000:0.0:1780340808.240695:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940448128 00000100:00100000:0.0:1780340808.240843:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1331 00000100:00100000:0.0:1780340808.240871:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940448128:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340808.240970:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940448128:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 102us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340808.240979:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1331 00000100:00080000:1.0:1780340808.241462:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340808.248330:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340808.248378:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340808.248441:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340808.248718:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940448256 00000100:00100000:0.0:1780340808.248733:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940448256 00000100:00100000:0.0:1780340808.248850:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1332 00000100:00100000:0.0:1780340808.248866:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940448256:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340808.248986:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940448256:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 126us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340808.248996:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1332 00000100:00100000:3.0:1780340808.249151:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940448384 00000100:00100000:3.0:1780340808.249157:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940448384 00000100:00100000:3.0:1780340808.249203:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940448512 00000100:00100000:3.0:1780340808.249206:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940448512 00000100:00100000:0.0:1780340808.249230:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2564 00000100:00100000:3.0:1780340808.249240:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2565 00000100:00100000:0.0:1780340808.249245:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940448384:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340808.249255:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940448512:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340808.249288:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940448384:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 48us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340808.249300:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2564 00000100:00100000:3.0:1780340808.249301:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940448512:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 49us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340808.249325:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2565 00000100:00080000:1.0:1780340808.250087:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340808.250094:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780340808.250098:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1780340808.590186:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340809.609978:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1780340809.667150:0:88242:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1780340809.667232:0:88242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04497b6400/0xa2465143277448e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774495 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340809.667253:0:88242:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04497b6400/0xa2465143277448e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774495 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340809.667261:0:88242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04497b6400/0xa2465143277448e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432774495 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340809.667268:0:88242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c04497b6400/0xa2465143277448e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432774495 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340809.667364:0:88242:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1780340809.667372:0:88242:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1780340809.667412:0:88242:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1780340809.667417:0:88242:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1780340809.667424:0:88242:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1780340809.667459:0:88242:0:(import.c:65:import_set_state_nolock()) ffff8c047b1fb800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1780340809.667593:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961153664:0@lo:39:umount.0 00000100:00100000:1.0:1780340809.667697:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340809.667904:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961153664 00000100:00100000:3.0:1780340809.667914:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961153664 00000100:00100000:3.0:1780340809.667984:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:3.0:1780340809.667996:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1866818961153664:12345-0@lo:39:umount.0 00000020:00000080:3.0:1780340809.668032:0:63712:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774591 00000100:00080000:3.0:1780340809.668053:0:63712:0:(import.c:65:import_set_state_nolock()) ffff8c0471e4d000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1780340809.668139:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340809.668150:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04497b6400/0xa2465143277448e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432774495 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.668160:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04497b6400 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:0.0:1780340809.668164:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04497b6400/0xa2465143277448e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432774495 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.668173:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04497b6400/0xa2465143277448e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432774495 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340809.668196:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04497b6400/0xa2465143277448e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432774495 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340809.668203:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1780340809.668206:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1780340809.668208:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1780340809.668242:0:6504:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c04497b6400/0xa2465143277448e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432774495 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.668249:0:6504:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780340809.668276:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04497b6400/0xa2465143277448e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432774495 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.668284:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04497b6400/0xa2465143277448e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432774495 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.668297:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340809.668299:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340809.668301:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340809.668341:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340809.668355:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961153792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340809.668397:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340809.668492:0:6502:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961153792 00000100:00100000:0.0:1780340809.668497:0:6502:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961153792 00000100:00100000:0.0:1780340809.668550:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1780340809.668559:0:6502:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961153792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780340809.668572:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340809.668591:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04497b7e00/0xa24651432774495 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2465143277448e expref: 23 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.668609:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340809.668690:0:6502:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3661:x1866818961153792:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340809.668706:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00010000:00010000:2.0:1780340809.668824:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340809.669031:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961153792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340809.669150:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3658:x1866818961153664:12345-0@lo:39:umount.0 Request processed in 1155us (1452us total) trans 0 rc 0/0 00000100:00080000:1.0:1780340809.669255:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c047b1fb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1780340809.669364:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961153664:0@lo:39:umount.0 00000100:00100000:2.0:1780340809.669410:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000020:00000080:2.0:1780340809.669421:0:63712:0:(genops.c:906:class_export_put()) final put ffff8c045f0c2000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1780340809.669485:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045f0c2000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1780340809.669565:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0471e4d000 for lustre-MDT0000 00000100:00080000:3.0:1780340809.670087:0:88242:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1780340809.670093:0:88242:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1780340809.670098:0:88242:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1780340809.672193:0:88242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32a800/0xa246514327743ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327743bc expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340809.672218:0:88242:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32a800/0xa246514327743ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327743bc expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340809.672226:0:88242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32a800/0xa246514327743ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa246514327743bc expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340809.672232:0:88242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c047a32a800/0xa246514327743ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa246514327743bc expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340809.672488:0:88242:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340809.672498:0:88242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa246514327744b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327744bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340809.672506:0:88242:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa246514327744b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327744bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340809.672512:0:88242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa246514327744b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa246514327744bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340809.672518:0:88242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa246514327744b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa246514327744bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.676134:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780340809.676153:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c047a32a800/0xa246514327743ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa246514327743bc expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.676174:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a800 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:0.0:1780340809.676180:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c047a32a800/0xa246514327743ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa246514327743bc expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.676191:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c047a32a800/0xa246514327743ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xa246514327743bc expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340809.676199:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c047a32a800/0xa246514327743ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xa246514327743bc expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340809.676206:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1780340809.676209:0:23160:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1780340809.676265:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c047a32a800/0xa246514327743ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327743bc expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.676271:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780340809.676318:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c047a32a800/0xa246514327743ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327743bc expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.676326:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c047a32a800/0xa246514327743ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327743bc expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.676346:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340809.676367:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa246514327744b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa246514327744bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.676374:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b2c00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:0.0:1780340809.676377:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa246514327744b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa246514327744bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.676384:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa246514327744b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa246514327744bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340809.676390:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa246514327744b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa246514327744bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340809.676395:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1780340809.676398:0:23160:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1780340809.676411:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa246514327744b8 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327744bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.676417:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780340809.676423:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa246514327744b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327744bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.676430:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340809.676431:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340809.676434:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340809.677861:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961154048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340809.677979:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340809.678057:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340809.678064:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961153920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340809.678090:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340809.678132:0:25499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961154048 00000100:00100000:3.0:1780340809.678141:0:25499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961154048 00000100:00100000:3.0:1780340809.678211:0:25499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961153920 00000100:00100000:3.0:1780340809.678215:0:25499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961153920 00000100:00100000:3.0:1780340809.678238:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1780340809.678248:0:25499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04757c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961154048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340809.678281:0:25499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340809.678315:0:25499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04497b7800/0xa246514327744bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327744b8 expref: 23 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340809.678337:0:25499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340809.678375:0:25499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04757c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3660:x1866818961154048:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340809.678384:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1780340809.678438:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:3.0:1780340809.678444:0:25499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:3660:x1866818961153920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340809.678451:0:25499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340809.678460:0:25499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04497b7000/0xa246514327743bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327743ae expref: 21 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340809.678471:0:25499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340809.678490:0:25499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3660:x1866818961153920:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340809.678497:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:3.0:1780340809.678875:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961153920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340809.678889:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961154048:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340809.684360:0:88242:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1780340809.684381:0:88242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa246514327744b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327744bf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340809.684405:0:88242:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1780340809.684423:0:88242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04497b7400/0xa24651432774480 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774487 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340809.684433:0:88242:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04497b7400/0xa24651432774480 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774487 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340809.684440:0:88242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04497b7400/0xa24651432774480 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432774487 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340809.684448:0:88242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c04497b7400/0xa24651432774480 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432774487 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340809.687914:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340809.688006:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04497b7400/0xa24651432774480 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432774487 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340809.688023:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04497b7400 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340809.688028:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04497b7400/0xa24651432774480 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432774487 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340809.688072:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04497b7400/0xa24651432774480 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432774487 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340809.688081:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04497b7400/0xa24651432774480 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432774487 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340809.688087:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1780340809.688090:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1780340809.688140:0:6505:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c04497b7400/0xa24651432774480 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432774487 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340809.688145:0:6505:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1780340809.688322:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961154176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340809.688423:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1780340809.688527:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04497b7400/0xa24651432774480 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432774487 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340809.688539:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340809.688541:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340809.688543:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340809.688666:0:7443:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961154176 00000100:00100000:0.0:1780340809.688678:0:7443:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961154176 00000100:00100000:0.0:1780340809.688791:0:7443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:0.0:1780340809.688804:0:7443:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3661:x1866818961154176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780340809.688824:0:7443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340809.688846:0:7443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04497b6200/0xa24651432774487 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774480 expref: 20 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.688880:0:7443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340809.691145:0:88242:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1780340809.691162:0:88242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04497b7400/0xa24651432774480 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432774487 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340809.691192:0:88242:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1780340809.691212:0:88242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa246514327743a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327743a7 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340809.691221:0:88242:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa246514327743a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327743a7 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340809.691229:0:88242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa246514327743a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa246514327743a7 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340809.691235:0:88242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa246514327743a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa246514327743a7 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340809.691258:0:88242:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1780340809.691260:0:88242:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1780340809.691264:0:88242:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1780340809.691384:0:88242:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1780340809.691389:0:88242:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1780340809.691395:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1780340809.691401:0:88242:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1780340809.691666:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340809.691675:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa246514327743a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa246514327743a7 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340809.691683:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b200 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340809.691687:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa246514327743a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa246514327743a7 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340809.691697:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa246514327743a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa246514327743a7 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340809.691705:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa246514327743a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa246514327743a7 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340809.691730:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1780340809.691733:0:7442:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1780340809.691734:0:7442:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1780340809.691793:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa246514327743a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327743a7 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340809.691801:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1780340809.693429:0:7443:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:3661:x1866818961154176:12345-0@lo:103:ldlm_bl.0 Request processed in 4490us (4870us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340809.693448:0:7443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00010000:00010000:0.0:1780340809.693525:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340809.693907:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961154176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340809.694017:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340809.694032:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961154304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340809.694133:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1780340809.694921:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa246514327743a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327743a7 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340809.694970:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c047a32b200/0xa246514327743a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327743a7 expref: -99 pid: 87334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340809.694998:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340809.695000:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340809.695003:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340809.695228:0:6502:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961154304 00000100:00100000:0.0:1780340809.695239:0:6502:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961154304 00000100:00100000:0.0:1780340809.695377:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:0.0:1780340809.695388:0:6502:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:3661:x1866818961154304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780340809.695408:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340809.695433:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a32ae00/0xa246514327743a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327743a0 expref: 19 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.695450:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340809.695519:0:6502:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:3661:x1866818961154304:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340809.695526:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1780340809.695593:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961154304:0@lo:103:ldlm_bl.0 00000004:00000080:2.0:1780340809.698180:0:88242:0:(mdt_handler.c:8186:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:2.0:1780340809.699164:0:88242:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1780340809.699181:0:88242:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c04480ac000 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 192.168.203.16@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780340809.699190:0:88242:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c045f0c3000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780340809.699216:0:88242:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c0458285800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780340809.699220:0:88242:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c047a0a3000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780340809.699225:0:88242:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c047a1ec800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 111669149700 stale:0 00000020:00080000:2.0:1780340809.699230:0:88242:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff8c0471d53380) has exports, disconnecting them 00000020:00080000:2.0:1780340809.699236:0:88242:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.16@tcp (ffff8c04480ac000), last request at 1780340808 00000020:00000080:2.0:1780340809.699245:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327748e0 00000020:00010000:2.0:1780340809.699258:0:88242:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c04480ac000: total 0 00000100:00080000:2.0:1780340809.699263:0:88242:0:(import.c:65:import_set_state_nolock()) ffff8c04480a9000 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1780340809.699292:0:41205:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c04480ac000: total 0 00010000:00010000:2.0:1780340809.699296:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340809.699328:0:41205:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c04480ac000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1780340809.699371:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347785000/0xa246514327748fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24b0 expref: 6 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340809.699404:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0347784a00/0xa24651432774918 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24b7 expref: 5 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340809.699418:0:41205:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c04480ac000, canceled 2 locks, left on hash table 0. 00000020:00080000:1.0:1780340809.706313:0:88242:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.16@tcp (ffff8c04480ac000): rc 0 00000020:00080000:1.0:1780340809.706326:0:88242:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c045f0c3000), last request at 1780340779 00000020:00000080:1.0:1780340809.706338:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277458a 00000100:00080000:1.0:1780340809.706351:0:88242:0:(import.c:65:import_set_state_nolock()) ffff8c045f0c0800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780340809.706388:0:88242:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c045f0c3000): rc 0 00000020:00000080:1.0:1780340809.706391:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c045f0c3000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1780340809.706434:0:88242:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c0458285800), last request at 1780340805 00000020:00000080:1.0:1780340809.706438:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774583 00000100:00080000:1.0:1780340809.706444:0:88242:0:(import.c:65:import_set_state_nolock()) ffff8c0458281800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780340809.706463:0:88242:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0458285800): rc 0 00000020:00000080:1.0:1780340809.706465:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c0458285800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1780340809.706470:0:88242:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c047a0a3000), last request at 1780340805 00000020:00000080:1.0:1780340809.706473:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277457c 00000100:00080000:1.0:1780340809.706493:0:88242:0:(import.c:65:import_set_state_nolock()) ffff8c047a95c000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780340809.706571:0:88242:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c047a0a3000): rc 0 00000020:00000080:1.0:1780340809.706573:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c047a0a3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1780340809.706578:0:88242:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c047a1ec800), last request at 1780340774 00000020:00000080:1.0:1780340809.706582:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774402 00000100:00080000:1.0:1780340809.706717:0:88242:0:(import.c:65:import_set_state_nolock()) ffff8c047a959800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1780340809.706732:0:88242:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c047a1ec800): rc 0 00000020:00000080:1.0:1780340809.706734:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c047a1ec800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:1.0:1780340809.706743:0:88242:0:(mdd_device.c:2374:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff99274145bae0 00000100:00080000:1.0:1780340809.706789:0:88242:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1780340809.706794:0:88242:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1780340809.709076:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340809.709091:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340809.710038:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340809.710058:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1780340809.710230:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045f0c3000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1780340809.710325:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0458285800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1780340809.710346:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047a0a3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1780340809.710371:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047a1ec800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1780340809.710398:0:49688:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c045f0c0800 for lustre-MDT0000 00000020:00000080:3.0:1780340809.710404:0:49688:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0458281800 for lustre-MDT0000 00000020:00000080:3.0:1780340809.710407:0:49688:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047a95c000 for lustre-MDT0000 00000020:00000080:3.0:1780340809.710410:0:49688:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047a959800 for lustre-MDT0000 00000100:00080000:0.0:1780340809.711148:0:88242:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1780340809.711192:0:88242:0:(import.c:65:import_set_state_nolock()) ffff8c034a94d800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1780340809.711251:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961154432:0@lo:39:umount.0 00000100:00100000:1.0:1780340809.711362:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780340809.712233:0:88242:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1780340809.712240:0:88242:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 3 00000004:00080000:0.0:1780340809.712263:0:88242:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:0.0:1780340809.712345:0:88242:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1780340809.712373:0:88242:0:(import.c:65:import_set_state_nolock()) ffff8c044d43a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1780340809.712469:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961154560:0@lo:9:umount.0 00000100:00100000:1.0:1780340809.712525:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340809.713292:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961154432 00000100:00100000:1.0:1780340809.713306:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961154432 00000100:00100000:1.0:1780340809.713377:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3872 00000100:00100000:1.0:1780340809.713389:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818961154432:12345-0@lo:39:umount.0 00000020:00000080:1.0:1780340809.713428:0:26074:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774441 00000100:00080000:1.0:1780340809.713439:0:26074:0:(import.c:65:import_set_state_nolock()) ffff8c0475491800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1780340809.713490:0:26074:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378739 00000100:00080000:0.0:1780340809.714061:0:88242:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1780340809.714074:0:88242:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 3 00000004:00080000:0.0:1780340809.714088:0:88242:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:0.0:1780340809.714161:0:88242:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1780340809.714183:0:88242:0:(import.c:65:import_set_state_nolock()) ffff8c04506d1000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1780340809.714237:0:88242:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8c0471d53380) has no exports 00000100:00100000:1.0:1780340809.715149:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3658:x1866818961154432:12345-0@lo:39:umount.0 Request processed in 1759us (3784us total) trans 81604378740 rc 0/0 00000100:00100000:1.0:1780340809.715159:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3872 00000100:00100000:1.0:1780340809.715203:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961154560 00000100:00100000:1.0:1780340809.715210:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961154560 00000100:00100000:1.0:1780340809.715271:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5906 00000100:00100000:1.0:1780340809.715278:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818961154560:12345-0@lo:9:umount.0 00000020:00000080:1.0:1780340809.715313:0:8400:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277445d 00000100:00080000:1.0:1780340809.715321:0:8400:0:(import.c:65:import_set_state_nolock()) ffff8c045310e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1780340809.715366:0:8400:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969454 00000100:00100000:1.0:1780340809.715462:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3658:x1866818961154560:12345-0@lo:9:umount.0 Request processed in 184us (2937us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340809.715468:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5906 00000100:00100000:1.0:1780340809.715504:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961154688:0@lo:9:umount.0 00000100:00100000:1.0:1780340809.715541:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1780340809.716030:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1780340809.716170:0:88242:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8c0471d53380) has no exports 00000100:00080000:1.0:1780340809.718880:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c044d43a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1780340809.718913:0:3658:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:1.0:1780340809.718915:0:3658:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:1.0:1780340809.719577:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961154560:0@lo:9:umount.0 00000100:00080000:1.0:1780340809.719619:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a94d800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1780340809.719626:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961154432:0@lo:39:umount.0 00000100:00100000:1.0:1780340809.719700:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961154688 00000100:00100000:1.0:1780340809.719709:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961154688 00000100:00100000:1.0:1780340809.719833:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5907 00000100:00100000:1.0:1780340809.719844:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818961154688:12345-0@lo:9:umount.0 00000020:00000080:1.0:1780340809.719886:0:8401:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277446b 00000100:00080000:1.0:1780340809.719920:0:8401:0:(import.c:65:import_set_state_nolock()) ffff8c044d43c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1780340809.720000:0:8401:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969453 00000100:00100000:1.0:1780340809.720238:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3658:x1866818961154688:12345-0@lo:9:umount.0 Request processed in 394us (4695us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340809.720247:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5907 00010000:00010000:1.0:1780340809.720276:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340809.720283:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1780340809.720318:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c04506d1000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1780340809.720332:0:3658:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:1.0:1780340809.720334:0:3658:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:1.0:1780340809.720337:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961154688:0@lo:9:umount.0 00010000:00010000:1.0:1780340809.720361:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1780340809.720799:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:2.0:1780340809.754073:0:41205:0:(genops.c:906:class_export_put()) final put ffff8c04480ac000/7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000020:00000080:1.0:1780340809.754169:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04480ac000/7d14eb83-fa7c-40d9-843e-6367bec0a7b4 for lustre-MDT0000 00000020:00000080:1.0:1780340809.754260:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c04480a9000 for lustre-MDT0000 00010000:00010000:1.0:1780340809.754281:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340809.754284:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340809.754288:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1780340809.799262:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774417 00000020:00000080:0.0:1780340809.799286:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c047651b000/lustre-QMT0000_UUID 00000020:01000000:0.0:1780340809.799312:0:88242:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1780340809.799419:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047651b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1780340809.799455:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340809.799470:0:88242:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1780340809.799476:0:88242:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff8c0445ba3380) has no exports 00000020:00000080:3.0:1780340809.800162:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774410 00000020:00000080:3.0:1780340809.800587:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c0346bbc800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1780340809.800674:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340809.800867:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0346bbc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1780340809.800987:0:88242:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1780340809.800991:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c047b19d800/lustre-QMT0000_UUID 00000020:00000080:3.0:1780340809.800994:0:88242:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047b19d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1780340809.801005:0:88242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1780340809.801460:0:88242:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c044418b000 - data ffff8c044d03faf8/ffff8c045f0e9800 00000020:01000000:3.0:1780340809.802179:0:88242:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c04441a7840 - data ffff8c04719de000/ffff8c034fcfdc00 00000100:00080000:3.0:1780340809.845604:0:88242:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1780340809.845618:0:88242:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1780340809.845637:0:88242:0:(client.c:3140:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8c03498ed880 x1866818961154432/t81604378740(81604378740) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340819 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340809.845674:0:88242:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1780340809.847444:0:88242:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1780340809.847452:0:88242:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 4 00000004:00080000:0.0:1780340809.847506:0:88242:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:0.0:1780340809.847509:0:88242:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1780340809.852240:0:87353:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1780340809.852250:0:87353:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x68:0x0] index 1 count 1 00000040:00080000:3.0:1780340809.852267:0:87353:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 26 count 2 00000100:00080000:1.0:1780340809.853115:0:88242:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1780340809.853122:0:88242:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 4 00000004:00080000:1.0:1780340809.853174:0:88242:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:1.0:1780340809.853177:0:88242:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1780340809.853448:0:87355:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1780340809.853454:0:87355:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6a:0x0] index 1 count 1 00000040:00080000:3.0:1780340809.853463:0:87355:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 26 count 2 00000020:00000080:1.0:1780340809.854571:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327743d1 00000020:00000080:1.0:1780340809.854584:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c034a948000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780340809.855397:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327743e6 00000020:00000080:1.0:1780340809.855405:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c0445b45000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340809.855478:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c034a948000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1780340809.855542:0:88242:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1780340809.855550:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340809.855562:0:88242:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1780340809.855567:0:88242:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8c0471d519c0) has no exports 00000004:01000000:1.0:1780340809.855846:0:88242:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1780340809.855855:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774464 00000020:00000080:1.0:1780340809.855859:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c0346fd0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340809.855920:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0445b45000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1780340809.855972:0:88242:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1780340809.855977:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340809.855983:0:88242:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1780340809.855985:0:88242:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8c047ac719c0) has no exports 00000020:00000080:1.0:1780340809.855992:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774456 00000020:00000080:1.0:1780340809.855996:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c04754ef800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1780340809.856015:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0346fd0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1780340809.856484:0:88242:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1780340809.856490:0:88242:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1780340809.856495:0:88242:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969453 gen 5 00000004:00080000:1.0:1780340809.856502:0:88242:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:1.0:1780340809.856505:0:88242:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1780340809.856538:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04754ef800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780340809.856627:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340809.856634:0:88242:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780340809.856640:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774448 00000020:00000080:1.0:1780340809.856646:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c047651e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340809.856665:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c04506d1000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1780340809.856672:0:80497:0:(genops.c:906:class_export_put()) final put ffff8c047651f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340809.856673:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047651f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1780340809.856678:0:80497:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1780340809.856943:0:88242:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1780340809.856949:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340809.856954:0:88242:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1780340809.856957:0:88242:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8c0445ba0000) has no exports 00000020:00000080:1.0:1780340809.856963:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277443a 00000020:00000080:1.0:1780340809.856967:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c044d43b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1780340809.856983:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047651e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1780340809.857395:0:88242:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1780340809.857400:0:88242:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1780340809.857403:0:88242:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969454 gen 5 00000004:00080000:1.0:1780340809.857407:0:88242:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:1.0:1780340809.857419:0:88242:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1780340809.857447:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c044d43b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780340809.857527:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340809.857532:0:88242:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1780340809.857547:0:88242:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1780340809.857553:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277442c 00000020:00000080:1.0:1780340809.857557:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c045f0c6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340809.857608:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c044d43a000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1780340809.857614:0:80497:0:(genops.c:906:class_export_put()) final put ffff8c045f0c4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340809.857616:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045f0c4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1780340809.857620:0:80497:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1780340809.857733:0:88242:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1780340809.857738:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340809.857743:0:88242:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1780340809.857746:0:88242:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8c03482b4d40) has no exports 00000020:00000080:1.0:1780340809.857751:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774425 00000020:00000080:1.0:1780340809.857755:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c034a94c000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1780340809.857840:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045f0c6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1780340809.858829:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c034a94c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1780340809.859885:0:88242:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1780340809.859894:0:88242:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1780340809.859898:0:88242:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1780340809.859906:0:88242:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1780340809.859977:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340809.859990:0:88242:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1780340809.860057:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c034a94d800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1780340809.860066:0:80497:0:(genops.c:906:class_export_put()) final put ffff8c045f0c3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1780340809.860070:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045f0c3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1780340809.860076:0:80497:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340809.860194:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340809.860199:0:88242:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340809.860203:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c034a948800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340809.860206:0:88242:0:(genops.c:865:class_export_destroy()) destroying export ffff8c034a948800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1780340809.860212:0:88242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340809.860368:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327743ed 00000020:00000080:0.0:1780340809.860376:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c0445b41800/lustre-MDD0000_UUID 00000020:01000000:0.0:1780340809.860388:0:88242:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1780340809.860392:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780340809.860398:0:88242:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1780340809.860402:0:88242:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8c047ac73380) has no exports 00000020:00000080:0.0:1780340809.860426:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340809.860429:0:88242:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1780340809.860433:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327743f4 00000020:00000080:0.0:1780340809.860436:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c0445b40000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1780340809.860443:0:88242:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c046b9ae000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1780340809.860447:0:88242:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c046b9ae000 3 00000020:01000004:0.0:1780340809.860450:0:88242:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c046b9ae000 from lustre-MDT0000 00000020:00000080:0.0:1780340809.860474:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340809.860476:0:88242:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1780340809.860479:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c034a94e000/lustre-MDT0000_UUID 00000020:00000080:0.0:1780340809.860481:0:88242:0:(genops.c:865:class_export_destroy()) destroying export ffff8c034a94e000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1780340809.860488:0:88242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1780340809.860517:0:88242:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1780340809.860532:0:88242:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1780340809.860535:0:88242:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1780340809.860537:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780340809.860540:0:88242:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1780340809.860550:0:88242:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8c047b1fd000 540506f4-4e8e-4fb6-b537-f45d44291964 192.168.203.16@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1780340809.860556:0:88242:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8c046b96f000 f26f7947-2bb0-4491-8dd4-005fa8e64f3a 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1780340809.860560:0:88242:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8c0445ba19c0) has exports, disconnecting them 00000020:00080000:0.0:1780340809.860565:0:88242:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.16@tcp (ffff8c047b1fd000), last request at 1780340802 00000020:00000080:0.0:1780340809.860578:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327748b6 00000020:00010000:0.0:1780340809.860581:0:88242:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c047b1fd000: total 2 00000100:00080000:0.0:1780340809.860585:0:88242:0:(import.c:65:import_set_state_nolock()) ffff8c047b1f8800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1780340809.860602:0:88242:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.16@tcp (ffff8c047b1fd000): rc 0 00000020:00080000:0.0:1780340809.860605:0:88242:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8c046b96f000), last request at 1780340774 00000020:00010000:0.0:1780340809.860619:0:6504:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c047b1fd000: total 2 00010000:00010000:0.0:1780340809.860648:0:6504:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c047b1fd000, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1780340809.860709:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453122400/0xa246514327748bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2440 expref: 5 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.860731:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453123a00/0xa246514327748d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced247f expref: 4 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.860742:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c045ec6de00/0xa246514327748c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2447 expref: 3 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.860752:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0347785e00/0xa246514327748cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2478 expref: 2 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.860781:0:6504:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c047b1fd000, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1780340809.860802:0:6504:0:(genops.c:906:class_export_put()) final put ffff8c047b1fd000/540506f4-4e8e-4fb6-b537-f45d44291964 00000020:00000080:3.0:1780340809.860843:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0445b41800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1780340809.860847:0:80497:0:(genops.c:906:class_export_put()) final put ffff8c045f0c6000/lustre-MDD0000_UUID 00000020:00000080:3.0:1780340809.860849:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045f0c6000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1780340809.860853:0:80497:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1780340809.860888:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0445b40000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1780340809.860926:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340809.860928:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340809.860931:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1780340809.860943:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774392 00000020:00010000:0.0:1780340809.860947:0:88242:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c046b96f000: total 1 00000100:00080000:0.0:1780340809.860950:0:88242:0:(import.c:65:import_set_state_nolock()) ffff8c046b968000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1780340809.860963:0:88242:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c046b96f000): rc 0 00000020:00080000:0.0:1780340809.860968:0:88242:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8c0445ba19c0) has no exports 00000100:00100000:0.0:1780340809.861061:0:87339:0:(service.c:3186:ptlrpc_main()) ll_mgs_0000: service thread [ffff8c0445ba9600:87339] 0 exiting: rc = 1 00000100:00100000:3.0:1780340809.861143:0:87341:0:(service.c:3186:ptlrpc_main()) ll_mgs_0001: service thread [ffff8c047a2c9a00:87341] 1 exiting: rc = 0 00000100:00100000:3.0:1780340809.861308:0:87342:0:(service.c:3186:ptlrpc_main()) ll_mgs_0002: service thread [ffff8c047a2c8200:87342] 2 exiting: rc = 0 00000020:00000080:3.0:1780340809.861355:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047b1fd000/540506f4-4e8e-4fb6-b537-f45d44291964 for MGS 00000020:00000080:3.0:1780340809.861384:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047b1f8800 for MGS 00000100:00100000:0.0:1780340809.861438:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861446:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861453:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861458:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861463:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861469:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861475:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861481:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861487:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861494:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861499:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861505:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861510:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861516:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861521:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861527:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861532:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861538:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861543:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861550:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861556:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861562:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861568:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861574:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861579:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861592:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861597:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861604:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861612:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861618:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861624:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861630:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861636:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861642:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861648:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861654:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861660:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861666:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861675:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861683:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861692:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861698:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861704:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861709:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861717:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861723:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861729:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861736:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861741:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861747:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861788:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861795:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861801:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861806:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861812:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861818:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861824:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861830:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861836:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861842:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861855:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861861:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861866:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1780340809.861872:0:88242:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:0.0:1780340809.862851:0:6505:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c046b96f000: total 0 00010000:00010000:0.0:1780340809.862921:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c046b96f000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1780340809.862956:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04497b6800/0xa24651432774521 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2465143277451a expref: 14 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.862976:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a8b2a00/0xa2465143277452f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774528 expref: 13 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.862991:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a8b3e00/0xa2465143277453d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774536 expref: 12 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.863004:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a8b2400/0xa246514327744cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327744c6 expref: 11 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.863013:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a8b3400/0xa2465143277454b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774544 expref: 10 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.863025:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a32a200/0xa246514327744db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327744d4 expref: 9 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.863039:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a32b000/0xa246514327744e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327744e2 expref: 8 pid: 87339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.863056:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a32b600/0xa24651432774567 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774560 expref: 7 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.863066:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f8600/0xa246514327744f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327744f0 expref: 6 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.863090:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04497b7200/0xa24651432774559 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774552 expref: 5 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.863103:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a32b800/0xa24651432774513 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2465143277450c expref: 4 pid: 87341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.863111:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a32bc00/0xa24651432774575 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2465143277456e expref: 3 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.863120:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f8c00/0xa24651432774505 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa246514327744fe expref: 2 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340809.863129:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c046b96f000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1780340809.863146:0:6505:0:(genops.c:906:class_export_put()) final put ffff8c046b96f000/f26f7947-2bb0-4491-8dd4-005fa8e64f3a 00010000:00010000:0.0:1780340809.863161:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340809.863163:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340809.863165:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1780340809.863853:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b96f000/f26f7947-2bb0-4491-8dd4-005fa8e64f3a for MGS 00000020:00000080:3.0:1780340809.863892:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c046b968000 for MGS 00000020:01000000:0.0:1780340809.864196:0:88242:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c04441318a0 - data ffff8c044d0e41b0/ffff8c04713b0c00 00000020:01000000:0.0:1780340809.864445:0:88242:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c047a94d300 - data ffff8c044d194ca8/ffff8c034aa98400 00000020:00000080:0.0:1780340809.865135:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774368 00000020:00000080:0.0:1780340809.865145:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c04530a2000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1780340809.865164:0:88242:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c046b9ae000 from MGS, refs=2 00000020:01000004:0.0:1780340809.865168:0:88242:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c046b9ae000 2 00000020:01000004:0.0:1780340809.865171:0:88242:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c046b9ae000 from MGS 00000020:00000080:0.0:1780340809.865200:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340809.865209:0:88242:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1780340809.865212:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c0470f6f800/MGS 00000020:00000080:0.0:1780340809.865214:0:88242:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0470f6f800/MGS for MGS 00000020:01000000:0.0:1780340809.865234:0:88242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:3.0:1780340809.865283:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04530a2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1780340809.865372:0:88242:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1780340809.865389:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780340809.865398:0:88242:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1780340809.865407:0:88242:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8c047a0a7000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1780340809.865413:0:88242:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff8c0476588000) has exports, disconnecting them 00000020:00080000:0.0:1780340809.865419:0:88242:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8c047a0a7000), last request at 1780340774 00000020:00000080:0.0:1780340809.865424:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327744a3 00000020:00080000:0.0:1780340809.865435:0:88242:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c047a0a7000): rc 0 00000020:00000080:0.0:1780340809.865441:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c047a0a7000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1780340809.865674:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047a0a7000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1780340809.871890:0:88242:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1780340809.871901:0:88242:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1780340809.871906:0:88242:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1780340809.871915:0:88242:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1780340809.872058:0:49688:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047b1fb800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1780340809.872170:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340809.872181:0:88242:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1780340809.872188:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c046bae1800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1780340809.872193:0:88242:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046bae1800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1780340809.872201:0:88242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1780340809.872317:0:88242:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c046b9ae000 1 00000020:00000080:1.0:1780340809.872324:0:88242:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277435a 00000020:00000080:1.0:1780340809.872332:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c0470f6b000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1780340809.872369:0:88242:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1780340809.872373:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340809.872379:0:88242:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1780340809.872384:0:88242:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8c0471d54d40) has no exports 00000020:00000080:3.0:1780340809.872671:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0470f6b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780340809.963030:0:88242:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340809.963063:0:88242:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1780340809.963072:0:88242:0:(genops.c:906:class_export_put()) final put ffff8c046b9aa800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1780340809.963079:0:88242:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b9aa800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1780340809.963117:0:88242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1780340809.963291:0:88242:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8c046b9a9000 00000020:02000400:1.0:1780340809.963377:0:88242:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1780340810.641897:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818961154944:0@lo:400:kworker.0 00000100:00100000:3.0:1780340810.641967:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340810.642000:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961155456:0@lo:400:kworker.0 00000100:00100000:1.0:1780340810.642621:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961154816:0@lo:400:kworker.0 00000400:00000100:1.0:1780340810.642652:0:3659:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961154816 offset 0 length 224: 4 00000100:00100000:1.0:1780340810.642678:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961155328:0@lo:400:kworker.0 00000100:00100000:1.0:1780340810.642701:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340810.642719:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961155840:0@lo:400:kworker.0 00000100:00100000:1.0:1780340810.642735:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340810.642797:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961154944 00000100:00100000:1.0:1780340810.642805:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961154944 00000100:00100000:1.0:1780340810.642841:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961155328 00000100:00100000:1.0:1780340810.642843:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961155328 00000100:00100000:1.0:1780340810.642877:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961155840 00000100:00100000:1.0:1780340810.642880:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961155840 00000100:00100000:1.0:1780340810.642892:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1780340810.642902:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961155328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340810.642959:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961155328:12345-0@lo:400:kworker.0 Request processed in 59us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340810.642966:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1780340810.642984:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1780340810.642988:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3660:x1866818961154944:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1780340810.642994:0:63711:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780340810.643019:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3660:x1866818961154944:12345-0@lo:400:kworker.0 Request processed in 30us (1053us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780340810.643025:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1780340810.643045:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:1.0:1780340810.643062:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3659:x1866818961155840:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1780340810.643067:0:63711:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780340810.643090:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3659:x1866818961155840:12345-0@lo:400:kworker.0 Request processed in 27us (353us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780340810.643096:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:1.0:1780340810.643136:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961155328:0@lo:400:kworker.0 00000100:00080000:1.0:1780340810.643146:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1780340810.643152:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1780340810.643156:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1780340810.643161:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340810.643165:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3559 00000100:00080000:1.0:1780340810.643170:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340810.643195:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0444226680 x1866818961155968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340810.643214:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961155840:0@lo:400:kworker.0 00010000:00010000:0.0:1780340810.643389:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340810.644181:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961155968:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1780340810.644423:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340810.644689:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961155968 00000100:00100000:2.0:1780340810.644697:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961155968 00000100:00100000:2.0:1780340810.644733:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:2.0:1780340810.644740:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961155968:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1780340810.644778:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340810.644822:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961155968:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 81us (399us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340810.644846:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00080000:2.0:1780340810.644885:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340810.644891:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340810.644894:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961155968:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1780340810.645749:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961155200:0@lo:400:kworker.0 00000100:00100000:0.0:1780340810.645817:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961155072:0@lo:400:kworker.0 00000100:00100000:0.0:1780340810.645880:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340810.645915:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961155584:0@lo:400:kworker.0 00000100:00100000:0.0:1780340810.645967:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340810.646005:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961155584 00000100:00100000:0.0:1780340810.646011:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961155584 00000100:00100000:0.0:1780340810.646064:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:0.0:1780340810.646073:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961155584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340810.646117:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961155584:12345-0@lo:400:kworker.0 Request processed in 47us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340810.646124:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:0.0:1780340810.646158:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961155584:0@lo:400:kworker.0 00000100:00100000:2.0:1780340810.646615:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340810.646638:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961155712:0@lo:400:kworker.0 00000100:00100000:2.0:1780340810.646659:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340810.646687:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961155072 00000100:00100000:2.0:1780340810.646690:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961155072 00000100:00100000:2.0:1780340810.646720:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961155200 00000100:00100000:2.0:1780340810.646723:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961155200 00000100:00100000:2.0:1780340810.646738:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:2.0:1780340810.646745:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961155072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340810.646798:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961155072:12345-0@lo:400:kworker.0 Request processed in 53us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340810.646805:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:2.0:1780340810.646818:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1780340810.646822:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3662:x1866818961155200:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1780340810.646828:0:63712:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1780340810.646852:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3662:x1866818961155200:12345-0@lo:400:kworker.0 Request processed in 28us (238us total) trans 0 rc -107/-107 00000100:00100000:2.0:1780340810.646857:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1780340810.646871:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961155712 00000100:00100000:2.0:1780340810.646874:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961155712 00000100:00100000:2.0:1780340810.646896:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:2.0:1780340810.646917:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961155712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340810.646946:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961155712:12345-0@lo:400:kworker.0 Request processed in 32us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340810.646951:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00080000:2.0:1780340810.646974:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1780340810.646979:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1780340810.646983:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1780340810.646987:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340810.646990:0:3662:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3559 00000100:00080000:2.0:1780340810.646995:0:3662:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340810.647022:0:3662:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047207c000 x1866818961156096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340810.647053:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961155200:0@lo:400:kworker.0 00000100:00100000:2.0:1780340810.647068:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961155712:0@lo:400:kworker.0 00000100:00100000:2.0:1780340810.647092:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961156096:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1780340810.647118:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340810.647139:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961156096 00000100:00100000:2.0:1780340810.647142:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961156096 00000100:00100000:2.0:1780340810.647157:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:2.0:1780340810.647160:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961156096:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1780340810.647177:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340810.647205:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961156096:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 43us (86us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340810.647219:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:3.0:1780340810.648455:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1780340810.648521:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1780340810.648526:0:3660:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1780340810.648531:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1780340810.648536:0:3660:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340810.648540:0:3660:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3559 00000100:00080000:3.0:1780340810.648546:0:3660:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340810.648571:0:3660:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c045ecbc700 x1866818961156224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340810.648587:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818961154944:0@lo:400:kworker.0 00000100:00080000:3.0:1780340810.648630:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340810.648637:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340810.648640:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340810.648842:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961155456 00000100:00100000:3.0:1780340810.648849:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961155456 00000100:00100000:3.0:1780340810.648892:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3873 00000100:00100000:3.0:1780340810.648900:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3660:x1866818961155456:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1780340810.648909:0:22660:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1780340810.648963:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3660:x1866818961155456:12345-0@lo:400:kworker.0 Request processed in 63us (515us total) trans 0 rc -107/-107 00000100:00100000:3.0:1780340810.648970:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3873 00000100:00080000:3.0:1780340810.649137:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1780340810.649141:0:3660:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1780340810.649143:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1780340810.649148:0:3660:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340810.649151:0:3660:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3559 00000100:00080000:3.0:1780340810.649155:0:3660:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340810.649171:0:3660:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c045ecbf480 x1866818961156352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340810.649181:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961155456:0@lo:400:kworker.0 00000100:00100000:2.0:1780340810.650600:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961156224:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1780340810.650661:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340810.650690:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961156352:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1780340810.650714:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1780340810.650745:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340810.650750:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340810.650754:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961156096:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1780340810.650802:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961156224 00000100:00100000:2.0:1780340810.650808:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961156224 00000100:00100000:2.0:1780340810.650838:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:2.0:1780340810.650844:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961156224:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1780340810.650864:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340810.650902:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961156224:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 56us (241us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340810.650908:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00080000:2.0:1780340810.650930:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340810.650934:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340810.650937:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961156224:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1780340810.650965:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961155072:0@lo:400:kworker.0 00000100:00100000:3.0:1780340810.651739:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961156352 00000100:00100000:3.0:1780340810.651746:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961156352 00000100:00100000:3.0:1780340810.651802:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874 00000100:00100000:3.0:1780340810.651808:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961156352:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1780340810.651823:0:8410:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340810.651864:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961156352:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 56us (1149us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340810.651870:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874 00000100:00080000:2.0:1780340810.653784:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340810.653798:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340810.653804:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961156352:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1780340811.658382:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340812.170214:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961156480:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340812.170284:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340812.170965:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961156608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340812.177227:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340812.177498:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961156480 00000100:00100000:1.0:1780340812.177508:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961156480 00000100:00100000:1.0:1780340812.177578:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2078 00000100:00100000:1.0:1780340812.177589:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961156480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340812.177621:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340812.177701:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961156480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (7417us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340812.177709:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2078 00000100:00080000:0.0:1780340812.180238:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340812.182909:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961156480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340812.183293:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961156608 00000100:00100000:2.0:1780340812.183302:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961156608 00000100:00100000:2.0:1780340812.183362:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2079 00000100:00100000:2.0:1780340812.183372:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961156608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340812.183399:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780340812.183460:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961156608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (6239us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340812.183467:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2079 00000100:00100000:3.0:1780340812.183668:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961156608:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1780340812.183691:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1780340812.682402:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1780340813.203163:0:72681:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1780340813.203183:0:72681:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378740 is committed 00000020:00000080:0.0:1780340813.203207:0:72681:0:(genops.c:906:class_export_put()) final put ffff8c0475496800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:0.0:1780340813.203304:0:72681:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411386 batchid updated 00000020:00080000:2.0:1780340813.204472:0:72701:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411386 00000004:00080000:2.0:1780340813.204604:0:72701:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c034acd8780 with version 10 00000020:00080000:2.0:1780340813.204627:0:72701:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411386 cancel update log [0x2000088d1:0x2:0x0].2: rc = 0 00000020:00080000:2.0:1780340813.204743:0:72701:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411386 cancel update log [0x2400090a0:0x2:0x0].2: rc = 0 00000020:00080000:2.0:1780340813.204752:0:72701:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411386 00000004:00080000:0.0:1780340813.205152:0:72687:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c034acb9780 version 10 rpc_version 10 00000020:00100000:0.0:1780340813.206227:0:72687:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1780340813.206248:0:72687:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c03498ed880 x1866818961156864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340813.206278:0:72687:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8c03498ed880 x1866818961156864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340813.206290:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000020:00000080:1.0:1780340813.207261:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0475496800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1780340813.207519:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0475491800 for lustre-MDT0001 00000400:00000100:1.0:1780340813.359654:0:3654:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940448640 offset 0 length 224: 4 00000100:00100000:1.0:1780340813.359707:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340813.359747:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340813.359954:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940449152 00000100:00100000:3.0:1780340813.359969:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940449152 00000100:00100000:3.0:1780340813.360067:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2568 00000100:00100000:3.0:1780340813.360081:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940449152:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340813.360184:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940449152:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 105us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340813.360193:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2568 00000100:00100000:1.0:1780340813.360308:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340813.360336:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00080000:0.0:1780340813.360416:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340813.361565:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940448896 00000100:00100000:2.0:1780340813.361577:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940448896 00000100:00100000:2.0:1780340813.361660:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940448768 00000100:00100000:2.0:1780340813.361664:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940448768 00000100:00100000:2.0:1780340813.361695:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1335 00000100:00100000:2.0:1780340813.361705:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940448896:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340813.362138:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1325 00000100:00100000:3.0:1780340813.362146:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2407:x1866818940448768:12345-192.168.203.16@tcp:400:kworker.0 00000020:00080000:3.0:1780340813.362154:0:64454:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.16@tcp 00000100:00100000:3.0:1780340813.362198:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2407:x1866818940448768:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 51us (1890us total) trans 0 rc -107/-107 00000100:00100000:3.0:1780340813.362206:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1325 00000100:00100000:3.0:1780340813.362375:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940449024 00000100:00100000:3.0:1780340813.362380:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940449024 00000100:00100000:3.0:1780340813.362418:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2569 00000100:00100000:3.0:1780340813.362436:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940449024:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340813.362471:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940449024:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 47us (2135us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340813.362500:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2569 00000100:00100000:2.0:1780340813.362864:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940448896:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 1159us (3155us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340813.362874:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1335 00000100:00080000:0.0:1780340813.363080:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340813.363087:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340813.367677:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340813.367942:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940449280 00000100:00100000:2.0:1780340813.367956:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940449280 00000100:00100000:2.0:1780340813.368033:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1326 00000100:00100000:2.0:1780340813.368062:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940449280:12345-192.168.203.16@tcp:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1780340813.368092:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340813.368182:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940449280:12345-192.168.203.16@tcp:38:ptlrpcd_00_00.0 Request processed in 120us (522us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340813.368189:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1326 00010000:00010000:0.0:1780340813.706003:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340814.220528:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00010000:00010000:0.0:1780340814.730150:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340815.242633:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00010000:00010000:0.0:1780340815.754170:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780340815.754171:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340815.754182:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340815.754188:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340815.754198:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3590 00000100:00080000:2.0:1780340815.754206:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1780340815.754212:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1780340815.754217:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340815.754244:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961156992:0@lo:400:kworker.0 00000100:00100000:2.0:1780340815.754254:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047207f800 x1866818961157120/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340815.754310:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340815.754316:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340815.754319:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000400:00000100:0.0:1780340815.754327:0:3661:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961156992 offset 0 length 224: 4 00000100:00080000:2.0:1780340815.754328:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3590 00000100:00080000:2.0:1780340815.754339:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780340815.754345:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340815.754368:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047207ed80 x1866818961157376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340815.754396:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340815.754400:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340815.754402:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1780340815.754413:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961157248:0@lo:400:kworker.0 00000100:00080000:2.0:1780340815.754425:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3590 00000100:00080000:2.0:1780340815.754429:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780340815.754436:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340815.754458:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340815.754465:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047207c000 x1866818961157632/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340815.754490:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340815.754499:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961157504:0@lo:400:kworker.0 00000100:00100000:0.0:1780340815.754525:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1780340815.754555:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340815.754560:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340815.754562:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340815.754570:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3590 00000100:00100000:0.0:1780340815.754573:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961157888:0@lo:400:kworker.0 00000100:00080000:2.0:1780340815.754576:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780340815.754586:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340815.754602:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d4c9500 x1866818961158016/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340815.754628:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340815.754642:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961157120:0@lo:38:kworker.0 00000100:00100000:0.0:1780340815.754654:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340815.754677:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961157760:0@lo:400:kworker.0 00000100:00100000:2.0:1780340815.754714:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340815.754723:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340815.754797:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961157376:0@lo:38:kworker.0 00000100:00100000:0.0:1780340815.754830:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961157248 00000100:00100000:2.0:1780340815.754838:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340815.754842:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961157248 00000100:00100000:2.0:1780340815.754865:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961157632:0@lo:38:kworker.0 00000100:00100000:0.0:1780340815.754910:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961157504 00000100:00100000:0.0:1780340815.754916:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961157504 00000100:00100000:2.0:1780340815.754917:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340815.754946:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961158016:0@lo:38:kworker.0 00000100:00100000:0.0:1780340815.754947:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961157120 00000100:00100000:0.0:1780340815.754955:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961157120 00000100:00100000:0.0:1780340815.754972:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961157376 00000100:00100000:0.0:1780340815.754976:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961157376 00000100:00100000:2.0:1780340815.754995:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340815.755011:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1780340815.755025:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961157248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340815.755053:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961158016 00000100:00100000:2.0:1780340815.755062:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961158016 00000100:00100000:2.0:1780340815.755097:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1780340815.755106:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961157248:12345-0@lo:400:kworker.0 Request processed in 83us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340815.755116:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961157504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340815.755121:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1780340815.755151:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:0.0:1780340815.755157:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961157120:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340815.755181:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340815.755189:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961157504:12345-0@lo:400:kworker.0 Request processed in 80us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340815.755198:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:2.0:1780340815.755236:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:0.0:1780340815.755243:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961157120:12345-0@lo:38:kworker.0 Request processed in 81us (527us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340815.755249:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961157376:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1780340815.755261:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:1.0:1780340815.755271:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961157888 00000100:00100000:1.0:1780340815.755278:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961157888 00010000:00020000:2.0:1780340815.755279:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340815.755282:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:0.0:1780340815.755293:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961158016:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340815.755306:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340815.755325:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961157760 00000100:00100000:1.0:1780340815.755329:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961157760 00000100:00100000:2.0:1780340815.755344:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961157376:12345-0@lo:38:kworker.0 Request processed in 94us (505us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340815.755355:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:0.0:1780340815.755355:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961158016:12345-0@lo:38:kworker.0 Request processed in 57us (364us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340815.755360:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00000100:00100000:0.0:1780340815.755371:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:1.0:1780340815.755373:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961157888:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1780340815.755408:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340815.755413:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340815.755418:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340815.755520:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:3.0:1780340815.755533:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961157760:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1780340815.755635:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340815.755640:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340815.755644:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961157120:0@lo:38:kworker.0 00000100:00100000:1.0:1780340815.765215:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961157888:12345-0@lo:400:kworker.0 Request processed in 9828us (10570us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340815.765232:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00100000:1.0:1780340815.765582:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961157888:0@lo:400:kworker.0 00000100:00100000:1.0:1780340815.767880:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961157632 00000100:00100000:1.0:1780340815.767895:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961157632 00000100:00100000:1.0:1780340815.767938:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3875 00000100:00100000:1.0:1780340815.767946:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961157632:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340815.767983:0:22660:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340815.768074:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961157632:12345-0@lo:38:kworker.0 Request processed in 126us (13162us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340815.768080:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3875 00000001:00100000:1.0:1780340815.769704:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780340815.769719:0:9462:0:(genops.c:906:class_export_put()) final put ffff8c044d439800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1780340815.771375:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780340815.771383:0:8395:0:(genops.c:906:class_export_put()) final put ffff8c0450113000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780340815.771409:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c044d439800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1780340815.771457:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0450113000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1780340815.771474:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c044d43c000 for lustre-OST0001 00000020:00000080:1.0:1780340815.771479:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c045310e800 for lustre-OST0000 00000100:00100000:0.0:1780340815.771622:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961157504:0@lo:400:kworker.0 00000100:00100000:0.0:1780340815.771658:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961157248:0@lo:400:kworker.0 00000100:00100000:3.0:1780340815.773058:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961157760:12345-0@lo:400:kworker.0 Request processed in 17521us (18328us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340815.773071:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00100000:1.0:1780340815.773160:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961157760:0@lo:400:kworker.0 00000100:00080000:2.0:1780340815.777455:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340815.777467:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340815.777472:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961157376:0@lo:38:kworker.0 00000100:00080000:2.0:1780340815.777493:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340815.777496:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340815.777499:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961157632:0@lo:38:kworker.0 00000100:00080000:2.0:1780340815.777510:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340815.777513:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340815.777516:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961158016:0@lo:38:kworker.0 00000100:00100000:0.0:1780340816.265880:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00010000:00010000:0.0:1780340816.778164:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340817.290298:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:3.0:1780340817.290510:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340817.290529:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961158144:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340817.290593:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340817.291097:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961158144 00000100:00100000:1.0:1780340817.291104:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961158144 00000100:00100000:1.0:1780340817.291174:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080 00000100:00100000:1.0:1780340817.291185:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961158144:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1780340817.291185:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340817.291197:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340817.291210:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961158272:0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340817.291218:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340817.291250:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340817.291276:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961158144:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340817.291283:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080 00000100:00100000:1.0:1780340817.291301:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961158272 00000100:00100000:1.0:1780340817.291305:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961158272 00000100:00100000:1.0:1780340817.291356:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2081 00000100:00100000:1.0:1780340817.291362:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961158272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340817.291378:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340817.291414:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961158272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340817.291421:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2081 00000100:00080000:1.0:1780340817.291438:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340817.291471:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961158272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340817.291723:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961158144:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1780340817.805029:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340818.314000:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:1.0:1780340818.477492:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340818.477536:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000400:00000100:1.0:1780340818.477562:0:3654:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940449408 offset 0 length 224: 4 00000100:00100000:1.0:1780340818.477591:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340818.477627:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340818.477686:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940449664 00000100:00100000:2.0:1780340818.477698:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940449664 00000100:00100000:2.0:1780340818.477810:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940449536 00000100:00100000:2.0:1780340818.477827:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940449536 00000100:00100000:2.0:1780340818.477849:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1338 00000100:00100000:2.0:1780340818.477859:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2409:x1866818940449664:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340818.477947:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2409:x1866818940449664:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 90us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340818.477955:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1338 00000100:00100000:2.0:1780340818.477972:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1330 00000100:00100000:2.0:1780340818.477988:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940449536:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:2.0:1780340818.478008:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340818.478034:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940449536:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 55us (406us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340818.478040:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1330 00000100:00080000:1.0:1780340818.479274:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340818.480022:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940449920 00000100:00100000:3.0:1780340818.480035:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940449920 00000100:00100000:3.0:1780340818.480098:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940449792 00000100:00100000:3.0:1780340818.480102:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940449792 00000100:00100000:3.0:1780340818.480126:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2572 00000100:00100000:3.0:1780340818.480135:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2409:x1866818940449920:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340818.480198:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2409:x1866818940449920:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 64us (2662us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340818.480206:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2572 00000100:00100000:1.0:1780340818.480224:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2573 00000100:00100000:1.0:1780340818.480237:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2409:x1866818940449792:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340818.480268:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2409:x1866818940449792:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 36us (2687us total) trans 0 rc 0/0 00000100:00080000:0.0:1780340818.480441:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340818.480445:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340818.486914:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2573 00010000:00010000:2.0:1780340818.828740:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340819.339745:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00010000:00010000:0.0:1780340819.851141:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340820.361886:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00080000:1.0:1780340820.874936:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340820.874943:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340820.874947:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340820.874955:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3595 00000100:00080000:1.0:1780340820.874969:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1780340820.874988:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340820.875024:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0444225500 x1866818961158528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340820.875045:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340820.875048:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340820.875050:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340820.875053:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3595 00000100:00080000:1.0:1780340820.875055:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00100000:3.0:1780340820.875189:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961158656:0@lo:400:kworker.0 00000100:00100000:3.0:1780340820.875289:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340820.875352:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340820.875368:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961158400:0@lo:400:kworker.0 00000400:00000100:3.0:1780340820.875391:0:3662:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961158400 offset 0 length 224: 4 00000100:00100000:3.0:1780340820.875445:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961158656 00000100:00100000:3.0:1780340820.875453:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961158656 00000100:00100000:3.0:1780340820.875503:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:3.0:1780340820.875514:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961158656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340820.875570:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961158656:12345-0@lo:400:kworker.0 Request processed in 58us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340820.875577:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:3.0:1780340820.875617:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961158656:0@lo:400:kworker.0 00000100:00100000:2.0:1780340820.876474:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961158528:0@lo:38:kworker.0 00000100:00100000:2.0:1780340820.876532:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340820.876574:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961158528 00000100:00100000:2.0:1780340820.876579:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961158528 00000100:00100000:2.0:1780340820.876617:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:2.0:1780340820.876623:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961158528:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340820.876643:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340820.876673:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961158528:12345-0@lo:38:kworker.0 Request processed in 49us (141us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340820.876680:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00080000:2.0:1780340820.876708:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340820.876712:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340820.876724:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961158528:0@lo:38:kworker.0 00000100:00080000:1.0:1780340820.877085:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340820.877113:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0444226d80 x1866818961158784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340820.877162:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340820.877166:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340820.877169:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340820.877174:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3595 00000100:00080000:1.0:1780340820.877178:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1780340820.877181:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340820.877192:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0444225c00 x1866818961159040/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340820.877217:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340820.877221:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340820.877222:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340820.877226:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3595 00000100:00100000:0.0:1780340820.877488:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961159296:0@lo:400:kworker.0 00000100:00100000:0.0:1780340820.877567:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340820.877642:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961159296 00000100:00100000:0.0:1780340820.877648:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961159296 00000100:00100000:0.0:1780340820.877693:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:0.0:1780340820.877701:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961159296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340820.877745:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961159296:12345-0@lo:400:kworker.0 Request processed in 44us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340820.877752:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00080000:0.0:1780340820.877790:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340820.877794:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340820.877817:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961159296:0@lo:400:kworker.0 00010000:00010000:0.0:1780340820.877924:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340820.877951:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961159168:0@lo:400:kworker.0 00000100:00100000:0.0:1780340820.877988:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340820.878018:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340820.878025:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961158912:0@lo:400:kworker.0 00000100:00100000:0.0:1780340820.878046:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780340820.878550:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1780340820.878561:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340820.878587:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0444225f80 x1866818961159424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340820.878653:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961159168 00000100:00100000:1.0:1780340820.878659:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961159168 00000100:00100000:1.0:1780340820.878699:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575 00000100:00100000:1.0:1780340820.878707:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961159168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340820.878753:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961159168:12345-0@lo:400:kworker.0 Request processed in 48us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340820.878792:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575 00000100:00080000:1.0:1780340820.878809:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340820.878833:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961159168:0@lo:400:kworker.0 00000100:00100000:1.0:1780340820.878875:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961158912 00000100:00100000:1.0:1780340820.878878:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961158912 00000100:00100000:2.0:1780340820.879944:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961158784:0@lo:38:kworker.0 00000100:00100000:2.0:1780340820.880023:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340820.880057:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961159040:0@lo:38:kworker.0 00000100:00100000:2.0:1780340820.880095:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340820.880124:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961159040 00000100:00100000:2.0:1780340820.880129:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961159040 00000100:00100000:2.0:1780340820.880164:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3876 00000100:00100000:2.0:1780340820.880169:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961159040:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340820.880193:0:26074:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340820.880224:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961159040:12345-0@lo:38:kworker.0 Request processed in 53us (128us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340820.880229:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3876 00000100:00080000:2.0:1780340820.880457:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340820.880463:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340820.880467:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961159040:0@lo:38:kworker.0 00000100:00100000:2.0:1780340820.880474:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961159424:0@lo:38:kworker.0 00000100:00100000:2.0:1780340820.880536:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340820.880558:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961158784 00000100:00100000:2.0:1780340820.880562:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961158784 00000100:00100000:2.0:1780340820.880580:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961159424 00000100:00100000:2.0:1780340820.880583:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961159424 00000100:00100000:2.0:1780340820.880599:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:2.0:1780340820.880604:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961158784:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340820.880615:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340820.880651:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961158784:12345-0@lo:38:kworker.0 Request processed in 46us (629us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340820.880657:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:2.0:1780340820.880669:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1780340820.880673:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961159424:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340820.880682:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340820.880702:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961159424:12345-0@lo:38:kworker.0 Request processed in 28us (166us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340820.880708:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00080000:2.0:1780340820.880736:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340820.880740:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340820.880744:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961159424:0@lo:38:kworker.0 00000100:00080000:2.0:1780340820.880797:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340820.880802:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340820.880804:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961158784:0@lo:38:kworker.0 00000100:00100000:1.0:1780340820.881027:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1780340820.881036:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961158912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340820.881412:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961158912:12345-0@lo:400:kworker.0 Request processed in 377us (3364us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340820.881420:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1780340820.881492:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961158912:0@lo:400:kworker.0 00000100:00080000:2.0:1780340820.881668:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340821.385827:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00010000:00010000:0.0:1780340821.898625:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340822.422219:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:0.0:1780340822.422750:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961159552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340822.422850:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340822.422899:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961159552 00000100:00100000:0.0:1780340822.422907:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961159552 00000100:00100000:0.0:1780340822.422974:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2082 00000100:00100000:0.0:1780340822.422984:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961159552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340822.423014:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340822.423057:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961159552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340822.423064:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2082 00000100:00080000:0.0:1780340822.423084:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340822.423125:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961159552:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340822.441941:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961159680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340822.442034:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340822.442124:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961159680 00000100:00100000:0.0:1780340822.442133:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961159680 00000100:00100000:0.0:1780340822.442188:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2083 00000100:00100000:0.0:1780340822.442198:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961159680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340822.442226:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340822.442278:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961159680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340822.442285:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2083 00000100:00080000:0.0:1780340822.442304:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340822.442338:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961159680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340822.588006:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000400:00000100:0.0:1780340822.588037:0:3653:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940450048 offset 0 length 224: 4 00000100:00100000:0.0:1780340822.588052:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340822.588073:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340822.588094:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340822.588129:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940450432 00000100:00100000:0.0:1780340822.588138:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940450432 00000100:00100000:0.0:1780340822.588188:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940450560 00000100:00100000:0.0:1780340822.588190:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940450560 00000100:00100000:0.0:1780340822.588209:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2576 00000100:00100000:0.0:1780340822.588219:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940450432:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340822.588285:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940450432:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 67us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340822.588292:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2576 00000100:00100000:0.0:1780340822.588307:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2577 00000100:00100000:0.0:1780340822.588313:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2408:x1866818940450560:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340822.588331:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2408:x1866818940450560:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 18us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340822.588336:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2577 00000100:00080000:0.0:1780340822.588349:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340822.588353:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340822.591381:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940450176 00000100:00100000:2.0:1780340822.591394:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940450176 00000100:00100000:2.0:1780340822.591437:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940450304 00000100:00100000:2.0:1780340822.591440:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940450304 00000100:00100000:2.0:1780340822.591482:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1341 00000100:00100000:2.0:1780340822.591492:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2406:x1866818940450304:12345-192.168.203.16@tcp:38:kworker.0 00010000:02000400:2.0:1780340822.591521:0:64454:0:(ldlm_lib.c:951:target_handle_reconnect()) lustre-MDT0001: Client 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 (at 192.168.203.16@tcp) reconnecting 00000100:00100000:1.0:1780340822.596393:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1334 00000100:00100000:1.0:1780340822.596407:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940450176:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:1.0:1780340822.596433:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340822.596518:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940450176:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 112us (8442us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340822.596525:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1334 00000100:00080000:1.0:1780340822.596555:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1780340822.619973:0:64454:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0001: connection from 7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp t0 exp ffff8c047b1fc000 cur 3602 last 1780340822 00000004:00100000:2.0:1780340822.620023:0:64454:0:(mdt_handler.c:7301:mdt_connect_internal()) lustre-MDT0001: cli 192.168.203.16@tcp supports cksum type f7, return f7 00000100:00080000:2.0:1780340822.620094:0:64454:0:(import.c:65:import_set_state_nolock()) ffff8c046b9ad000 : changing import state from FULL to RECOVER 00000100:00080000:2.0:1780340822.620107:0:64454:0:(import.c:65:import_set_state_nolock()) ffff8c046b9ad000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340822.620213:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2406:x1866818940450304:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 28720us (32115us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340822.620227:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1341 00000100:00100000:1.0:1780340822.634262:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340822.634328:0:63719:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940447872 00000100:00100000:1.0:1780340822.634338:0:63719:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940447872 00000100:00100000:1.0:1780340822.634393:0:63719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:1.0:1780340822.634404:0:63719:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:70364:x1866818940447872:12345-192.168.203.16@tcp:700:cp.0 00000100:00080000:1.0:1780340822.634464:0:63719:0:(client.c:1831:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8c0444225500 x1866818961159808/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340822.634475:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00010000:00010000:1.0:1780340822.923719:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340823.435316:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:0.0:1780340823.708034:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00010000:00010000:1.0:1780340823.946344:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340824.476992:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:1.0:1780340824.715981:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00010000:00010000:1.0:1780340824.971087:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340825.487349:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:0.0:1780340825.746222:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00010000:00010000:0.0:1780340825.993931:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1780340825.998828:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340825.998834:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340825.998838:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340825.998845:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3600 00000100:00080000:0.0:1780340825.998851:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1780340825.998858:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340825.998880:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034cc8f800 x1866818961160064/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340825.998910:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340825.998913:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340825.998915:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340825.998918:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3600 00000100:00080000:0.0:1780340825.998931:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1780340825.998935:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340825.998945:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034cc8c380 x1866818961160320/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340825.998960:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340825.998963:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340825.998964:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340825.998967:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3600 00000100:00080000:0.0:1780340825.998970:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1780340825.998972:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340825.998994:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034cc8ea00 x1866818961160576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340825.999012:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340825.999015:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340825.999016:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340825.999019:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3600 00000100:00080000:0.0:1780340825.999022:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1780340825.999024:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340825.999033:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034cc8e680 x1866818961160960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340825.999065:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961160704:0@lo:400:kworker.0 00000100:00100000:0.0:1780340825.999149:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340825.999188:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1780340825.999194:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961159936:0@lo:400:kworker.0 00000400:00000100:0.0:1780340825.999214:0:3659:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961159936 offset 0 length 224: 4 00000100:00100000:0.0:1780340825.999234:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961160832:0@lo:400:kworker.0 00000100:00100000:0.0:1780340825.999251:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340825.999274:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961160064:0@lo:38:kworker.0 00000100:00100000:0.0:1780340825.999298:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340825.999317:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961160320:0@lo:38:kworker.0 00000100:00100000:0.0:1780340825.999340:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340825.999354:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961160576:0@lo:38:kworker.0 00000100:00100000:0.0:1780340825.999391:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340825.999405:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961160960:0@lo:38:kworker.0 00000100:00100000:0.0:1780340825.999432:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340825.999457:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961160192:0@lo:400:kworker.0 00000100:00100000:0.0:1780340825.999477:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340825.999491:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780340825.999495:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961160448:0@lo:400:kworker.0 00000100:00100000:0.0:1780340825.999513:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340825.999548:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961160704 00000100:00100000:0.0:1780340825.999556:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961160704 00000100:00100000:0.0:1780340825.999602:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961160832 00000100:00100000:0.0:1780340825.999605:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961160832 00000100:00100000:0.0:1780340825.999623:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:0.0:1780340825.999631:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961160704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340825.999681:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961160704:12345-0@lo:400:kworker.0 Request processed in 51us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340825.999687:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:0.0:1780340825.999703:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:0.0:1780340825.999708:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961160832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340825.999736:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961160832:12345-0@lo:400:kworker.0 Request processed in 28us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340825.999742:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:0.0:1780340825.999784:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961160064 00000100:00100000:0.0:1780340825.999787:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961160064 00000100:00100000:0.0:1780340825.999799:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961160320 00000100:00100000:0.0:1780340825.999801:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961160320 00000100:00100000:0.0:1780340825.999806:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961160960 00000100:00100000:0.0:1780340825.999809:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961160960 00000100:00100000:0.0:1780340825.999815:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961160192 00000100:00100000:0.0:1780340825.999816:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961160192 00000100:00100000:0.0:1780340825.999841:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961160448 00000100:00100000:0.0:1780340825.999843:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961160448 00000100:00100000:0.0:1780340825.999856:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1780340825.999861:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961160192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340825.999895:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961160192:12345-0@lo:400:kworker.0 Request processed in 33us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340825.999900:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1780340825.999912:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1780340825.999917:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961160448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340825.999956:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961160448:12345-0@lo:400:kworker.0 Request processed in 38us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340825.999961:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1780340825.999972:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:0.0:1780340825.999976:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961160064:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340825.999992:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340826.000024:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961160064:12345-0@lo:38:kworker.0 Request processed in 46us (725us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340826.000030:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:0.0:1780340826.000041:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1780340826.000045:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961160320:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340826.000054:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340826.000076:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961160320:12345-0@lo:38:kworker.0 Request processed in 30us (734us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340826.000081:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1780340826.000091:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1780340826.000095:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961160960:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340826.000111:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340826.000133:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961160960:12345-0@lo:38:kworker.0 Request processed in 37us (701us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340826.000139:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1780340826.000175:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961160448:0@lo:400:kworker.0 00000100:00100000:0.0:1780340826.000185:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961160192:0@lo:400:kworker.0 00000100:00080000:0.0:1780340826.000214:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340826.000218:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340826.000221:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961160064:0@lo:38:kworker.0 00000100:00080000:0.0:1780340826.000228:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340826.000231:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340826.000234:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961160320:0@lo:38:kworker.0 00000100:00080000:0.0:1780340826.000240:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340826.000243:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340826.000246:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961160960:0@lo:38:kworker.0 00000100:00100000:0.0:1780340826.000266:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961160832:0@lo:400:kworker.0 00000100:00100000:0.0:1780340826.000275:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961160704:0@lo:400:kworker.0 00000100:00100000:1.0:1780340826.000442:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961160576 00000100:00100000:1.0:1780340826.000446:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961160576 00000100:00100000:1.0:1780340826.000479:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877 00000100:00100000:1.0:1780340826.000484:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961160576:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340826.000494:0:8411:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340826.000534:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961160576:12345-0@lo:38:kworker.0 Request processed in 49us (1143us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340826.000540:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877 00000100:00080000:1.0:1780340826.000560:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780340826.000564:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340826.000566:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780340826.000584:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340826.000588:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340826.000591:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961160576:0@lo:38:kworker.0 00000100:00100000:2.0:1780340826.508047:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:1.0:1780340826.767542:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00010000:00010000:0.0:1780340827.027104:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1780340827.027189:0:3659:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780340810/real 1780340810] req@ffff8c045ecbdf80 x1866818961154816/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780340826 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340827.027227:0:3659:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8c045ecbdf80 x1866818961154816/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780340826 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340827.027237:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1780340827.027242:0:3659:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1780340827.027245:0:3659:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.116@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1780340827.027247:0:3659:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1780340827.027272:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c045ecbdf80 x1866818961154816/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780340826 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340827.027281:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c047207fb80 x1866818961156992/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340831 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340827.027300:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c0444227800 x1866818961158400/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340836 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340827.027311:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c034cc8c700 x1866818961159936/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340841 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1780340827.027320:0:3659:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1780340827.027323:0:3659:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1780340827.027325:0:3659:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1780340827.027327:0:3659:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1780340827.027356:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961159936:0@lo:400:kworker.0 00000100:00100000:1.0:1780340827.027362:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961154816:0@lo:400:kworker.0 00000100:00080000:1.0:1780340827.027391:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340827.027396:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1780340827.027399:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340827.027403:0:80497:0:(import.c:512:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 3554 00000100:00080000:1.0:1780340827.027411:0:80497:0:(import.c:626:import_select_connection()) MGC192.168.203.116@tcp: import ffff8c0475490800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340827.027439:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0444224000 x1866818961161088/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340827.027457:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340827.027460:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340827.027462:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340827.027465:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3605 00000100:00080000:1.0:1780340827.027468:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340827.027472:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340827.027493:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0444224380 x1866818961161216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340827.027510:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340827.027513:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340827.027515:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340827.027518:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3605 00000100:00080000:1.0:1780340827.027520:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340827.027524:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340827.027534:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0444227b80 x1866818961161472/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340827.027549:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340827.027552:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340827.027553:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340827.027556:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3605 00000100:00080000:1.0:1780340827.027559:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340827.027563:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340827.027573:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0444225f80 x1866818961161728/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340827.027644:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340827.027648:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340827.027650:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340827.027653:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3605 00000100:00080000:1.0:1780340827.027656:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340827.027658:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340827.027676:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d4cad80 x1866818961162112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340827.027700:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961161088:0@lo:250:kworker.0 00000400:00000100:1.0:1780340827.027746:0:3658:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961161088 offset 0 length 520: 4 00000100:00100000:1.0:1780340827.027803:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961161216:0@lo:38:kworker.0 00000100:00100000:1.0:1780340827.027836:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340827.027855:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961161472:0@lo:38:kworker.0 00000100:00100000:1.0:1780340827.027875:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340827.027889:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961161728:0@lo:38:kworker.0 00000100:00100000:1.0:1780340827.027911:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340827.027944:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961162112:0@lo:38:kworker.0 00000100:00100000:1.0:1780340827.027964:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340827.027989:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961161856:0@lo:400:kworker.0 00000100:00100000:1.0:1780340827.028014:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340827.028030:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340827.028036:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961161984:0@lo:400:kworker.0 00000100:00100000:1.0:1780340827.028054:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340827.028084:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961161728 00000100:00100000:1.0:1780340827.028093:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961161728 00000100:00100000:1.0:1780340827.028129:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3878 00000100:00100000:1.0:1780340827.028138:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a205500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961161728:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340827.028159:0:26074:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340827.028199:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a205500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961161728:12345-0@lo:38:kworker.0 Request processed in 60us (285us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340827.028216:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3878 00000100:00100000:1.0:1780340827.028238:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961161216 00000100:00100000:1.0:1780340827.028243:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961161216 00000100:00100000:1.0:1780340827.028260:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961161472 00000100:00100000:1.0:1780340827.028263:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961161472 00000100:00100000:1.0:1780340827.028275:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961162112 00000100:00100000:1.0:1780340827.028277:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961162112 00000100:00100000:1.0:1780340827.028286:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:1.0:1780340827.028291:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961161216:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340827.028301:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340827.028329:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961161216:12345-0@lo:38:kworker.0 Request processed in 37us (493us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340827.028335:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:1.0:1780340827.028346:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:1.0:1780340827.028350:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961161472:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340827.028359:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340827.028382:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a204a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961161472:12345-0@lo:38:kworker.0 Request processed in 31us (506us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340827.028387:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:1.0:1780340827.028398:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1780340827.028402:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961162112:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340827.028411:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340827.028432:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a207b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961162112:12345-0@lo:38:kworker.0 Request processed in 29us (467us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340827.028438:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:1.0:1780340827.028454:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961161856 00000100:00100000:1.0:1780340827.028464:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961161856 00000100:00100000:1.0:1780340827.028501:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961161984 00000100:00100000:1.0:1780340827.028504:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961161984 00000100:00100000:1.0:1780340827.028524:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1780340827.028530:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961161856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340827.028573:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961161856:12345-0@lo:400:kworker.0 Request processed in 44us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340827.028579:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1780340827.028590:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:1.0:1780340827.028595:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a204e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961161984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340827.028618:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a204e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961161984:12345-0@lo:400:kworker.0 Request processed in 24us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340827.028623:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00080000:1.0:1780340827.028659:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340827.028663:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340827.028667:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961161216:0@lo:38:kworker.0 00000100:00080000:1.0:1780340827.028691:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340827.028695:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340827.028698:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961161472:0@lo:38:kworker.0 00000100:00080000:1.0:1780340827.028707:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340827.028710:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340827.028712:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961161728:0@lo:38:kworker.0 00000100:00080000:1.0:1780340827.028720:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340827.028722:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340827.028725:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961162112:0@lo:38:kworker.0 00000100:00080000:1.0:1780340827.028789:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340827.028793:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340827.028813:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961161984:0@lo:400:kworker.0 00000100:00100000:1.0:1780340827.028823:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961161856:0@lo:400:kworker.0 00000100:00100000:0.0:1780340827.028912:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961161344:0@lo:400:kworker.0 00000100:00100000:0.0:1780340827.028956:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340827.028991:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961156992:0@lo:400:kworker.0 00000100:00100000:0.0:1780340827.029005:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780340827.029019:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961161600:0@lo:400:kworker.0 00000100:00100000:0.0:1780340827.029043:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340827.029072:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961158400:0@lo:400:kworker.0 00000100:00100000:0.0:1780340827.029092:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961161344 00000100:00100000:0.0:1780340827.029096:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961161344 00000100:00100000:0.0:1780340827.029138:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961161600 00000100:00100000:0.0:1780340827.029141:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961161600 00000100:00100000:0.0:1780340827.029157:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:0.0:1780340827.029163:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961161344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340827.029197:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961161344:12345-0@lo:400:kworker.0 Request processed in 35us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340827.029204:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:0.0:1780340827.029217:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:0.0:1780340827.029223:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961161600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340827.029248:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961161600:12345-0@lo:400:kworker.0 Request processed in 26us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340827.029253:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:0.0:1780340827.029291:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961161600:0@lo:400:kworker.0 00000100:00100000:0.0:1780340827.029301:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444226680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961161344:0@lo:400:kworker.0 00000100:00080000:2.0:1780340827.029328:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340827.530972:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:0.0:1780340827.537352:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961162368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340827.537429:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340827.537465:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340827.537472:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961162240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340827.537496:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340827.537550:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961162368 00000100:00100000:0.0:1780340827.537563:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961162368 00000100:00100000:0.0:1780340827.537601:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084 00000100:00100000:0.0:1780340827.537622:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961162368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340827.537651:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340827.537693:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961162368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340827.537700:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084 00000100:00100000:0.0:1780340827.537715:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961162240 00000100:00100000:0.0:1780340827.537718:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961162240 00000100:00100000:0.0:1780340827.537739:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085 00000100:00100000:0.0:1780340827.537743:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961162240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340827.537779:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340827.537819:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961162240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340827.537825:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085 00000100:00100000:0.0:1780340827.537867:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961162240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340827.537878:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961162368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340827.713712:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340827.713755:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940451072 00000100:00100000:0.0:1780340827.713782:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940451072 00000100:00100000:0.0:1780340827.714206:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1346 00000100:00100000:0.0:1780340827.714219:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2409:x1866818940451072:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340827.714552:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2409:x1866818940451072:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 334us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340827.714560:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1346 00000100:00080000:2.0:1780340827.714614:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:0.0:1780340827.716957:0:3653:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940450816 offset 0 length 224: 4 00000100:00100000:0.0:1780340827.717182:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340827.717217:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340827.717254:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340827.717281:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940450944 00000100:00100000:0.0:1780340827.717301:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940450944 00000100:00100000:0.0:1780340827.717345:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1341 00000100:00100000:0.0:1780340827.717353:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1866818940450944:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:0.0:1780340827.717375:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340827.717480:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1866818940450944:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 126us (299us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340827.717486:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1341 00000100:00100000:0.0:1780340827.717510:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940451200 00000100:00100000:0.0:1780340827.717514:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940451200 00000100:00100000:0.0:1780340827.717551:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940451328 00000100:00100000:0.0:1780340827.717554:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940451328 00000100:00080000:2.0:1780340827.717568:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340827.717573:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340827.717581:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5908 00000100:00100000:0.0:1780340827.717588:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04776c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2406:x1866818940451200:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:0.0:1780340827.717619:0:8400:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327748e7 00000100:00080000:0.0:1780340827.717629:0:8400:0:(import.c:65:import_set_state_nolock()) ffff8c0475faf800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1780340827.717683:0:8400:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969454 00000100:00100000:0.0:1780340827.717881:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04776c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+2:2406:x1866818940451200:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 293us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340827.717889:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5908 00000100:00100000:3.0:1780340827.718276:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5909 00000100:00100000:3.0:1780340827.718288:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2406:x1866818940451328:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:3.0:1780340827.718304:0:25492:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327748ee 00000100:00080000:3.0:1780340827.718309:0:25492:0:(import.c:65:import_set_state_nolock()) ffff8c0447db2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780340827.718345:0:25492:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969453 00000100:00100000:3.0:1780340827.719282:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+2:2406:x1866818940451328:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 988us (2018us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340827.719294:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5909 00010000:00010000:3.0:1780340827.719522:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340827.719986:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340827.785849:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00010000:00010000:1.0:1780340828.042951:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340828.572145:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000400:00000100:1.0:1780340828.717168:0:3653:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940451456 offset 0 length 520: 4 00000100:00100000:1.0:1780340828.717211:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340828.717248:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340828.717281:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940451712 00000100:00100000:1.0:1780340828.717291:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940451712 00000100:00100000:1.0:1780340828.717345:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940451584 00000100:00100000:1.0:1780340828.717348:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940451584 00000100:00100000:1.0:1780340828.717370:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1347 00000100:00100000:1.0:1780340828.717381:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2408:x1866818940451712:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340828.717465:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a206680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2408:x1866818940451712:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 87us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340828.717473:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1347 00000100:00100000:1.0:1780340828.717491:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1342 00000100:00100000:1.0:1780340828.717497:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940451584:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:1.0:1780340828.717518:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340828.717543:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a205c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940451584:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 45us (294us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340828.717550:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1342 00000100:00100000:1.0:1780340828.809886:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00010000:00010000:0.0:1780340829.068147:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340829.069244:0:63720:0:(service.c:3465:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:0.0:1780340829.069262:0:63720:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000020:01000004:3.0:1780340829.463412:0:88665:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1780340829.463417:0:88665:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1780340829.463423:0:88665:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1780340829.463542:0:88665:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8c0471e4b800 00000020:01000004:3.0:1780340829.463557:0:88665:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1780340829.463570:0:88665:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1780340829.463582:0:88665:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8c047658b380) 00000020:00000080:3.0:1780340829.463598:0:88665:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1780340829.543883:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1780340829.545074:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1780340829.549406:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1780340829.549599:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1780340829.549982:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1780340829.550286:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1780340829.550582:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1780340829.550909:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1780340829.551168:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1780340829.551402:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1780340829.551587:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1780340829.551989:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1780340829.552409:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1780340829.552640:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1780340829.552940:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1780340829.553237:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1780340829.553475:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1780340829.553698:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1780340829.554080:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1780340829.554303:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1780340829.554610:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1780340829.554916:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1780340829.555152:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1780340829.555493:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1780340829.555707:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1780340829.556150:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1780340829.556409:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1780340829.556636:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1780340829.556936:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1780340829.557176:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1780340829.557474:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1780340829.557658:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1780340829.558177:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1780340829.558606:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1780340829.561075:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1780340829.561570:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1780340829.561746:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1780340829.562493:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1780340829.562682:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1780340829.563077:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1780340829.563394:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1780340829.563629:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1780340829.563971:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1780340829.564288:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1780340829.564593:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1780340829.564991:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1780340829.565400:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1780340829.565998:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1780340829.566575:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1780340829.566929:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1780340829.567431:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1780340829.567641:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1780340829.567939:0:88665:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:1.0:1780340829.569088:0:88665:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1780340829.569302:0:88665:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1780340829.569310:0:88665:0:(osd_handler.c:8933:osd_obd_connect()) connect #0 00000020:00000080:1.0:1780340829.569331:0:88665:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa2465143277497a 00000020:01000004:1.0:1780340829.569337:0:88665:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1780340829.569351:0:88665:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1780340829.569365:0:88665:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c0471e4b800 from MGS 00000020:01000004:1.0:1780340829.569368:0:88665:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1780340829.569378:0:88665:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8c0445ba4d40) 00000020:00000080:1.0:1780340829.569390:0:88665:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1780340829.569457:0:88665:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0471e4b800 from MGS, refs=2 00080000:01000000:1.0:1780340829.569462:0:88665:0:(osd_handler.c:8933:osd_obd_connect()) connect #1 00000020:00000080:1.0:1780340829.569467:0:88665:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432774988 00010000:00010000:1.0:1780340829.569586:0:88665:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1780340829.574911:0:88665:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00000100:00100000:0.0:1780340829.579348:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 10000000:01000000:0.0:1780340829.586102:0:88669:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1780340829.586164:0:88665:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1780340829.586212:0:88665:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1780340829.586969:0:88665:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1780340829.587412:0:88665:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1780340829.587572:0:88665:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1780340829.587579:0:88665:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1780340829.588270:0:88665:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1780340829.588278:0:88665:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1780340829.591634:0:88665:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1780340829.591645:0:88665:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1780340829.592451:0:88665:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1780340829.592473:0:88665:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1780340829.592475:0:88665:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.116@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1780340829.592478:0:88665:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.116@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1780340829.592484:0:88665:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8c0475490800 already not connected (conn 64, was 0): CONNECTING 00000100:00100000:1.0:1780340829.592489:0:88665:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000100:00100000:1.0:1780340829.833885:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00010000:00010000:0.0:1780340830.089928:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340830.606164:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:0.0:1780340830.858495:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00010000:00010000:1.0:1780340831.114520:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340831.625878:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:0.0:1780340831.881863:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00000100:00080000:2.0:1780340832.138405:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340832.138412:0:71335:0:(pinger.c:249:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1780340832.138415:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340832.138419:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340832.138423:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340832.138431:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3607 00000100:00080000:2.0:1780340832.138435:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340832.138442:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340832.138477:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c045f16c000 x1866818961162496/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340832.138526:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340832.138530:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340832.138532:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340832.138535:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3607 00000100:00080000:2.0:1780340832.138550:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340832.138554:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340832.138564:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c045f16fb80 x1866818961162752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340832.138785:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961162496:0@lo:38:kworker.0 00000100:00100000:1.0:1780340832.138847:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340832.138873:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961162752:0@lo:38:kworker.0 00000100:00100000:1.0:1780340832.138903:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340832.138936:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961162496 00000100:00100000:1.0:1780340832.138943:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961162496 00000100:00100000:1.0:1780340832.138979:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961162752 00000100:00100000:1.0:1780340832.138982:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961162752 00000100:00100000:1.0:1780340832.138997:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:1.0:1780340832.139010:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961162496:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340832.139031:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340832.139072:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961162496:12345-0@lo:38:kworker.0 Request processed in 60us (223us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340832.139079:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:1.0:1780340832.139094:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:1.0:1780340832.139098:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961162752:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340832.139106:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340832.139127:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a204700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961162752:12345-0@lo:38:kworker.0 Request processed in 28us (224us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340832.139132:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00080000:1.0:1780340832.139168:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340832.139172:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340832.139176:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961162496:0@lo:38:kworker.0 00000100:00080000:1.0:1780340832.139183:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340832.139186:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340832.139188:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961162752:0@lo:38:kworker.0 00000100:00100000:3.0:1780340832.139342:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961162624:0@lo:400:kworker.0 00000100:00100000:3.0:1780340832.139382:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340832.139410:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340832.139416:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961162880:0@lo:400:kworker.0 00000100:00100000:3.0:1780340832.139435:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340832.139459:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961162624 00000100:00100000:3.0:1780340832.139463:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961162624 00000100:00100000:3.0:1780340832.139500:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961162880 00000100:00100000:3.0:1780340832.139503:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961162880 00000100:00100000:3.0:1780340832.139521:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:3.0:1780340832.139528:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961162624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340832.139569:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961162624:12345-0@lo:400:kworker.0 Request processed in 41us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340832.139576:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:3.0:1780340832.139960:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:3.0:1780340832.139969:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961162880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340832.140001:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961162880:12345-0@lo:400:kworker.0 Request processed in 34us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340832.140007:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:3.0:1780340832.140041:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961162880:0@lo:400:kworker.0 00000100:00100000:3.0:1780340832.140051:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961162624:0@lo:400:kworker.0 00000100:00080000:3.0:1780340832.140089:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340832.140249:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340832.140257:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340832.140260:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340832.140265:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3607 00000100:00080000:2.0:1780340832.140269:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340832.140273:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340832.140306:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c045f16d180 x1866818961163008/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340832.140350:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340832.140353:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:1.0:1780340832.140464:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961163008:0@lo:38:kworker.0 00000100:00100000:1.0:1780340832.140494:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340832.140525:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961163008 00000100:00100000:1.0:1780340832.140528:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961163008 00000100:00100000:1.0:1780340832.140546:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3879 00000100:00100000:1.0:1780340832.140551:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a205880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961163008:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340832.140565:0:8411:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340832.140612:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a205880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961163008:12345-0@lo:38:kworker.0 Request processed in 60us (116us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340832.140618:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3879 00000100:00080000:1.0:1780340832.140639:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340832.140643:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340832.140646:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961163008:0@lo:38:kworker.0 00000100:00080000:2.0:1780340832.140778:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340832.140783:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3607 00000100:00080000:2.0:1780340832.140785:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340832.140789:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340832.140803:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c045f16fb80 x1866818961163392/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340832.140875:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961163136:0@lo:400:kworker.0 00000100:00100000:3.0:1780340832.140913:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340832.140938:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340832.140943:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961163264:0@lo:400:kworker.0 00000100:00100000:3.0:1780340832.140969:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340832.140994:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961163136 00000100:00100000:3.0:1780340832.140998:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961163136 00000100:00100000:3.0:1780340832.141024:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961163264 00000100:00100000:3.0:1780340832.141027:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961163264 00000100:00100000:3.0:1780340832.141042:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:3.0:1780340832.141049:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961163136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340832.141084:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961163136:12345-0@lo:400:kworker.0 Request processed in 36us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340832.141090:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:3.0:1780340832.141102:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:3.0:1780340832.141108:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961163264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340832.141136:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961163264:12345-0@lo:400:kworker.0 Request processed in 29us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340832.141140:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00080000:3.0:1780340832.141153:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340832.141156:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340832.141171:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961163264:0@lo:400:kworker.0 00000100:00100000:3.0:1780340832.141180:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961163136:0@lo:400:kworker.0 00010000:00010000:0.0:1780340832.142802:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340832.143091:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961163392:0@lo:38:kworker.0 00000100:00100000:1.0:1780340832.143147:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340832.143273:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961163392 00000100:00100000:3.0:1780340832.143281:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961163392 00000100:00100000:3.0:1780340832.143337:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:3.0:1780340832.143343:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961163392:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1780340832.143516:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340832.143567:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a206300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961163392:12345-0@lo:38:kworker.0 Request processed in 223us (420us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340832.143575:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00080000:1.0:1780340832.143660:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340832.143665:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340832.143669:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961163392:0@lo:38:kworker.0 00000100:00100000:0.0:1780340832.650043:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340832.650064:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961163520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340832.650125:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340832.650185:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961163520 00000100:00100000:0.0:1780340832.650192:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961163520 00000100:00100000:0.0:1780340832.650239:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2086 00000100:00100000:0.0:1780340832.650247:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961163520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340832.650274:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340832.650310:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961163520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340832.650316:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2086 00000100:00100000:0.0:1780340832.650374:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961163520:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340832.651427:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:3.0:1780340832.655067:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340832.655089:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961163648:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340832.655188:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340832.655286:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961163648 00000100:00100000:2.0:1780340832.655294:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961163648 00000100:00100000:2.0:1780340832.655942:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087 00000100:00100000:2.0:1780340832.655957:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961163648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340832.655988:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340832.656054:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961163648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340832.656061:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087 00000100:00100000:1.0:1780340832.656162:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961163648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340832.743972:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340832.744015:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340832.744154:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940451840 00000100:00100000:1.0:1780340832.744154:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940451968 00000100:00100000:3.0:1780340832.744163:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940451840 00000100:00100000:1.0:1780340832.744163:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940451968 00000100:00100000:3.0:1780340832.744204:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1346 00000100:00100000:3.0:1780340832.744212:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1866818940451840:12345-192.168.203.16@tcp:38:kworker.0 00000100:00100000:1.0:1780340832.744221:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1350 00000100:00100000:1.0:1780340832.744227:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2409:x1866818940451968:12345-192.168.203.16@tcp:400:kworker.0 00010000:00020000:3.0:1780340832.744235:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1780340832.744297:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340832.744361:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2406:x1866818940451840:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 147us (398us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340832.744368:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1346 00000100:00100000:1.0:1780340832.749831:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2409:x1866818940451968:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 5592us (5803us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340832.749845:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1350 00000100:00100000:0.0:1780340832.905915:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00010000:00010000:1.0:1780340833.162291:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340833.673900:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:2.0:1780340833.773994:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340833.774035:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340833.774226:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940452224 00000100:00100000:0.0:1780340833.774236:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940452224 00000100:00100000:0.0:1780340833.774291:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940452096 00000100:00100000:0.0:1780340833.774294:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940452096 00000100:00100000:0.0:1780340833.774325:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1351 00000100:00100000:0.0:1780340833.774335:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2408:x1866818940452224:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340833.774401:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2408:x1866818940452224:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 68us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340833.774409:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1351 00000100:00100000:0.0:1780340833.774429:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1347 00000100:00100000:0.0:1780340833.774435:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2406:x1866818940452096:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:0.0:1780340833.774454:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340833.774481:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2406:x1866818940452096:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 46us (445us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340833.774489:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1347 00000100:00100000:0.0:1780340833.930446:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00010000:00010000:0.0:1780340834.185948:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1780340834.197188:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000020:00000080:2.0:1780340834.197204:0:8395:0:(genops.c:906:class_export_put()) final put ffff8c0475faa800/7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000020:00000080:1.0:1780340834.197417:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0475faa800/7d14eb83-fa7c-40d9-843e-6367bec0a7b4 for lustre-OST0000 00000020:00000080:1.0:1780340834.197504:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0475faf800 for lustre-OST0000 00000001:00100000:2.0:1780340834.198653:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000020:00000080:2.0:1780340834.198660:0:9462:0:(genops.c:906:class_export_put()) final put ffff8c04480ad000/7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000020:00000080:3.0:1780340834.199721:0:49688:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04480ad000/7d14eb83-fa7c-40d9-843e-6367bec0a7b4 for lustre-OST0001 00000020:00000080:3.0:1780340834.200158:0:49688:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0447db2800 for lustre-OST0001 00000100:00100000:0.0:1780340834.698029:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:0.0:1780340834.953953:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00010000:00010000:0.0:1780340835.210136:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340835.723536:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:0.0:1780340835.978662:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00010000:00010000:2.0:1780340836.234023:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340836.746023:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:0.0:1780340837.002224:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00000100:00100000:2.0:1780340837.258107:0:3658:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780340827/real 1780340827] req@ffff8c0444224000 x1866818961161088/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780340837 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340837.258173:0:3658:0:(client.c:2511:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c0444224000 x1866818961161088/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780340837 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340837.258192:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340837.258200:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1780340837.258212:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961161088:0@lo:250:kworker.0 10000000:01000000:0.0:1780340837.258386:0:88665:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1780340837.258405:0:88665:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2200/0xa24651432774560 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774567 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340837.258417:0:88665:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2200/0xa24651432774560 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774567 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340837.258424:0:88665:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1780340837.258444:0:88665:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340837.258453:0:88665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2200/0xa24651432774560 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774567 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.258470:0:88665:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa246514327744c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xa246514327744cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340837.258477:0:88665:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa246514327744c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xa246514327744cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340837.258482:0:88665:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340837.258485:0:88665:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340837.258489:0:88665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa246514327744c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xa246514327744cd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.258496:0:88665:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04497b7600/0xa246514327744e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xa246514327744e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340837.258501:0:88665:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04497b7600/0xa246514327744e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xa246514327744e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340837.258506:0:88665:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340837.258509:0:88665:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340837.258548:0:88665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04497b7600/0xa246514327744e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xa246514327744e9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.258561:0:88665:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c03476f9a00/0xa2465143277450c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774513 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340837.258567:0:88665:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c03476f9a00/0xa2465143277450c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774513 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340837.258572:0:88665:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340837.258575:0:88665:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340837.258578:0:88665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c03476f9a00/0xa2465143277450c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774513 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.258586:0:88665:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04497b7c00/0xa2465143277451a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774521 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340837.258592:0:88665:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04497b7c00/0xa2465143277451a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774521 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340837.258597:0:88665:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340837.258601:0:88665:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340837.258604:0:88665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04497b7c00/0xa2465143277451a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774521 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.258612:0:88665:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c047a32a600/0xa24651432774536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xa2465143277453d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340837.258617:0:88665:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c047a32a600/0xa24651432774536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xa2465143277453d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340837.258622:0:88665:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340837.258630:0:88665:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340837.258634:0:88665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c047a32a600/0xa24651432774536 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xa2465143277453d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.258641:0:88665:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa24651432774544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xa2465143277454b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340837.258647:0:88665:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa24651432774544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xa2465143277454b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340837.258652:0:88665:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340837.258655:0:88665:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340837.258657:0:88665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa24651432774544 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xa2465143277454b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.258665:0:88665:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2800/0xa2465143277456e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774575 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340837.258671:0:88665:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2800/0xa2465143277456e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774575 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340837.258675:0:88665:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340837.258678:0:88665:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340837.258680:0:88665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2800/0xa2465143277456e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774575 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.258690:0:88665:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04497b6000/0xa246514327744d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa246514327744db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340837.258696:0:88665:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04497b6000/0xa246514327744d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa246514327744db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340837.258710:0:88665:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340837.258713:0:88665:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340837.258717:0:88665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04497b6000/0xa246514327744d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa246514327744db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.258726:0:88665:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c047a32aa00/0xa246514327744f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa246514327744f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340837.258731:0:88665:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c047a32aa00/0xa246514327744f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa246514327744f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340837.258736:0:88665:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340837.258738:0:88665:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340837.258740:0:88665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c047a32aa00/0xa246514327744f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa246514327744f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.258750:0:88665:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa246514327744fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340837.258756:0:88665:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa246514327744fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340837.258802:0:88665:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1780340837.258805:0:88665:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340837.258809:0:88665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa246514327744fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774505 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.258818:0:88665:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c03476f8a00/0xa24651432774528 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xa2465143277452f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340837.258834:0:88665:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c03476f8a00/0xa24651432774528 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xa2465143277452f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340837.258848:0:88665:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1780340837.258852:0:88665:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340837.258856:0:88665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c03476f8a00/0xa24651432774528 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xa2465143277452f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.258864:0:88665:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa24651432774552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774559 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340837.258871:0:88665:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa24651432774552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774559 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340837.258876:0:88665:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1780340837.258878:0:88665:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340837.258881:0:88665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c047a32b400/0xa24651432774552 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774559 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1780340837.258896:0:88665:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8c0475490800 already not connected (conn 64, was 0): DISCONN 00000100:00080000:0.0:1780340837.258902:0:88665:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340837.258907:0:88665:0:(import.c:512:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 3607 00000100:00080000:0.0:1780340837.258912:0:88665:0:(import.c:591:import_select_connection()) MGC192.168.203.116@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1780340837.258917:0:88665:0:(import.c:626:import_select_connection()) MGC192.168.203.116@tcp: import ffff8c0475490800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340837.258948:0:88665:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c048583d180 x1866818961163776/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340837.258966:0:88665:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00010000:00010000:0.0:1780340837.259012:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1780340837.259277:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340837.259283:0:71335:0:(pinger.c:249:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1780340837.259294:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340837.259298:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340837.259300:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340837.259304:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3612 00000100:00080000:1.0:1780340837.259307:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340837.259311:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340837.259330:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034a205f80 x1866818961163904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340837.259369:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340837.259373:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340837.259374:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340837.259377:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3612 00000100:00080000:1.0:1780340837.259380:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340837.259383:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340837.259396:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034a204380 x1866818961164160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340837.259410:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340837.259413:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340837.259414:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340837.259416:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3612 00000100:00080000:1.0:1780340837.259418:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340837.259440:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340837.259453:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d4c9180 x1866818961164416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340837.259495:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340837.259498:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1780340837.259500:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340837.259504:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3612 00000100:00080000:1.0:1780340837.259506:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1780340837.259510:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340837.259519:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d4cb800 x1866818961164800/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340837.259541:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961164544:0@lo:400:kworker.0 00000100:00100000:1.0:1780340837.259638:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340837.259685:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340837.259692:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961164672:0@lo:400:kworker.0 00000100:00100000:1.0:1780340837.259714:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340837.259747:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961164544 00000100:00100000:1.0:1780340837.259754:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961164544 00000100:00100000:1.0:1780340837.259822:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961164672 00000100:00100000:1.0:1780340837.259825:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961164672 00000100:00100000:1.0:1780340837.260071:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:1.0:1780340837.260080:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961164544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340837.260128:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961164544:12345-0@lo:400:kworker.0 Request processed in 49us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340837.260134:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00000100:00100000:1.0:1780340837.260148:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585 00000100:00100000:1.0:1780340837.260155:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961164672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340837.260179:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a206a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961164032:0@lo:400:kworker.0 00000100:00100000:1.0:1780340837.260197:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961164672:12345-0@lo:400:kworker.0 Request processed in 41us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340837.260211:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585 00000100:00100000:3.0:1780340837.260222:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340837.260302:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a204e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961164288:0@lo:400:kworker.0 00000100:00100000:1.0:1780340837.260364:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961164672:0@lo:400:kworker.0 00000100:00080000:2.0:1780340837.262193:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340837.262201:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340837.262221:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961163776:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1780340837.266156:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961164032 00000100:00100000:3.0:1780340837.266171:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961164032 00000100:00100000:3.0:1780340837.266282:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1780340837.266309:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961164032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340837.266400:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961164032:12345-0@lo:400:kworker.0 Request processed in 97us (6179us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340837.266408:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00080000:3.0:1780340837.266439:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340837.266475:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a206a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961164032:0@lo:400:kworker.0 00000100:00100000:0.0:1780340837.268558:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340837.268746:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961164544:0@lo:400:kworker.0 00000100:00100000:3.0:1780340837.272346:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961164288 00000100:00100000:3.0:1780340837.272362:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961164288 00000100:00100000:3.0:1780340837.272446:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:3.0:1780340837.272457:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961164288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340837.272558:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961164288:12345-0@lo:400:kworker.0 Request processed in 103us (4005us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340837.272566:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:3.0:1780340837.272625:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a204e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961164288:0@lo:400:kworker.0 00000100:00080000:0.0:1780340837.273233:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340837.273641:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340837.273743:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961163904:0@lo:38:kworker.0 00000100:00100000:2.0:1780340837.273809:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340837.273897:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961164160:0@lo:38:kworker.0 00000100:00100000:2.0:1780340837.273923:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340837.277154:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961163776 00000100:00100000:0.0:1780340837.277170:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961163776 00000100:00100000:0.0:1780340837.277220:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1780340837.277228:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3658:x1866818961163776:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1780340837.277256:0:88671:0:(ldlm_lib.c:1430:target_handle_connect()) MGS: connection from f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo t0 exp 0000000000000000 cur 3617 last 0 00000020:00000080:0.0:1780340837.277284:0:88671:0:(genops.c:1406:class_connect()) connect: client f26f7947-2bb0-4491-8dd4-005fa8e64f3a, cookie 0xa2465143277498f 00000100:00080000:0.0:1780340837.277423:0:88671:0:(import.c:65:import_set_state_nolock()) ffff8c047651f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340837.277505:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:3658:x1866818961163776:12345-0@lo:250:mount.lustre.0 Request processed in 275us (3864us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340837.277513:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1780340837.278232:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961164416:0@lo:38:kworker.0 00000100:00100000:2.0:1780340837.278274:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340837.278317:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961164800:0@lo:38:kworker.0 00000100:00100000:2.0:1780340837.278358:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340837.278421:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961164416 00000100:00100000:0.0:1780340837.278427:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961164416 00000100:00100000:0.0:1780340837.278453:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3880 00000100:00100000:0.0:1780340837.278458:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961164416:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340837.278475:0:26074:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340837.278505:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961164416:12345-0@lo:38:kworker.0 Request processed in 45us (230us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340837.278511:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3880 00000100:00100000:3.0:1780340837.281873:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961163904 00000100:00100000:3.0:1780340837.281889:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961163904 00000100:00100000:3.0:1780340837.281986:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961164160 00000100:00100000:3.0:1780340837.281990:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961164160 00000100:00100000:0.0:1780340837.283156:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:0.0:1780340837.283168:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961163904:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340837.283192:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340837.283281:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961163904:12345-0@lo:38:kworker.0 Request processed in 113us (9471us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340837.283306:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:0.0:1780340837.283330:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:0.0:1780340837.283335:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961164160:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340837.283345:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340837.283385:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961164160:12345-0@lo:38:kworker.0 Request processed in 49us (9461us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340837.283391:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:2.0:1780340837.284969:0:3658:0:(client.c:3102:ptlrpc_free_committed()) MGC192.168.203.116@tcp: committing for last_committed 0 gen 27 00000100:00080000:2.0:1780340837.284982:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.116@tcp: connect to target with instance 0 00000100:00080000:2.0:1780340837.284990:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1780340837.284995:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1780340837.284999:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1780340837.285003:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1780340837.285038:0:3658:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1780340837.285051:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961163776:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1780340837.285066:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340837.285070:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340837.285072:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961163904:0@lo:38:kworker.0 00000100:00080000:2.0:1780340837.285082:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340837.285084:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340837.285087:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a204380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961164160:0@lo:38:kworker.0 00000100:00080000:2.0:1780340837.285097:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340837.285100:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340837.285102:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961164416:0@lo:38:kworker.0 00000100:00080000:2.0:1780340837.285147:0:88665:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1780340837.285156:0:88665:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1780340837.285193:0:88665:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1780340837.285197:0:88665:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1780340837.285303:0:88665:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 0 is initialized 00000020:01000004:2.0:1780340837.285345:0:88665:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.116@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1780340837.285349:0:88665:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1780340837.285350:0:88665:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1780340837.285351:0:88665:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340837.285352:0:88665:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340837.285353:0:88665:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340837.285354:0:88665:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340837.285356:0:88665:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780340837.285357:0:88665:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1780340837.285359:0:88665:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340837.285360:0:88665:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1780340837.285362:0:88665:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1780340837.285365:0:88665:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1780340837.285366:0:88665:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1780340837.285367:0:88665:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340837.285368:0:88665:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340837.285369:0:88665:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340837.285370:0:88665:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340837.285371:0:88665:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780340837.285372:0:88665:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1780340837.285373:0:88665:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340837.285374:0:88665:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1780340837.285397:0:88665:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1780340837.285414:0:88665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961164928:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1780340837.285466:0:88665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340837.285489:0:88665:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443afbb40 going to sleep for 11 seconds 00000020:01000000:2.0:1780340837.285522:0:71335:0:(tgt_mount.c:1581:tgt_import_update()) NID #0: 192.168.203.116@tcp 10000000:01000000:2.0:1780340837.285533:0:71335:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1780340837.285536:0:71335:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1780340837.285537:0:71335:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1780340837.285538:0:71335:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340837.285539:0:71335:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340837.285540:0:71335:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340837.285542:0:71335:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340837.285543:0:71335:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780340837.285544:0:71335:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340837.285545:0:71335:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1780340837.285590:0:71335:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1780340837.285603:0:71335:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1780340837.285605:0:71335:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1780340837.285606:0:71335:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1780340837.285608:0:71335:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340837.285609:0:71335:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340837.285610:0:71335:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340837.285611:0:71335:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340837.285612:0:71335:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780340837.285613:0:71335:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340837.285614:0:71335:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1780340837.285628:0:71335:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1780340837.285632:0:71335:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1780340837.285634:0:71335:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1780340837.285635:0:71335:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1780340837.285637:0:71335:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340837.285638:0:71335:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340837.285639:0:71335:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340837.285640:0:71335:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340837.285641:0:71335:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780340837.285642:0:71335:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340837.285643:0:71335:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1780340837.285661:0:71335:0:(tgt_mount.c:1592:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1780340837.285678:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340837.285687:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0345eb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961165312:0@lo:253:kworker.0 00000100:00100000:2.0:1780340837.285715:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340837.285741:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961165184:0@lo:253:kworker.0 00000100:00100000:2.0:1780340837.285803:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340837.285821:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780340837.285826:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961165056:0@lo:253:kworker.0 00000100:00100000:2.0:1780340837.285863:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340837.285905:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961164928 00000100:00100000:2.0:1780340837.285911:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961164928 00000100:00100000:2.0:1780340837.285939:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961165312 00000100:00100000:2.0:1780340837.285941:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961165312 00000100:00100000:2.0:1780340837.285950:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961165184 00000100:00100000:2.0:1780340837.285957:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961165184 00000100:00100000:2.0:1780340837.285969:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961165056 00000100:00100000:2.0:1780340837.285971:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961165056 00000100:00100000:2.0:1780340837.285984:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1780340837.285991:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:88665:x1866818961164928:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1780340837.286030:0:88671:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1780340837.286033:0:88671:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1780340837.286035:0:88671:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:0.0:1780340837.286658:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1780340837.286669:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3660:x1866818961165312:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1780340837.286689:0:88673:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:0.0:1780340837.286718:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961164800 00000100:00100000:0.0:1780340837.286722:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961164800 00000100:00100000:0.0:1780340837.286751:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:0.0:1780340837.286756:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961164800:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340837.286791:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340837.286874:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961164800:12345-0@lo:38:kworker.0 Request processed in 116us (8514us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340837.286880:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00080000:0.0:1780340837.286925:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340837.286931:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340837.286934:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961164800:0@lo:38:kworker.0 10000000:01000000:0.0:1780340837.289945:0:88675:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1780340837.290660:0:88671:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 116 20000000:01000000:2.0:1780340837.293129:0:88676:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1780340837.293137:0:88676:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1780340837.293141:0:88676:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1780340837.293143:0:88676:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1780340837.293323:0:88676:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1780340837.296558:0:88671:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1780340837.296621:0:88673:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1780340837.297113:0:88671:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1780340837.300865:0:88673:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1780340837.300883:0:88673:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1780340837.301301:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3660:x1866818961165312:12345-0@lo:253:kworker.0 Request processed in 14630us (15580us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340837.301319:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1780340837.301360:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1780340837.301371:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:3662:x1866818961165184:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1780340837.301397:0:88673:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1780340837.301547:0:88673:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1780340837.301726:0:88675:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1780340837.301732:0:88675:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1780340837.301754:0:88675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c045ec6d200/0xa24651432774996 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.301786:0:88675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c045ec6d200/0xa24651432774996 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1780340837.301795:0:88675:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000065498s 00010000:00010000:2.0:1780340837.301801:0:88675:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c045ec6d200/0xa24651432774996 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.301807:0:88675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c045ec6d200/0xa24651432774996 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.301814:0:88675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c045ec6d200/0xa24651432774996 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.301832:0:88675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c045ec6d200/0xa24651432774996 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.301848:0:88675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6d200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340837.301852:0:88675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c045ec6d200/0xa24651432774996 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.301861:0:88675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c045ec6d200/0xa24651432774996 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.301873:0:88675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c045ec6d200/0xa24651432774996 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.301881:0:88675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c045ec6d200/0xa24651432774996 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.301887:0:88675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c045ec6d200/0xa24651432774996 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1780340837.301979:0:3660:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1780340837.301982:0:3660:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1780340837.301983:0:3660:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780340837.301985:0:3660:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780340837.301986:0:3660:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780340837.301988:0:3660:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780340837.301989:0:3660:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780340837.301991:0:3660:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780340837.301992:0:3660:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1780340837.301995:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0345eb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961165312:0@lo:253:kworker.0 00000100:00100000:0.0:1780340837.304155:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:88665:x1866818961164928:12345-0@lo:253:mount.lustre.0 Request processed in 18155us (18681us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340837.304179:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1780340837.304199:0:88665:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961164928:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1780340837.304215:0:88665:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1780340837.304218:0:88665:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1780340837.304220:0:88665:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1780340837.304221:0:88665:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340837.304222:0:88665:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340837.304223:0:88665:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000100:00100000:0.0:1780340837.304224:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000020:01000004:2.0:1780340837.304225:0:88665:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340837.304226:0:88665:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1780340837.304227:0:88665:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1780340837.304228:0:88665:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340837.304229:0:88665:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000100:00100000:0.0:1780340837.304233:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+5:3662:x1866818961165056:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1780340837.304261:0:88671:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1780340837.304298:0:88673:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1780340837.304308:0:88671:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1780340837.304336:0:88673:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000020:01000004:3.0:1780340837.304549:0:88665:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c0471e4b800 from lustre-MDT0000 10000000:01000000:3.0:1780340837.304578:0:88665:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1780340837.304581:0:88665:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1780340837.304589:0:88665:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c0471e4b800 10000000:01000000:3.0:1780340837.304593:0:88665:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1780340837.304598:0:88665:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c0471e4b800 10000000:01000000:3.0:1780340837.304601:0:88665:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1780340837.304604:0:88665:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8c0471e4b800 from 1 10000000:01000000:3.0:1780340837.304607:0:88665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1780340837.304642:0:88665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722ae800/0xa2465143277499d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.304653:0:88665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04722ae800/0xa2465143277499d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.304662:0:88665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04722ae800/0xa2465143277499d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340837.304683:0:88665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961165440:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1780340837.304741:0:88665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340837.304856:0:88665:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0451281a80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340837.304969:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+5:3662:x1866818961165184:12345-0@lo:253:kworker.0 Request processed in 3600us (19163us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340837.304976:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1780340837.304999:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961165440 00000100:00100000:3.0:1780340837.305004:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961165440 00000100:00100000:3.0:1780340837.305094:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1780340837.305102:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+5:88665:x1866818961165440:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780340837.305110:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340837.305123:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04722af000/0xa246514327749a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277499d expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.305143:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04722af000/0xa246514327749a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277499d expref: 6 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.305153:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04722af000/0xa246514327749a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277499d expref: 6 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.305162:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722af000, rc 0) 00000100:00100000:3.0:1780340837.305190:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:88665:x1866818961165440:12345-0@lo:101:mount.lustre.0 Request processed in 90us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340837.305196:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1780340837.305226:0:88665:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961165440:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780340837.305238:0:88665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04722ae800/0xa2465143277499d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327749a4 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.305247:0:88665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04722ae800/0xa2465143277499d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327749a4 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340837.305259:0:88665:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1780340837.305280:0:88665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722ae800/0xa2465143277499d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327749a4 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.305288:0:88665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04722ae800/0xa2465143277499d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327749a4 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340837.305296:0:88665:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1780340837.305300:0:88665:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1780340837.305304:0:88665:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c0471e4b800 10000000:01000000:3.0:1780340837.305307:0:88665:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1780340837.305310:0:88665:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1780340837.305312:0:88665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1780340837.305327:0:88665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722aea00/0xa246514327749ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.305334:0:88665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04722aea00/0xa246514327749ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.305342:0:88665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04722aea00/0xa246514327749ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340837.305353:0:88665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961165568:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1780340837.305377:0:88665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340837.305389:0:88665:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0451281a80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340837.305517:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961165568 00000100:00100000:3.0:1780340837.305521:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961165568 00000100:00100000:3.0:1780340837.305541:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1780340837.305547:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:88665:x1866818961165568:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780340837.305554:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340837.305570:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04722afc00/0xa246514327749b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327749ab expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.305582:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04722afc00/0xa246514327749b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327749ab expref: 7 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.305590:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04722afc00/0xa246514327749b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327749ab expref: 7 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.305596:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722afc00, rc 0) 00000100:00100000:3.0:1780340837.305625:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:88665:x1866818961165568:12345-0@lo:101:mount.lustre.0 Request processed in 78us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340837.305630:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1780340837.305698:0:88665:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961165568:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780340837.305708:0:88665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04722aea00/0xa246514327749ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327749b2 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.305715:0:88665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04722aea00/0xa246514327749ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327749b2 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340837.305785:0:88665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961165696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780340837.305810:0:88665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340837.305827:0:88665:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0451281a80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340837.305848:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961165696 00000100:00100000:3.0:1780340837.305852:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961165696 00000100:00100000:3.0:1780340837.305869:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1780340837.305875:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:88665:x1866818961165696:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780340837.305979:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:88665:x1866818961165696:12345-0@lo:501:mount.lustre.0 Request processed in 103us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340837.306007:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1780340837.306163:0:88665:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961165696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780340837.306188:0:88665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961165824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780340837.306225:0:88665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340837.306238:0:88665:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0451281a80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340837.306250:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961165824 00000100:00100000:3.0:1780340837.306254:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961165824 00000100:00100000:3.0:1780340837.306269:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1780340837.306274:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:88665:x1866818961165824:12345-0@lo:503:mount.lustre.0 20000000:01000000:2.0:1780340837.306858:0:88675:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1780340837.306864:0:88675:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1780340837.306898:0:88675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c045ec6ce00/0xa246514327749b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.306909:0:88675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c045ec6ce00/0xa246514327749b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1780340837.306917:0:88675:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000065498s 00010000:00010000:2.0:1780340837.306921:0:88675:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c045ec6ce00/0xa246514327749b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.306926:0:88675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c045ec6ce00/0xa246514327749b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.306933:0:88675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c045ec6ce00/0xa246514327749b9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.306940:0:88675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c045ec6ce00/0xa246514327749b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.306946:0:88675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6ce00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340837.306949:0:88675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c045ec6ce00/0xa246514327749b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.306956:0:88675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c045ec6ce00/0xa246514327749b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.306967:0:88675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c045ec6ce00/0xa246514327749b9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.306974:0:88675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c045ec6ce00/0xa246514327749b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.306990:0:88675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c045ec6ce00/0xa246514327749b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340837.307627:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:88665:x1866818961165824:12345-0@lo:503:mount.lustre.0 Request processed in 1348us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340837.307636:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1780340837.307735:0:88665:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a204380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961165824:0@lo:503:mount.lustre.0 00000020:01000004:1.0:1780340837.307897:0:3662:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1780340837.307900:0:3662:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1780340837.307902:0:3662:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780340837.307903:0:3662:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780340837.307904:0:3662:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780340837.307906:0:3662:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780340837.307908:0:3662:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1780340837.307909:0:3662:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780340837.307911:0:3662:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1780340837.307914:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961165184:0@lo:253:kworker.0 00000100:00100000:2.0:1780340837.311665:0:88677:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0345eb8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88677:1866818961165952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340837.311791:0:88677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340837.311826:0:88677:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443afbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340837.312170:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961165952 00000100:00100000:0.0:1780340837.312180:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961165952 00000100:00100000:0.0:1780340837.312234:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1780340837.312243:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:88677:x1866818961165952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340837.313204:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:88677:x1866818961165952:12345-0@lo:502:llog_process_th.0 Request processed in 957us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340837.313218:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1780340837.313342:0:88677:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0345eb8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88677:1866818961165952:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780340837.313374:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340837.313386:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340837.313388:0:88677:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1780340837.313393:0:88677:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1780340837.313396:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1780340837.313409:0:88677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8c047ac74d40) 00000020:00000080:2.0:1780340837.313432:0:88677:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:2.0:1780340837.313438:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1780340837.313531:0:88677:0:(osd_handler.c:8933:osd_obd_connect()) connect #2 00000020:00000080:2.0:1780340837.313690:0:88677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa246514327749c7 00000020:00000080:1.0:1780340837.314122:0:88677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1780340837.314127:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340837.314132:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340837.314134:0:88677:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1780340837.314137:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780340837.314141:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340837.314142:0:88677:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1780340837.314146:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780340837.314154:0:88677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8c0445ba19c0) 00000020:00000080:1.0:1780340837.314168:0:88677:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:1.0:1780340837.314172:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1780340837.314174:0:88677:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1780340837.314177:0:88677:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1780340837.314183:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1780340837.314247:0:88677:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0471e4b800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1780340837.314258:0:88677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8c0445ba0000) 00000020:00000080:1.0:1780340837.314268:0:88677:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:1.0:1780340837.314322:0:88677:0:(lod_dev.c:2290:lod_obd_connect()) connect #0 00000020:00000080:1.0:1780340837.314328:0:88677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa246514327749dc 00000020:00000080:1.0:1780340837.314426:0:88677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1780340837.314432:0:88677:0:(mdd_device.c:1668:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1780340837.314437:0:88677:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa246514327749e3 00080000:01000000:1.0:1780340837.314442:0:88677:0:(osd_handler.c:8933:osd_obd_connect()) connect #3 00000020:00000080:1.0:1780340837.314446:0:88677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa246514327749ea 20000000:01000000:1.0:1780340837.315742:0:88671:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1780340837.316330:0:88671:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1780340837.317904:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3662:x1866818961165056:12345-0@lo:253:kworker.0 Request processed in 13662us (32030us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340837.317916:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:2.0:1780340837.318820:0:88675:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1780340837.318826:0:88675:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1780340837.318855:0:88675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c045ec6d200/0xa246514327749f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.318870:0:88675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c045ec6d200/0xa246514327749f1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1780340837.318879:0:88675:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000065498s 00010000:00010000:2.0:1780340837.318883:0:88675:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c045ec6d200/0xa246514327749f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.318898:0:88675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c045ec6d200/0xa246514327749f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.318905:0:88675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c045ec6d200/0xa246514327749f1 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.318912:0:88675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c045ec6d200/0xa246514327749f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.318918:0:88675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6d200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340837.318922:0:88675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c045ec6d200/0xa246514327749f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.318930:0:88675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c045ec6d200/0xa246514327749f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.318942:0:88675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c045ec6d200/0xa246514327749f1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.318950:0:88675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c045ec6d200/0xa246514327749f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.318956:0:88675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c045ec6d200/0xa246514327749f1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1780340837.327756:0:3662:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1780340837.327981:0:3662:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1780340837.327983:0:3662:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780340837.327985:0:3662:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780340837.327986:0:3662:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780340837.327988:0:3662:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780340837.327989:0:3662:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780340837.327991:0:3662:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780340837.327992:0:3662:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1780340837.327999:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961165056:0@lo:253:kworker.0 00010000:00010000:3.0:1780340837.418512:0:88677:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1780340837.419913:0:88677:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 111669149700 lx: 0 gen 21 00000001:00080000:3.0:1780340837.419959:0:88677:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 idx: 2 lr: 0 srv lr: 111669149700 lx: 0 gen 23 00000001:00000004:3.0:1780340837.419979:0:88677:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 111669149700 00000001:00080000:3.0:1780340837.420237:0:88677:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1780340837.420298:0:88677:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8c047a9df3c0: xid 1866818961150464, transno 111669149700, client gen 21, slot idx 0 00000020:00000080:3.0:1780340837.421263:0:88677:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8c047658cd40) 00000020:00000080:3.0:1780340837.421285:0:88677:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:3.0:1780340837.421359:0:88677:0:(osd_handler.c:8933:osd_obd_connect()) connect #4 00000020:00000080:3.0:1780340837.421365:0:88677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432774a0d 00000020:00000080:3.0:1780340837.443185:0:88677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1780340837.452062:0:88677:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa24651432774a14 00000020:00000080:3.0:1780340837.452376:0:88677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1780340837.452389:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780340837.452395:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340837.452398:0:88677:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1780340837.452401:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1780340837.452404:0:88677:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1780340837.452406:0:88677:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1780340837.452408:0:88677:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1780340837.452409:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1780340837.452412:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340837.452414:0:88677:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1780340837.452417:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780340837.452421:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340837.452422:0:88677:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1780340837.452427:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1780340837.452463:0:88677:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1780340837.452476:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780340837.452479:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340837.452480:0:88677:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1780340837.452483:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780340837.452486:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340837.452487:0:88677:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1780340837.452490:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1780340837.452495:0:88677:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:00000080:3.0:1780340837.452517:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1780340837.452547:0:88677:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8c0476588000) 00000020:00000080:3.0:1780340837.452564:0:88677:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1780340837.452569:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1780340837.452620:0:88677:0:(osp_dev.c:1197:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1780340837.452626:0:88677:0:(osd_handler.c:8933:osd_obd_connect()) connect #5 00000020:00000080:3.0:1780340837.452630:0:88677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432774a22 00010000:00080000:3.0:1780340837.452658:0:88677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c044d438000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:3.0:1780340837.454644:0:88677:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1780340837.455700:0:88677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1780340837.455713:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1780340837.457404:0:88677:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1780340837.457428:0:88677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432774a29 00000100:00080000:2.0:1780340837.457439:0:88677:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1780340837.457446:0:88677:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c044d438000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340837.457483:0:88677:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0345eb8000 x1866818961166080/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340837.457524:0:88677:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1780340837.457609:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340837.457615:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340837.457617:0:88677:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1780340837.457620:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1780340837.457624:0:88677:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1780340837.457626:0:88677:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1780340837.457628:0:88677:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1780340837.457629:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1780340837.457632:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340837.457634:0:88677:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1780340837.457636:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1780340837.457641:0:88677:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1780340837.457644:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340837.457646:0:88677:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1780340837.457649:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1780340837.457653:0:88677:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:01000000:2.0:1780340837.457677:0:88677:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1780340837.457679:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1780340837.457692:0:88677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c047ac70000) 00000020:00000080:2.0:1780340837.457709:0:88677:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1780340837.457714:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1780340837.458027:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0345eb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961166080:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1780340837.458092:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340837.458152:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961166080 00000100:00100000:0.0:1780340837.458158:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961166080 00000100:00100000:0.0:1780340837.458188:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3881 00000100:00100000:0.0:1780340837.458195:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961166080:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1780340837.458220:0:8411:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3617 last 0 00000020:00000080:0.0:1780340837.458250:0:8411:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432774a37 00000004:00100000:0.0:1780340837.458264:0:8411:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1780340837.458360:0:8411:0:(import.c:65:import_set_state_nolock()) ffff8c0442c0f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340837.458407:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1866818961166080:12345-0@lo:38:llog_process_th.0 Request processed in 210us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340837.458414:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3881 00000100:00100000:0.0:1780340837.458451:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1780340837.458459:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:0.0:1780340837.458466:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1780340837.458478:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1780340837.458481:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c044d438000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1780340837.458488:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0345eb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961166080:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1780340837.458617:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340837.458626:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961166208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780340837.458658:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340837.458727:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961166208 00000100:00100000:0.0:1780340837.458732:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961166208 00000100:00100000:0.0:1780340837.458790:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3882 00000100:00100000:0.0:1780340837.458797:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a204e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961166208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780340837.458819:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:0.0:1780340837.458865:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a204e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961166208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340837.458873:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3882 00000100:00100000:3.0:1780340837.459004:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961166208:0@lo:41:osp-pre-1-0.0 00000004:00080000:2.0:1780340837.459254:0:88677:0:(osp_dev.c:1197:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1780340837.459260:0:88677:0:(osd_handler.c:8933:osd_obd_connect()) connect #6 00000020:00000080:2.0:1780340837.459267:0:88677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432774a3e 00010000:00080000:2.0:1780340837.459296:0:88677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c047570b000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:2.0:1780340837.459510:0:88677:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:2.0:1780340837.460686:0:88677:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1780340837.461472:0:88677:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1780340837.466067:0:88677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1780340837.466417:0:88677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].27, 64 off9920 00000040:00080000:1.0:1780340837.466568:0:88677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6c:0x0].1, 64 off8256 00000040:00080000:3.0:1780340837.467153:0:88683:0:(llog.c:800:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:3.0:1780340837.467159:0:88683:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1780340837.467717:0:88677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780340837.467729:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1780340837.467804:0:88677:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1780340837.467824:0:88677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432774a45 00000100:00080000:1.0:1780340837.467834:0:88677:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1780340837.467851:0:88677:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c047570b000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340837.467888:0:88677:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d4ca300 x1866818961166336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340837.467957:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961166336:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1780340837.468032:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340837.468127:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961166336 00000100:00100000:3.0:1780340837.468134:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961166336 00000100:00100000:3.0:1780340837.468165:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5910 00000100:00100000:3.0:1780340837.468172:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0345eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3658:x1866818961166336:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1780340837.468196:0:25487:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3617 last 0 00000020:00000080:3.0:1780340837.468218:0:25487:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432774a4c 00002000:00100000:3.0:1780340837.468231:0:25487:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c0458285800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211351c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1780340837.468236:0:25487:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1780340837.468239:0:25487:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1780340837.468298:0:25487:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1780340837.468320:0:25487:0:(import.c:65:import_set_state_nolock()) ffff8c0458281800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1780340837.468642:0:88677:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1780340837.468705:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340837.468710:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340837.468713:0:88677:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1780340837.468716:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1780340837.468725:0:88677:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1780340837.468727:0:88677:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780340837.468728:0:88677:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780340837.468730:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1780340837.468733:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340837.468734:0:88677:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1780340837.468737:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1780340837.468754:0:88677:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1780340837.468778:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340837.468780:0:88677:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1780340837.468784:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1780340837.468788:0:88677:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:01000000:1.0:1780340837.468805:0:88677:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1780340837.468807:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780340837.468819:0:88677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c0445ba3380) 00000020:00000080:1.0:1780340837.468835:0:88677:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:1.0:1780340837.468850:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1780340837.468914:0:88677:0:(osp_dev.c:1197:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1780340837.468920:0:88677:0:(osd_handler.c:8933:osd_obd_connect()) connect #7 00000020:00000080:1.0:1780340837.468925:0:88677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432774a5a 00010000:00080000:1.0:1780340837.468951:0:88677:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c046b90b800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:1.0:1780340837.469136:0:88677:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1780340837.469197:0:88677:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1780340837.469210:0:88677:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1780340837.472333:0:88677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1780340837.473601:0:88677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].27, 64 off9920 00000040:00080000:0.0:1780340837.473826:0:88677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6e:0x0].1, 64 off8256 00000040:00080000:0.0:1780340837.474253:0:88685:0:(llog.c:800:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:0.0:1780340837.474258:0:88685:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1780340837.474993:0:88677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340837.475005:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1780340837.475043:0:88677:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1780340837.475062:0:88677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432774a61 00000100:00080000:0.0:1780340837.475074:0:88677:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1780340837.475080:0:88677:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c046b90b800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340837.475116:0:88677:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c048583c000 x1866818961166464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340837.475656:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961166464:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1780340837.475726:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340837.476161:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0345eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3658:x1866818961166336:12345-0@lo:8:llog_process_th.0 Request processed in 7986us (8127us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340837.476182:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5910 00000100:00100000:3.0:1780340837.476205:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961166464 00000100:00100000:3.0:1780340837.476212:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961166464 00000100:00100000:3.0:1780340837.476244:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5911 00000100:00100000:3.0:1780340837.476250:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3658:x1866818961166464:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1780340837.476278:0:8830:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3617 last 0 00000020:00000080:3.0:1780340837.476304:0:8830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432774a68 00002000:00100000:3.0:1780340837.476318:0:8830:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c0445bcc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211351c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1780340837.476322:0:8830:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1780340837.476325:0:8830:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1780340837.476392:0:8830:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1780340837.476415:0:8830:0:(import.c:65:import_set_state_nolock()) ffff8c0475492000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340837.476457:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3658:x1866818961166464:12345-0@lo:8:llog_process_th.0 Request processed in 205us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340837.476463:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5911 00000100:00080000:0.0:1780340837.477119:0:88677:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1780340837.477203:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780340837.477210:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340837.477219:0:88677:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1780340837.477224:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780340837.477228:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340837.477230:0:88677:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1780340837.477233:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1780340837.477235:0:88677:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1780340837.477238:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780340837.477240:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340837.477242:0:88677:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1780340837.477244:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780340837.477247:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340837.477248:0:88677:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1780340837.477252:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1780340837.477286:0:88677:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88677:1866818961166592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340837.477336:0:88677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340837.477365:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961166592 00000100:00100000:0.0:1780340837.477369:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961166592 00000100:00100000:0.0:1780340837.477446:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1780340837.477454:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:88677:x1866818961166592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340837.477550:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:88677:x1866818961166592:12345-0@lo:502:llog_process_th.0 Request processed in 96us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340837.477557:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1780340837.477641:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780340837.477651:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1780340837.477658:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1780340837.477664:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1780340837.477667:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c047570b000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1780340837.477681:0:3658:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:2.0:1780340837.477686:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961166336:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1780340837.477709:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1780340837.477713:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1780340837.477729:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1780340837.477733:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1780340837.477735:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c046b90b800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1780340837.477744:0:3658:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:2.0:1780340837.477747:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961166464:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1780340837.477811:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f16d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961166720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340837.477854:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340837.477887:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961166720 00000100:00100000:2.0:1780340837.477891:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961166720 00000100:00100000:2.0:1780340837.477925:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088 00000100:00100000:2.0:1780340837.477931:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961166720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780340837.477950:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780340837.477983:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961166720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340837.477997:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088 00000100:00080000:2.0:1780340837.478014:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340837.478038:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f16d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961166720:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1780340837.478258:0:88683:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1780340837.478319:0:88683:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3617467559189ns, next at 0ns, rc = 0 00080000:00080000:3.0:1780340837.478326:0:88683:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1780340837.479475:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961166848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340837.479524:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340837.479808:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961166848 00000100:00100000:3.0:1780340837.479815:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961166848 00000100:00100000:3.0:1780340837.479878:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089 00000100:00100000:3.0:1780340837.479886:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961166848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340837.479909:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340837.479952:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961166848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340837.479959:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089 00000100:00100000:3.0:1780340837.480049:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961166848:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1780340837.480204:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1780340837.480298:0:88685:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1780340837.480367:0:88685:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3617469607527ns, next at 0ns, rc = 0 00080000:00080000:1.0:1780340837.480374:0:88685:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1780340837.480425:0:88677:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a877480 going to sleep for 11 seconds 00000100:00100000:2.0:1780340837.480442:0:88677:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88677:1866818961166592:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780340837.480475:0:88677:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340837.480482:0:88677:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340837.480484:0:88677:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1780340837.480489:0:88677:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1780340837.481159:0:88665:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1780340837.481188:0:88665:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1780340837.481210:0:88665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722aea00/0xa246514327749ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327749b2 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.481222:0:88665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04722aea00/0xa246514327749ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327749b2 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340837.481230:0:88665:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c0471e4b800 from 1 10000000:01000000:3.0:1780340837.481233:0:88665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1780340837.481263:0:88665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722aec00/0xa24651432774a6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.481270:0:88665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04722aec00/0xa24651432774a6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.481278:0:88665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04722aec00/0xa24651432774a6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340837.481298:0:88665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961166976:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1780340837.481341:0:88665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340837.481366:0:88665:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a871180 going to sleep for 11 seconds 00000100:00100000:1.0:1780340837.482544:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961166976 00000100:00100000:1.0:1780340837.482554:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961166976 00000100:00100000:1.0:1780340837.482597:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1780340837.482606:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:88665:x1866818961166976:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780340837.482620:0:88671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340837.482648:0:88671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453123c00/0xa24651432774a76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774a6f expref: -99 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340837.482672:0:88671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453123c00/0xa24651432774a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774a6f expref: 8 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340837.482684:0:88671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453123c00/0xa24651432774a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774a6f expref: 8 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340837.482692:0:88671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123c00, rc 0) 00000100:00100000:1.0:1780340837.482779:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:88665:x1866818961166976:12345-0@lo:101:mount.lustre.0 Request processed in 174us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340837.482786:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1780340837.483259:0:88665:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961166976:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780340837.483275:0:88665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04722aec00/0xa24651432774a6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774a76 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.483284:0:88665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04722aec00/0xa24651432774a6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774a76 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340837.483956:0:88665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961167104:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1780340837.484008:0:88665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340837.484199:0:88665:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a871180 going to sleep for 11 seconds 00000100:00100000:1.0:1780340837.484403:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961167104 00000100:00100000:1.0:1780340837.484409:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961167104 00000100:00100000:1.0:1780340837.484455:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1780340837.484463:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:88665:x1866818961167104:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1780340837.484480:0:88672:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1780340837.484500:0:88672:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1780340837.484504:0:88672:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1780340837.484508:0:88672:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1780340837.484510:0:88672:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 119 00000100:00100000:1.0:1780340837.484598:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:88665:x1866818961167104:12345-0@lo:256:mount.lustre.0 Request processed in 135us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340837.484606:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1780340837.484725:0:88665:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961167104:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1780340837.485402:0:88665:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1780340837.485497:0:88665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722aec00/0xa24651432774a6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774a76 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.485510:0:88665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04722aec00/0xa24651432774a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774a76 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340837.485519:0:88665:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c0471e4b800 from 1 10000000:01000000:3.0:1780340837.485522:0:88665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1780340837.485551:0:88665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432774a7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.485560:0:88665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432774a7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.485570:0:88665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432774a7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340837.485587:0:88665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961167232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1780340837.485624:0:88665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340837.485663:0:88665:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a871180 going to sleep for 11 seconds 00000100:00100000:1.0:1780340837.486012:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961167232 00000100:00100000:1.0:1780340837.486028:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961167232 00000100:00100000:1.0:1780340837.486071:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1780340837.486079:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:88665:x1866818961167232:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780340837.486102:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340837.486114:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453122400/0xa24651432774a84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774a7d expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340837.486135:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453122400/0xa24651432774a84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774a7d expref: 9 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340837.486145:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453122400/0xa24651432774a84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774a7d expref: 9 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340837.486154:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122400, rc 0) 00000100:00100000:1.0:1780340837.486188:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:88665:x1866818961167232:12345-0@lo:101:mount.lustre.0 Request processed in 110us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340837.486195:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1780340837.486395:0:88665:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961167232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780340837.486416:0:88665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432774a7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774a84 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.486425:0:88665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432774a7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774a84 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340837.486483:0:88665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961167360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780340837.486507:0:88665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340837.486538:0:88665:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a871180 going to sleep for 11 seconds 00000100:00100000:3.0:1780340837.486554:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961167360 00000100:00100000:3.0:1780340837.486557:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961167360 00000100:00100000:3.0:1780340837.486581:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1780340837.486587:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:88665:x1866818961167360:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780340837.486711:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:88665:x1866818961167360:12345-0@lo:501:mount.lustre.0 Request processed in 124us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340837.486960:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1780340837.486988:0:88665:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961167360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780340837.487014:0:88665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961167488:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780340837.487053:0:88665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1780340837.487198:0:88666:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1780340837.487410:0:88665:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a871180 going to sleep for 11 seconds 00000004:00080000:2.0:1780340837.489227:0:88666:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1780340837.489530:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961167488 00000100:00100000:1.0:1780340837.489541:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961167488 00000100:00100000:1.0:1780340837.489582:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1780340837.489590:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:88665:x1866818961167488:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780340837.490582:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:88665:x1866818961167488:12345-0@lo:503:mount.lustre.0 Request processed in 988us (3524us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340837.490593:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1780340837.490734:0:88665:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961167488:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780340837.491368:0:88687:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88687:1866818961167616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340837.491420:0:88687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340837.491454:0:88687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345303cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340837.491502:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961167616 00000100:00100000:2.0:1780340837.491508:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961167616 00000100:00100000:2.0:1780340837.491545:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1780340837.491553:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:88687:x1866818961167616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340837.492087:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:88687:x1866818961167616:12345-0@lo:502:llog_process_th.0 Request processed in 532us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340837.492097:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1780340837.492176:0:88687:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88687:1866818961167616:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780340837.492202:0:88687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780340837.492213:0:88687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340837.492220:0:88687:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1780340837.492228:0:88687:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0471e4b800 00000020:00000080:1.0:1780340837.492231:0:88687:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1780340837.492239:0:88687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340837.492241:0:88687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340837.492243:0:88687:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1780340837.492245:0:88687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780340837.492248:0:88687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340837.492249:0:88687:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1780340837.492252:0:88687:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0471e4b800 00000020:00000080:1.0:1780340837.492254:0:88687:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1780340837.492329:0:88687:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88687:1866818961167744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340837.492364:0:88687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340837.492393:0:88687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345303cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340837.492448:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961167744 00000100:00100000:3.0:1780340837.492453:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961167744 00000100:00100000:3.0:1780340837.492488:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1780340837.492495:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:88687:x1866818961167744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340837.492580:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:88687:x1866818961167744:12345-0@lo:502:llog_process_th.0 Request processed in 84us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340837.492596:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1780340837.492674:0:88687:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88687:1866818961167744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1780340837.492692:0:88687:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780340837.492697:0:88687:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340837.492699:0:88687:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1780340837.492703:0:88687:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1780340837.492962:0:88665:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1780340837.492986:0:88665:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1780340837.493009:0:88665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432774a7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774a84 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.493020:0:88665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432774a7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774a84 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340837.493065:0:88665:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1780340837.493068:0:88665:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c0471e4b800 10000000:01000000:3.0:1780340837.493072:0:88665:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c0471e4b800 10000000:01000000:3.0:1780340837.493076:0:88665:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1780340837.493081:0:88665:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c0471e4b800 from 1 10000000:01000000:3.0:1780340837.493084:0:88665:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1780340837.493108:0:88665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432774a8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.493116:0:88665:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432774a8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.493123:0:88665:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432774a8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340837.493137:0:88665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a206a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961167872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1780340837.493166:0:88665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340837.493187:0:88665:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a871180 going to sleep for 11 seconds 00000100:00100000:3.0:1780340837.493202:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961167872 00000100:00100000:3.0:1780340837.493205:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961167872 00000100:00100000:3.0:1780340837.493237:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1780340837.493243:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:88665:x1866818961167872:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780340837.493252:0:88671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340837.493264:0:88671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04722af600/0xa24651432774a92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774a8b expref: -99 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.493282:0:88671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04722af600/0xa24651432774a92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774a8b expref: 10 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.493293:0:88671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04722af600/0xa24651432774a92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774a8b expref: 10 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.493300:0:88671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722af600, rc 0) 00000100:00100000:3.0:1780340837.493329:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:88665:x1866818961167872:12345-0@lo:101:mount.lustre.0 Request processed in 86us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340837.493335:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1780340837.493367:0:88665:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a206a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961167872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780340837.493378:0:88665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432774a8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774a92 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.493385:0:88665:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432774a8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774a92 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340837.493428:0:88665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a206a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961168000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780340837.493454:0:88665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340837.493470:0:88665:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a871180 going to sleep for 11 seconds 00000100:00100000:3.0:1780340837.493481:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961168000 00000100:00100000:3.0:1780340837.493485:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961168000 00000100:00100000:3.0:1780340837.493508:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1780340837.493514:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:88665:x1866818961168000:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780340837.493606:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:88665:x1866818961168000:12345-0@lo:501:mount.lustre.0 Request processed in 92us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340837.493613:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1780340837.493641:0:88665:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a206a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961168000:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780340837.493665:0:88665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a206a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961168128:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780340837.493703:0:88665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340837.493819:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961168128 00000100:00100000:1.0:1780340837.493823:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961168128 00000100:00100000:1.0:1780340837.493852:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1780340837.493858:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:88665:x1866818961168128:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780340837.493928:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:88665:x1866818961168128:12345-0@lo:503:mount.lustre.0 Request processed in 69us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340837.493934:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1780340837.494022:0:88665:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a871180 going to sleep for 11 seconds 00000100:00100000:3.0:1780340837.494035:0:88665:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a206a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961168128:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780340837.496360:0:88688:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88688:1866818961168256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340837.496435:0:88688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340837.496483:0:88688:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a865240 going to sleep for 11 seconds 00000100:00100000:1.0:1780340837.496533:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961168256 00000100:00100000:1.0:1780340837.496540:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961168256 00000100:00100000:1.0:1780340837.496582:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1780340837.496591:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:88688:x1866818961168256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340837.496725:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:88688:x1866818961168256:12345-0@lo:502:llog_process_th.0 Request processed in 125us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340837.496733:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1780340837.496907:0:88688:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88688:1866818961168256:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1780340837.496964:0:88688:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1780340837.496978:0:88688:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8c03482b3380) 00000020:00000080:0.0:1780340837.497002:0:88688:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1780340837.497163:0:88688:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0471e4b800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1780340837.497167:0:88688:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0471e4b800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1780340837.497170:0:88688:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c0471e4b800 4 00010000:00080000:0.0:1780340837.497197:0:88688:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c047b1f8800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:0.0:1780340837.502139:0:88688:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1780340837.502245:0:88688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1780340837.502292:0:88688:0:(lwp_dev.c:494:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1780340837.502304:0:88688:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa24651432774aa0 00000100:00080000:0.0:1780340837.502314:0:88688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1780340837.502320:0:88688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c047b1f8800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340837.502353:0:88688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c048583df80 x1866818961168384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340837.502385:0:88688:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1780340837.505735:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961168384:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1780340837.505832:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340837.505908:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961168384 00000100:00100000:3.0:1780340837.505916:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961168384 00000100:00100000:3.0:1780340837.505949:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1780340837.505956:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a206a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961168384:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1780340837.506013:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a206a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961168384:12345-0@lo:38:llog_process_th.0 Request processed in 56us (181us total) trans 0 rc -11/-11 00000100:00100000:3.0:1780340837.506020:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1780340837.506058:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1780340837.506066:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c047b1f8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340837.506070:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1780340837.506074:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961168384:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1780340837.508993:0:88688:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88688:1866818961168512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340837.509071:0:88688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340837.509106:0:88688:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345303300 going to sleep for 11 seconds 00000100:00100000:1.0:1780340837.511800:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961168512 00000100:00100000:1.0:1780340837.511813:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961168512 00000100:00100000:1.0:1780340837.511883:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1780340837.511893:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:88688:x1866818961168512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340837.512056:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:88688:x1866818961168512:12345-0@lo:502:llog_process_th.0 Request processed in 164us (2984us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340837.512065:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1780340837.512126:0:88688:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88688:1866818961168512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340837.512184:0:88688:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88688:1866818961168640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340837.512223:0:88688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340837.512249:0:88688:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345303300 going to sleep for 11 seconds 00000100:00100000:3.0:1780340837.512327:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961168640 00000100:00100000:3.0:1780340837.512337:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961168640 00000100:00100000:3.0:1780340837.512370:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1780340837.512378:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:88688:x1866818961168640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340837.512447:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:88688:x1866818961168640:12345-0@lo:502:llog_process_th.0 Request processed in 69us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340837.512454:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1780340837.512491:0:88688:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88688:1866818961168640:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1780340837.512509:0:88688:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1780340837.512577:0:88665:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1780340837.512600:0:88665:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780340837.512616:0:88665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432774a8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774a92 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.512627:0:88665:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432774a8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774a92 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1780340837.512671:0:88665:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1780340837.512673:0:88665:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1780340837.512675:0:88665:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780340837.512676:0:88665:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780340837.512678:0:88665:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780340837.512679:0:88665:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780340837.512680:0:88665:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780340837.512682:0:88665:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1780340837.512683:0:88665:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780340837.512684:0:88665:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1780340837.512688:0:88665:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1780340837.512690:0:88665:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1780340837.512692:0:88665:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1780340837.512693:0:88665:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780340837.512694:0:88665:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780340837.512695:0:88665:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780340837.512700:0:88665:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780340837.512701:0:88665:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780340837.512702:0:88665:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1780340837.512703:0:88665:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780340837.512704:0:88665:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1780340837.512715:0:88665:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1780340837.512737:0:88665:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961168768:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1780340837.512792:0:88665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340837.512806:0:88665:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0448106cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340837.512825:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961168768 00000100:00100000:3.0:1780340837.512829:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961168768 00000100:00100000:3.0:1780340837.512861:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1780340837.512868:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:88665:x1866818961168768:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1780340837.512887:0:88673:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1780340837.512900:0:88673:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1780340837.526169:0:88673:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1780340837.526186:0:88673:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1780340837.526447:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:88665:x1866818961168768:12345-0@lo:253:mount.lustre.0 Request processed in 13575us (13649us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340837.526459:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1780340837.526565:0:88665:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:88665:1866818961168768:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1780340837.526578:0:88665:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1780340837.526581:0:88665:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1780340837.526582:0:88665:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780340837.526584:0:88665:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780340837.526585:0:88665:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780340837.526586:0:88665:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780340837.526587:0:88665:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780340837.526589:0:88665:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780340837.526590:0:88665:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780340837.526592:0:88665:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780340837.526593:0:88665:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1780340837.526612:0:88665:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1780340837.527325:0:88675:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1780340837.527331:0:88675:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1780340837.527350:0:88675:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c045ec6d200/0xa24651432774aa7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.527381:0:88675:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0453123c00/0xa24651432774a76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774a6f expref: 9 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.527390:0:88675:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c045ec6d200/0xa24651432774aa7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.527423:0:88675:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0453123c00/0xa24651432774a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774a6f expref: 9 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.527438:0:88675:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0453123c00/0xa24651432774a76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774a6f expref: 9 pid: 88671 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340837.527452:0:88675:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88675:1866818961168896:0@lo:104: 00000100:00100000:2.0:1780340837.527491:0:88675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340837.527533:0:88675:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446ff2780 going to sleep for 11 seconds 00000100:00100000:0.0:1780340837.527588:0:9471:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961168896 00000100:00100000:0.0:1780340837.527595:0:9471:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961168896 00000100:00100000:0.0:1780340837.527638:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1780340837.527646:0:9471:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:88675:x1866818961168896:12345-0@lo:104: 00010000:00010000:0.0:1780340837.527659:0:9471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c04722aec00/0xa24651432774a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774a76 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.527712:0:9471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1780340837.527730:0:9471:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:88675:x1866818961168896:12345-0@lo:104: Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340837.527737:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1780340837.527787:0:88675:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88675:1866818961168896:0@lo:104: 00010000:00010000:0.0:1780340837.527803:0:88675:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c045ec6d200/0xa24651432774aa7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.527823:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340837.527829:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04722aec00/0xa24651432774a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774a76 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.527845:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722aec00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:0.0:1780340837.527849:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04722aec00/0xa24651432774a6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774a76 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.527857:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04722aec00/0xa24651432774a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774a76 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340837.527865:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04722aec00/0xa24651432774a6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774a76 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340837.527871:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340837.527897:0:6505:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c04722aec00/0xa24651432774a6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774a76 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.527903:0:6505:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780340837.527920:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04722aec00/0xa24651432774a6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774a76 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.527937:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04722aec00/0xa24651432774a6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774a76 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340837.527952:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340837.527954:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340837.527956:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340837.527964:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340837.527974:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961169024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780340837.528002:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340837.528308:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961169024 00000100:00100000:3.0:1780340837.528313:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961169024 00010000:00010000:3.0:1780340837.528332:0:25498:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0453123c00/0xa24651432774a76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774a6f expref: 10 pid: 88671 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340837.528361:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:3.0:1780340837.528368:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:3660:x1866818961169024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340837.528378:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340837.528382:0:25498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0453123c00/0xa24651432774a76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774a6f expref: 10 pid: 88671 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.528392:0:25498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0453123c00/0xa24651432774a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774a6f expref: 10 pid: 88671 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.528403:0:25498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453123c00/0xa24651432774a76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774a6f expref: 10 pid: 88671 timeout: 3717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.528425:0:25498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c045ec6d200/0xa24651432774aa7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.528433:0:25498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c045ec6d200/0xa24651432774aa7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1780340837.528445:0:25498:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001114967s 00010000:00010000:3.0:1780340837.528449:0:25498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c045ec6d200/0xa24651432774aa7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.528455:0:25498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c045ec6d200/0xa24651432774aa7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.528461:0:25498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c045ec6d200/0xa24651432774aa7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.528466:0:25498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c045ec6d200/0xa24651432774aa7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.528471:0:25498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6d200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340837.528475:0:25498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c045ec6d200/0xa24651432774aa7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.528482:0:25498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c045ec6d200/0xa24651432774aa7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.528502:0:25498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c045ec6d200/0xa24651432774aa7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340837.528511:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340837.528550:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:3660:x1866818961169024:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340837.528557:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00100000:3.0:1780340837.528583:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961169024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340837.528655:0:88675:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c045ec6d200/0xa24651432774aa7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.528664:0:88675:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c045ec6d200/0xa24651432774aa7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340837.528671:0:88675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c045ec6d200/0xa24651432774aa7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88675 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1780340837.535987:0:88665:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444069 00000040:01000000:0.0:1780340837.536293:0:88665:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1780340837.536363:0:88695:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444069 00000020:00080000:2.0:1780340837.536368:0:88695:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444069 00000040:01000000:2.0:1780340837.537195:0:88696:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1780340837.537593:0:88696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1780340837.538092:0:88665:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1780340837.540377:0:88696:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1780340837.540463:0:88696:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1780340837.543520:0:88697:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ae680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88697:1866818961169152:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1780340837.543590:0:88697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340837.543631:0:88697:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446ff2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340837.543734:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961169152 00000100:00100000:1.0:1780340837.543743:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961169152 00000100:00100000:1.0:1780340837.543825:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883 00000100:00100000:1.0:1780340837.543859:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88697:x1866818961169152:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780340837.543940:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88697:x1866818961169152:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 82us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340837.543948:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883 00000100:00100000:1.0:1780340837.543994:0:88697:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ae680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88697:1866818961169152:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1780340837.544026:0:88697:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1780340837.544051:0:88697:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4cad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88697:1866818961169280:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780340837.544081:0:88697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340837.544094:0:88697:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0447d76a80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340837.544192:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961169280 00000100:00100000:0.0:1780340837.544197:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961169280 00000100:00100000:0.0:1780340837.544231:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3884 00000100:00100000:0.0:1780340837.544239:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88697:x1866818961169280:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1780340837.544337:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88697:x1866818961169280:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 100us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340837.544344:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3884 00000040:01000000:0.0:1780340837.544702:0:88665:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1780340837.544738:0:88665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1780340837.545297:0:88665:0:(mdd_device.c:556:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1780340837.545305:0:88665:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1780340837.545339:0:88665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1780340837.546385:0:88665:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1780340837.546948:0:88665:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1780340837.546978:0:88665:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1780340837.547064:0:88665:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1780340837.547506:0:88665:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4e:0x0] (8/32) registered 00000100:00100000:1.0:1780340837.547893:0:88697:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4cad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88697:1866818961169280:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780340837.547980:0:88697:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4cad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88697:1866818961169408:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1780340837.548037:0:88697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340837.548072:0:88697:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0447d76a80 going to sleep for 11 seconds 00000100:00100000:2.0:1780340837.548396:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961169408 00000100:00100000:2.0:1780340837.548404:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961169408 00000100:00100000:2.0:1780340837.548451:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3885 00000100:00100000:2.0:1780340837.548460:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88697:x1866818961169408:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1780340837.548537:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88697:x1866818961169408:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 77us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340837.548546:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3885 00000100:00100000:1.0:1780340837.548612:0:88697:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4cad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88697:1866818961169408:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1780340837.548659:0:88697:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1780340837.550897:0:88697:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1780340837.550972:0:88697:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1780340837.550977:0:88697:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:1.0:1780340837.555689:0:88665:0:(ldlm_lib.c:3035:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 111669149700 00010000:00080000:2.0:1780340837.556547:0:88698:0:(ldlm_lib.c:2838:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 88698 00010000:02000000:2.0:1780340837.556564:0:88698:0:(ldlm_lib.c:2320:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:2.0:1780340837.556567:0:88698:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1780340837.556571:0:88698:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1780340837.557324:0:88665:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1780340837.557343:0:88665:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.116@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1780340837.557366:0:88665:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=47 00000080:00000004:1.0:1780340837.557387:0:88665:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1780340837.560690:0:88665:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1780340837.565299:0:88665:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1780340837.769917:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961169536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340837.769995:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340837.770048:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961169536 00000100:00100000:0.0:1780340837.770055:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961169536 00000100:00100000:0.0:1780340837.770095:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090 00000100:00100000:0.0:1780340837.770103:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961169536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340837.770124:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340837.770164:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961169536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340837.770171:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090 00000100:00100000:0.0:1780340837.770234:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961169536:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340837.770374:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:3.0:1780340837.773102:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961169664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340837.773161:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340837.773648:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961169664 00000100:00100000:2.0:1780340837.773657:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961169664 00000100:00100000:2.0:1780340837.773707:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2091 00000100:00100000:2.0:1780340837.773716:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961169664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340837.774896:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340837.774991:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a204380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961169664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1274us (1828us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340837.775000:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2091 00000100:00100000:3.0:1780340837.775176:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961169664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340838.037876:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00010000:00010000:0.0:1780340838.281959:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340838.793912:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 10000000:01000000:0.0:1780340838.794007:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1780340838.794011:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c0471e4b800 from 120 10000000:01000000:0.0:1780340838.794015:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1780340838.794062:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0347785800/0xa24651432774aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.794074:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0347785800/0xa24651432774aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.794085:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0347785800/0xa24651432774aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340838.794108:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961169792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340838.794177:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340838.794220:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0347591d80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340838.794290:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961169792 00000100:00100000:3.0:1780340838.794298:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961169792 00000100:00100000:3.0:1780340838.794362:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1780340838.794371:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:6514:x1866818961169792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340838.794384:0:88671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340838.794397:0:88671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04722ae000/0xa24651432774ab5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774aae expref: -99 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.794423:0:88671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04722ae000/0xa24651432774ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774aae expref: 10 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.794433:0:88671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04722ae000/0xa24651432774ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774aae expref: 10 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.794441:0:88671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722ae000, rc 0) 00000100:00100000:3.0:1780340838.794487:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961169792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340838.794493:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1780340838.794651:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961169792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340838.794663:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0347785800/0xa24651432774aae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774ab5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.794671:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0347785800/0xa24651432774aae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774ab5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340838.794717:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961169920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1780340838.794748:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340838.794809:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0347591d80 going to sleep for 11 seconds 00000100:00100000:2.0:1780340838.794880:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961169920 00000100:00100000:2.0:1780340838.794885:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961169920 00000100:00100000:2.0:1780340838.794909:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1780340838.794916:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961169920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1780340838.794931:0:88673:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1780340838.794954:0:88673:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1780340838.794957:0:88673:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 120 00000100:00100000:2.0:1780340838.795039:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961169920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340838.795047:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1780340838.795123:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961169920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1780340838.795168:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1780340838.795175:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0347785800/0xa24651432774aae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774ab5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.795183:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0347785800/0xa24651432774aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774ab5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340838.795191:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780340838.795193:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c045f0c4800 from 52 10000000:01000000:0.0:1780340838.795196:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780340838.795213:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0347784000/0xa24651432774abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.795220:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0347784000/0xa24651432774abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.795227:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0347784000/0xa24651432774abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340838.795250:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961170048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340838.795274:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340838.795296:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0347591d80 going to sleep for 11 seconds 00000100:00100000:2.0:1780340838.795356:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961170048 00000100:00100000:2.0:1780340838.795359:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961170048 00000100:00100000:2.0:1780340838.795378:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1780340838.795384:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961170048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340838.795393:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340838.795403:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c045ec6d200/0xa24651432774ac3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774abc expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.795418:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c045ec6d200/0xa24651432774ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774abc expref: 11 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.795426:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c045ec6d200/0xa24651432774ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774abc expref: 11 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.795433:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c045ec6d200, rc 0) 00000100:00100000:2.0:1780340838.795472:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961170048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340838.795478:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1780340838.795608:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961170048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340838.795618:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0347784000/0xa24651432774abc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774ac3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.795626:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0347784000/0xa24651432774abc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774ac3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340838.795676:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961170176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340838.795702:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340838.795723:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0347591d80 going to sleep for 11 seconds 00000100:00100000:2.0:1780340838.795775:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961170176 00000100:00100000:2.0:1780340838.795779:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961170176 00000100:00100000:2.0:1780340838.795797:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1780340838.795803:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961170176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.795925:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961170176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340838.795941:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1780340838.796013:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961170176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340838.796042:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961170304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340838.796081:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340838.796108:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0347591d80 going to sleep for 11 seconds 00000100:00100000:2.0:1780340838.796158:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961170304 00000100:00100000:2.0:1780340838.796163:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961170304 00000100:00100000:2.0:1780340838.796182:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1780340838.796188:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961170304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.796275:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961170304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340838.796282:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1780340838.796372:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961170304:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780340838.797293:0:88758:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1780340838.797660:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1780340838.797683:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1780340838.797692:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0347784000/0xa24651432774abc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774ac3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.797703:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0347784000/0xa24651432774abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774ac3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340838.797711:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1780340838.797713:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c045f0c4800 from 117 10000000:01000000:2.0:1780340838.797716:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1780340838.797746:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa24651432774aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.797754:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa24651432774aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.797792:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa24651432774aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340838.797812:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961170432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.797883:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340838.797915:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0346ef6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1780340838.797988:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961170432 00000100:00100000:3.0:1780340838.797994:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961170432 00000100:00100000:3.0:1780340838.798027:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1780340838.798035:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961170432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340838.798046:0:88671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340838.798057:0:88671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04722af800/0xa24651432774ad1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774aca expref: -99 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.798078:0:88671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04722af800/0xa24651432774ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774aca expref: 12 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.798087:0:88671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04722af800/0xa24651432774ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774aca expref: 12 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.798095:0:88671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722af800, rc 0) 00000100:00100000:3.0:1780340838.798140:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961170432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340838.798147:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1780340838.798346:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961170432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340838.798358:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa24651432774aca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774ad1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.798366:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa24651432774aca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774ad1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340838.798413:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961170560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.798445:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340838.798473:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0346ef6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1780340838.798577:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961170560 00000100:00100000:3.0:1780340838.798582:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961170560 00000100:00100000:3.0:1780340838.798602:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1780340838.798608:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961170560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1780340838.798622:0:88671:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1780340838.798640:0:88671:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1780340838.798644:0:88671:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1780340838.798647:0:88671:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1780340838.798649:0:88671:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1780340838.798652:0:88671:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 120 00000100:00100000:3.0:1780340838.798735:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961170560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340838.798747:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1780340838.799174:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961170560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1780340838.799256:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1780340838.799263:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa24651432774aca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774ad1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.799272:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa24651432774aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774ad1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340838.799279:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1780340838.799282:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:2.0:1780340838.799284:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1780340838.799302:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c045ec6dc00/0xa24651432774ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.799310:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c045ec6dc00/0xa24651432774ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.799327:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c045ec6dc00/0xa24651432774ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340838.799406:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961170688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.799439:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340838.799467:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0346ef6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1780340838.799520:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961170688 00000100:00100000:3.0:1780340838.799524:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961170688 00000100:00100000:3.0:1780340838.799558:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1780340838.799565:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961170688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340838.799574:0:88671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340838.799584:0:88671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04722aec00/0xa24651432774adf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774ad8 expref: -99 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.799601:0:88671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04722aec00/0xa24651432774adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774ad8 expref: 13 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.799610:0:88671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04722aec00/0xa24651432774adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774ad8 expref: 13 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.799618:0:88671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722aec00, rc 0) 00000100:00100000:3.0:1780340838.799654:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961170688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340838.799661:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1780340838.799875:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961170688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340838.799886:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c045ec6dc00/0xa24651432774ad8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774adf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.799894:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c045ec6dc00/0xa24651432774ad8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774adf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340838.799959:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961170816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.799985:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340838.800010:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0346ef6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340838.800052:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961170816 00000100:00100000:0.0:1780340838.800056:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961170816 00000100:00100000:0.0:1780340838.800088:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1780340838.800095:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03499e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961170816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340838.800232:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03499e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961170816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340838.800246:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1780340838.801838:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961170816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.801887:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961170944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.801955:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340838.801988:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0346ef6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1780340838.802108:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961170944 00000100:00100000:1.0:1780340838.802114:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961170944 00000100:00100000:1.0:1780340838.802154:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1780340838.802162:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961170944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340838.803427:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961170944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340838.803633:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961170944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1172us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340838.803643:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000040:00080000:1.0:1780340838.805059:0:88759:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1780340838.805276:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1780340838.805301:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1780340838.805311:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c045ec6dc00/0xa24651432774ad8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774adf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.805323:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c045ec6dc00/0xa24651432774ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774adf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340838.805333:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1780340838.805358:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8c045f0c4800 from 1 10000000:01000000:3.0:1780340838.805361:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1780340838.805396:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432774ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.805406:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432774ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.805416:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432774ae6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340838.805449:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961171072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340838.805501:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340838.805543:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446e32000 going to sleep for 11 seconds 00000100:00100000:1.0:1780340838.806462:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961171072 00000100:00100000:1.0:1780340838.806471:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961171072 00000100:00100000:1.0:1780340838.806519:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1780340838.806528:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961171072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340838.806544:0:88671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340838.806560:0:88671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453123400/0xa24651432774aed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774ae6 expref: -99 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340838.806586:0:88671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453123400/0xa24651432774aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774ae6 expref: 14 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340838.806596:0:88671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453123400/0xa24651432774aed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774ae6 expref: 14 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340838.806605:0:88671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123400, rc 0) 00000100:00100000:1.0:1780340838.806658:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:6514:x1866818961171072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340838.806665:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1780340838.806726:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961171072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340838.806741:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432774ae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774aed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340838.806776:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432774ae6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774aed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340838.806796:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1780340838.806801:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432774ae6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774aed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340838.806808:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432774ae6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774aed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340838.806816:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1780340838.806818:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c045f0c4800 from 7 10000000:01000000:1.0:1780340838.806820:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1780340838.806849:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122e00/0xa24651432774af4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340838.806856:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453122e00/0xa24651432774af4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340838.806865:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453122e00/0xa24651432774af4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340838.806881:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961171200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340838.806906:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340838.806929:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a89f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340838.807058:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961171200 00000100:00100000:2.0:1780340838.807063:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961171200 00000100:00100000:2.0:1780340838.807093:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1780340838.807100:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:6514:x1866818961171200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340838.807107:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340838.807123:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c045ec6d000/0xa24651432774afb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774af4 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.807137:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c045ec6d000/0xa24651432774afb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774af4 expref: 15 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.807145:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c045ec6d000/0xa24651432774afb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774af4 expref: 15 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.807151:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c045ec6d000, rc 0) 00000100:00100000:2.0:1780340838.807183:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961171200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340838.807189:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1780340838.807223:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4cad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961171200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340838.807233:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453122e00/0xa24651432774af4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774afb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.807241:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453122e00/0xa24651432774af4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774afb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340838.807296:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961171328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.807320:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340838.807352:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0346ef69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340838.807364:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961171328 00000100:00100000:2.0:1780340838.807367:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961171328 00000100:00100000:2.0:1780340838.807388:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1780340838.807395:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961171328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.807491:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961171328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340838.807504:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1780340838.807537:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961171328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.807563:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961171456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.807602:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340838.807614:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0346ef69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340838.807624:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961171456 00000100:00100000:2.0:1780340838.807628:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961171456 00000100:00100000:2.0:1780340838.807647:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1780340838.807652:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961171456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.807727:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961171456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340838.807733:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1780340838.807800:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961171456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340838.808485:0:88760:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1780340838.808546:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1780340838.808565:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1780340838.808572:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122e00/0xa24651432774af4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774afb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.808582:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453122e00/0xa24651432774af4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774afb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340838.808590:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1780340838.808593:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c04773ad000 from 52 10000000:01000000:2.0:1780340838.808597:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780340838.808618:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c045ec6cc00/0xa24651432774b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.808633:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c045ec6cc00/0xa24651432774b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.808642:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c045ec6cc00/0xa24651432774b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340838.808658:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961171584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.808691:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340838.808706:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04509bec00 going to sleep for 11 seconds 00000100:00100000:2.0:1780340838.808721:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961171584 00000100:00100000:2.0:1780340838.808725:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961171584 00000100:00100000:2.0:1780340838.808753:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1780340838.808785:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961171584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340838.808795:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340838.808806:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c045ec6d800/0xa24651432774b09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774b02 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.808822:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c045ec6d800/0xa24651432774b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774b02 expref: 16 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.808844:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c045ec6d800/0xa24651432774b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774b02 expref: 16 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.808851:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c045ec6d800, rc 0) 00000100:00100000:2.0:1780340838.808882:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961171584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340838.808888:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1780340838.808932:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961171584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340838.808943:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c045ec6cc00/0xa24651432774b02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b09 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.808950:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c045ec6cc00/0xa24651432774b02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774b09 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340838.808988:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961171712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.809008:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340838.809020:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04509bec00 going to sleep for 11 seconds 00000100:00100000:2.0:1780340838.809030:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961171712 00000100:00100000:2.0:1780340838.809033:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961171712 00000100:00100000:2.0:1780340838.809052:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1780340838.809057:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961171712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.809141:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961171712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340838.809147:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1780340838.809174:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961171712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.809195:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961171840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.809229:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340838.809241:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04509bec00 going to sleep for 11 seconds 00000100:00100000:2.0:1780340838.809251:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961171840 00000100:00100000:2.0:1780340838.809254:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961171840 00000100:00100000:2.0:1780340838.809272:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1780340838.809278:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961171840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.809343:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961171840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340838.809355:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1780340838.809392:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961171840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340838.810111:0:88761:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1780340838.810158:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1780340838.810173:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1780340838.810180:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c045ec6cc00/0xa24651432774b02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b09 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.810189:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c045ec6cc00/0xa24651432774b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b09 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340838.810197:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1780340838.810200:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1780340838.810202:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1780340838.810226:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c045ec6da00/0xa24651432774b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.810233:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c045ec6da00/0xa24651432774b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.810241:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c045ec6da00/0xa24651432774b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340838.810255:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961171968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.810290:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340838.810306:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04509be780 going to sleep for 11 seconds 00000100:00100000:2.0:1780340838.810322:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961171968 00000100:00100000:2.0:1780340838.810326:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961171968 00000100:00100000:2.0:1780340838.810362:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1780340838.810369:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961171968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340838.810378:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340838.810387:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c045ec6d400/0xa24651432774b17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774b10 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.810403:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c045ec6d400/0xa24651432774b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774b10 expref: 17 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.810412:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c045ec6d400/0xa24651432774b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774b10 expref: 17 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.810420:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c045ec6d400, rc 0) 00000100:00100000:2.0:1780340838.810449:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961171968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340838.810455:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1780340838.810489:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961171968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340838.810500:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c045ec6da00/0xa24651432774b10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b17 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.810507:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c045ec6da00/0xa24651432774b10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774b17 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340838.810545:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961172096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.810566:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340838.810578:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04509be780 going to sleep for 11 seconds 00000100:00100000:2.0:1780340838.810588:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961172096 00000100:00100000:2.0:1780340838.810590:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961172096 00000100:00100000:2.0:1780340838.810617:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1780340838.810623:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961172096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.810725:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961172096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340838.810732:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1780340838.810784:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961172096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.810808:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961172224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.826098:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340838.826150:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04509be780 going to sleep for 11 seconds 00000100:00100000:3.0:1780340838.826207:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961172224 00000100:00100000:3.0:1780340838.826217:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961172224 00000100:00100000:3.0:1780340838.826273:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1780340838.826282:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961172224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340838.827239:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961172224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 954us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340838.827250:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1780340838.827352:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961172224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780340838.828568:0:88762:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1780340838.828744:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1780340838.828805:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1780340838.828816:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c045ec6da00/0xa24651432774b10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b17 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.828840:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c045ec6da00/0xa24651432774b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b17 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340838.828849:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1780340838.828863:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c04773ad000 from 7 10000000:01000000:3.0:1780340838.828866:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1780340838.828899:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722afe00/0xa24651432774b1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.828906:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04722afe00/0xa24651432774b1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.828915:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04722afe00/0xa24651432774b1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340838.828937:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961172352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340838.828998:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340838.829021:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446e32e40 going to sleep for 11 seconds 00000100:00100000:2.0:1780340838.829294:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961172352 00000100:00100000:2.0:1780340838.829302:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961172352 00000100:00100000:2.0:1780340838.829356:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1780340838.829366:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961172352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340838.829379:0:88671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340838.829391:0:88671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c045ec6c800/0xa24651432774b25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774b1e expref: -99 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.829412:0:88671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c045ec6c800/0xa24651432774b25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774b1e expref: 18 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.829422:0:88671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c045ec6c800/0xa24651432774b25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774b1e expref: 18 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.829429:0:88671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c045ec6c800, rc 0) 00000100:00100000:2.0:1780340838.829463:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961172352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340838.829469:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1780340838.830187:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961172352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340838.830201:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04722afe00/0xa24651432774b1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b25 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.830211:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04722afe00/0xa24651432774b1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774b25 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340838.830271:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961172480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340838.830304:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340838.830331:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446e32e40 going to sleep for 11 seconds 00000100:00100000:2.0:1780340838.830500:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961172480 00000100:00100000:2.0:1780340838.830506:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961172480 00000100:00100000:2.0:1780340838.830542:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1780340838.830549:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961172480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.830667:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961172480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340838.830674:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1780340838.830816:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961172480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340838.830870:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961172608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340838.830911:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340838.830929:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a89f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340838.831582:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961172608 00000100:00100000:2.0:1780340838.831589:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961172608 00000100:00100000:2.0:1780340838.831633:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1780340838.831640:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961172608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.831781:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961172608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340838.831788:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1780340838.832185:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961172608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780340838.833722:0:88763:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1780340838.835202:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1780340838.835228:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1780340838.835240:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722afe00/0xa24651432774b1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b25 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.835252:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04722afe00/0xa24651432774b1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b25 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340838.835262:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1780340838.835264:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c047b065000 from 52 10000000:01000000:2.0:1780340838.835267:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780340838.835305:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c045ec6d600/0xa24651432774b2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.835312:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c045ec6d600/0xa24651432774b2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.835349:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c045ec6d600/0xa24651432774b2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340838.835375:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961172736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.835434:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340838.835480:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0442b84a80 going to sleep for 11 seconds 00000100:00100000:1.0:1780340838.835950:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961172736 00000100:00100000:1.0:1780340838.835958:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961172736 00000100:00100000:1.0:1780340838.836011:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1780340838.836021:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961172736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340838.836035:0:88672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340838.836049:0:88672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453123600/0xa24651432774b33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774b2c expref: -99 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340838.836071:0:88672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453123600/0xa24651432774b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774b2c expref: 19 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340838.836081:0:88672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453123600/0xa24651432774b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774b2c expref: 19 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340838.836090:0:88672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123600, rc 0) 00000100:00100000:1.0:1780340838.836133:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961172736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340838.836139:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1780340838.836262:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961172736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340838.836274:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c045ec6d600/0xa24651432774b2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b33 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.836283:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c045ec6d600/0xa24651432774b2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774b33 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340838.836351:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961172864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.836378:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340838.836404:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0442b84a80 going to sleep for 11 seconds 00000100:00100000:1.0:1780340838.836498:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961172864 00000100:00100000:1.0:1780340838.836503:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961172864 00000100:00100000:1.0:1780340838.836534:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1780340838.836542:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961172864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340838.836671:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961172864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340838.836678:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1780340838.836752:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961172864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340838.836811:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961172992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340838.836862:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340838.836875:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446e32e40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340838.837080:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961172992 00000100:00100000:0.0:1780340838.837085:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961172992 00000100:00100000:0.0:1780340838.837121:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1780340838.837128:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961172992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340838.837213:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961172992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340838.837219:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1780340838.837294:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961172992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340838.843309:0:88764:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1780340838.844108:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1780340838.844136:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780340838.844149:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c045ec6d600/0xa24651432774b2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b33 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.844161:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c045ec6d600/0xa24651432774b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b33 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340838.844171:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1780340838.844174:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1780340838.844177:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1780340838.844215:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0347785e00/0xa24651432774b3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.844223:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0347785e00/0xa24651432774b3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.844232:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0347785e00/0xa24651432774b3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340838.844274:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961173120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340838.844351:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340838.844392:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acd8180 going to sleep for 11 seconds 00000100:00100000:1.0:1780340838.844507:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961173120 00000100:00100000:1.0:1780340838.844515:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961173120 00000100:00100000:1.0:1780340838.844567:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1780340838.844577:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961173120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340838.844591:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340838.844605:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453123000/0xa24651432774b41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774b3a expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340838.844627:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453123000/0xa24651432774b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774b3a expref: 20 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340838.844637:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453123000/0xa24651432774b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774b3a expref: 20 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340838.844645:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123000, rc 0) 00000100:00100000:1.0:1780340838.844687:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961173120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340838.844694:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1780340838.845959:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961173120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340838.845980:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0347785e00/0xa24651432774b3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b41 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.845991:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0347785e00/0xa24651432774b3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774b41 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340838.846069:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961173248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340838.846115:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340838.846151:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acd8180 going to sleep for 11 seconds 00000100:00100000:1.0:1780340838.846265:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961173248 00000100:00100000:1.0:1780340838.846271:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961173248 00000100:00100000:1.0:1780340838.846309:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1780340838.846316:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961173248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340838.846462:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961173248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340838.846485:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1780340838.851118:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961173248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340838.851185:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961173376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340838.851270:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340838.851313:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acd8180 going to sleep for 11 seconds 00000100:00100000:1.0:1780340838.851322:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961173376 00000100:00100000:1.0:1780340838.851330:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961173376 00000100:00100000:1.0:1780340838.851389:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1780340838.851398:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961173376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340838.852599:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961173376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1200us (1327us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340838.852610:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1780340838.852701:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961173376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780340838.854127:0:88765:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1780340838.854300:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1780340838.854323:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1780340838.854343:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0347785e00/0xa24651432774b3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b41 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.854355:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0347785e00/0xa24651432774b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b41 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340838.854364:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1780340838.854366:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c047b065000 from 7 10000000:01000000:2.0:1780340838.854380:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1780340838.854413:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c045ec6de00/0xa24651432774b48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.854421:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c045ec6de00/0xa24651432774b48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.854430:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c045ec6de00/0xa24651432774b48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340838.854452:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961173504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.854505:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340838.854542:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0442b84a80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340838.854643:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961173504 00000100:00100000:0.0:1780340838.854649:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961173504 00000100:00100000:0.0:1780340838.854695:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1780340838.854703:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961173504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340838.854716:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340838.854908:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0347784a00/0xa24651432774b4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774b48 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.854931:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0347784a00/0xa24651432774b4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774b48 expref: 21 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.854941:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0347784a00/0xa24651432774b4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774b48 expref: 21 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.855072:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0347784a00, rc 0) 00000100:00100000:0.0:1780340838.855111:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961173504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 409us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340838.855118:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1780340838.855201:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961173504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340838.855214:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c045ec6de00/0xa24651432774b48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b4f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.855222:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c045ec6de00/0xa24651432774b48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774b4f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340838.855280:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961173632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.855307:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340838.855342:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0442b84a80 going to sleep for 11 seconds 00000100:00100000:1.0:1780340838.855435:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961173632 00000100:00100000:1.0:1780340838.855440:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961173632 00000100:00100000:1.0:1780340838.855472:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1780340838.855479:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961173632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340838.855583:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961173632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340838.855589:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1780340838.855680:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961173632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340838.855714:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961173760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340838.856097:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340838.856252:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0458a2f900 going to sleep for 11 seconds 00000100:00100000:1.0:1780340838.856729:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961173760 00000100:00100000:1.0:1780340838.856745:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961173760 00000100:00100000:1.0:1780340838.856877:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1780340838.856885:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961173760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340838.857213:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961173760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 329us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340838.857222:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1780340838.857362:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961173760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340838.858523:0:88766:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1780340838.858696:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1780340838.858730:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1780340838.858740:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c045ec6de00/0xa24651432774b48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b4f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.858753:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c045ec6de00/0xa24651432774b48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b4f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340838.858793:0:6514:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1780340838.858796:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8c0471e119c0 from 1 10000000:01000000:3.0:1780340838.858798:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1780340838.858847:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432774b56 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.858855:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432774b56 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.858865:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432774b56 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340838.858887:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961173888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340838.858953:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340838.858988:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446e32e40 going to sleep for 11 seconds 00000100:00100000:2.0:1780340838.859284:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961173888 00000100:00100000:2.0:1780340838.859291:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961173888 00000100:00100000:2.0:1780340838.859358:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1780340838.859368:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034de95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961173888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340838.859382:0:88671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340838.859395:0:88671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c045ec6c600/0xa24651432774b5d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774b56 expref: -99 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.859416:0:88671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c045ec6c600/0xa24651432774b5d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774b56 expref: 22 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.859425:0:88671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c045ec6c600/0xa24651432774b5d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774b56 expref: 22 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340838.859433:0:88671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c045ec6c600, rc 0) 00000100:00100000:2.0:1780340838.859480:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034de95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961173888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340838.859487:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1780340838.859620:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961173888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340838.859633:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432774b56 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b5d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.859641:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432774b56 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774b5d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340838.859656:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1780340838.859660:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432774b56 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b5d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.859666:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432774b56 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b5d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340838.859679:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1780340838.859681:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8c0471e119c0 from 1 10000000:01000000:0.0:1780340838.859683:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1780340838.859700:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0347785000/0xa24651432774b64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.859719:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0347785000/0xa24651432774b64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.859732:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0347785000/0xa24651432774b64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340838.859746:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961174016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340838.859798:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340838.859818:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0458a2ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1780340838.860006:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961174016 00000100:00100000:3.0:1780340838.860012:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961174016 00000100:00100000:3.0:1780340838.860039:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1780340838.860046:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034de94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961174016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340838.860054:0:88672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340838.860072:0:88672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f8a00/0xa24651432774b6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774b64 expref: -99 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.860087:0:88672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f8a00/0xa24651432774b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774b64 expref: 23 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.860096:0:88672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f8a00/0xa24651432774b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774b64 expref: 23 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340838.860104:0:88672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8a00, rc 0) 00000100:00100000:3.0:1780340838.860133:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034de94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961174016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340838.860139:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1780340838.860438:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961174016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340838.860448:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0347785000/0xa24651432774b64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b6b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.860455:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0347785000/0xa24651432774b64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774b6b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340838.860507:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961174144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340838.860535:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340838.860563:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0458a2ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1780340838.860665:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961174144 00000100:00100000:2.0:1780340838.860669:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961174144 00000100:00100000:2.0:1780340838.860689:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1780340838.860695:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034de97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961174144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340838.860972:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034de97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961174144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (435us total) trans 0 rc -2/-2 00000100:00100000:2.0:1780340838.860979:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1780340838.861047:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961174144:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1780340838.861073:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1780340838.861088:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0347785000/0xa24651432774b64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b6b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340838.861096:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0347785000/0xa24651432774b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774b6b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340838.917003:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340838.917049:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340838.917084:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340838.917235:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940452608 00000100:00100000:1.0:1780340838.917246:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940452608 00000100:00100000:1.0:1780340838.917315:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940452480 00000100:00100000:1.0:1780340838.917318:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940452480 00000100:00100000:1.0:1780340838.917370:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1354 00000100:00100000:1.0:1780340838.917381:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2409:x1866818940452608:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340838.917412:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940452352 00000100:00100000:2.0:1780340838.917416:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940452352 00000100:00100000:2.0:1780340838.917438:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 60 00000100:00100000:2.0:1780340838.917444:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034de94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2406:x1866818940452352:12345-192.168.203.16@tcp:250:kworker.0 00000100:00100000:1.0:1780340838.917449:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2409:x1866818940452608:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 72us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340838.917455:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1354 00010000:00080000:2.0:1780340838.917464:0:88671:0:(ldlm_lib.c:1430:target_handle_connect()) MGS: connection from 540506f4-4e8e-4fb6-b537-f45d44291964@192.168.203.16@tcp t0 exp 0000000000000000 cur 3618 last 0 00000100:00100000:1.0:1780340838.917471:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1352 00000100:00100000:1.0:1780340838.917475:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2406:x1866818940452480:12345-192.168.203.16@tcp:38:kworker.0 00010000:00080000:1.0:1780340838.917489:0:63710:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '7d14eb83-fa7c-40d9-843e-6367bec0a7b4' at ffff8c0345f1f800, cookie 0xa246514327749ff 00010000:00080000:1.0:1780340838.917493:0:63710:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from 7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp recovering/t0 exp ffff8c0345f1f800 cur 3618 last 1780340837 00000020:00000080:2.0:1780340838.917495:0:88671:0:(genops.c:1406:class_connect()) connect: client 540506f4-4e8e-4fb6-b537-f45d44291964, cookie 0xa24651432774b72 00010000:02000400:1.0:1780340838.917500:0:63710:0:(ldlm_lib.c:2021:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:1.0:1780340838.917505:0:63710:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:1.0:1780340838.917521:0:63710:0:(mdt_handler.c:7301:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1780340838.917606:0:88671:0:(import.c:65:import_set_state_nolock()) ffff8c0452443000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1780340838.917633:0:63710:0:(import.c:65:import_set_state_nolock()) ffff8c0445b42000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340838.917635:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034de94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+4:2406:x1866818940452352:12345-192.168.203.16@tcp:250:kworker.0 Request processed in 190us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340838.917642:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 60 00000100:00100000:1.0:1780340838.917655:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2406:x1866818940452480:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 178us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340838.917661:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1352 00000100:00080000:0.0:1780340838.917924:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340838.936573:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340838.936679:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940452736 00000100:00100000:3.0:1780340838.936689:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940452736 00000100:00100000:3.0:1780340838.936866:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1353 00000100:00100000:3.0:1780340838.936879:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2406:x1866818940452736:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1780340838.936900:0:63711:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c034d4c9c00 x1866818940452736/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:264/0 lens 328/0 e 0 to 0 dl 1780340849 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340838.936925:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2406:x1866818940452736:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 Request processed in 50us (360us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340838.936932:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1353 00010000:00080000:2.0:1780340838.936991:0:88698:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1780340839.049876:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00010000:00010000:0.0:1780340839.305882:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340839.824088:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:1.0:1780340840.040607:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340840.041461:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940452864 00000100:00100000:3.0:1780340840.041473:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940452864 00000100:00100000:3.0:1780340840.041536:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 61 00000100:00100000:3.0:1780340840.041547:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034de96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+4:70274:x1866818940452864:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340840.041563:0:88672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340840.041660:0:88672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f8200/0xa24651432774b79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced24da expref: -99 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340840.044923:0:88672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f8200/0xa24651432774b79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24da expref: 5 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340840.044940:0:88672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f8200/0xa24651432774b79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24da expref: 5 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340840.044950:0:88672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8200, rc 0) 00000100:00100000:3.0:1780340840.045011:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034de96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+5:70274:x1866818940452864:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 3466us (4413us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340840.045390:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 61 00000100:00100000:1.0:1780340840.058186:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340840.058275:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940452992 00000100:00100000:2.0:1780340840.058660:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940452992 00000100:00100000:2.0:1780340840.058734:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 62 00000100:00100000:2.0:1780340840.058745:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034de97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+5:70274:x1866818940452992:12345-192.168.203.16@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1780340840.058876:0:88673:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1780340840.058893:0:88673:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1780340840.058897:0:88673:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1780340840.058900:0:88673:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1780340840.058903:0:88673:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1780340840.058905:0:88673:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 120 00000100:00100000:3.0:1780340840.068217:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034de97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+5:70274:x1866818940452992:12345-192.168.203.16@tcp:256:ll_cfg_requeue.0 Request processed in 9462us (10028us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340840.068231:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 62 00000100:00100000:1.0:1780340840.073881:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00000100:00100000:1.0:1780340840.080958:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340840.086406:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940453120 00000100:00100000:0.0:1780340840.086418:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940453120 00000100:00100000:0.0:1780340840.086537:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 63 00000100:00100000:0.0:1780340840.086547:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034de97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+5:70274:x1866818940453120:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340840.086562:0:88672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340840.086588:0:88672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0347785c00/0xa24651432774b80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced24e1 expref: -99 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340840.086615:0:88672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0347785c00/0xa24651432774b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24e1 expref: 6 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340840.086626:0:88672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0347785c00/0xa24651432774b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24e1 expref: 6 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340840.086634:0:88672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0347785c00, rc 0) 00000100:00100000:0.0:1780340840.086714:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034de97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+6:70274:x1866818940453120:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 169us (5765us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340840.086735:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 63 00000100:00100000:3.0:1780340840.097019:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340840.097098:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940453248 00000100:00100000:1.0:1780340840.097108:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940453248 00000100:00100000:1.0:1780340840.097153:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 64 00000100:00100000:1.0:1780340840.097163:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+6:70274:x1866818940453248:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340840.097335:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+7:70274:x1866818940453248:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 173us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340840.097343:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 64 00000100:00100000:1.0:1780340840.105329:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340840.105485:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940453376 00000100:00100000:0.0:1780340840.105500:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940453376 00000100:00100000:0.0:1780340840.105558:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 65 00000100:00100000:0.0:1780340840.105569:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+7:70274:x1866818940453376:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340840.105706:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+7:70274:x1866818940453376:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 138us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340840.105714:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 65 00000100:00100000:0.0:1780340840.115077:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340840.115258:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940453504 00000100:00100000:3.0:1780340840.115269:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940453504 00000100:00100000:3.0:1780340840.115314:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 66 00000100:00100000:3.0:1780340840.115324:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+7:70274:x1866818940453504:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340840.115348:0:88671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340840.115369:0:88671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f9400/0xa24651432774b87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced24e8 expref: -99 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340840.115409:0:88671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f9400/0xa24651432774b87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24e8 expref: 8 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340840.115420:0:88671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f9400/0xa24651432774b87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24e8 expref: 8 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340840.115436:0:88671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9400, rc 0) 00000100:00100000:3.0:1780340840.115513:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940453504:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 190us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340840.115519:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 66 00000100:00100000:3.0:1780340840.120979:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340840.130452:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940453632 00000100:00100000:1.0:1780340840.130466:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940453632 00000100:00100000:1.0:1780340840.130539:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 67 00000100:00100000:1.0:1780340840.130550:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940453632:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340840.130688:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940453632:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 140us (9716us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340840.131185:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 67 00000100:00100000:0.0:1780340840.139172:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340840.139207:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940453760 00000100:00100000:0.0:1780340840.139217:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940453760 00000100:00100000:0.0:1780340840.139263:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 68 00000100:00100000:0.0:1780340840.139273:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940453760:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340840.139405:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940453760:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 133us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340840.139413:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 68 00000100:00100000:1.0:1780340840.152085:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340840.153310:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940453888 00000100:00100000:3.0:1780340840.153335:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940453888 00000100:00100000:3.0:1780340840.153407:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 69 00000100:00100000:3.0:1780340840.153418:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940453888:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340840.153435:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340840.153451:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f9a00/0xa24651432774b8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced24ef expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340840.153641:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f9a00/0xa24651432774b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24ef expref: 9 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340840.153653:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f9a00/0xa24651432774b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24ef expref: 9 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340840.153662:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9a00, rc 0) 00000100:00100000:3.0:1780340840.153801:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940453888:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 384us (1722us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340840.153808:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 69 00000100:00100000:0.0:1780340840.162259:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340840.162427:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940454016 00000100:00100000:1.0:1780340840.162437:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940454016 00000100:00100000:1.0:1780340840.162497:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 70 00000100:00100000:1.0:1780340840.162508:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940454016:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340840.162620:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940454016:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 114us (372us total) trans 0 rc -2/-2 00000100:00100000:1.0:1780340840.162628:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 70 00010000:00010000:2.0:1780340840.330097:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340840.855001:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:1.0:1780340841.101006:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00010000:00010000:3.0:1780340841.356248:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340841.866736:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:1.0:1780340842.121851:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 0 seconds 00010000:00010000:0.0:1780340842.381190:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340842.891792:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047aa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961174400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340842.891883:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340842.892403:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961174272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340842.892438:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340842.892520:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961174272 00000100:00100000:3.0:1780340842.892529:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961174272 00000100:00100000:3.0:1780340842.892658:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092 00000100:00100000:3.0:1780340842.892669:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961174272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340842.892699:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340842.892747:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961174272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340842.892754:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092 00000100:00080000:3.0:1780340842.892830:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340842.892870:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961174272:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340842.893420:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780340842.893429:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ac7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961174528:0@lo:400:kworker.0 00000100:00100000:2.0:1780340842.894009:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340842.894065:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961174400 00000100:00100000:2.0:1780340842.894072:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961174400 00000100:00100000:2.0:1780340842.894110:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886 00000100:00100000:2.0:1780340842.894117:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961174400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340842.894146:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:2.0:1780340842.894197:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961174400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (2314us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340842.894204:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886 00000100:00100000:1.0:1780340842.894493:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961174528 00000100:00100000:1.0:1780340842.894498:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961174528 00000100:00100000:1.0:1780340842.894529:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1780340842.894536:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961174528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340842.894579:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961174528:12345-0@lo:400:kworker.0 Request processed in 44us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340842.894586:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1780340842.894715:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ac7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961174528:0@lo:400:kworker.0 00000100:00100000:2.0:1780340842.894734:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047aa6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961174400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780340842.895394:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961174656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340842.895438:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340842.895500:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961174656 00000100:00100000:3.0:1780340842.895505:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961174656 00000100:00100000:3.0:1780340842.895546:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093 00000100:00100000:3.0:1780340842.895679:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961174656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340842.895705:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780340842.895744:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961174656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340842.895750:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093 00000100:00100000:3.0:1780340842.896022:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961174656:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1780340842.896042:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340842.897328:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340842.897336:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340842.897339:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340842.897346:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3617 00000100:00080000:0.0:1780340842.897359:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340842.897366:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340842.897409:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047ac7f480 x1866818961174784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340842.897448:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340842.897452:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340842.897453:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340842.897457:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3617 00000100:00080000:0.0:1780340842.897459:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340842.897462:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340842.897474:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d874000 x1866818961175040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340842.897492:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340842.897496:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340842.897497:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340842.897500:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3617 00000100:00080000:0.0:1780340842.897503:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340842.897505:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340842.897515:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d877480 x1866818961175296/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340842.897523:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340842.897526:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340842.897528:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340842.897530:0:49688:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3617 00000100:00080000:0.0:1780340842.897537:0:49688:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340842.897540:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340842.897550:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d877100 x1866818961175424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340842.897571:0:49688:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1780340842.897574:0:49688:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340842.897576:0:49688:0:(import.c:65:import_set_state_nolock()) ffff8c047b1f8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340842.897580:0:49688:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c047b1f8800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340842.897588:0:49688:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03498ec000 x1866818961175808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340842.897615:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 0 seconds 00000100:00100000:0.0:1780340842.897656:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ac7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961174784:0@lo:38:kworker.0 00000100:00100000:0.0:1780340842.897709:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340842.897733:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961175040:0@lo:38:kworker.0 00000100:00100000:0.0:1780340842.897754:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340842.897809:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961175296:0@lo:38:kworker.0 00000100:00100000:0.0:1780340842.897832:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340842.897847:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961175424:0@lo:38:kworker.0 00000100:00100000:0.0:1780340842.897865:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340842.897880:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961175808:0@lo:38:kworker.0 00000100:00100000:0.0:1780340842.897901:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340842.897937:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961174784 00000100:00100000:0.0:1780340842.897943:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961174784 00000100:00100000:0.0:1780340842.897966:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961175040 00000100:00100000:0.0:1780340842.897968:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961175040 00000100:00100000:0.0:1780340842.897982:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961175424 00000100:00100000:0.0:1780340842.897985:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961175424 00000100:00100000:0.0:1780340842.897991:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961175808 00000100:00100000:0.0:1780340842.897993:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961175808 00000100:00100000:0.0:1780340842.898005:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:0.0:1780340842.898011:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961174784:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1780340842.898035:0:64454:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3622 last 0 00000020:00000080:0.0:1780340842.898070:0:64454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa24651432774b95 00000004:00100000:0.0:1780340842.898085:0:64454:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1780340842.898212:0:64454:0:(import.c:65:import_set_state_nolock()) ffff8c046bae4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340842.898256:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1866818961174784:12345-0@lo:38:kworker.0 Request processed in 244us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340842.898263:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:0.0:1780340842.898280:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:0.0:1780340842.898284:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961175040:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1780340842.898295:0:64454:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3622 last 0 00000020:00000080:0.0:1780340842.898317:0:64454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa24651432774b9c 00000004:00100000:0.0:1780340842.898324:0:64454:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1780340842.898340:0:64454:0:(import.c:65:import_set_state_nolock()) ffff8c046bae1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340842.898367:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1866818961175040:12345-0@lo:38:kworker.0 Request processed in 81us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340842.898373:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:0.0:1780340842.898386:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:0.0:1780340842.898390:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961175424:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1780340842.898401:0:64454:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3622 last 0 00000020:00000080:0.0:1780340842.898425:0:64454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa24651432774ba3 00000004:00100000:0.0:1780340842.898437:0:64454:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1780340842.898452:0:64454:0:(import.c:65:import_set_state_nolock()) ffff8c046bae6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340842.898479:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1866818961175424:12345-0@lo:38:kworker.0 Request processed in 87us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340842.898484:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:0.0:1780340842.898497:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:0.0:1780340842.898501:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961175808:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1780340842.898513:0:64454:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3622 last 0 00000020:00000080:0.0:1780340842.898534:0:64454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa24651432774baa 00000004:00100000:0.0:1780340842.898539:0:64454:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1780340842.898550:0:64454:0:(import.c:65:import_set_state_nolock()) ffff8c04506d1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340842.898573:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1866818961175808:12345-0@lo:38:kworker.0 Request processed in 70us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340842.898579:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00010000:00080000:0.0:1780340842.898611:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c047ac7f480 x1866818961174784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340842.898624:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 27 00000100:00080000:0.0:1780340842.899447:0:3658:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8c047ac7f480 x1866818961174784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340867 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340842.899456:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1780340842.899460:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1780340842.899464:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1780340842.899469:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ac7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961174784:0@lo:38:kworker.0 00010000:00080000:0.0:1780340842.899488:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c034d874000 x1866818961175040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340842.899512:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 27 00000100:00080000:0.0:1780340842.900348:0:3658:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8c034d874000 x1866818961175040/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340867 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340842.900358:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1780340842.900362:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1780340842.900365:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:0.0:1780340842.900369:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961175040:0@lo:38:kworker.0 00010000:00080000:0.0:1780340842.900390:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c034d877100 x1866818961175424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340867 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340842.900399:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 27 00000100:00100000:1.0:1780340842.901557:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961175296 00000100:00100000:1.0:1780340842.901568:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961175296 00000100:00100000:1.0:1780340842.901617:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3887 00000100:00100000:1.0:1780340842.901624:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961175296:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780340842.901651:0:26074:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8c0345f1f000, cookie 0xa246514327749f8 00010000:00080000:1.0:1780340842.901656:0:26074:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff8c0345f1f000 cur 3622 last 1780340837 00000004:00100000:1.0:1780340842.901676:0:26074:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780340842.901704:0:26074:0:(import.c:65:import_set_state_nolock()) ffff8c0445b44800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780340842.901816:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818961175296:12345-0@lo:38:kworker.0 Request processed in 191us (3982us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340842.901824:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3887 00010000:00080000:1.0:1780340842.901847:0:88698:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1780340842.901852:0:88698:0:(ldlm_lib.c:2668:replay_request_or_update()) Waiting for transno 111669149701 00000020:00080000:1.0:1780340842.901856:0:88698:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340842.901859:0:88698:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149701 00000020:00080000:1.0:1780340842.901862:0:88698:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340842.901864:0:88698:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149701 00000100:00100000:1.0:1780340842.901880:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961175168:0@lo:400:kworker.0 00000100:00100000:1.0:1780340842.901913:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340842.901938:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340842.901943:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961175552:0@lo:400:kworker.0 00000100:00100000:1.0:1780340842.901967:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340842.902000:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961175168 00000100:00100000:1.0:1780340842.902004:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961175168 00000100:00100000:1.0:1780340842.902044:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1780340842.902052:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961175168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340842.902091:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961175168:12345-0@lo:400:kworker.0 Request processed in 40us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340842.902097:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1780340842.902118:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961175552 00000100:00100000:1.0:1780340842.902121:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961175552 00000100:00100000:1.0:1780340842.902155:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00000100:00100000:1.0:1780340842.902162:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961175552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340842.902277:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961175552:12345-0@lo:400:kworker.0 Request processed in 115us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340842.902282:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00000100:00080000:1.0:1780340842.902306:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780340842.902311:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340842.902342:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961175552:0@lo:400:kworker.0 00000100:00100000:1.0:1780340842.902354:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961175168:0@lo:400:kworker.0 00000001:00100000:3.0:1780340842.902940:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1780340842.903126:0:72681:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1780340842.909836:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961175680:0@lo:400:kworker.0 00000100:00100000:1.0:1780340842.909914:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340842.909953:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340842.909961:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034872b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961174912:0@lo:400:kworker.0 00000100:00100000:1.0:1780340842.909986:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340842.910029:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961175680 00000100:00100000:1.0:1780340842.910031:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961174912 00000100:00100000:1.0:1780340842.910037:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961174912 00000100:00100000:3.0:1780340842.910038:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961175680 00000100:00100000:3.0:1780340842.910099:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:3.0:1780340842.910109:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961175680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340842.910172:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961175680:12345-0@lo:400:kworker.0 Request processed in 65us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340842.910180:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00000001:00100000:3.0:1780340842.910268:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00080000:0.0:1780340842.911991:0:3658:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8c034d877100 x1866818961175424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340867 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340842.912005:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:0.0:1780340842.912010:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1780340842.912014:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1780340842.912020:0:3658:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000d620ab92): req@ffff8c0444225500 x1866818961159808/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340842.912043:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961175424:0@lo:38:kworker.0 00000100:00100000:0.0:1780340842.912121:0:63719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340842.912143:0:63719:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b307600 going to sleep for 11 seconds 00010000:00080000:0.0:1780340842.912176:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c03498ec000 x1866818961175808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340842.913774:0:63717:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961159808 00000100:00100000:3.0:1780340842.913788:0:63717:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961159808 00000100:00100000:3.0:1780340842.913972:0:63717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1780340842.913982:0:63717:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:63719:x1866818961159808:12345-0@lo:700:mdt_seqm_0000.0 00010000:00080000:3.0:1780340842.914001:0:63717:0:(ldlm_lib.c:3193:target_queue_recovery_request()) @@@ not queueing req@ffff8c047207df80 x1866818961159808/t0(0) o700->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:268/0 lens 264/0 e 0 to 0 dl 1780340853 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340842.914701:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 27 00000100:00080000:0.0:1780340842.914722:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1780340842.914729:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1780340842.914734:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c047b1f8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1780340842.914743:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961175808:0@lo:38:kworker.0 00000100:00080000:0.0:1780340842.914826:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 27 00000100:00080000:0.0:1780340842.914833:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1780340842.914838:0:3658:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:0.0:1780340842.914841:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 111669149700 gen 3 00000100:00080000:0.0:1780340842.914845:0:3658:0:(recover.c:53:ptlrpc_replay_next()) import ffff8c034a39c800 from lustre-MDT0000_UUID committed 111669149700 last 0 00000100:00080000:0.0:1780340842.914848:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1780340842.916701:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961175296:0@lo:38:kworker.0 00010000:00080000:3.0:1780340842.916785:0:88923:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:3.0:1780340842.916791:0:88923:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:3.0:1780340842.916811:0:88923:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1780340842.917212:0:88923:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1780340842.917420:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961175936:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1780340842.917499:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780340842.921649:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780340842.921660:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340842.921743:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961175680:0@lo:400:kworker.0 00000100:00100000:1.0:1780340842.921855:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:1.0:1780340842.921867:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961174912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340842.921957:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961174912:12345-0@lo:400:kworker.0 Request processed in 93us (11969us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340842.921964:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:1.0:1780340842.921992:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034872b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961174912:0@lo:400:kworker.0 00000100:00100000:3.0:1780340842.923928:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961175936 00000100:00100000:3.0:1780340842.923944:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961175936 00000100:00100000:3.0:1780340842.923998:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3888 00000100:00100000:3.0:1780340842.924009:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818961175936:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:3.0:1780340842.924030:0:22660:0:(ldlm_lib.c:3119:target_queue_recovery_request()) @@@ queue final req req@ffff8c04497ae300 x1866818961175936/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:268/0 lens 224/0 e 0 to 0 dl 1780340853 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340842.924045:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818961175936:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 41us (6547us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340842.924052:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3888 00000020:00080000:1.0:1780340842.924824:0:88698:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340842.924830:0:88698:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 111669149701 00010000:00080000:1.0:1780340842.924833:0:88698:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1780340842.924836:0:88698:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340842.924843:0:88698:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1780340842.924911:0:88698:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780340842.924923:0:88698:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 192.168.203.16@tcp: req@ffff8c034d4c9c00 x1866818940452736/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:264/0 lens 328/0 e 0 to 0 dl 1780340849 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1780340842.924945:0:88698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340842.924977:0:88698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432774bb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced24b0 expref: -99 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340842.925003:0:88698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432774bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24b0 expref: 7 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340842.925021:0:88698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432774bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24b0 expref: 7 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340842.925029:0:88698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c045ec6c400, rc 0) 00010000:00080000:2.0:1780340842.925110:0:88698:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:2.0:1780340842.925123:0:88698:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 40000000:02000000:2.0:1780340842.935244:0:63717:0:(fid_handler.c:117:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000300000400-0x0000000340000400]:1:mdt 00000100:00100000:1.0:1780340842.936666:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340842.940962:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940454144 00000100:00100000:0.0:1780340842.940979:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940454144 00000100:00100000:0.0:1780340842.941053:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1357 00000100:00100000:0.0:1780340842.941065:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034872b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2406:x1866818940454144:12345-192.168.203.16@tcp:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1780340842.941087:0:63710:0:(ldlm_lib.c:3119:target_queue_recovery_request()) @@@ queue final req req@ffff8c034872b800 x1866818940454144/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:268/0 lens 224/0 e 0 to 0 dl 1780340853 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340842.941115:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034872b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2406:x1866818940454144:12345-192.168.203.16@tcp:400:ptlrpcd_rcv.0 Request processed in 53us (4465us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340842.941122:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1357 00010000:00080000:3.0:1780340842.943048:0:88698:0:(ldlm_lib.c:2270:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1780340842.943199:0:88698:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116992 00000100:00100000:2.0:1780340842.945928:0:63717:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:63719:x1866818961159808:12345-0@lo:700:mdt_seqm_0000.0 Request processed in 31937us (33796us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340842.945948:0:63717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1780340842.946015:0:63719:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225500 pname:cluuid:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-lwp-MDT0001_UUID:63719:1866818961159808:0@lo:700:mdt_seqm_0000.0 40000000:02000000:2.0:1780340842.946030:0:63719:0:(fid_request.c:121:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000300000400-0x0000000340000400]:1:mdt] 00000001:00100000:3.0:1780340842.964375:0:88666:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000001:00100000:3.0:1780340842.964385:0:88666:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1780340842.967169:0:88698:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1780340842.967283:0:88698:0:(ldlm_lib.c:1981:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1780340842.967297:0:88698:0:(ldlm_lib.c:2922:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8c04497ae300 x1866818961175936/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:268/0 lens 224/0 e 0 to 0 dl 1780340853 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1780340842.983280:0:88698:0:(ldlm_lib.c:2922:target_recovery_thread()) @@@ processing final ping from 192.168.203.16@tcp: req@ffff8c034872b800 x1866818940454144/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:268/0 lens 224/0 e 0 to 0 dl 1780340853 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1780340842.983369:0:88698:0:(ldlm_lib.c:1853:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:1.0:1780340842.984103:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1780340842.984124:0:3658:0:(client.c:3224:ptlrpc_resend_req()) @@@ going to resend req@ffff8c034759dc00 x1866818961175936/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340858 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340842.984134:0:3658:0:(client.c:3233:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8c034759dc00 x1866818961175936/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340858 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340842.984142:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1780340842.984165:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1780340842.984178:0:3658:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002f977f5d): req@ffff8c03498ed880 x1866818961156864/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340842.984215:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961175936:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1780340842.984339:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961176064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340842.984400:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340842.984492:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961176064 00000100:00100000:1.0:1780340842.984509:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961176064 00000100:00100000:1.0:1780340842.984571:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3889 00000100:00100000:1.0:1780340842.984581:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818961176064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780340842.984610:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445228544 avail 1298989056 00000100:00100000:1.0:1780340842.984678:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818961176064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340842.984702:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3889 00000100:00100000:1.0:1780340842.984751:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961176064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340842.994897:0:72687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340842.994938:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a3c1240 going to sleep for 11 seconds 00000100:00100000:1.0:1780340842.994961:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961156864 00000100:00100000:1.0:1780340842.994970:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961156864 00000100:00100000:1.0:1780340842.995023:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3890 00000100:00100000:1.0:1780340842.995032:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:72687:x1866818961156864:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1780340842.996846:0:63719:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:70364:x1866818940447872:12345-192.168.203.16@tcp:700:cp.0 Request processed in 20362435us (20362585us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340842.996870:0:63719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:1.0:1780340842.998736:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:72687:x1866818961156864:12345-0@lo:1000:osp_up0-1.0 Request processed in 3698us (3838us total) trans 115964116993 rc 0/0 00000100:00100000:1.0:1780340842.998749:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3890 00000100:00100000:1.0:1780340842.998834:0:72687:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72687:1866818961156864:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1780340843.008498:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340843.011734:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940454400 00000100:00100000:2.0:1780340843.011749:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940454400 00000100:00080000:1.0:1780340843.011841:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340843.011953:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1358 00000100:00100000:2.0:1780340843.011965:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:70364:x1866818940454400:12345-192.168.203.16@tcp:101:cp.0 00010000:00010000:2.0:1780340843.011986:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340843.012008:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c200/0xa24651432774bb8 lrc: 2/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced24f6 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.012109:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6c000/0xa24651432774bbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.012117:0:63711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6c000/0xa24651432774bbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.012126:0:63711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6c000/0xa24651432774bbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340843.012148:0:63711:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961176192:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1780340843.012205:0:63711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340843.012231:0:63711:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446ff2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1780340843.016532:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961176192 00000100:00100000:1.0:1780340843.016545:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961176192 00000100:00100000:1.0:1780340843.016597:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3891 00000100:00100000:1.0:1780340843.016607:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:63711:x1866818961176192:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1780340843.016632:0:26074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340843.016654:0:26074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122200/0xa24651432774bc6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa24651432774bbf expref: -99 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.016703:0:26074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122200/0xa24651432774bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774bbf expref: 8 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.016719:0:26074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122200/0xa24651432774bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774bbf expref: 8 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.016727:0:26074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:1.0:1780340843.016730:0:26074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1780340843.016734:0:26074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122200, rc 0) 00000100:00100000:1.0:1780340843.016839:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63711:x1866818961176192:12345-0@lo:101:mdt00_001.0 Request processed in 233us (4633us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340843.016846:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3891 00000100:00100000:1.0:1780340843.016895:0:63711:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497adc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961176192:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1780340843.016912:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6c000/0xa24651432774bbf lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa24651432774bc6 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.016924:0:63711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6c000/0xa24651432774bbf lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa24651432774bc6 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780340843.016945:0:63711:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1780340843.016952:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6c000/0xa24651432774bbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa24651432774bc6 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.016959:0:63711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6c000/0xa24651432774bbf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa24651432774bc6 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.017016:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774bcd lrc: 3/0,1 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.017031:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774bcd lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.017041:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774bcd lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.017053:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123e00/0xa24651432774bd4 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.017059:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123e00/0xa24651432774bd4 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.017065:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123e00/0xa24651432774bd4 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340843.017206:0:63711:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961176320:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780340843.017241:0:63711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340843.017263:0:63711:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034b093a80 going to sleep for 11 seconds 00000100:00100000:1.0:1780340843.017279:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961176320 00000100:00100000:1.0:1780340843.017283:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961176320 00000100:00100000:1.0:1780340843.017323:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3892 00000100:00100000:1.0:1780340843.017331:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63711:x1866818961176320:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780340843.017567:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63711:x1866818961176320:12345-0@lo:1000:mdt00_001.0 Request processed in 237us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340843.017575:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3892 00000100:00100000:1.0:1780340843.017606:0:63711:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961176320:0@lo:1000:mdt00_001.0 00000004:00080000:1.0:1780340843.019315:0:63711:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x491:0x0], count =401 00000004:00080000:1.0:1780340843.019335:0:63711:0:(osp_object.c:1640:osp_create()) Writing gap [0x280000400:0x491:0x0]+401 in llog 00000004:00080000:1.0:1780340843.019384:0:63711:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x622:0x0], index 0: 0 00010000:00010000:1.0:1780340843.019659:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123800/0xa24651432774bdb lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.021641:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123800/0xa24651432774bdb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.021670:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123800/0xa24651432774bdb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.021850:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774bcd lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.021860:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774bcd lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.021867:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774bcd lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.021875:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774bcd lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.021881:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340843.021886:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774bcd lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.021894:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774bcd lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.021908:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff8c045a87a400) 00010000:00010000:1.0:1780340843.021912:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340843.021917:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774bcd lrc: 3/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.021943:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774bcd lrc: 0/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340843.021961:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000019ac2a19 reply state 00000000374078ea transno 81604378741 ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123e00/0xa24651432774bd4 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.021975:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123e00/0xa24651432774bd4 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.021982:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff8c04495cd700) 00010000:00010000:1.0:1780340843.021985:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340843.021989:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780340843.022048:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c045ec6c200/0xa24651432774bb8 lrc: 0/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24f6 expref: 10 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.022064:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123800/0xa24651432774bdb lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24f6 expref: 9 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.022072:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff8c04495cda00) 00010000:00010000:1.0:1780340843.022074:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780340843.022077:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123800, rc 0) 00000100:00100000:1.0:1780340843.022176:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:70364:x1866818940454400:12345-192.168.203.16@tcp:101:cp.0 Request processed in 10213us (13687us total) trans 81604378741 rc 0/0 00000100:00100000:1.0:1780340843.022186:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1358 00000100:00100000:1.0:1780340843.028924:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340843.036855:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940454528 00000100:00100000:2.0:1780340843.036871:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940454528 00000100:00100000:2.0:1780340843.036936:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5912 00000100:00100000:2.0:1780340843.036960:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2406:x1866818940454528:12345-192.168.203.16@tcp:8:cp.0 00010000:00080000:2.0:1780340843.036995:0:8401:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0000: connection from 7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp t0 exp 0000000000000000 cur 3623 last 0 00000020:00000080:2.0:1780340843.037028:0:8401:0:(genops.c:1406:class_connect()) connect: client 7d14eb83-fa7c-40d9-843e-6367bec0a7b4, cookie 0xa24651432774be9 00002000:00100000:2.0:1780340843.037052:0:8401:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7d14eb83-fa7c-40d9-843e-6367bec0a7b4/ffff8c047570e000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211351c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1780340843.037064:0:8401:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1780340843.037146:0:8401:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1780340843.037179:0:8401:0:(import.c:65:import_set_state_nolock()) ffff8c047570a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340843.037247:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2406:x1866818940454528:12345-192.168.203.16@tcp:8:cp.0 Request processed in 287us (8337us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340843.037255:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5912 00000100:00100000:1.0:1780340843.040206:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340843.041419:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940454656 00000100:00100000:2.0:1780340843.041431:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940454656 00000100:00100000:2.0:1780340843.041510:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5913 00000100:00100000:2.0:1780340843.041523:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:0:x1866818940454656:12345-192.168.203.16@tcp:101:cp.0 00010000:00010000:2.0:1780340843.041541:0:25495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340843.041566:0:25495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774bf0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced24fd expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340843.041593:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x622:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.041613:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.041615:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.041623:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774bf0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24fd expref: 7 pid: 25495 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.041643:0:25495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774bf0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24fd expref: 7 pid: 25495 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.041672:0:25495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c045ec6ca00, rc 0) 00000100:00100000:2.0:1780340843.041727:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:0:x1866818940454656:12345-192.168.203.16@tcp:101:cp.0 Request processed in 208us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340843.041735:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5913 00000100:00080000:1.0:1780340843.041919:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00000080:0.0:1780340843.045081:0:88698:0:(mdd_device.c:2374:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff992744f37e10 00100000:10000000:0.0:1780340843.045094:0:88698:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000100:00100000:2.0:1780340843.046457:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000001:02000400:1.0:1780340843.047257:0:88932:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1780340843.049988:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940454784 00000100:00100000:0.0:1780340843.050001:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940454784 00000100:00100000:0.0:1780340843.050062:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5914 00000100:00100000:0.0:1780340843.050072:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:70364:x1866818940454784:12345-192.168.203.16@tcp:101:cp.0 00010000:00010000:0.0:1780340843.050089:0:23153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340843.050106:0:23153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bc9e19a/0xa24651432774bf7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2504 expref: -99 pid: 23153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.050136:0:23153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774bf0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24fd expref: 8 pid: 25495 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.050145:0:23153:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.050147:0:23153:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.050151:0:23153:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bc9e19a/0xa24651432774bf7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2504 expref: 8 pid: 23153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.050180:0:23153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774bf0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24fd expref: 8 pid: 25495 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.050193:0:23153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774bf0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24fd expref: 8 pid: 25495 timeout: 3723 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340843.050205:0:23153:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:23153:1866818961176448:192.168.203.16@tcp:104: 00000100:00100000:0.0:1780340843.050298:0:23153:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047a901600 going to sleep for 11 seconds 00000004:00080000:2.0:1780340843.053145:0:88684:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x302:0x0] 00000100:00100000:2.0:1780340843.053190:0:88684:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88684:1866818961176576:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1780340843.053249:0:88684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340843.053273:0:88684:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446ff2900 going to sleep for 11 seconds 00000100:00100000:3.0:1780340843.053324:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961176576 00000100:00100000:3.0:1780340843.053331:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961176576 00000100:00100000:3.0:1780340843.053448:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5915 00000100:00100000:3.0:1780340843.053459:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:88684:x1866818961176576:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1780340843.053488:0:25493:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 833 -> diff = -63 00002000:02000040:3.0:1780340843.053493:0:25493:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:771 to 0x280000401:833) 00000004:00080000:0.0:1780340843.054933:0:88686:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x303:0x0] 00000100:00100000:0.0:1780340843.054972:0:88686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88686:1866818961176704:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1780340843.055022:0:88686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340843.055047:0:88686:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047a9016c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340843.055069:0:25497:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961176704 00000100:00100000:0.0:1780340843.055074:0:25497:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961176704 00000100:00100000:0.0:1780340843.055109:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5916 00000100:00100000:0.0:1780340843.055116:0:25497:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:88686:x1866818961176704:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1780340843.055138:0:25497:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 833 -> diff = -62 00002000:02000040:0.0:1780340843.055142:0:25497:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:772 to 0x2c0000401:833) 00002000:00010000:0.0:1780340843.055183:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x341:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.055190:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774bfe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055205:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.055207:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.055212:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774bfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055227:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774bfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055237:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774bfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055246:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774bfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055273:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1780340843.055366:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x340:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.055371:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774c05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055378:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.055380:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.055383:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774c05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055391:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774c05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055398:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774c05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055404:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774c05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055417:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1780340843.055457:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x33f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.055462:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa24651432774c0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055469:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.055470:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.055479:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa24651432774c0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055488:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa24651432774c0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055496:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa24651432774c0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055503:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa24651432774c0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055516:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1780340843.055556:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x33e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.055560:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774c13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055568:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.055569:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.055572:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774c13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055580:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774c13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055588:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774c13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055604:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774c13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055619:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1780340843.055655:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x33d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.055660:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa24651432774c1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055668:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.055669:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.055671:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa24651432774c1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055693:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa24651432774c1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055701:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa24651432774c1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055707:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa24651432774c1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055719:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1780340843.055753:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x33c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.055808:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774c21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055828:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.055830:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.055833:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774c21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055842:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774c21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055850:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774c21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055858:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774c21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055867:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1780340843.055905:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x33b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.055911:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432774c28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055919:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.055921:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.055923:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432774c28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055932:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432774c28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055951:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432774c28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055959:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432774c28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.055968:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1780340843.056000:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x33a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.056005:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774c2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056012:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056014:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056016:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774c2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056024:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774c2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056032:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774c2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056039:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774c2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056048:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1780340843.056088:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x339:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.056092:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432774c36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056100:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056101:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056104:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432774c36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056112:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432774c36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056120:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432774c36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056128:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432774c36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056136:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1780340843.056164:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x338:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.056169:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432774c3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056176:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056177:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056180:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432774c3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056189:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432774c3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056201:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432774c3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056207:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432774c3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056215:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:0.0:1780340843.056248:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x337:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.056253:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432774c44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056259:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056261:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056263:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432774c44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056272:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432774c44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056279:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432774c44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056285:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432774c44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056293:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:0.0:1780340843.056333:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x336:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.056337:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa24651432774c4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056345:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056346:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056348:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa24651432774c4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056356:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa24651432774c4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056364:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa24651432774c4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056371:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa24651432774c4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056379:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:0.0:1780340843.056410:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x335:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.056414:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432774c52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056421:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056423:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056426:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432774c52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056434:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432774c52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056448:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432774c52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056455:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432774c52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056464:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:0.0:1780340843.056495:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x334:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.056500:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432774c59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056508:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056510:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056513:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432774c59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056521:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432774c59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056529:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432774c59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056536:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432774c59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056544:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:0.0:1780340843.056580:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x333:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.056584:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432774c60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056591:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056593:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056596:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432774c60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056604:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432774c60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056612:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432774c60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056620:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432774c60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056628:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:0.0:1780340843.056655:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x332:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.056660:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432774c67 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056667:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056669:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056671:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432774c67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056680:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432774c67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056693:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432774c67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056701:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432774c67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056709:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:0.0:1780340843.056742:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x331:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.056748:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432774c6e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056756:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056783:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056786:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432774c6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056807:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432774c6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056816:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432774c6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056823:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432774c6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056833:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:0.0:1780340843.056872:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x330:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.056877:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432774c75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056884:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056886:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056889:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432774c75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056897:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432774c75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056903:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432774c75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056909:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432774c75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056916:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:0.0:1780340843.056945:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x32f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.056950:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432774c7c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056958:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056959:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.056962:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432774c7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056969:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432774c7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056982:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432774c7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056989:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432774c7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.056997:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:0.0:1780340843.057030:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x32e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.057034:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432774c83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057041:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.057043:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.057045:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432774c83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057053:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432774c83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057060:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432774c83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057067:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432774c83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057075:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:0.0:1780340843.057114:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x32d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.057118:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432774c8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057126:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.057127:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.057130:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432774c8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057137:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432774c8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057145:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432774c8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057151:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432774c8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057160:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:0.0:1780340843.057195:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x32c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.057199:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432774c91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057206:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.057207:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.057210:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432774c91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057218:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432774c91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057232:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432774c91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057238:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432774c91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057246:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00010000:0.0:1780340843.057280:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x32b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.057284:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432774c98 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057291:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.057293:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.057295:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432774c98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057305:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432774c98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057312:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432774c98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057318:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432774c98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057326:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/23 locks to regular blp list, 23 blwis in pool 00002000:00010000:0.0:1780340843.057365:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x32a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.057370:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432774c9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057377:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.057378:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.057381:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432774c9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057390:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432774c9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057397:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432774c9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057403:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432774c9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057410:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/24 locks to regular blp list, 24 blwis in pool 00002000:00010000:0.0:1780340843.057444:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x329:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.057448:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d353f586/0xa24651432774ca6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057455:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.057456:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.057458:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d353f586/0xa24651432774ca6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057466:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d353f586/0xa24651432774ca6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057479:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d353f586/0xa24651432774ca6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057486:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d353f586/0xa24651432774ca6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057494:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/25 locks to regular blp list, 25 blwis in pool 00002000:00010000:0.0:1780340843.057528:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x328:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.057532:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432774cad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057539:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.057541:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.057543:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432774cad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057551:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432774cad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057558:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432774cad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057564:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432774cad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057572:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/26 locks to regular blp list, 26 blwis in pool 00002000:00010000:0.0:1780340843.057611:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x327:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.057616:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432774cb4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057624:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.057625:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.057628:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432774cb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057637:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432774cb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057644:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432774cb4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057652:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432774cb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057660:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/27 locks to regular blp list, 27 blwis in pool 00002000:00010000:0.0:1780340843.057690:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x326:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.057695:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432774cbb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057702:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.057703:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.057706:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432774cbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057713:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432774cbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057728:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432774cbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057734:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432774cbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.057742:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/28 locks to regular blp list, 28 blwis in pool 00002000:00010000:0.0:1780340843.061904:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x325:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.061920:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b031c8df/0xa24651432774cc2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.061937:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.061939:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.061944:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b031c8df/0xa24651432774cc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.061959:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b031c8df/0xa24651432774cc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.061968:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b031c8df/0xa24651432774cc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.061976:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b031c8df/0xa24651432774cc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.061987:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/29 locks to regular blp list, 29 blwis in pool 00002000:00010000:0.0:1780340843.062093:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x324:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.062098:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010ff8653/0xa24651432774cc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062106:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.062107:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.062110:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010ff8653/0xa24651432774cc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062119:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010ff8653/0xa24651432774cc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062126:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010ff8653/0xa24651432774cc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062133:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010ff8653/0xa24651432774cc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062141:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/30 locks to regular blp list, 30 blwis in pool 00002000:00010000:0.0:1780340843.062172:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x323:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.062177:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa24651432774cd0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062183:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.062185:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.062187:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa24651432774cd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062196:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa24651432774cd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062210:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa24651432774cd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062217:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa24651432774cd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062225:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/31 locks to regular blp list, 31 blwis in pool 00002000:00010000:0.0:1780340843.062259:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x322:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340843.062264:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000badc0708/0xa24651432774cd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062271:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.062273:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340843.062275:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000badc0708/0xa24651432774cd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062284:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000badc0708/0xa24651432774cd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062291:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000badc0708/0xa24651432774cd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062298:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000badc0708/0xa24651432774cd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062306:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/32 locks to regular blp list, 32 blwis in pool 00002000:00080000:0.0:1780340843.062526:0:25497:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:771 00000100:00100000:0.0:1780340843.062623:0:25497:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:88686:x1866818961176704:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7504us (7597us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340843.062633:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5916 00010000:00010000:0.0:1780340843.062676:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 31 total in blp. (31 blwis in pool) 00010000:00010000:0.0:1780340843.062683:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774bfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062691:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.062695:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774bfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062705:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774bfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062721:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774bfe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062728:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f22e4ba7/0xa24651432774bfe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062746:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 30 total in blp. (30 blwis in pool) 00010000:00010000:0.0:1780340843.062749:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774c05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.062754:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.063131:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774c05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063150:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774c05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063160:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774c05 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063167:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf509087/0xa24651432774c05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063180:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 29 total in blp. (29 blwis in pool) 00010000:00010000:0.0:1780340843.063184:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa24651432774c0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063190:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.063193:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa24651432774c0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063201:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa24651432774c0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063209:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa24651432774c0c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063216:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001238011e/0xa24651432774c0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063242:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 28 total in blp. (28 blwis in pool) 00010000:00010000:0.0:1780340843.063246:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774c13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063253:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.063256:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774c13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063263:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774c13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063273:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774c13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063281:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eca9a6f5/0xa24651432774c13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063291:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 27 total in blp. (27 blwis in pool) 00010000:00010000:0.0:1780340843.063294:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa24651432774c1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063301:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.063304:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa24651432774c1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063321:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa24651432774c1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063329:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa24651432774c1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063336:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002cf33531/0xa24651432774c1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063347:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 26 total in blp. (26 blwis in pool) 00010000:00010000:0.0:1780340843.063350:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774c21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063357:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.063359:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774c21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063366:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774c21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063374:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774c21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063380:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fad77c1a/0xa24651432774c21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063401:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 25 total in blp. (25 blwis in pool) 00010000:00010000:0.0:1780340843.063405:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432774c28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063412:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.063415:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432774c28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063422:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432774c28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063430:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432774c28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063436:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d964739/0xa24651432774c28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063447:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 24 total in blp. (24 blwis in pool) 00010000:00010000:0.0:1780340843.063451:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774c2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063457:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.063460:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774c2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063475:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774c2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063484:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774c2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063491:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000626ce577/0xa24651432774c2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063501:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 23 total in blp. (23 blwis in pool) 00010000:00010000:0.0:1780340843.063504:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432774c36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063510:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.063513:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432774c36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063519:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432774c36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063528:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432774c36 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063535:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000281a407/0xa24651432774c36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063554:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 22 total in blp. (22 blwis in pool) 00010000:00010000:0.0:1780340843.063557:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432774c3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063564:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32aa00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.063566:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432774c3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063573:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432774c3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063582:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432774c3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063588:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f044ba84/0xa24651432774c3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063598:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:0.0:1780340843.063601:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432774c44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063607:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.063610:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432774c44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063625:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432774c44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063634:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432774c44 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063640:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ae8eeba/0xa24651432774c44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063651:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:0.0:1780340843.063654:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa24651432774c4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063660:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32bc00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.063662:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa24651432774c4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063669:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa24651432774c4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063677:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa24651432774c4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063684:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a48912e9/0xa24651432774c4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063702:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:0.0:1780340843.063705:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432774c52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063711:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.063714:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432774c52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063721:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432774c52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063729:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432774c52 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063736:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000567c9c37/0xa24651432774c52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063746:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:0.0:1780340843.063749:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432774c59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063755:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.063792:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432774c59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063817:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432774c59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063827:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432774c59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063834:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000cd9e3a/0xa24651432774c59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063847:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:0.0:1780340843.063850:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432774c60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063856:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.063859:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432774c60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063866:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432774c60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063874:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432774c60 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063881:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a00cb1f7/0xa24651432774c60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063900:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:0.0:1780340843.063903:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432774c67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063909:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.063912:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432774c67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063919:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432774c67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063927:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432774c67 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063934:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009fc2ffd5/0xa24651432774c67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063944:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:0.0:1780340843.063947:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432774c6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063953:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32b200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.063955:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432774c6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063971:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432774c6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063979:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432774c6e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063986:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000206590f5/0xa24651432774c6e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.063997:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1780340843.064001:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432774c75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064007:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32ae00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.064009:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432774c75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064016:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432774c75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064024:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432774c75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064032:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6aab590/0xa24651432774c75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064050:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:0.0:1780340843.064053:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432774c7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064059:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.064062:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432774c7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064069:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432774c7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064077:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432774c7c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064084:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa486f20/0xa24651432774c7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064093:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1780340843.064096:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432774c83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064102:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32be00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.064105:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432774c83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064121:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432774c83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064130:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432774c83 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064137:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000879fd871/0xa24651432774c83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064148:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1780340843.064150:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432774c8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064156:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.064159:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432774c8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064166:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432774c8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064174:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432774c8a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064181:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a2fad5f/0xa24651432774c8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064200:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1780340843.064203:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432774c91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064208:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32ba00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.064211:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432774c91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064218:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432774c91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064227:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432774c91 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064234:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000147b1d7/0xa24651432774c91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064245:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:0.0:1780340843.064249:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432774c98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064254:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32a000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.064257:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432774c98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064274:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432774c98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064283:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432774c98 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064290:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000566b0733/0xa24651432774c98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064301:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1780340843.064304:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432774c9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064310:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a32ac00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.064313:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432774c9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064320:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432774c9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064327:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432774c9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064334:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008491f401/0xa24651432774c9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064352:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1780340843.064356:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d353f586/0xa24651432774ca6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064362:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.064365:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d353f586/0xa24651432774ca6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064372:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d353f586/0xa24651432774ca6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064381:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d353f586/0xa24651432774ca6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064387:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d353f586/0xa24651432774ca6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064397:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1780340843.064400:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432774cad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064406:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.064409:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432774cad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064424:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432774cad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064433:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432774cad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064439:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000236f9084/0xa24651432774cad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064449:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1780340843.064452:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432774cb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064458:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.064460:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432774cb4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064467:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432774cb4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064475:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432774cb4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064482:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de7e248c/0xa24651432774cb4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064501:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1780340843.064504:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432774cbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064510:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.064513:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432774cbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064520:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432774cbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064528:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432774cbb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064535:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8df12a1/0xa24651432774cbb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064545:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1780340843.064548:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b031c8df/0xa24651432774cc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064554:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440030800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.064556:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b031c8df/0xa24651432774cc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064571:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b031c8df/0xa24651432774cc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064580:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b031c8df/0xa24651432774cc2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064586:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b031c8df/0xa24651432774cc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064597:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1780340843.064600:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010ff8653/0xa24651432774cc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064606:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440030e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.064608:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010ff8653/0xa24651432774cc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064615:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010ff8653/0xa24651432774cc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064623:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010ff8653/0xa24651432774cc9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064630:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010ff8653/0xa24651432774cc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064648:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780340843.064651:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa24651432774cd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064658:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.064660:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa24651432774cd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064667:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa24651432774cd0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064675:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa24651432774cd0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064682:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576864b9/0xa24651432774cd0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064691:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340843.064694:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000badc0708/0xa24651432774cd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064700:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440030200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.064702:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000badc0708/0xa24651432774cd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064718:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000badc0708/0xa24651432774cd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064726:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000badc0708/0xa24651432774cd7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064733:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000badc0708/0xa24651432774cd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.064743:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.064745:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.064747:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.064777:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.064785:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.064791:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.064806:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340843.065065:0:88686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88686:1866818961176704:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1780340843.065078:0:88686:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x341:0x0] from OST, last_created [0x2c0000401:0x341:0x0]last_used is [0x2c0000401:0x303:0x0] 00000100:00100000:0.0:1780340843.065152:0:88686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88686:1866818961176960:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1780340843.065197:0:88686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340843.065218:0:88686:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a247d80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340843.065231:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340843.065241:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961176832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340843.065263:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340843.065292:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961176960 00000100:00100000:0.0:1780340843.065303:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961176960 00000100:00100000:0.0:1780340843.065337:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5917 00000100:00100000:0.0:1780340843.065345:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:88686:x1866818961176960:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1780340843.065382:0:25494:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 834 00000100:00100000:0.0:1780340843.075669:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:88686:x1866818961176960:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10317us (10464us total) trans 4294969454 rc 0/0 00000100:00100000:0.0:1780340843.076781:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5917 00000100:00100000:0.0:1780340843.076837:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961176832 00000100:00100000:0.0:1780340843.076845:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961176832 00000100:00100000:0.0:1780340843.076885:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094 00000100:00100000:0.0:1780340843.076892:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961176832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780340843.076915:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340843.076962:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961176832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (11698us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340843.076968:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094 00000100:00100000:0.0:1780340843.077014:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961176832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340843.077435:0:88686:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88686:1866818961176960:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1780340843.077449:0:88686:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x341:0x0]-[0x2c0000401:0x361:0x0] 00000100:00100000:1.0:1780340843.090540:0:23153:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:23153:1866818961176448:192.168.203.16@tcp:104: 00010000:00010000:1.0:1780340843.090572:0:23153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007bc9e19a/0xa24651432774bf7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2504 expref: 8 pid: 23153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.090594:0:23153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0347784800, rc 0) 00000100:00100000:1.0:1780340843.090660:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:70364:x1866818940454784:12345-192.168.203.16@tcp:101:cp.0 Request processed in 40589us (44210us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340843.090668:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5914 00000100:00100000:1.0:1780340843.091066:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340843.091239:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940454912 00000100:00100000:1.0:1780340843.091247:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940454912 00010000:00010000:1.0:1780340843.091272:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774bf0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24fd expref: 8 pid: 25495 timeout: 3723 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340843.091299:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2552 00000100:00100000:1.0:1780340843.091306:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2407:x1866818940454912:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1780340843.091319:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340843.091336:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774bf0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24fd expref: 8 pid: 25495 timeout: 3723 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.091347:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774bf0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24fd expref: 8 pid: 25495 timeout: 3723 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.091368:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a4b66d4f/0xa24651432774bf0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24fd expref: 8 pid: 25495 timeout: 3723 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.091583:0:6501:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340843.091585:0:6501:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340843.091592:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007bc9e19a/0xa24651432774bf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2504 expref: 7 pid: 23153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.091602:0:6501:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bc9e19a/0xa24651432774bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2504 expref: 7 pid: 23153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.091631:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007bc9e19a/0xa24651432774bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2504 expref: 7 pid: 23153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340843.091643:0:6501:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444226300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6501:1866818961177088:192.168.203.16@tcp:105: 00000100:00100000:1.0:1780340843.091754:0:6501:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034b0936c0 going to sleep for 11 seconds 00002000:00010000:2.0:1780340843.110562:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x341:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.110575:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432774cde lrc: 3/0,1 mode: --/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.110592:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.110594:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.110599:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432774cde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.110613:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432774cde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.110624:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432774cde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.110646:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432774cde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.110666:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340843.110680:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340843.110686:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432774cde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.110694:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.110704:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432774cde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.110713:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432774cde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.110730:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432774cde lrc: 1/0,0 mode: --/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.110737:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009750d1e5/0xa24651432774cde lrc: 0/0,0 mode: --/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.110777:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.110779:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.110781:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340843.110954:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x340:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.110969:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432774ce5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.110976:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.110978:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.110980:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432774ce5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.110988:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432774ce5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.110996:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432774ce5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.111003:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432774ce5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.111019:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340843.111027:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340843.111031:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432774ce5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.111946:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.111951:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432774ce5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.111962:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432774ce5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.111991:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432774ce5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.111998:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4e90bc2/0xa24651432774ce5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.112016:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.112018:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.112020:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340843.112169:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x33f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.112174:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432774cec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.112183:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.112185:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.112188:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432774cec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.112199:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432774cec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.112207:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432774cec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.112214:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432774cec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.112248:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340843.112257:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340843.112262:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432774cec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.112404:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.112408:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432774cec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.112416:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432774cec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.112430:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432774cec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.112438:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ca73517/0xa24651432774cec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.112457:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.112459:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.112461:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340843.112554:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x33e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.112560:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa24651432774cf3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.112569:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.112575:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.112579:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa24651432774cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.112588:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa24651432774cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.112596:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa24651432774cf3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.112602:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa24651432774cf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113001:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340843.113010:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340843.113015:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa24651432774cf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113024:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ebe00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.113027:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa24651432774cf3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113102:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa24651432774cf3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113116:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa24651432774cf3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113136:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008739ed8/0xa24651432774cf3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113151:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.113153:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.113154:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340843.113210:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x33d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.113215:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432774cfa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113224:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.113225:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.113228:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432774cfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113237:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432774cfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113244:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432774cfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113251:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432774cfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113267:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340843.113274:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340843.113286:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432774cfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113292:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ebc00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.113295:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432774cfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113303:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432774cfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113314:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432774cfa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113387:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b81ab740/0xa24651432774cfa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113402:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.113404:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.113406:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340843.113453:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x33c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.113458:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa24651432774d01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113466:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.113468:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.113471:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa24651432774d01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113492:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa24651432774d01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113500:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa24651432774d01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113507:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa24651432774d01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113521:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340843.113530:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340843.113534:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa24651432774d01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113540:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eae00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.113544:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa24651432774d01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113846:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa24651432774d01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113858:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa24651432774d01 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113865:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009e0b8c4/0xa24651432774d01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.113951:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.113953:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.113954:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340843.114001:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x33b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.114006:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432774d08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114014:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.114016:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.114019:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432774d08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114028:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432774d08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114103:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432774d08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114112:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432774d08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114130:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340843.114168:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x33a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.114173:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432774d0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114192:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.114193:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.114197:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432774d0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114205:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432774d0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114213:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432774d0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114221:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432774d0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114236:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780340843.114244:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340843.114248:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432774d08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114255:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.114258:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432774d08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114266:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432774d08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114290:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432774d08 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114296:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa24651432774d08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114310:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340843.114313:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432774d0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114385:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.114388:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432774d0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114397:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432774d0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114407:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432774d0f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114414:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b0cb94b/0xa24651432774d0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114426:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.114428:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.114436:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340843.114483:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x339:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.114488:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432774d16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114496:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.114497:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.114501:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432774d16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114509:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432774d16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114517:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432774d16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114524:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432774d16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114539:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340843.114545:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340843.114548:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432774d16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114556:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.114559:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432774d16 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114578:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432774d16 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114589:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432774d16 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114596:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b3b4fce/0xa24651432774d16 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114609:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.114611:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.114613:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340843.114714:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x338:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.114719:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432774d1d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114727:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.114728:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.114731:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432774d1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114739:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432774d1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.114747:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432774d1d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.115392:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432774d1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.115411:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340843.115422:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340843.115426:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432774d1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.115432:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eac00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.115435:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432774d1d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.115443:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432774d1d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.115455:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432774d1d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.115462:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9db288e/0xa24651432774d1d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.115477:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.115479:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.115480:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340843.115531:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x337:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.115543:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa24651432774d24 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.115551:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.115553:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.115555:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa24651432774d24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.115564:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa24651432774d24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.115572:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa24651432774d24 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.115579:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa24651432774d24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.115592:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340843.115599:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340843.115603:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa24651432774d24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.115610:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eaa00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.115613:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa24651432774d24 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.115748:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa24651432774d24 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.115972:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa24651432774d24 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.115979:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c808233/0xa24651432774d24 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.115993:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.115995:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.115997:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340843.116393:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x336:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.116398:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432774d2b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.116406:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.116408:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.116411:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432774d2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.116420:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432774d2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.116427:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432774d2b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.116435:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432774d2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.116462:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340843.116471:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340843.116477:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432774d2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.116485:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.116488:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432774d2b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.116496:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432774d2b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.116498:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.116509:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432774d2b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.116516:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aaa560a1/0xa24651432774d2b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.116531:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.116533:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.116535:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340843.116581:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x335:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.116587:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa24651432774d32 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.116595:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.116603:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.116607:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa24651432774d32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.116617:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa24651432774d32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.116625:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa24651432774d32 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.116632:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa24651432774d32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.116806:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340843.116883:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x334:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.116889:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432774d39 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.116898:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.116900:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.116903:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432774d39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.116912:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432774d39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.116919:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432774d39 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.116938:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432774d39 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.117050:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780340843.117056:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa24651432774d32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.117068:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.117073:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa24651432774d32 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.117081:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa24651432774d32 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.117103:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa24651432774d32 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.117111:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2ae5ba2/0xa24651432774d32 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.117127:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340843.117130:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432774d39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.117135:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.117138:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432774d39 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.117146:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432774d39 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.117155:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432774d39 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.117162:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.117164:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.117166:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.117297:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1780340843.117302:0:25493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2caaf8f/0xa24651432774d39 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.117387:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340843.117449:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x333:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.117454:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa24651432774d40 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.117462:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.117463:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.117466:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa24651432774d40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.117474:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa24651432774d40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.117481:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa24651432774d40 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.117489:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa24651432774d40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.117504:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340843.117518:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340843.117522:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa24651432774d40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.117528:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eba00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.117531:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa24651432774d40 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.117539:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa24651432774d40 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.117550:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa24651432774d40 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.117557:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051d5dd63/0xa24651432774d40 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.117571:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.117573:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.117575:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340843.117614:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x332:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.118019:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432774d47 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118027:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.118029:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.118032:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432774d47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118404:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432774d47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118412:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432774d47 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118419:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432774d47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118440:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340843.118499:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x331:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.118504:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa24651432774d4e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118512:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.118513:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.118517:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa24651432774d4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118526:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa24651432774d4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118534:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa24651432774d4e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118542:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa24651432774d4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118571:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1780340843.118613:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x330:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.118618:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432774d55 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118626:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.118627:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.118630:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432774d55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118639:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432774d55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118647:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432774d55 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118655:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432774d55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118672:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1780340843.118682:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1780340843.118686:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432774d47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118693:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.118696:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432774d47 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118710:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432774d47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118723:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432774d47 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118729:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6ae8967/0xa24651432774d47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118747:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340843.118750:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa24651432774d4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118756:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.118787:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa24651432774d4e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118803:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa24651432774d4e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118814:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa24651432774d4e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.118821:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a17321f0/0xa24651432774d4e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340843.118905:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.119419:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.119997:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340843.120005:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432774d55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120017:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.120020:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432774d55 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120029:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432774d55 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120110:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432774d55 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120118:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004129978d/0xa24651432774d55 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120136:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.120138:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.120140:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340843.120214:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x32f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.120220:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa24651432774d5c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120229:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.120238:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.120242:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa24651432774d5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120251:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa24651432774d5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120260:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa24651432774d5c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120268:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa24651432774d5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120285:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1780340843.120408:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340843.120419:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa24651432774d5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.120427:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.120430:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa24651432774d5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.120438:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa24651432774d5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.120449:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa24651432774d5c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.120456:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000224eb179/0xa24651432774d5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.120469:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.120471:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.120473:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340843.120578:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x32e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.120584:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000554a8bb3/0xa24651432774d63 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120591:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.120593:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.120595:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000554a8bb3/0xa24651432774d63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120603:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000554a8bb3/0xa24651432774d63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120610:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000554a8bb3/0xa24651432774d63 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120627:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000554a8bb3/0xa24651432774d63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120643:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340843.120685:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x32d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.120689:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073b2aedd/0xa24651432774d6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120697:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.120698:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.120701:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073b2aedd/0xa24651432774d6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120710:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073b2aedd/0xa24651432774d6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120717:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073b2aedd/0xa24651432774d6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120724:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073b2aedd/0xa24651432774d6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120809:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1780340843.120848:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x32c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.120864:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa24651432774d71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120889:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.120890:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.120893:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa24651432774d71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120902:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa24651432774d71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120909:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa24651432774d71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.120916:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa24651432774d71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.123182:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1780340843.123196:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000554a8bb3/0xa24651432774d63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.123209:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.123213:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000554a8bb3/0xa24651432774d63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.123237:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000554a8bb3/0xa24651432774d63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.123257:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000554a8bb3/0xa24651432774d63 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.123266:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000554a8bb3/0xa24651432774d63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.123306:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780340843.123310:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073b2aedd/0xa24651432774d6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.125419:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.125425:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073b2aedd/0xa24651432774d6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.125436:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073b2aedd/0xa24651432774d6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.125455:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073b2aedd/0xa24651432774d6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.125462:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073b2aedd/0xa24651432774d6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.125510:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340843.125513:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa24651432774d71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.125520:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.125523:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa24651432774d71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.125531:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa24651432774d71 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.125543:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa24651432774d71 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.125551:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.125552:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.125555:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.130414:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1780340843.130429:0:25493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000072914e2/0xa24651432774d71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340843.130565:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x32b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.130572:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e18a076c/0xa24651432774d78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.130585:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.130588:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.130593:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e18a076c/0xa24651432774d78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.130818:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.130959:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e18a076c/0xa24651432774d78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.130972:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e18a076c/0xa24651432774d78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.130981:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e18a076c/0xa24651432774d78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.131102:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340843.131156:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x32a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.131162:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d86fbf77/0xa24651432774d7f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.131171:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.131173:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.131176:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d86fbf77/0xa24651432774d7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.131186:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d86fbf77/0xa24651432774d7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.131195:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d86fbf77/0xa24651432774d7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.131203:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d86fbf77/0xa24651432774d7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.131255:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780340843.131262:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e18a076c/0xa24651432774d78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.131270:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.131275:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e18a076c/0xa24651432774d78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.131296:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e18a076c/0xa24651432774d78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.131313:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e18a076c/0xa24651432774d78 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.131330:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e18a076c/0xa24651432774d78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.131347:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340843.131351:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d86fbf77/0xa24651432774d7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.131357:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.131360:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d86fbf77/0xa24651432774d7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.131367:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d86fbf77/0xa24651432774d7f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.131377:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d86fbf77/0xa24651432774d7f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.131384:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.131385:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.131393:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.131509:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1780340843.131514:0:25493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d86fbf77/0xa24651432774d7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340843.131566:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x329:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.131570:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774d86 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.131578:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.131580:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.131582:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774d86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.131591:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774d86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.131599:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774d86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.131606:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774d86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.131681:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340843.131687:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774d86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.131694:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.131697:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774d86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.131704:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774d86 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.131715:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774d86 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.131723:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.131725:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.131726:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.131832:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1780340843.131837:0:25493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774d86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340843.131908:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x328:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.131914:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774d8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.131922:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.131923:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.131926:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774d8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.131935:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774d8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.131943:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774d8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.131951:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774d8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340843.131956:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340843.132081:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00010000:00010000:0.0:1780340843.132102:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340843.132108:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774d8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.132116:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.132119:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774d8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.132126:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774d8d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340843.132132:0:6501:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444226300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6501:1866818961177088:192.168.203.16@tcp:105: 00010000:00010000:0.0:1780340843.132152:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774d8d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340843.132153:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780340843.132164:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.132166:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.132168:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.132206:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:1.0:1780340843.132209:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940454912:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 40901us (41143us total) trans 0 rc 0/0 00010000:00010000:2.0:1780340843.132212:0:25493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774d8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340843.132224:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2552 00000100:00100000:2.0:1780340843.132250:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940455168 00000100:00100000:2.0:1780340843.132258:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940455168 00000100:00100000:2.0:1780340843.132299:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 234 00000100:00100000:2.0:1780340843.132310:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:70364:x1866818940455168:12345-192.168.203.16@tcp:35:cp.0 00000001:00080000:2.0:1780340843.132711:0:63714:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378742 00000100:00100000:2.0:1780340843.132830:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:70364:x1866818940455168:12345-192.168.203.16@tcp:35:cp.0 Request processed in 522us (752us total) trans 81604378743 rc 0/0 00000100:00100000:2.0:1780340843.132838:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 234 00000020:00080000:2.0:1780340843.132842:0:63714:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1780340843.132945:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340843.132999:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x327:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.133004:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432774d94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133014:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.133016:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.133020:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432774d94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133029:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432774d94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133113:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432774d94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133120:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432774d94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133137:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340843.133177:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x326:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.133181:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa24651432774d9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133195:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.133196:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.133200:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa24651432774d9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133209:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa24651432774d9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133218:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa24651432774d9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133225:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa24651432774d9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133241:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780340843.133250:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340843.133254:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432774d94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133262:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.133265:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432774d94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133274:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432774d94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133298:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432774d94 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133305:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e55ef39f/0xa24651432774d94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133391:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340843.133396:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa24651432774d9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133402:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.133406:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa24651432774d9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133412:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa24651432774d9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133422:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa24651432774d9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133428:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005eba0e7a/0xa24651432774d9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133440:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.133441:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.133450:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340843.133495:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x325:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.133500:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa24651432774da2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133507:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.133509:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.133512:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa24651432774da2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133520:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa24651432774da2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133528:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa24651432774da2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133534:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa24651432774da2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133547:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340843.133588:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x324:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.133594:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa24651432774da9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.133602:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.133603:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.133605:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa24651432774da9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.134245:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa24651432774da9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.134257:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa24651432774da9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.134264:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa24651432774da9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.134553:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340843.134559:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa24651432774da2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.134567:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.134571:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa24651432774da2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.134579:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa24651432774da2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.134593:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa24651432774da2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.134600:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6a39078/0xa24651432774da2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.134613:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.134615:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.134714:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.134727:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.146068:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340843.146180:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x323:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.146190:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774db0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146207:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.146209:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.146214:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774db0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146228:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774db0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146237:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774db0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146245:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774db0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146269:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780340843.146279:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340843.146286:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa24651432774da9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146293:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.146298:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa24651432774da9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146307:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa24651432774da9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146323:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa24651432774da9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146330:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000506a0a43/0xa24651432774da9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146346:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340843.146349:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774db0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146355:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340843.146358:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774db0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.146400:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.146427:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774db0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146439:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774db0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146447:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079a07f36/0xa24651432774db0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146462:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.146464:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340843.146467:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340843.146512:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x322:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340843.146518:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774db7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146526:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.146527:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340843.146530:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774db7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146540:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774db7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146548:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774db7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146566:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774db7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340843.146589:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1780340843.146897:0:25493:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:770 00000100:00100000:2.0:1780340843.146983:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:88684:x1866818961176576:12345-0@lo:5:osp-pre-0-0.0 Request processed in 93523us (93730us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340843.146993:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5915 00000100:00100000:2.0:1780340843.147050:0:88684:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88684:1866818961176576:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1780340843.147067:0:88684:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x341:0x0] from OST, last_created [0x280000401:0x341:0x0]last_used is [0x280000401:0x302:0x0] 00000100:00100000:2.0:1780340843.147137:0:88684:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ae680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88684:1866818961177344:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1780340843.147172:0:88684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340843.147198:0:88684:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446ff2900 going to sleep for 11 seconds 00000100:00100000:2.0:1780340843.147213:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780340843.147224:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961177216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340843.147251:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340843.147287:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961177344 00000100:00100000:2.0:1780340843.147294:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961177344 00000100:00100000:2.0:1780340843.147334:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5918 00000100:00100000:2.0:1780340843.147344:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:88684:x1866818961177344:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1780340843.147381:0:25487:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 834 00010000:00010000:0.0:1780340843.150811:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340843.150824:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774db7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.150837:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340843.150843:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774db7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.150862:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774db7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.150891:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774db7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.150899:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000108fe982/0xa24651432774db7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340843.150927:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.150928:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340843.150930:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340843.152032:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961177216 00000100:00100000:0.0:1780340843.152042:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961177216 00000100:00100000:0.0:1780340843.152098:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095 00000100:00100000:0.0:1780340843.152110:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961177216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340843.152136:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 896 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340843.152218:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961177216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (4966us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340843.152236:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095 00000100:00100000:2.0:1780340843.152826:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:88684:x1866818961177344:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5482us (5652us total) trans 4294969455 rc 0/0 00000100:00100000:2.0:1780340843.152837:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5918 00000100:00100000:0.0:1780340843.153449:0:88684:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ae680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88684:1866818961177344:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1780340843.153465:0:88684:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x341:0x0]-[0x280000401:0x361:0x0] 00000100:00100000:2.0:1780340843.154361:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961177216:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1780340843.408178:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340844.074471:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340844.074530:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340844.074559:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340844.074598:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340844.074640:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940455552 00000100:00100000:2.0:1780340844.074654:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940455552 00000100:00100000:2.0:1780340844.074731:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940455424 00000100:00100000:2.0:1780340844.074734:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940455424 00000100:00100000:2.0:1780340844.074814:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1358 00000100:00100000:2.0:1780340844.074826:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2407:x1866818940455552:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340844.074933:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2407:x1866818940455552:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 110us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340844.074942:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1358 00000100:00100000:2.0:1780340844.074963:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1359 00000100:00100000:2.0:1780340844.074970:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940455424:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340844.074999:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940455424:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 29us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340844.075005:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1359 00000100:00100000:2.0:1780340844.075032:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940455680 00000100:00100000:2.0:1780340844.075036:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940455680 00000100:00100000:2.0:1780340844.075064:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2588 00000100:00100000:2.0:1780340844.075071:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03474c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940455680:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340844.075099:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03474c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940455680:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 29us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340844.075115:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2588 00000100:00080000:2.0:1780340844.075137:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780340844.075905:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940455296 00000100:00100000:3.0:1780340844.075914:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940455296 00000100:00100000:3.0:1780340844.075960:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 72 00000100:00100000:3.0:1780340844.075967:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940455296:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340844.076026:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940455296:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 59us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340844.076033:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 72 00000020:00000004:2.0:1780340844.305997:0:88986:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1780340844.308236:0:88986:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1780340844.437094:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1780340845.423515:0:89036:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1780340845.424312:0:89036:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1780340845.450024:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340845.566967:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340845.567062:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940455808 00000100:00100000:2.0:1780340845.567077:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940455808 00000100:00100000:2.0:1780340845.567164:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1359 00000100:00100000:2.0:1780340845.567177:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:70630:x1866818940455808:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:2.0:1780340845.567205:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340845.567231:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6200/0xa24651432774dbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced250b expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1780340845.571903:0:63711:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4607us 00010000:00010000:2.0:1780340845.585577:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432774dc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.585605:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432774dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.585620:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432774dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.585639:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432774dcc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.585646:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432774dcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.585652:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432774dcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340845.585953:0:63711:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a07c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:63711:1866818961177472:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1780340845.586046:0:63711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340845.586090:0:63711:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446ff29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340845.587460:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961177472 00000100:00100000:1.0:1780340845.587476:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961177472 00000100:00100000:1.0:1780340845.587538:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3893 00000100:00100000:1.0:1780340845.587557:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63711:x1866818961177472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780340845.588019:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63711:x1866818961177472:12345-0@lo:1000:mdt00_001.0 Request processed in 462us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340845.588029:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3893 00000100:00100000:3.0:1780340845.588070:0:63711:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a07c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:63711:1866818961177472:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1780340845.588149:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432774dd3 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588169:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432774dd3 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588195:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432774dd3 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340845.588239:0:63711:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432774dd3 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588256:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432774dc5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588263:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432774dc5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588270:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432774dc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588277:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432774dc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588283:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340845.588287:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432774dc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588295:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432774dc5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588310:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:3.0:1780340845.588314:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340845.588320:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432774dc5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588326:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432774dc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588344:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432774dcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588351:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432774dcc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588358:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432774dcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588363:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340845.588367:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432774dcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588372:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432774dcc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588381:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8c0477219100) 00010000:00010000:3.0:1780340845.588383:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340845.588386:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432774dcc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588392:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432774dcc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588441:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6200/0xa24651432774dbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced250b expref: 9 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588456:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432774dd3 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced250b expref: 8 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.588473:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c047a68b200) 00010000:00010000:3.0:1780340845.588475:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1780340845.588478:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8c00, rc 0) 00000100:00100000:3.0:1780340845.588537:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:70630:x1866818940455808:12345-192.168.203.16@tcp:101:rm.0 Request processed in 21363us (21585us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340845.588544:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1359 00000100:00100000:0.0:1780340845.591900:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340845.599376:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940455936 00000100:00100000:2.0:1780340845.599396:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940455936 00000100:00100000:2.0:1780340845.599486:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1360 00000100:00100000:2.0:1780340845.599497:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:70630:x1866818940455936:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:2.0:1780340845.599526:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340845.599555:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7000/0xa24651432774dda lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2512 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.599633:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6600/0xa24651432774de1 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.599650:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6600/0xa24651432774de1 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.599664:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6600/0xa24651432774de1 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340845.599724:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00200000:2.0:1780340845.599729:0:63710:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1780340845.601083:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7000/0xa24651432774dda lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2512 expref: 14 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.601119:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6600/0xa24651432774de1 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2512 expref: 13 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.601143:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c0444f27600) 00010000:00010000:2.0:1780340845.601147:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1780340845.601152:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6600, rc 0) 00000100:00100000:2.0:1780340845.601253:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:70630:x1866818940455936:12345-192.168.203.16@tcp:101:rm.0 Request processed in 1755us (9363us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340845.601264:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1360 00000100:00080000:2.0:1780340845.601335:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340845.604508:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340845.605441:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940456192 00000100:00100000:2.0:1780340845.605457:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940456192 00000100:00100000:2.0:1780340845.606124:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1361 00000100:00100000:2.0:1780340845.606140:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:70630:x1866818940456192:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:2.0:1780340845.606169:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340845.606199:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6e00/0xa24651432774de8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2519 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340845.606333:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1780340845.606473:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6e00/0xa24651432774de8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2519 expref: 15 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.606493:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219500) 00010000:00010000:2.0:1780340845.606496:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780340845.606504:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6e00/0xa24651432774de8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2519 expref: 15 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.606528:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6e00, rc 0) 00000100:00100000:2.0:1780340845.606617:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+14:70630:x1866818940456192:12345-192.168.203.16@tcp:101:rm.0 Request processed in 482us (2118us total) trans 81604378744 rc 301/301 00000100:00100000:2.0:1780340845.606700:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1361 00000100:00100000:2.0:1780340845.617527:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340845.618005:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940456320 00000100:00100000:1.0:1780340845.618018:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940456320 00000100:00100000:1.0:1780340845.618084:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 235 00000100:00100000:1.0:1780340845.618096:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034af39050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+14:70630:x1866818940456320:12345-192.168.203.16@tcp:37:rm.0 00000100:00100000:1.0:1780340845.622454:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034af39050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+14:70630:x1866818940456320:12345-192.168.203.16@tcp:37:rm.0 Request processed in 4342us (4923us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340845.622473:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 235 00000100:00100000:1.0:1780340845.632130:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340845.632224:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940456576 00000100:00100000:2.0:1780340845.632239:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940456576 00000100:00100000:2.0:1780340845.632324:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 236 00000100:00100000:2.0:1780340845.632337:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+14:70630:x1866818940456576:12345-192.168.203.16@tcp:35:rm.0 00000100:00100000:2.0:1780340845.632650:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+15:70630:x1866818940456576:12345-192.168.203.16@tcp:35:rm.0 Request processed in 315us (535us total) trans 81604378745 rc 0/0 00000100:00100000:2.0:1780340845.632668:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 236 00000100:00100000:2.0:1780340845.636729:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340845.637033:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940456832 00000100:00100000:3.0:1780340845.637046:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940456832 00000100:00100000:3.0:1780340845.637121:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1362 00000100:00100000:3.0:1780340845.637134:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+15:70630:x1866818940456832:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:3.0:1780340845.637170:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340845.637198:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8400/0xa24651432774df6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2520 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.637352:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa24651432774dfd lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.637371:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa24651432774dfd lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.637383:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa24651432774dfd lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340845.637396:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:3.0:1780340845.637543:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8400/0xa24651432774df6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2520 expref: 18 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.637593:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa24651432774dfd lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2520 expref: 17 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.637602:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c0444f27600) 00010000:00010000:3.0:1780340845.637605:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780340845.637609:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8600, rc 0) 00000100:00100000:3.0:1780340845.638119:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+17:70630:x1866818940456832:12345-192.168.203.16@tcp:101:rm.0 Request processed in 985us (1402us total) trans 81604378746 rc 0/0 00000100:00100000:3.0:1780340845.638129:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1362 00000100:00100000:3.0:1780340845.642349:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340845.643281:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940456960 00000100:00100000:2.0:1780340845.643456:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940456960 00000100:00100000:2.0:1780340845.643547:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1363 00000100:00100000:2.0:1780340845.643559:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+17:70630:x1866818940456960:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:2.0:1780340845.643603:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340845.643638:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7000/0xa24651432774e0b lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2527 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.644080:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6000/0xa24651432774e12 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.644101:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6000/0xa24651432774e12 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.644115:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6000/0xa24651432774e12 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340845.644196:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00000004:00200000:2.0:1780340845.644200:0:64454:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780340845.644228:0:64454:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6000/0xa24651432774e12 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.644262:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7000/0xa24651432774e0b lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2527 expref: 19 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.644900:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6000/0xa24651432774e12 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2527 expref: 18 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.644912:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff8c045a87a400) 00010000:00010000:2.0:1780340845.644915:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780340845.644920:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6000, rc 0) 00000100:00100000:2.0:1780340845.645022:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+18:70630:x1866818940456960:12345-192.168.203.16@tcp:101:rm.0 Request processed in 1464us (2688us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340845.645032:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1363 00000100:00100000:1.0:1780340845.648978:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340845.649073:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940457216 00000100:00100000:2.0:1780340845.649087:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940457216 00000100:00100000:2.0:1780340845.649260:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1364 00000100:00100000:2.0:1780340845.649273:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+18:70630:x1866818940457216:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:2.0:1780340845.649300:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340845.649326:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa24651432774e19 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced252e expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340845.649456:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1780340845.649580:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa24651432774e19 lrc: 1/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced252e expref: 20 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.649613:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c0444f27600) 00010000:00010000:2.0:1780340845.649616:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780340845.649623:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa24651432774e19 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced252e expref: 20 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.649638:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7c00, rc 0) 00000100:00100000:2.0:1780340845.649805:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+19:70630:x1866818940457216:12345-192.168.203.16@tcp:101:rm.0 Request processed in 535us (842us total) trans 81604378747 rc 301/301 00000100:00100000:2.0:1780340845.649814:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1364 00000100:00100000:1.0:1780340845.662220:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340845.662485:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940457344 00000100:00100000:2.0:1780340845.662500:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940457344 00000100:00100000:3.0:1780340845.662693:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 237 00000100:00100000:3.0:1780340845.662707:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+19:70630:x1866818940457344:12345-192.168.203.16@tcp:37:rm.0 00000100:00100000:1.0:1780340845.667730:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+19:70630:x1866818940457344:12345-192.168.203.16@tcp:37:rm.0 Request processed in 5009us (7064us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340845.667746:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 237 00000100:00100000:1.0:1780340845.671322:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340845.671433:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940457600 00000100:00100000:0.0:1780340845.671448:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940457600 00000100:00100000:0.0:1780340845.671526:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 238 00000100:00100000:0.0:1780340845.671539:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+19:70630:x1866818940457600:12345-192.168.203.16@tcp:35:rm.0 00000100:00100000:0.0:1780340845.672186:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+20:70630:x1866818940457600:12345-192.168.203.16@tcp:35:rm.0 Request processed in 645us (871us total) trans 81604378748 rc 0/0 00000100:00100000:0.0:1780340845.672195:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 238 00000100:00100000:2.0:1780340845.674661:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340845.674878:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940457856 00000100:00100000:3.0:1780340845.674891:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940457856 00000100:00100000:3.0:1780340845.674995:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1365 00000100:00100000:3.0:1780340845.675006:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+20:70630:x1866818940457856:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:3.0:1780340845.675038:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340845.675061:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8400/0xa24651432774e27 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2535 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.675202:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9600/0xa24651432774e2e lrc: 3/1,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.675221:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9600/0xa24651432774e2e lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.675255:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9600/0xa24651432774e2e lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340845.675269:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:3.0:1780340845.675410:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8400/0xa24651432774e27 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2535 expref: 23 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.675431:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9600/0xa24651432774e2e lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2535 expref: 22 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.675440:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff8c045a87a400) 00010000:00010000:3.0:1780340845.675443:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1780340845.675447:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9600, rc 0) 00000100:00100000:3.0:1780340845.675515:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+22:70630:x1866818940457856:12345-192.168.203.16@tcp:101:rm.0 Request processed in 512us (869us total) trans 81604378749 rc 0/0 00000100:00100000:3.0:1780340845.675522:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1365 00000100:00100000:3.0:1780340845.681476:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340845.681605:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940457984 00000100:00100000:2.0:1780340845.681618:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940457984 00000100:00100000:2.0:1780340845.681854:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1366 00000100:00100000:2.0:1780340845.681868:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:70630:x1866818940457984:12345-192.168.203.16@tcp:41:rm.0 00000004:00000024:2.0:1780340845.681941:0:64454:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7846010880 avail 7382962176 00000100:00100000:2.0:1780340845.682038:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:70630:x1866818940457984:12345-192.168.203.16@tcp:41:rm.0 Request processed in 173us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340845.682047:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1366 00000100:00100000:1.0:1780340845.692330:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340845.693430:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940458240 00000100:00100000:2.0:1780340845.693446:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940458240 00000100:00100000:2.0:1780340845.693534:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1367 00000100:00100000:2.0:1780340845.693546:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+22:70630:x1866818940458240:12345-192.168.203.16@tcp:36:rm.0 00010000:00010000:2.0:1780340845.693628:0:63712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1780340845.693681:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123800/0xa24651432774bdb lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24f6 expref: 22 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.693705:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff8c04495cda00) 00010000:00010000:2.0:1780340845.693726:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6000/0xa24651432774e12 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2527 expref: 21 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.693735:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff8c045a87a400) 00010000:00010000:2.0:1780340845.693738:0:63712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340845.693920:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7000/0xa24651432774e3c lrc: 3/0,1 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.693938:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7000/0xa24651432774e3c lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.693949:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7000/0xa24651432774e3c lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.693962:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7200/0xa24651432774e43 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.693969:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7200/0xa24651432774e43 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.693975:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7200/0xa24651432774e43 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694240:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7600/0xa24651432774e4a lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694250:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7600/0xa24651432774e4a lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694266:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7600/0xa24651432774e4a lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1780340845.694550:0:63712:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x4c:0x0].2, 64 off8320 00000004:00080000:2.0:1780340845.694563:0:63712:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3625683802213ns, next at 3626683799600ns, rc = 0 00010000:00010000:2.0:1780340845.694619:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa24651432774e51 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694629:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa24651432774e51 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694637:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa24651432774e51 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694645:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa24651432774e51 lrc: 4/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694652:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa24651432774e51 lrc: 4/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694658:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa24651432774e51 lrc: 3/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694736:0:63712:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340845.694805:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7600/0xa24651432774e4a lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694813:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7600/0xa24651432774e4a lrc: 2/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694820:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7600/0xa24651432774e4a lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694835:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340845.694840:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7600/0xa24651432774e4a lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694848:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7600/0xa24651432774e4a lrc: 4/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694860:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff8c0477219500) 00010000:00010000:2.0:1780340845.694864:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1780340845.694868:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7600/0xa24651432774e4a lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694875:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7600/0xa24651432774e4a lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694897:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7000/0xa24651432774e3c lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694904:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7000/0xa24651432774e3c lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694910:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7000/0xa24651432774e3c lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694916:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7000/0xa24651432774e3c lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694922:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340845.694924:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7000/0xa24651432774e3c lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694942:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7000/0xa24651432774e3c lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694950:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff8c045a87a400) 00010000:00010000:2.0:1780340845.694953:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340845.694956:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7000/0xa24651432774e3c lrc: 3/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694962:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7000/0xa24651432774e3c lrc: 0/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340845.694972:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000b4da163 reply state 0000000071a67d42 transno 81604378750 ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7200/0xa24651432774e43 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694984:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7200/0xa24651432774e43 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.694991:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff8c04495cd700) 00010000:00010000:2.0:1780340845.694993:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340845.694997:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340845.695105:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+22:70630:x1866818940458240:12345-192.168.203.16@tcp:36:rm.0 Request processed in 1557us (2786us total) trans 81604378750 rc 0/0 00000100:00100000:2.0:1780340845.695115:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1367 00000100:00100000:1.0:1780340845.700881:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00010000:00010000:0.0:1780340845.701451:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340845.701464:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa24651432774e51 lrc: 2/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.701479:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340845.701484:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa24651432774e51 lrc: 2/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.701496:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa24651432774e51 lrc: 3/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.701517:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff8c0477219500) 00010000:00010000:0.0:1780340845.701520:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1780340845.701527:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa24651432774e51 lrc: 1/0,0 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.701560:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa24651432774e51 lrc: 0/0,0 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340845.701568:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940458496 00000100:00100000:3.0:1780340845.701584:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940458496 00010000:00010000:0.0:1780340845.701598:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340845.701601:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340845.701603:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340845.701675:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 239 00000100:00100000:3.0:1780340845.701688:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+22:70630:x1866818940458496:12345-192.168.203.16@tcp:35:rm.0 00000100:00100000:3.0:1780340845.702057:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+23:70630:x1866818940458496:12345-192.168.203.16@tcp:35:rm.0 Request processed in 371us (1190us total) trans 81604378751 rc 0/0 00000100:00100000:3.0:1780340845.702066:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 239 00000100:00100000:3.0:1780340845.705680:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340845.717645:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940458752 00000100:00100000:2.0:1780340845.717666:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940458752 00000100:00100000:0.0:1780340845.721353:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1368 00000100:00100000:1.0:1780340845.722380:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+23:70630:x1866818940458752:12345-192.168.203.16@tcp:36:rm.0 00010000:00010000:1.0:1780340845.722475:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1780340845.722515:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9600/0xa24651432774e2e lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2535 expref: 23 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.722541:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0347785200/0xa24651432774942 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24c5 expref: 22 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.722574:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff8c045a87a400) 00010000:00010000:1.0:1780340845.722596:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6600/0xa24651432774de1 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2512 expref: 21 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.722605:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c0444f27600) 00010000:00010000:1.0:1780340845.722609:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780340845.722640:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122a00/0xa24651432774e58 lrc: 3/0,1 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.722656:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122a00/0xa24651432774e58 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.722667:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122a00/0xa24651432774e58 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.722687:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa24651432774e5f lrc: 3/0,1 mode: --/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.722694:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa24651432774e5f lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.722701:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa24651432774e5f lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.722884:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774e66 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.722893:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774e66 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.722911:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774e66 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340845.723222:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:1.0:1780340845.723245:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774e66 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.723253:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774e66 lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.726435:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774e66 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.726457:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340845.726462:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774e66 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.726473:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774e66 lrc: 4/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.726495:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff8c04495cd300) 00010000:00010000:1.0:1780340845.726498:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1780340845.726504:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774e66 lrc: 2/0,0 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.726511:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122c00/0xa24651432774e66 lrc: 0/0,0 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.726558:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122a00/0xa24651432774e58 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.726565:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122a00/0xa24651432774e58 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.726595:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122a00/0xa24651432774e58 lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.726602:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122a00/0xa24651432774e58 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.726607:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340845.726610:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122a00/0xa24651432774e58 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.726616:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122a00/0xa24651432774e58 lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.726626:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c0444f27600) 00010000:00010000:1.0:1780340845.726628:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340845.726632:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122a00/0xa24651432774e58 lrc: 3/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.726638:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122a00/0xa24651432774e58 lrc: 0/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340845.726651:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000028a3ea56 reply state 00000000db46cfa6 transno 81604378752 ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa24651432774e5f lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.726666:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa24651432774e5f lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.726674:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff8c04495cd100) 00010000:00010000:1.0:1780340845.726676:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340845.726680:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780340845.726854:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+22:70630:x1866818940458752:12345-192.168.203.16@tcp:36:rm.0 Request processed in 5481us (21193us total) trans 81604378752 rc 0/0 00000100:00100000:1.0:1780340845.726873:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1368 00000100:00100000:1.0:1780340845.739642:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340845.739709:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340845.739813:0:25499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940458880 00000100:00100000:0.0:1780340845.739835:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940459136 00000100:00100000:3.0:1780340845.739840:0:25499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940458880 00000100:00100000:0.0:1780340845.739841:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940459136 00000100:00100000:0.0:1780340845.739918:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 240 00000100:00100000:3.0:1780340845.739923:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 713 00000100:00100000:0.0:1780340845.739935:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+22:70630:x1866818940459136:12345-192.168.203.16@tcp:35:rm.0 00000100:00100000:3.0:1780340845.739936:0:25499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2407:x1866818940458880:12345-192.168.203.16@tcp:103:rm.0 00010000:00010000:3.0:1780340845.739961:0:25499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340845.739995:0:25499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432774dd3 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced250b expref: 8 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.740017:0:25499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c047a68b200) 00010000:00010000:3.0:1780340845.740036:0:25499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340845.740101:0:25499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940458880:12345-192.168.203.16@tcp:103:rm.0 Request processed in 171us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340845.740108:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 713 00000100:00100000:0.0:1780340845.740187:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+23:70630:x1866818940459136:12345-192.168.203.16@tcp:35:rm.0 Request processed in 256us (476us total) trans 81604378753 rc 0/0 00000100:00100000:0.0:1780340845.740195:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 240 00000100:00100000:2.0:1780340845.748757:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340845.748997:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940459392 00000100:00100000:1.0:1780340845.749010:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940459392 00000100:00100000:1.0:1780340845.749194:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1369 00000100:00100000:1.0:1780340845.749206:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+23:70630:x1866818940459392:12345-192.168.203.16@tcp:36:rm.0 00010000:00010000:1.0:1780340845.749290:0:63710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1780340845.749328:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa24651432774dfd lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2520 expref: 23 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.749355:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04722ae400/0xa24651432774926 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24be expref: 22 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.749370:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c0444f27600) 00010000:00010000:1.0:1780340845.749385:0:63710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780340845.749447:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.749457:0:63710:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.749468:0:63710:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340845.749496:0:63710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444227b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63710:1866818961177600:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1780340845.749558:0:63710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340845.749706:0:63710:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034b093f00 going to sleep for 11 seconds 00000100:00100000:2.0:1780340845.754557:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961177600 00000100:00100000:2.0:1780340845.754576:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961177600 00000100:00100000:2.0:1780340845.754669:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3894 00000100:00100000:2.0:1780340845.754682:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63710:x1866818961177600:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1780340845.754728:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340845.754755:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432774e74 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa24651432774e6d expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.754829:0:8410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432774bb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24b0 expref: 6 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.754841:0:8410:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432774e74 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774e6d expref: 9 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.754886:0:8410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432774bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24b0 expref: 6 pid: 88698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.755496:0:8410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432774bb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24b0 expref: 6 pid: 88698 timeout: 3725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340845.755515:0:8410:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a07ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8410:1866818961177728:192.168.203.16@tcp:104: 00000100:00100000:2.0:1780340845.755638:0:8410:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446ff29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340845.762631:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340845.763044:0:8410:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a07ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8410:1866818961177728:192.168.203.16@tcp:104: 00000100:00100000:0.0:1780340845.763079:0:19125:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940459520 00000100:00100000:0.0:1780340845.763089:0:19125:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940459520 00010000:00010000:2.0:1780340845.763093:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432774e74 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774e6d expref: 9 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.763109:0:8410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:2.0:1780340845.763112:0:8410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340845.763116:0:8410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432774e74 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774e6d expref: 9 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.763126:0:19125:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432774bb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24b0 expref: 7 pid: 88698 timeout: 3725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.763151:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7600, rc 0) 00000100:00100000:0.0:1780340845.763160:0:19125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2553 00000100:00100000:0.0:1780340845.763169:0:19125:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04757c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940459520:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780340845.763194:0:19125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340845.763200:0:19125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432774bb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24b0 expref: 7 pid: 88698 timeout: 3725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.763212:0:19125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432774bb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24b0 expref: 7 pid: 88698 timeout: 3725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340845.763226:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63710:x1866818961177600:12345-0@lo:101:mdt00_000.0 Request processed in 8547us (13668us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340845.763234:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3894 00010000:00010000:0.0:1780340845.763245:0:19125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c045ec6c400/0xa24651432774bb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24b0 expref: 7 pid: 88698 timeout: 3725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.763263:0:19125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:0.0:1780340845.763267:0:19125:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432774e74 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774e6d expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.763277:0:19125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432774e74 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xa24651432774e6d expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.763286:0:19125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432774e74 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xa24651432774e6d expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340845.763294:0:63710:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444227b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63710:1866818961177600:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1780340845.763313:0:63710:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.763324:0:63710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.763326:0:19125:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432774e74 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774e6d expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340845.763344:0:19125:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19125:1866818961177856:0@lo:105: 00000100:00100000:0.0:1780340845.763386:0:19125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340845.763427:0:19125:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a247480 going to sleep for 11 seconds 00000100:00100000:2.0:1780340845.764061:0:9471:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961177856 00000100:00100000:2.0:1780340845.764068:0:9471:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961177856 00000100:00100000:2.0:1780340845.765071:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1780340845.765092:0:9471:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:19125:x1866818961177856:12345-0@lo:105: 00010000:00010000:2.0:1780340845.765110:0:9471:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.765124:0:9471:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.765135:0:9471:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.765143:0:9471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.765172:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.765182:0:9471:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340845.765219:0:9471:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8c0453122a00) 00000100:00100000:2.0:1780340845.765304:0:9471:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:19125:x1866818961177856:12345-0@lo:105: Request processed in 221us (1916us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340845.765313:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1780340845.765885:0:19125:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19125:1866818961177856:0@lo:105: 00010000:00010000:0.0:1780340845.765909:0:19125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340845.765993:0:19125:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04757c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2407:x1866818940459520:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 2821us (3375us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340845.766003:0:19125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2553 00010000:00010000:0.0:1780340845.766231:0:63710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.766260:0:63710:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780340845.766287:0:63710:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1780340845.766348:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa4400/0xa24651432774e7b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.766356:0:63710:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa4400/0xa24651432774e7b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.766366:0:63710:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa4400/0xa24651432774e7b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340845.766389:0:63710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63710:1866818961177984:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1780340845.766433:0:63710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340845.766466:0:63710:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a247b40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340845.766488:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961177984 00000100:00100000:0.0:1780340845.766495:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961177984 00000100:00100000:0.0:1780340845.766536:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895 00000100:00100000:0.0:1780340845.766545:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63710:x1866818961177984:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1780340845.766564:0:26074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340845.766583:0:26074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432774e82 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa24651432774e7b expref: -99 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.766613:0:26074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432774e82 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774e7b expref: 10 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.766628:0:26074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432774e82 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774e7b expref: 10 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.766643:0:26074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8c0345328300) 00010000:00010000:0.0:1780340845.766646:0:26074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340845.766650:0:26074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5c00, rc 0) 00000100:00100000:0.0:1780340845.766685:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63710:x1866818961177984:12345-0@lo:101:mdt00_000.0 Request processed in 141us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340845.766692:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895 00000100:00100000:0.0:1780340845.766728:0:63710:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63710:1866818961177984:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1780340845.766741:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa4400/0xa24651432774e7b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa24651432774e82 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.766750:0:63710:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa4400/0xa24651432774e7b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa24651432774e82 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780340845.766798:0:63710:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1780340845.766840:0:63710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63710:1866818961178112:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1780340845.766868:0:63710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340845.766885:0:63710:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a247540 going to sleep for 11 seconds 00000100:00100000:0.0:1780340845.766902:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961178112 00000100:00100000:0.0:1780340845.766906:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961178112 00000100:00100000:0.0:1780340845.766933:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896 00000100:00100000:0.0:1780340845.766940:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63710:x1866818961178112:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1780340845.767014:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63710:x1866818961178112:12345-0@lo:1000:mdt00_000.0 Request processed in 74us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340845.767021:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896 00000100:00100000:0.0:1780340845.767050:0:63710:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63710:1866818961178112:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1780340845.767109:0:63710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63710:1866818961178240:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1780340845.767132:0:63710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340845.767145:0:63710:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a247540 going to sleep for 11 seconds 00000100:00100000:0.0:1780340845.767157:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961178240 00000100:00100000:0.0:1780340845.767160:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961178240 00000100:00100000:0.0:1780340845.767181:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3897 00000100:00100000:0.0:1780340845.767186:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63710:x1866818961178240:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1780340845.767281:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63710:x1866818961178240:12345-0@lo:1000:mdt00_000.0 Request processed in 94us (148us total) trans 0 rc 1/1 00000100:00100000:0.0:1780340845.767287:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3897 00000100:00100000:0.0:1780340845.767315:0:63710:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63710:1866818961178240:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1780340845.767357:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa5800/0xa24651432774e89 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.767365:0:63710:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa5800/0xa24651432774e89 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.767374:0:63710:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa5800/0xa24651432774e89 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340845.767384:0:63710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63710:1866818961178368:0@lo:101:mdt00_000.0 00000100:00100000:0.0:1780340845.767405:0:63710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340845.767418:0:63710:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a247b40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340845.767428:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961178368 00000100:00100000:0.0:1780340845.767431:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961178368 00000100:00100000:0.0:1780340845.767451:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898 00000100:00100000:0.0:1780340845.767457:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63710:x1866818961178368:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1780340845.767464:0:22660:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340845.767482:0:22660:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4200/0xa24651432774e90 lrc: 2/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa24651432774e89 expref: -99 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.767501:0:22660:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4200/0xa24651432774e90 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774e89 expref: 11 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.767513:0:22660:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4200/0xa24651432774e90 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774e89 expref: 11 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.767521:0:22660:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c0345328700) 00010000:00010000:0.0:1780340845.767523:0:22660:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1780340845.767526:0:22660:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4200, rc 0) 00000100:00100000:0.0:1780340845.767552:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63710:x1866818961178368:12345-0@lo:101:mdt00_000.0 Request processed in 94us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340845.767557:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898 00000100:00100000:0.0:1780340845.767582:0:63710:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63710:1866818961178368:0@lo:101:mdt00_000.0 00010000:00010000:0.0:1780340845.767592:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa5800/0xa24651432774e89 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa24651432774e90 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.767599:0:63710:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa5800/0xa24651432774e89 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa24651432774e90 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.767623:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4e00/0xa24651432774e97 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.767634:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4e00/0xa24651432774e97 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.767642:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4e00/0xa24651432774e97 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1780340845.768126:0:63710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].3, 432 off36352 00000040:00080000:0.0:1780340845.768193:0:63710:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].3, 512 off36784 00000004:00080000:0.0:1780340845.768200:0:63710:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c034a247b40 with version 11 00000004:00080000:1.0:1780340845.768398:0:72687:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c034acb9780 version 11 rpc_version 11 00000020:00100000:1.0:1780340845.768429:0:72687:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1780340845.768439:0:72687:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c0444227b80 x1866818961178624/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1760/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340845.768459:0:72687:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444227b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72687:1866818961178624:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1780340845.768513:0:72687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340845.768539:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034b093a80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340845.776087:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961178624 00000100:00100000:0.0:1780340845.776108:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961178624 00000100:00100000:0.0:1780340845.776201:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3899 00000100:00100000:0.0:1780340845.776214:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:72687:x1866818961178624:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1780340845.788650:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:72687:x1866818961178624:12345-0@lo:1000:osp_up0-1.0 Request processed in 12425us (20123us total) trans 115964116994 rc 0/0 00000100:00100000:0.0:1780340845.788679:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899 00000100:00100000:1.0:1780340845.791369:0:72687:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444227b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72687:1866818961178624:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1780340845.791502:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1780340845.791537:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4e00/0xa24651432774e97 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.791549:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4e00/0xa24651432774e97 lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.791557:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4e00/0xa24651432774e97 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.791564:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340845.791569:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4e00/0xa24651432774e97 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.791578:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4e00/0xa24651432774e97 lrc: 4/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.791598:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c0345328f00) 00010000:00010000:0.0:1780340845.791601:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340845.791634:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4e00/0xa24651432774e97 lrc: 2/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.791641:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4e00/0xa24651432774e97 lrc: 0/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.791669:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa5800/0xa24651432774e89 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa24651432774e90 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.791679:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa5800/0xa24651432774e89 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa24651432774e90 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.791687:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa5800/0xa24651432774e89 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa24651432774e90 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.791723:0:63710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1780340845.791747:0:63710:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1780340845.791754:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.791806:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.791814:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.791908:0:63710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:0.0:1780340845.791914:0:63710:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1780340845.791920:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa4400/0xa24651432774e7b lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa24651432774e82 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340845.791939:0:63710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa4400/0xa24651432774e7b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa24651432774e82 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340845.792056:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+22:70630:x1866818940459392:12345-192.168.203.16@tcp:36:rm.0 Request processed in 42849us (43311us total) trans 81604378754 rc 0/0 00000100:00100000:0.0:1780340845.792067:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1369 00010000:00010000:3.0:1780340845.796990:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340845.797008:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa5800/0xa24651432774e89 lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xa24651432774e90 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.797024:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5800 already unused, calling callback (ffffffffc18205b0) 00010000:00010000:3.0:1780340845.797175:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa5800/0xa24651432774e89 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa24651432774e90 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340845.797187:0:23160:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa5800/0xa24651432774e89 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa24651432774e90 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.797248:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa5800/0xa24651432774e89 lrc: 2/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa24651432774e90 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.797255:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1780340845.797356:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1780340845.797440:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa5800/0xa24651432774e89 lrc: 1/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa24651432774e90 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.797449:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa5800/0xa24651432774e89 lrc: 0/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa24651432774e90 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.797478:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340845.797483:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.797490:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122a00 already unused, calling callback (ffffffffc18205b0) 00010000:00010000:3.0:1780340845.797494:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340845.797500:0:23160:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.797521:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.797527:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780340845.797609:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340845.809253:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961178880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780340845.809369:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340845.809416:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961178752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780340845.809440:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340845.809565:0:6503:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961178880 00000100:00100000:1.0:1780340845.809576:0:6503:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961178880 00000100:00100000:1.0:1780340845.809649:0:6503:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961178752 00000100:00100000:1.0:1780340845.809653:0:6503:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961178752 00000100:00100000:1.0:1780340845.809690:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1780340845.809701:0:6503:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+13:3662:x1866818961178880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340845.809723:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340845.809754:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432774e74 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774e6d expref: 13 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.809819:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:1.0:1780340845.809826:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340845.809874:0:6503:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3662:x1866818961178880:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340845.809883:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1780340845.809914:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1780340845.809921:0:6503:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3662:x1866818961178752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340845.809928:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340845.809940:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4200/0xa24651432774e90 lrc: 0/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774e89 expref: 11 pid: 22660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340845.809970:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff8c0345328700) 00010000:00010000:1.0:1780340845.809982:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340845.810007:0:6503:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:3662:x1866818961178752:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340845.810013:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1780340845.810075:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961178880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340845.810086:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961178752:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340845.811637:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.811655:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0453122a00/0xa24651432774e6d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa24651432774e74 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340845.811681:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340845.811684:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340845.811687:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340846.475255:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340847.498869:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340848.010307:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818961179136:0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.010377:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340848.010428:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961179648:0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.010455:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340848.010471:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961180160:0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.010491:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340848.010505:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961180672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340848.010526:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340848.010552:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1780340848.010559:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961179008:0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.010587:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340848.010614:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961179520:0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.010657:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340848.010673:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961180032:0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.010693:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340848.010707:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1866818961180544:0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.010725:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340848.010788:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961179648 00000100:00100000:0.0:1780340848.010795:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961179648 00000100:00100000:0.0:1780340848.010841:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961180160 00000100:00100000:0.0:1780340848.010845:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961180160 00000100:00100000:0.0:1780340848.010949:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900 00000100:00100000:0.0:1780340848.010959:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3660:x1866818961179648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.011022:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3660:x1866818961179648:12345-0@lo:400:kworker.0 Request processed in 64us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340848.011029:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3900 00000100:00100000:0.0:1780340848.011046:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901 00000100:00100000:0.0:1780340848.011052:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961180160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.011079:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961180160:12345-0@lo:400:kworker.0 Request processed in 28us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340848.011085:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901 00000100:00100000:0.0:1780340848.011107:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961180672 00000100:00100000:0.0:1780340848.011110:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961180672 00000100:00100000:0.0:1780340848.011137:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096 00000100:00100000:0.0:1780340848.011142:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961180672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340848.011162:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340848.011186:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961180672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340848.011200:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096 00000100:00100000:0.0:1780340848.011216:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961179008 00000100:00100000:0.0:1780340848.011220:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961179008 00000100:00100000:0.0:1780340848.011238:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1780340848.011243:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961179008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.011267:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961179008:12345-0@lo:400:kworker.0 Request processed in 24us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340848.011272:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1780340848.011295:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961179136 00000100:00100000:0.0:1780340848.011298:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961179136 00000100:00100000:0.0:1780340848.011318:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961179520 00000100:00100000:0.0:1780340848.011320:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961179520 00000100:00100000:0.0:1780340848.011330:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961180032 00000100:00100000:0.0:1780340848.011332:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961180032 00000100:00100000:0.0:1780340848.011342:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961180544 00000100:00100000:0.0:1780340848.011344:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961180544 00000100:00100000:0.0:1780340848.011354:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:0.0:1780340848.011359:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1866818961179136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.011382:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1866818961179136:12345-0@lo:400:kworker.0 Request processed in 23us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340848.011387:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:0.0:1780340848.011397:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:0.0:1780340848.011403:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961179520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.011424:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961179520:12345-0@lo:400:kworker.0 Request processed in 22us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340848.011429:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00100000:0.0:1780340848.011439:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:0.0:1780340848.011450:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961180032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.011473:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961180032:12345-0@lo:400:kworker.0 Request processed in 24us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340848.011478:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:0.0:1780340848.011488:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:0.0:1780340848.011492:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1866818961180544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.011510:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1866818961180544:12345-0@lo:400:kworker.0 Request processed in 18us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340848.011515:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:0.0:1780340848.011554:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961179008:0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.011565:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961179520:0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.011573:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961180032:0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.011581:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1866818961180544:0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.011589:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818961179136:0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.011597:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961179648:0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.011604:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961180160:0@lo:400:kworker.0 00000100:00100000:0.0:1780340848.011616:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961180672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340848.011940:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961179264:0@lo:400:kworker.0 00000100:00100000:2.0:1780340848.011972:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340848.011991:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961179776:0@lo:400:kworker.0 00000100:00100000:2.0:1780340848.012011:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340848.012026:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961180288:0@lo:400:kworker.0 00000100:00100000:2.0:1780340848.012042:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340848.012058:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1780340848.012063:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961179392:0@lo:400:kworker.0 00000100:00100000:2.0:1780340848.012079:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340848.012091:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961179904:0@lo:400:kworker.0 00000100:00100000:2.0:1780340848.012107:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340848.012120:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961180416:0@lo:400:kworker.0 00000100:00100000:2.0:1780340848.012150:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340848.012177:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961179264 00000100:00100000:2.0:1780340848.012181:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961179264 00000100:00100000:2.0:1780340848.012208:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961179392 00000100:00100000:2.0:1780340848.012211:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961179392 00000100:00100000:2.0:1780340848.012226:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:2.0:1780340848.012232:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961179264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340848.012269:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961179264:12345-0@lo:400:kworker.0 Request processed in 37us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340848.012275:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:2.0:1780340848.012286:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:2.0:1780340848.012291:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961179392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340848.012314:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961179392:12345-0@lo:400:kworker.0 Request processed in 23us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340848.012320:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00080000:2.0:1780340848.012335:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340848.012338:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780340848.012341:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340848.012350:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961179776 00000100:00100000:2.0:1780340848.012353:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961179776 00000100:00100000:2.0:1780340848.012377:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961180288 00000100:00100000:2.0:1780340848.012380:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961180288 00000100:00100000:2.0:1780340848.012407:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961179904 00000100:00100000:2.0:1780340848.012410:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961179904 00000100:00100000:2.0:1780340848.012426:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961180416 00000100:00100000:2.0:1780340848.012428:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961180416 00000100:00100000:2.0:1780340848.012446:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:2.0:1780340848.012452:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961179776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340848.012481:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961179776:12345-0@lo:400:kworker.0 Request processed in 29us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340848.012492:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000100:00100000:2.0:1780340848.012503:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:2.0:1780340848.012508:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961180288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340848.012534:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961180288:12345-0@lo:400:kworker.0 Request processed in 27us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340848.012539:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00000100:00100000:2.0:1780340848.012549:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00100000:2.0:1780340848.012554:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961179904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340848.012576:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961179904:12345-0@lo:400:kworker.0 Request processed in 23us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340848.012581:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00100000:2.0:1780340848.012590:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:2.0:1780340848.012596:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961180416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340848.012618:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961180416:12345-0@lo:400:kworker.0 Request processed in 22us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340848.012623:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00080000:2.0:1780340848.012654:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340848.012656:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340848.012677:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961179392:0@lo:400:kworker.0 00000100:00100000:2.0:1780340848.012687:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961179904:0@lo:400:kworker.0 00000100:00100000:2.0:1780340848.012697:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961180416:0@lo:400:kworker.0 00000100:00100000:2.0:1780340848.012705:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961179264:0@lo:400:kworker.0 00000100:00100000:2.0:1780340848.012714:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961179776:0@lo:400:kworker.0 00000100:00100000:2.0:1780340848.012731:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961180288:0@lo:400:kworker.0 00000004:00080000:1.0:1780340848.014156:0:72690:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3628003394839ns, next at 3629003392382ns, rc = 0 00000100:00100000:1.0:1780340848.014192:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961180928:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340848.014240:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340848.014266:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340848.014273:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961180800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340848.014297:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340848.014332:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961180800 00000100:00100000:1.0:1780340848.014337:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961180800 00000100:00100000:1.0:1780340848.014374:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902 00000100:00100000:1.0:1780340848.014381:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961180800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780340848.014420:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445478400 avail 1299238912 00000100:00100000:1.0:1780340848.014458:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961180800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340848.014465:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3902 00000100:00100000:1.0:1780340848.014507:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961180800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780340848.014862:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340848.014881:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961181056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340848.014911:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340848.014942:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961181056 00000100:00100000:3.0:1780340848.014946:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961181056 00000100:00100000:3.0:1780340848.014974:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3903 00000100:00100000:3.0:1780340848.014980:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3660:x1866818961181056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340848.015001:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445232640 avail 1298993152 00000100:00100000:3.0:1780340848.015034:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3660:x1866818961181056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 54us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340848.015040:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3903 00000100:00100000:3.0:1780340848.015073:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961181056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340848.015217:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961180928 00000100:00100000:0.0:1780340848.015222:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961180928 00000100:00100000:0.0:1780340848.015258:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097 00000100:00100000:0.0:1780340848.015265:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961180928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340848.015281:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340848.015330:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961180928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340848.015337:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097 00000100:00100000:0.0:1780340848.015440:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961180928:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1780340848.018698:0:72681:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 3 committed 00010000:00010000:2.0:1780340848.018816:0:72681:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa4400/0xa24651432774e7b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa24651432774e82 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340848.018835:0:72681:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa4400/0xa24651432774e7b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa24651432774e82 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.018879:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123e00/0xa24651432774bd4 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.018897:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123e00/0xa24651432774bd4 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340848.018900:0:72681:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa4400/0xa24651432774e7b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa24651432774e82 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.018919:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123e00/0xa24651432774bd4 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340848.018920:0:72681:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340848.018932:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340848.018940:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123e00/0xa24651432774bd4 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.018950:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123e00/0xa24651432774bd4 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340848.018956:0:72681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c0475fa4400/0xa24651432774e7b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa24651432774e82 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.018970:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff8c04495cd700) 00010000:00010000:3.0:1780340848.018986:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000001:00080000:2.0:1780340848.018986:0:72681:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378754 is committed 00010000:00010000:3.0:1780340848.018994:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123e00/0xa24651432774bd4 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.019002:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123e00/0xa24651432774bd4 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1780340848.019014:0:72681:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00010000:00010000:3.0:1780340848.019033:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7200/0xa24651432774e43 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.019041:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7200/0xa24651432774e43 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.019047:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7200/0xa24651432774e43 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.019052:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340848.019055:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7200/0xa24651432774e43 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.019062:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7200/0xa24651432774e43 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.019070:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff8c04495cd700) 00010000:00010000:3.0:1780340848.019073:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340848.019075:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7200/0xa24651432774e43 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.019081:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7200/0xa24651432774e43 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.019100:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa24651432774e5f lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.019112:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa24651432774e5f lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.019118:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa24651432774e5f lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.019123:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340848.019126:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa24651432774e5f lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.019132:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa24651432774e5f lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.019141:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff8c04495cd100) 00010000:00010000:3.0:1780340848.019144:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340848.019147:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa24651432774e5f lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.019151:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122800/0xa24651432774e5f lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340848.019379:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340848.019417:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961181184:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1780340848.019433:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340848.019455:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961181312:0@lo:6:osp-syn-0-1.0 00000100:00100000:1.0:1780340848.019515:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340848.019534:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340848.019606:0:6502:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961181184 00000100:00100000:1.0:1780340848.019616:0:6502:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961181184 00000100:00100000:1.0:1780340848.019692:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1780340848.019706:0:6502:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445595500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3659:x1866818961181184:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1780340848.019723:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340848.019748:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432774e82 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774e7b expref: 10 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340848.019804:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff8c0345328300) 00010000:00010000:1.0:1780340848.019816:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340848.020973:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961181312 00000100:00100000:3.0:1780340848.020985:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961181312 00000100:00100000:3.0:1780340848.021046:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5919 00000100:00100000:3.0:1780340848.021055:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961181312:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:3.0:1780340848.021087:0:25488:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1570 count 1 00010000:00010000:3.0:1780340848.021126:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432774e9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.021148:0:25488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007bc9e19a/0xa24651432774bf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2504 expref: 6 pid: 23153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.021157:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1780340848.021159:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1780340848.021162:0:25488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432774e9e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.021197:0:25488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007bc9e19a/0xa24651432774bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2504 expref: 6 pid: 23153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.021211:0:25488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007bc9e19a/0xa24651432774bf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2504 expref: 6 pid: 23153 timeout: 3728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340848.021225:0:25488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:25488:1866818961181440:192.168.203.16@tcp:104: 00000100:00100000:3.0:1780340848.021300:0:25488:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c03498453c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340848.024881:0:6502:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445595500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+9:3659:x1866818961181184:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 5165us (5353us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340848.024899:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:2.0:1780340848.025203:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961181184:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:3.0:1780340848.027796:0:25488:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:25488:1866818961181440:192.168.203.16@tcp:104: 00010000:00010000:3.0:1780340848.027827:0:25488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432774e9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340848.030688:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340848.030815:0:19125:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940459648 00000100:00100000:2.0:1780340848.030824:0:19125:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940459648 00010000:00010000:2.0:1780340848.030887:0:19125:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007bc9e19a/0xa24651432774bf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2504 expref: 7 pid: 23153 timeout: 3728 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340848.030928:0:19125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2554 00000100:00100000:2.0:1780340848.030938:0:19125:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445595c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940459648:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780340848.030952:0:19125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340848.030957:0:19125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007bc9e19a/0xa24651432774bf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2504 expref: 7 pid: 23153 timeout: 3728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340848.030983:0:19125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007bc9e19a/0xa24651432774bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2504 expref: 7 pid: 23153 timeout: 3728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340848.031004:0:19125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bc9e19a/0xa24651432774bf7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2504 expref: 7 pid: 23153 timeout: 3728 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340848.031019:0:19125:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340848.031021:0:19125:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340848.031025:0:19125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432774e9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340848.031033:0:19125:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432774e9e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340848.031058:0:19125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340848.031107:0:19125:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445595c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2407:x1866818940459648:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 171us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340848.031114:0:19125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2554 00000100:00080000:3.0:1780340848.031545:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1780340848.031577:0:25488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432774e9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.031615:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432774e9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.031629:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432774e9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.031637:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432774e9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340848.031681:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1780340848.031989:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+6:3662:x1866818961181312:12345-0@lo:6:osp-syn-0-1.0 Request processed in 10931us (12454us total) trans 4294969456 rc 0/0 00000100:00100000:3.0:1780340848.032001:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5919 00000004:00080000:1.0:1780340848.032036:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c0445597100/2, rc 0, transno 4294969456 00000100:00100000:1.0:1780340848.032048:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961181312:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1780340848.032099:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340848.032107:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432774e9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340848.032117:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340848.032122:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432774e9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340848.032147:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432774e9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340848.032162:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432774e9e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340848.032169:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432774e9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340848.032189:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340848.032192:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340848.032194:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340848.522588:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340848.522679:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961181568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340848.522753:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340848.522894:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961181696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340848.522923:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340848.522999:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961181568 00000100:00100000:0.0:1780340848.523011:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961181568 00000100:00100000:0.0:1780340848.523072:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961181696 00000100:00100000:0.0:1780340848.523075:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961181696 00000100:00100000:0.0:1780340848.523099:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098 00000100:00100000:0.0:1780340848.523109:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961181568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340848.523136:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340848.523214:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961181568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340848.523222:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098 00000100:00100000:0.0:1780340848.523254:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:0.0:1780340848.523261:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961181696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780340848.523271:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340848.523300:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961181696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340848.523306:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00000100:00100000:1.0:1780340848.523845:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034a205f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961181696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340848.523916:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961181568:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1780340848.660727:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969456 is committed 00000001:00080000:3.0:1780340848.660748:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969455 is committed 00000001:00100000:3.0:1780340848.660832:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000001:00080000:2.0:1780340849.040853:0:88666:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116994 is committed 00000001:00080000:0.0:1780340849.043505:0:9462:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969454 is committed 00000100:00100000:0.0:1780340849.196556:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340849.196599:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340849.196636:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340849.196727:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940459776 00000100:00100000:2.0:1780340849.196738:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940459776 00000100:00100000:2.0:1780340849.196819:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 74 00000100:00100000:2.0:1780340849.196850:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2410:x1866818940459776:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340849.196920:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2410:x1866818940459776:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 81us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340849.196927:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 74 00000100:00100000:3.0:1780340849.197480:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940459904 00000100:00100000:3.0:1780340849.197486:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940459904 00000100:00100000:3.0:1780340849.197528:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1366 00000100:00100000:3.0:1780340849.197536:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2409:x1866818940459904:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340849.197576:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2409:x1866818940459904:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 41us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340849.197583:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1366 00000100:00080000:2.0:1780340849.197641:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780340849.197780:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340849.197860:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940460032 00000100:00100000:2.0:1780340849.197864:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940460032 00000100:00100000:2.0:1780340849.197908:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1367 00000100:00100000:2.0:1780340849.197915:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2409:x1866818940460032:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340849.197975:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2409:x1866818940460032:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 59us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340849.197981:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1367 00000100:00080000:3.0:1780340849.198421:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340849.200001:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940460160 00000100:00100000:1.0:1780340849.200028:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940460160 00000100:00100000:0.0:1780340849.200193:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2593 00000100:00100000:0.0:1780340849.200209:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2409:x1866818940460160:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340849.200308:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2409:x1866818940460160:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 101us (3671us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340849.200316:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2593 00010000:00010000:1.0:1780340849.548318:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340850.571123:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340851.594569:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340852.618082:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340853.129950:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1780340853.129973:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961181824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340853.130042:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340853.130082:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961181952:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340853.130105:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340853.130136:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961181824 00000100:00100000:1.0:1780340853.130143:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961181824 00000100:00100000:1.0:1780340853.130193:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961181952 00000100:00100000:1.0:1780340853.130197:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961181952 00000100:00100000:0.0:1780340853.130208:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961182208:0@lo:400:kworker.0 00000100:00100000:1.0:1780340853.130214:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904 00000100:00100000:1.0:1780340853.130222:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961181824:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340853.130239:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1780340853.130256:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445232640 avail 1298993152 00000100:00100000:1.0:1780340853.130296:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961181824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340853.130304:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904 00000100:00100000:1.0:1780340853.130320:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3905 00000100:00100000:1.0:1780340853.130326:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961181952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780340853.130342:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445478400 avail 1299238912 00000100:00100000:3.0:1780340853.130354:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961182080:0@lo:400:kworker.0 00000100:00100000:1.0:1780340853.130366:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961181952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 41us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340853.130371:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3905 00000100:00100000:3.0:1780340853.130382:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340853.130389:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961182336:0@lo:400:kworker.0 00000100:00100000:3.0:1780340853.130407:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961182592:0@lo:400:kworker.0 00000100:00100000:3.0:1780340853.130428:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961182080 00000100:00100000:3.0:1780340853.130432:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961182080 00000100:00100000:3.0:1780340853.130467:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1780340853.130474:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961182080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340853.130507:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961182080:12345-0@lo:400:kworker.0 Request processed in 34us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340853.130513:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1780340853.130542:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961182464:0@lo:400:kworker.0 00000100:00100000:0.0:1780340853.130594:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961182720:0@lo:400:kworker.0 00000100:00100000:2.0:1780340853.130609:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340853.130617:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340853.130625:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961182976:0@lo:400:kworker.0 00000100:00100000:0.0:1780340853.130629:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961183232:0@lo:400:kworker.0 00000100:00100000:0.0:1780340853.130644:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340853.130645:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340853.130660:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961183488:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340853.130671:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961182720 00000100:00100000:0.0:1780340853.130674:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961182720 00000100:00100000:2.0:1780340853.130679:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340853.130701:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961183232 00000100:00100000:0.0:1780340853.130704:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961183232 00000100:00100000:2.0:1780340853.130706:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961182208 00000100:00100000:2.0:1780340853.130709:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961182208 00000100:00100000:2.0:1780340853.130741:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961182464 00000100:00100000:2.0:1780340853.130744:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961182464 00000100:00100000:2.0:1780340853.130786:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961182976 00000100:00100000:2.0:1780340853.130789:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961182976 00000100:00100000:2.0:1780340853.130803:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:2.0:1780340853.130809:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818961182208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340853.130814:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:3.0:1780340853.130820:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961182464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340853.130894:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:0.0:1780340853.130902:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961182720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340853.132327:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:1.0:1780340853.132344:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961183232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340853.137892:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818961182208:12345-0@lo:400:kworker.0 Request processed in 7073us (7641us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340853.137906:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00100000:2.0:1780340853.137941:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:2.0:1780340853.137955:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961182976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340853.138022:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961182976:12345-0@lo:400:kworker.0 Request processed in 74us (7375us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340853.138042:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00100000:2.0:1780340853.138066:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961183488 00000100:00100000:2.0:1780340853.138074:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961183488 00000100:00100000:2.0:1780340853.138119:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100 00000100:00100000:2.0:1780340853.138125:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961183488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340853.138145:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340853.138174:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961183488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (7493us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340853.138179:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100 00000100:00100000:2.0:1780340853.138224:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961182976:0@lo:400:kworker.0 00000100:00100000:2.0:1780340853.138239:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961183488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340853.138276:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961182208:0@lo:400:kworker.0 00000100:00080000:2.0:1780340853.138373:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780340853.138378:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340853.138380:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340853.138395:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340853.138425:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961183104:0@lo:400:kworker.0 00000100:00100000:2.0:1780340853.138452:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340853.138465:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961183616:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340853.142474:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340853.142685:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a205f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961182464:12345-0@lo:400:kworker.0 Request processed in 11862us (12071us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340853.142699:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00100000:2.0:1780340853.143845:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961182080:0@lo:400:kworker.0 00000100:00100000:2.0:1780340853.143890:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961183104 00000100:00100000:2.0:1780340853.143897:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961183104 00000100:00100000:2.0:1780340853.143946:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2596 00000100:00100000:2.0:1780340853.143954:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961183104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340853.144031:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961183104:12345-0@lo:400:kworker.0 Request processed in 78us (5577us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340853.144039:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2596 00000100:00100000:2.0:1780340853.144062:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961183616 00000100:00100000:2.0:1780340853.144066:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961183616 00000100:00100000:2.0:1780340853.144090:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101 00000100:00100000:2.0:1780340853.144096:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961183616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340853.144118:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780340853.144145:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3661:x1866818961183616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (1678us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340853.144151:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101 00000100:00080000:2.0:1780340853.144177:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340853.144187:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961182592 00000100:00100000:2.0:1780340853.144190:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961182592 00000100:00100000:2.0:1780340853.144213:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:2.0:1780340853.144218:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961182592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340853.144243:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961182592:12345-0@lo:400:kworker.0 Request processed in 26us (5848us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340853.144250:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00080000:2.0:1780340853.144265:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340853.144284:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961182592:0@lo:400:kworker.0 00000100:00100000:2.0:1780340853.144295:0:3661:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969455 gen 2 00000100:00100000:2.0:1780340853.144307:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961183104:0@lo:400:kworker.0 00000100:00100000:2.0:1780340853.144316:0:3661:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969456 gen 2 00000004:00080000:2.0:1780340853.144320:0:3661:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c0445597100, transno 4294969456 00000100:00100000:2.0:1780340853.144336:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961183616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340853.144371:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961182464:0@lo:400:kworker.0 00000100:00100000:2.0:1780340853.144400:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340853.144424:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961182848:0@lo:400:kworker.0 00000100:00100000:2.0:1780340853.144453:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340853.144468:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961183360:0@lo:400:kworker.0 00000100:00100000:3.0:1780340853.144491:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961182336 00000100:00100000:3.0:1780340853.144494:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961182336 00000100:00100000:3.0:1780340853.144526:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:3.0:1780340853.144532:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961182336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340853.144566:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961182336:12345-0@lo:400:kworker.0 Request processed in 35us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340853.144571:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00080000:3.0:1780340853.144587:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340853.144602:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961182848 00000100:00100000:3.0:1780340853.144611:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961182848 00000100:00100000:3.0:1780340853.144648:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:3.0:1780340853.144654:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961182848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340853.144695:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961182848:12345-0@lo:400:kworker.0 Request processed in 41us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340853.144700:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:0.0:1780340853.145109:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961182720:12345-0@lo:400:kworker.0 Request processed in 14207us (14490us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340853.145116:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:3.0:1780340853.145950:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961182720:0@lo:400:kworker.0 00000100:00100000:3.0:1780340853.148426:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340853.148485:0:3659:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116994 gen 3 00000004:00080000:3.0:1780340853.148492:0:3659:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 115964116993 committed transno 115964116994 00000004:00080000:3.0:1780340853.148510:0:3659:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 115964116994 committed transno 115964116994 00000020:00080000:3.0:1780340853.148517:0:3659:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8c034a247540 refcount 2 committed 0 result 0 batchid 77309411387 00000020:00080000:3.0:1780340853.148522:0:3659:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c0443770100 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8c034a247b40 00000020:00080000:3.0:1780340853.148525:0:3659:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].3 00000020:00080000:3.0:1780340853.148528:0:3659:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c0443770f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c04755b8c00 00000020:00080000:3.0:1780340853.148531:0:3659:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].3 00000100:00100000:3.0:1780340853.148567:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961181824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340853.148586:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961181952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780340853.148615:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961182336:0@lo:400:kworker.0 00000100:00100000:3.0:1780340853.148638:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961182848:0@lo:400:kworker.0 00000020:00080000:0.0:1780340853.148711:0:72701:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411387 committed batchid 77309411386 00000020:00080000:0.0:1780340853.148908:0:72701:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411386 00000100:00100000:2.0:1780340853.149402:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961183360 00000100:00100000:2.0:1780340853.149410:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961183360 00000100:00100000:2.0:1780340853.149464:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:2.0:1780340853.149473:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961183360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340853.153938:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961183360:12345-0@lo:400:kworker.0 Request processed in 4460us (5512us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340853.153950:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00100000:3.0:1780340853.154372:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961183360:0@lo:400:kworker.0 00000100:00100000:1.0:1780340853.161539:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961183232:12345-0@lo:400:kworker.0 Request processed in 29194us (30885us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340853.161554:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00100000:3.0:1780340853.161731:0:3662:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 2 00000100:00100000:3.0:1780340853.161753:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961183232:0@lo:400:kworker.0 00000100:00100000:3.0:1780340853.645542:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961183744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340853.645605:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340853.645779:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961183744 00000100:00100000:2.0:1780340853.645787:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961183744 00000100:00100000:2.0:1780340853.645828:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102 00000100:00100000:2.0:1780340853.645836:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961183744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780340853.645858:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340853.645904:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961183744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340853.645912:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102 00000100:00100000:2.0:1780340853.645929:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340853.645938:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961183872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340853.645965:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340853.645991:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961183872 00000100:00100000:2.0:1780340853.645994:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961183872 00000100:00100000:2.0:1780340853.646016:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103 00000100:00100000:2.0:1780340853.646023:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961183872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780340853.646046:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780340853.646077:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961183872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340853.646083:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103 00000100:00100000:2.0:1780340853.646136:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961183872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340853.646166:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961183744:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1780340853.646355:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340854.312353:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340854.312451:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340854.312487:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340854.312530:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340854.312570:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940460544 00000100:00100000:0.0:1780340854.312579:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940460544 00000100:00100000:0.0:1780340854.312632:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940460416 00000100:00100000:0.0:1780340854.312636:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940460416 00000100:00100000:0.0:1780340854.312663:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1374 00000100:00100000:0.0:1780340854.312673:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2408:x1866818940460544:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340854.312756:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2408:x1866818940460544:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 83us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340854.312783:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1374 00000100:00100000:0.0:1780340854.312805:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1375 00000100:00100000:0.0:1780340854.312812:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2408:x1866818940460416:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340854.312841:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2408:x1866818940460416:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 28us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340854.312847:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1375 00000100:00080000:0.0:1780340854.312866:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780340854.312870:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340854.314098:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940460672 00000100:00100000:3.0:1780340854.314108:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940460672 00000100:00100000:3.0:1780340854.314166:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2598 00000100:00100000:3.0:1780340854.314175:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2408:x1866818940460672:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340854.314221:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2408:x1866818940460672:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 48us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340854.314227:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2598 00000100:00100000:2.0:1780340854.315021:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940460288 00000100:00100000:2.0:1780340854.315030:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940460288 00000100:00100000:2.0:1780340854.315067:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 76 00000100:00100000:2.0:1780340854.315075:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940460288:12345-192.168.203.16@tcp:400:kworker.0 00000100:00080000:1.0:1780340854.315133:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340854.315187:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940460288:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 112us (2843us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340854.315194:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 76 00000001:02000400:3.0:1780340854.358512:0:89233:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 134: replay creation of a file created in a pool ========================================================== 15:07:32 (1780340852) 00010000:00010000:1.0:1780340854.665891:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1780340855.573565:0:89281:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc44452b80 20000000:00000080:3.0:1780340855.573587:0:89281:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8c0471506800 uarg=0000000000000000 00000040:00100000:3.0:1780340855.574242:0:89281:0:(llog.c:1067:llog_reverse_process()) index 51 : idx 49 00000040:00100000:3.0:1780340855.574253:0:89281:0:(llog.c:1067:llog_reverse_process()) index 47 : idx 1 00000040:00080000:3.0:1780340855.574388:0:89281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17176 20000000:01000000:3.0:1780340855.574414:0:89281:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-clilov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:3.0:1780340855.574431:0:89281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 112 off17288 00000040:00080000:3.0:1780340855.574447:0:89281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17512 00000040:00080000:3.0:1780340855.574517:0:89281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 224 off16208 20000000:01000000:3.0:1780340855.574524:0:89281:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:3.0:1780340855.574537:0:89281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 120 off16328 00000040:00080000:3.0:1780340855.581203:0:89281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16608 00000040:00080000:3.0:1780340855.582719:0:89281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].46, 224 off16240 20000000:01000000:3.0:1780340855.582752:0:89281:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:3.0:1780340855.582826:0:89281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].47, 120 off16360 00000040:00080000:3.0:1780340855.582997:0:89281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].49, 224 off16608 10000000:01000000:3.0:1780340855.583021:0:89281:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1780340855.583050:0:89281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c03476f8400/0xa24651432774ea5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583079:0:89281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c04722afc00/0xa246514327749b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327749ab expref: 22 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583087:0:89281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c04722af600/0xa24651432774a92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774a8b expref: 22 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583095:0:89281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c045ec6d200/0xa24651432774ac3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774abc expref: 22 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583102:0:89281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c04722aec00/0xa24651432774adf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774ad8 expref: 22 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583109:0:89281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c045ec6d800/0xa24651432774b09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774b02 expref: 22 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583116:0:89281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c045ec6d400/0xa24651432774b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774b10 expref: 22 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583123:0:89281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0453123600/0xa24651432774b33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774b2c expref: 22 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583129:0:89281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0453123000/0xa24651432774b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774b3a expref: 22 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583136:0:89281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c03476f8a00/0xa24651432774b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774b64 expref: 22 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583146:0:89281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0347785c00/0xa24651432774b80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24e1 expref: 8 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583164:0:89281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c03476f9a00/0xa24651432774b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24ef expref: 8 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583173:0:89281:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c03476f8400/0xa24651432774ea5 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583223:0:89281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c03476f9a00/0xa24651432774b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24ef expref: 8 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583243:0:89281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c03476f9a00/0xa24651432774b8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24ef expref: 8 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340855.583262:0:89281:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961184000:192.168.203.16@tcp:104: 00010000:00010000:3.0:1780340855.583398:0:89281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0347785c00/0xa24651432774b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24e1 expref: 8 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583407:0:89281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0347785c00/0xa24651432774b80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24e1 expref: 8 pid: 88672 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340855.583417:0:89281:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961184128:192.168.203.16@tcp:104: 00010000:00010000:3.0:1780340855.583452:0:89281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c03476f8a00/0xa24651432774b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774b64 expref: 22 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583461:0:89281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c03476f8a00/0xa24651432774b6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774b64 expref: 22 pid: 88672 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340855.583471:0:89281:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961184256:0@lo:104: 00000100:00100000:3.0:1780340855.583525:0:89281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1780340855.583590:0:89281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0453123000/0xa24651432774b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774b3a expref: 22 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583598:0:89281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0453123000/0xa24651432774b41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774b3a expref: 22 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340855.583608:0:89281:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961184384:0@lo:104: 00010000:00010000:3.0:1780340855.583637:0:89281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0453123600/0xa24651432774b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774b2c expref: 22 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583645:0:89281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0453123600/0xa24651432774b33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774b2c expref: 22 pid: 88672 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340855.583654:0:89281:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f51f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961184512:0@lo:104: 00010000:00010000:3.0:1780340855.583678:0:89281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c045ec6d400/0xa24651432774b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774b10 expref: 22 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583685:0:89281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c045ec6d400/0xa24651432774b17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774b10 expref: 22 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340855.583693:0:89281:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f50700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961184640:0@lo:104: 00010000:00010000:3.0:1780340855.583729:0:89281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c045ec6d800/0xa24651432774b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774b02 expref: 22 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.583737:0:89281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c045ec6d800/0xa24651432774b09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774b02 expref: 22 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340855.583744:0:89281:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f50000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961184768:0@lo:104: 00000100:00100000:0.0:1780340855.583791:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1780340855.583796:0:89281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c04722aec00/0xa24651432774adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774ad8 expref: 22 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340855.583813:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1780340855.583814:0:89281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c04722aec00/0xa24651432774adf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774ad8 expref: 22 pid: 88671 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340855.583824:0:89281:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f50e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961184896:0@lo:104: 00000100:00100000:0.0:1780340855.583847:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340855.583869:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340855.583872:0:6499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961184256 00000100:00100000:0.0:1780340855.583877:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340855.583881:0:6499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961184256 00000100:00100000:0.0:1780340855.583890:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961184384 00000100:00100000:0.0:1780340855.583893:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961184384 00000100:00100000:1.0:1780340855.583956:0:9471:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961184512 00000100:00100000:1.0:1780340855.583962:0:9471:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961184512 00000100:00100000:3.0:1780340855.584208:0:6499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961184640 00000100:00100000:3.0:1780340855.584213:0:6499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961184640 00000100:00100000:2.0:1780340855.585902:0:89281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1780340855.585986:0:89281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c045ec6d200/0xa24651432774ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774abc expref: 22 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340855.586004:0:89281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c045ec6d200/0xa24651432774ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774abc expref: 22 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340855.586020:0:89281:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961185024:0@lo:104: 00000100:00100000:2.0:1780340855.586076:0:89281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1780340855.586091:0:89281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c04722af600/0xa24651432774a92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774a8b expref: 22 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340855.586099:0:89281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c04722af600/0xa24651432774a92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774a8b expref: 22 pid: 88671 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340855.586124:0:89281:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961185152:0@lo:104: 00000100:00100000:2.0:1780340855.586146:0:89281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1780340855.586159:0:89281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c04722afc00/0xa246514327749b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa246514327749ab expref: 22 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340855.586166:0:89281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c04722afc00/0xa246514327749b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa246514327749ab expref: 22 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340855.586174:0:89281:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961185280:0@lo:104: 00000100:00100000:2.0:1780340855.586190:0:89281:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04775bb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340855.590457:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/3 left), rc = 0 00000100:00100000:0.0:1780340855.590518:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340855.590550:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961184768 00000100:00100000:0.0:1780340855.590561:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961184768 00000100:00100000:0.0:1780340855.590594:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961184896 00000100:00100000:0.0:1780340855.590597:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961184896 00000100:00100000:0.0:1780340855.590630:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961185024 00000100:00100000:0.0:1780340855.590633:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961185024 00000100:00100000:0.0:1780340855.590643:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961185152 00000100:00100000:0.0:1780340855.590646:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961185152 00000100:00100000:0.0:1780340855.590657:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961185280 00000100:00100000:0.0:1780340855.590659:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961185280 00000100:00100000:0.0:1780340855.590676:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1780340855.590687:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:89281:x1866818961184256:12345-0@lo:104: 00010000:00010000:0.0:1780340855.593079:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0347785000/0xa24651432774b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774b6b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340855.593412:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1780340855.593425:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee32850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:89281:x1866818961184256:12345-0@lo:104: Request processed in 2735us (9896us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340855.593439:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1780340855.593528:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1780340855.593542:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:89281:x1866818961184384:12345-0@lo:104: 00010000:00010000:0.0:1780340855.593552:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0347785e00/0xa24651432774b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774b41 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340855.593597:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1780340855.593602:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:89281:x1866818961184384:12345-0@lo:104: Request processed in 68us (9789us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340855.593608:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1780340855.593624:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1780340855.593630:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:89281:x1866818961184768:12345-0@lo:104: 00010000:00010000:0.0:1780340855.593639:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c045ec6cc00/0xa24651432774b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774b09 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340855.594949:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1780340855.594965:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:89281:x1866818961184768:12345-0@lo:104: Request processed in 1332us (11083us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340855.594975:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1780340855.595010:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1780340855.595022:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:89281:x1866818961184896:12345-0@lo:104: 00010000:00010000:0.0:1780340855.595034:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c045ec6dc00/0xa24651432774ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774adf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340855.595047:0:89281:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961184256:0@lo:104: 00000100:00100000:2.0:1780340855.595059:0:89281:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961184384:0@lo:104: 00000100:00100000:2.0:1780340855.595068:0:89281:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f50000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961184768:0@lo:104: 00000100:00100000:2.0:1780340855.595101:0:89281:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f50e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961184896:0@lo:104: 00010000:00010000:0.0:1780340855.595103:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1780340855.595107:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:89281:x1866818961184896:12345-0@lo:104: Request processed in 91us (9213us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340855.595113:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1780340855.595125:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1780340855.595132:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:89281:x1866818961185024:12345-0@lo:104: 00010000:00010000:0.0:1780340855.595140:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0347784000/0xa24651432774abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774ac3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340855.595195:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1780340855.595200:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:89281:x1866818961185024:12345-0@lo:104: Request processed in 69us (9123us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340855.595205:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1780340855.595218:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1780340855.595379:0:89281:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961185024:0@lo:104: 00000100:00100000:0.0:1780340855.596453:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:89281:x1866818961185152:12345-0@lo:104: 00010000:00010000:0.0:1780340855.596465:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432774a8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774a92 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340855.596559:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1780340855.596564:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:89281:x1866818961185152:12345-0@lo:104: Request processed in 122us (10418us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340855.600644:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340855.600682:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340855.600736:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940460800 00000100:00100000:2.0:1780340855.600747:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940460800 00010000:00010000:2.0:1780340855.600814:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c03476f9a00/0xa24651432774b8e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24ef expref: 9 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340855.600852:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940460928 00000100:00100000:2.0:1780340855.600855:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940460928 00010000:00010000:2.0:1780340855.600868:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0347785c00/0xa24651432774b80 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24e1 expref: 10 pid: 88672 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340855.600917:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2555 00000100:00100000:2.0:1780340855.600928:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:540506f4-4e8e-4fb6-b537-f45d44291964+10:2408:x1866818940460800:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780340855.600946:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340855.600952:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c03476f9a00/0xa24651432774b8e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24ef expref: 10 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340855.600965:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c03476f9a00/0xa24651432774b8e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24ef expref: 10 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340855.600992:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340855.601063:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:540506f4-4e8e-4fb6-b537-f45d44291964+10:2408:x1866818940460800:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 137us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340855.601071:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2555 00000100:00100000:2.0:1780340855.601092:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2556 00000100:00100000:2.0:1780340855.601098:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940460928:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780340855.601107:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340855.601112:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0347785c00/0xa24651432774b80 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24e1 expref: 9 pid: 88672 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340855.601121:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0347785c00/0xa24651432774b80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24e1 expref: 9 pid: 88672 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340855.601131:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340855.601149:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940460928:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 52us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340855.601156:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2556 00010000:00010000:1.0:1780340855.604202:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1780340855.604222:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0347785000/0xa24651432774b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774b6b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604239:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785000 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340855.604244:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0347785000/0xa24651432774b64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774b6b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604255:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0347785000/0xa24651432774b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774b6b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340855.604263:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0347785000/0xa24651432774b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774b6b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340855.604269:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340855.604331:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0347785000/0xa24651432774b64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774b6b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604338:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340855.604370:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0347785000/0xa24651432774b64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774b6b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604377:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0347785000/0xa24651432774b64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774b6b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604412:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1780340855.604416:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0347785e00/0xa24651432774b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774b41 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604422:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785e00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340855.604426:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0347785e00/0xa24651432774b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774b41 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604435:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0347785e00/0xa24651432774b3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774b41 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340855.604440:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0347785e00/0xa24651432774b3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774b41 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340855.604445:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340855.604462:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0347785e00/0xa24651432774b3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774b41 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604467:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340855.604485:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0347785e00/0xa24651432774b3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774b41 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604491:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0347785e00/0xa24651432774b3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774b41 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604499:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1780340855.604503:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c045ec6cc00/0xa24651432774b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774b09 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604522:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6cc00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340855.604524:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c045ec6cc00/0xa24651432774b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774b09 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604530:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c045ec6cc00/0xa24651432774b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774b09 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340855.604535:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c045ec6cc00/0xa24651432774b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774b09 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340855.604540:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340855.604552:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c045ec6cc00/0xa24651432774b02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774b09 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604557:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340855.604564:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c045ec6cc00/0xa24651432774b02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774b09 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604569:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c045ec6cc00/0xa24651432774b02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774b09 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604577:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1780340855.604580:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c045ec6dc00/0xa24651432774ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774adf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604585:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6dc00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340855.604588:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c045ec6dc00/0xa24651432774ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774adf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604606:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c045ec6dc00/0xa24651432774ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774adf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340855.604612:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c045ec6dc00/0xa24651432774ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774adf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340855.604617:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340855.604634:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c045ec6dc00/0xa24651432774ad8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774adf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604639:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340855.604645:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c045ec6dc00/0xa24651432774ad8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774adf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604651:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c045ec6dc00/0xa24651432774ad8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774adf expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604660:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780340855.604664:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0347784000/0xa24651432774abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774ac3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604669:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347784000 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340855.604671:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0347784000/0xa24651432774abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774ac3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604676:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0347784000/0xa24651432774abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774ac3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340855.604681:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0347784000/0xa24651432774abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774ac3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340855.604691:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340855.604715:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0347784000/0xa24651432774abc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774ac3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604721:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340855.604725:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0347784000/0xa24651432774abc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774ac3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604731:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0347784000/0xa24651432774abc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774ac3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604740:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340855.604744:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432774a8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774a92 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604749:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af400 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340855.604752:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432774a8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774a92 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604788:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432774a8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774a92 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340855.604857:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432774a8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774a92 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340855.604863:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340855.604877:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432774a8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774a92 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604881:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340855.604893:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432774a8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774a92 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604899:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04722af400/0xa24651432774a8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774a92 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.604909:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340855.604911:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340855.604914:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340855.604953:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961185408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340855.605065:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340855.605121:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961185920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340855.605143:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340855.605170:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780340855.605176:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961185792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340855.605198:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340855.605233:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961185536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340855.605257:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340855.605275:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ef31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961186048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340855.605293:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340855.605312:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340855.605318:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961185664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340855.605338:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340855.605376:0:19125:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961185408 00000100:00100000:1.0:1780340855.605386:0:19125:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961185408 00010000:00010000:1.0:1780340855.605429:0:19125:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c03476f8a00/0xa24651432774b6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774b64 expref: 23 pid: 88672 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340855.605471:0:19125:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961185920 00000100:00100000:1.0:1780340855.605475:0:19125:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961185920 00010000:00010000:1.0:1780340855.605488:0:19125:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c045ec6d200/0xa24651432774ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774abc expref: 24 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340855.605499:0:19125:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961185792 00000100:00100000:1.0:1780340855.605501:0:19125:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961185792 00010000:00010000:1.0:1780340855.605515:0:19125:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c04722aec00/0xa24651432774adf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774ad8 expref: 25 pid: 88671 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340855.605525:0:19125:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961185536 00000100:00100000:1.0:1780340855.605527:0:19125:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961185536 00010000:00010000:1.0:1780340855.605538:0:19125:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0453123000/0xa24651432774b41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774b3a expref: 26 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340855.605548:0:19125:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961186048 00000100:00100000:1.0:1780340855.605551:0:19125:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961186048 00010000:00010000:1.0:1780340855.605561:0:19125:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c04722af600/0xa24651432774a92 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774a8b expref: 27 pid: 88671 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340855.605570:0:19125:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961185664 00000100:00100000:1.0:1780340855.605573:0:19125:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961185664 00010000:00010000:1.0:1780340855.605582:0:19125:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c045ec6d800/0xa24651432774b09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774b02 expref: 28 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340855.605596:0:19125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:1.0:1780340855.605605:0:19125:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04757c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+28:3660:x1866818961185408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340855.605620:0:19125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340855.605626:0:19125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c03476f8a00/0xa24651432774b6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774b64 expref: 28 pid: 88672 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.605648:0:19125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c03476f8a00/0xa24651432774b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774b64 expref: 28 pid: 88672 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.605666:0:19125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f8a00/0xa24651432774b6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774b64 expref: 28 pid: 88672 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.605682:0:19125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340855.605739:0:19125:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04757c4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+27:3660:x1866818961185408:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340855.605746:0:19125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00100000:1.0:1780340855.608150:0:19125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558 00000100:00100000:1.0:1780340855.608168:0:19125:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ef33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+26:3660:x1866818961185920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340855.608188:0:19125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340855.608199:0:19125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c045ec6d200/0xa24651432774ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774abc expref: 26 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.608217:0:19125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c045ec6d200/0xa24651432774ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774abc expref: 26 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.608238:0:19125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c045ec6d200/0xa24651432774ac3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774abc expref: 26 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.608254:0:19125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340855.608724:0:19125:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ef33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+25:3660:x1866818961185920:12345-0@lo:103:ldlm_bl.0 Request processed in 560us (3577us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340855.608733:0:19125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558 00000100:00100000:1.0:1780340855.608775:0:19125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:1.0:1780340855.608786:0:19125:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+24:3660:x1866818961185792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340855.608888:0:19125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340855.608894:0:19125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c04722aec00/0xa24651432774adf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774ad8 expref: 24 pid: 88671 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.608904:0:19125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c04722aec00/0xa24651432774adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774ad8 expref: 24 pid: 88671 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.608917:0:19125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04722aec00/0xa24651432774adf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774ad8 expref: 24 pid: 88671 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.608928:0:19125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340855.608958:0:19125:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961185792:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (3759us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340855.608964:0:19125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00000100:00100000:1.0:1780340855.608978:0:19125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:1.0:1780340855.608984:0:19125:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3661:x1866818961185536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340855.608992:0:19125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340855.608996:0:19125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0453123000/0xa24651432774b41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774b3a expref: 22 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.609006:0:19125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0453123000/0xa24651432774b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774b3a expref: 22 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.609016:0:19125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453123000/0xa24651432774b41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774b3a expref: 22 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.609024:0:19125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340855.609062:0:19125:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:3661:x1866818961185536:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (3804us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340855.609078:0:19125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:1.0:1780340855.609092:0:19125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:1.0:1780340855.609099:0:19125:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3661:x1866818961186048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340855.609107:0:19125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340855.609111:0:19125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c04722af600/0xa24651432774a92 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774a8b expref: 20 pid: 88671 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.609119:0:19125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c04722af600/0xa24651432774a92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774a8b expref: 20 pid: 88671 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.609128:0:19125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340855.609151:0:19125:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3661:x1866818961186048:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (3857us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340855.609157:0:19125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:1.0:1780340855.609169:0:19125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:1.0:1780340855.609176:0:19125:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:3661:x1866818961185664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340855.609184:0:19125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340855.609189:0:19125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c045ec6d800/0xa24651432774b09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774b02 expref: 19 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.609197:0:19125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c045ec6d800/0xa24651432774b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774b02 expref: 19 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.609206:0:19125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c045ec6d800/0xa24651432774b09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774b02 expref: 19 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.609215:0:19125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340855.609237:0:19125:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:3661:x1866818961185664:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (3899us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340855.609250:0:19125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00100000:1.0:1780340855.609321:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961185792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340855.609333:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961185408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340855.609340:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961185920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340855.609400:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1780340855.609409:0:9471:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:89281:x1866818961185280:12345-0@lo:104: 00010000:00010000:1.0:1780340855.609423:0:9471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c04722aea00/0xa246514327749ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa246514327749b2 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.609469:0:9471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1780340855.609475:0:9471:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:89281:x1866818961185280:12345-0@lo:104: Request processed in 68us (18961us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340855.609481:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00010000:00010000:1.0:1780340855.609501:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340855.609507:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04722aea00/0xa246514327749ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa246514327749b2 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.609516:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722aea00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340855.609520:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04722aea00/0xa246514327749ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa246514327749b2 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.609530:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04722aea00/0xa246514327749ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa246514327749b2 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340855.609537:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04722aea00/0xa246514327749ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa246514327749b2 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340855.609555:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340855.609594:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c04722aea00/0xa246514327749ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327749b2 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.609601:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340855.609620:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04722aea00/0xa246514327749ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327749b2 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.609627:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04722aea00/0xa246514327749ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327749b2 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.609638:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340855.609640:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340855.609642:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340855.609657:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961186176:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340855.609696:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340855.615788:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961185664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340855.615816:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961185536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340855.615827:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ef31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961186048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780340855.616302:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1780340855.616347:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1780340855.616366:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:89281:x1866818961184512:12345-0@lo:104: 00010000:00010000:0.0:1780340855.616390:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c045ec6d600/0xa24651432774b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774b33 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340855.616454:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340855.616461:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340855.616468:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340855.616605:0:19125:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961186176 00000100:00100000:1.0:1780340855.616616:0:19125:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961186176 00010000:00010000:1.0:1780340855.616660:0:19125:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c04722afc00/0xa246514327749b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa246514327749ab expref: 18 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340855.616701:0:19125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:1.0:1780340855.616719:0:19125:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:3662:x1866818961186176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340855.616739:0:19125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340855.616745:0:19125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c04722afc00/0xa246514327749b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa246514327749ab expref: 18 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.616777:0:19125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c04722afc00/0xa246514327749b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa246514327749ab expref: 18 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.616843:0:19125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340855.619394:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1780340855.619426:0:6499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:89281:x1866818961184640:12345-0@lo:104: 00010000:00010000:3.0:1780340855.619448:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c045ec6da00/0xa24651432774b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774b17 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340855.619912:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340855.620124:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1780340855.620135:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:89281:x1866818961184512:12345-0@lo:104: Request processed in 3780us (36286us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340855.620145:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00010000:00010000:0.0:1780340855.620224:0:89281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f9a00/0xa24651432774b8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24ef expref: 8 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340855.620240:0:89281:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961184000:192.168.203.16@tcp:104: 00010000:00010000:0.0:1780340855.620255:0:89281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0347785c00/0xa24651432774b80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24e1 expref: 7 pid: 88672 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340855.620274:0:89281:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961184128:192.168.203.16@tcp:104: 00000100:00100000:0.0:1780340855.620287:0:89281:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f51f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961184512:0@lo:104: 00010000:00010000:0.0:1780340855.620301:0:89281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04722af600/0xa24651432774a92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774a8b expref: 18 pid: 88671 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340855.620310:0:89281:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961185152:0@lo:104: 00010000:00010000:0.0:1780340855.620343:0:89281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04722afc00/0xa246514327749b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa246514327749ab expref: 17 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340855.620352:0:89281:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961185280:0@lo:104: 00010000:00010000:2.0:1780340855.620989:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340855.620999:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c045ec6d600/0xa24651432774b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774b33 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340855.621011:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6d600 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:2.0:1780340855.621015:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c045ec6d600/0xa24651432774b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774b33 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340855.621025:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c045ec6d600/0xa24651432774b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774b33 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340855.621032:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c045ec6d600/0xa24651432774b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774b33 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340855.621038:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1780340855.621135:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c045ec6d600/0xa24651432774b2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774b33 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340855.621141:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780340855.621166:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c045ec6d600/0xa24651432774b2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774b33 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340855.621186:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c045ec6d600/0xa24651432774b2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774b33 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340855.621199:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340855.621201:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340855.621203:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340855.621258:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961186304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780340855.621398:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340855.621591:0:7443:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961186304 00000100:00100000:2.0:1780340855.621600:0:7443:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961186304 00010000:00010000:2.0:1780340855.621630:0:7443:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0453123600/0xa24651432774b33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774b2c expref: 17 pid: 88672 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340855.621714:0:7443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564 00000100:00100000:2.0:1780340855.621724:0:7443:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04757c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:3659:x1866818961186304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340855.621739:0:7443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340855.621745:0:7443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0453123600/0xa24651432774b33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774b2c expref: 17 pid: 88672 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340855.621778:0:7443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0453123600/0xa24651432774b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774b2c expref: 17 pid: 88672 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340855.621806:0:7443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453123600/0xa24651432774b33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774b2c expref: 17 pid: 88672 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340855.621821:0:7443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340855.621862:0:7443:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04757c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:3659:x1866818961186304:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340855.621870:0:7443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564 00000100:00100000:2.0:1780340855.622150:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961186304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340855.626151:0:19125:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:3662:x1866818961186176:12345-0@lo:103:ldlm_bl.0 Request processed in 9419us (16440us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340855.626171:0:19125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00010000:00010000:3.0:1780340855.627271:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1780340855.627288:0:6499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:89281:x1866818961184640:12345-0@lo:104: Request processed in 7877us (43413us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340855.627301:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1780340855.627324:0:89281:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f50700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89281:1866818961184640:0@lo:104: 00010000:00010000:0.0:1780340855.627469:0:89281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c03476f8400/0xa24651432774ea5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.628319:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340855.628331:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c045ec6da00/0xa24651432774b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774b17 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.628341:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c045ec6da00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340855.628345:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c045ec6da00/0xa24651432774b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774b17 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.628357:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c045ec6da00/0xa24651432774b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774b17 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340855.628365:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c045ec6da00/0xa24651432774b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774b17 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340855.628371:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340855.628432:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c045ec6da00/0xa24651432774b10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774b17 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.628439:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340855.628467:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c045ec6da00/0xa24651432774b10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774b17 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.628473:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c045ec6da00/0xa24651432774b10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774b17 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340855.628501:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340855.628521:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340855.628523:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340855.628544:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961186432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340855.628611:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340855.628913:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961186432 00000100:00100000:0.0:1780340855.628924:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961186432 00010000:00010000:0.0:1780340855.628963:0:25498:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c045ec6d400/0xa24651432774b17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774b10 expref: 15 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340855.629048:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:0.0:1780340855.629059:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:3660:x1866818961186432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780340855.629075:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340855.629081:0:25498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c045ec6d400/0xa24651432774b17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774b10 expref: 15 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340855.629094:0:25498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c045ec6d400/0xa24651432774b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774b10 expref: 15 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340855.629110:0:25498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c045ec6d400/0xa24651432774b17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774b10 expref: 15 pid: 88673 timeout: 3735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340855.629126:0:25498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c03476f8400/0xa24651432774ea5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340855.629150:0:25498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f8400/0xa24651432774ea5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340855.629169:0:25498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c03476f8400/0xa24651432774ea5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340855.629178:0:25498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c03476f8400/0xa24651432774ea5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340855.629191:0:25498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c03476f8400/0xa24651432774ea5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340855.629198:0:25498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c03476f8400/0xa24651432774ea5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340855.629204:0:25498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340855.629210:0:25498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c03476f8400/0xa24651432774ea5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340855.629218:0:25498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c03476f8400/0xa24651432774ea5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340855.629238:0:25498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c03476f8400/0xa24651432774ea5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340855.629248:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340855.629273:0:89281:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c03476f8400/0xa24651432774ea5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.629285:0:89281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c03476f8400/0xa24651432774ea5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340855.629291:0:89281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f8400/0xa24651432774ea5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340855.629298:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:3660:x1866818961186432:12345-0@lo:103:ldlm_bl.0 Request processed in 240us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340855.629308:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00000100:00100000:1.0:1780340855.629422:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961186432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340855.630610:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961186176:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340855.690283:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340856.714325:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340857.324719:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340857.325556:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940461056 00000100:00100000:1.0:1780340857.325573:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940461056 00000100:00100000:1.0:1780340857.325653:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:1.0:1780340857.325665:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+7:70274:x1866818940461056:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340857.325687:0:88672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340857.325723:0:88672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453123000/0xa24651432774eac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced253c expref: -99 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.325810:0:88672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453123000/0xa24651432774eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced253c expref: 8 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.325823:0:88672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453123000/0xa24651432774eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced253c expref: 8 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.325833:0:88672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123000, rc 0) 00000100:00100000:1.0:1780340857.325923:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940461056:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 260us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340857.325930:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:2.0:1780340857.336848:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340857.336973:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940461184 00000100:00100000:3.0:1780340857.336986:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940461184 00000100:00100000:3.0:1780340857.337078:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 78 00000100:00100000:3.0:1780340857.337090:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940461184:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340857.337302:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940461184:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 214us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340857.337310:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 78 00000100:00100000:0.0:1780340857.342632:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340857.342800:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940461312 00000100:00100000:2.0:1780340857.342814:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940461312 00000100:00100000:2.0:1780340857.342891:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 79 00000100:00100000:2.0:1780340857.342902:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940461312:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340857.343092:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940461312:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 191us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340857.343101:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 79 00000100:00100000:2.0:1780340857.347985:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340857.348074:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940461440 00000100:00100000:1.0:1780340857.348088:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940461440 00000100:00100000:1.0:1780340857.348166:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 80 00000100:00100000:1.0:1780340857.348183:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:71222:x1866818940461440:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1780340857.348582:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:71222:x1866818940461440:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 405us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340857.348593:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 80 10000000:01000000:0.0:1780340857.354148:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780340857.354157:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c0471e4b800 from 52 10000000:01000000:0.0:1780340857.354165:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780340857.354241:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4800/0xa24651432774eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340857.354257:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4800/0xa24651432774eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340857.354384:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4800/0xa24651432774eb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340857.354421:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961186560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340857.354513:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340857.354574:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acb96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340857.354803:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961186560 00000100:00100000:3.0:1780340857.354814:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961186560 00000100:00100000:3.0:1780340857.354959:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1780340857.354972:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:6514:x1866818961186560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340857.354992:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340857.355012:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f8400/0xa24651432774eba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774eb3 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.355041:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f8400/0xa24651432774eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774eb3 expref: 15 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.355054:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f8400/0xa24651432774eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774eb3 expref: 15 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.355064:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8400, rc 0) 00000100:00100000:3.0:1780340857.355116:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961186560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340857.355125:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1780340857.355728:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961186560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340857.355750:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4800/0xa24651432774eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774eba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340857.355787:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4800/0xa24651432774eb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774eba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340857.356253:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961186688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340857.356325:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340857.356371:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acb96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340857.356517:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961186688 00000100:00100000:1.0:1780340857.356524:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961186688 00000100:00100000:1.0:1780340857.356574:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1780340857.356584:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961186688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340857.356745:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961186688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340857.356753:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1780340857.356859:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961186688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340857.357029:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961186816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340857.357088:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340857.357124:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acb96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340857.357139:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961186816 00000100:00100000:0.0:1780340857.357143:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961186816 00000100:00100000:0.0:1780340857.357165:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1780340857.357171:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961186816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340857.358440:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961186816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340857.358457:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1780340857.358549:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961186816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340857.364262:0:89282:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89282:1866818961186944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340857.364389:0:89282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340857.364451:0:89282:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acb9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340857.364613:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961186944 00000100:00100000:3.0:1780340857.364623:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961186944 00000100:00100000:3.0:1780340857.364700:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1780340857.364712:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:89282:x1866818961186944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340857.364950:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:89282:x1866818961186944:12345-0@lo:502:llog_process_th.0 Request processed in 239us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340857.364967:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1780340857.365209:0:89282:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89282:1866818961186944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340857.365291:0:89282:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89282:1866818961187072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340857.365333:0:89282:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340857.365368:0:89282:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348210780 going to sleep for 11 seconds 00000100:00100000:3.0:1780340857.365522:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961187072 00000100:00100000:3.0:1780340857.365527:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961187072 00000100:00100000:3.0:1780340857.365568:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1780340857.365575:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:89282:x1866818961187072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340857.365655:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:89282:x1866818961187072:12345-0@lo:502:llog_process_th.0 Request processed in 79us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340857.365662:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1780340857.365831:0:89282:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89282:1866818961187072:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1780340857.365853:0:89282:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1780340857.366138:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1780340857.366169:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780340857.366181:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4800/0xa24651432774eb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774eba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.366195:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4800/0xa24651432774eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774eba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340857.366207:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1780340857.366209:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:3.0:1780340857.366213:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1780340857.366256:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f9e00/0xa24651432774ec1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.366274:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c03476f9e00/0xa24651432774ec1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.366290:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c03476f9e00/0xa24651432774ec1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340857.366307:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961187200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340857.366349:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340857.366383:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04775bb000 going to sleep for 11 seconds 00000100:00100000:1.0:1780340857.366606:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961187200 00000100:00100000:1.0:1780340857.366611:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961187200 00000100:00100000:1.0:1780340857.366650:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1780340857.366659:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961187200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340857.366672:0:88672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340857.366687:0:88672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453122600/0xa24651432774ec8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774ec1 expref: -99 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.366722:0:88672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453122600/0xa24651432774ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774ec1 expref: 16 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.366743:0:88672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453122600/0xa24651432774ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774ec1 expref: 16 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.366753:0:88672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122600, rc 0) 00000100:00100000:1.0:1780340857.366835:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961187200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340857.366842:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1780340857.367466:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961187200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340857.367486:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c03476f9e00/0xa24651432774ec1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774ec8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.367495:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c03476f9e00/0xa24651432774ec1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774ec8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340857.367570:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961187328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340857.367608:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340857.367647:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04775bb000 going to sleep for 11 seconds 00000100:00100000:1.0:1780340857.368206:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961187328 00000100:00100000:1.0:1780340857.368213:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961187328 00000100:00100000:1.0:1780340857.368359:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1780340857.368368:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961187328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340857.369519:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961187328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1146us (1904us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340857.369531:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1780340857.371138:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340857.371838:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940461568 00000100:00100000:1.0:1780340857.371853:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940461568 00000100:00100000:1.0:1780340857.371940:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 88 00000100:00100000:1.0:1780340857.371951:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+8:71222:x1866818940461568:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1780340857.372141:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+8:71222:x1866818940461568:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 191us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340857.372151:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 88 00000100:00100000:3.0:1780340857.379799:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961187328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340857.379903:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961187456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340857.380014:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340857.380066:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04775bb000 going to sleep for 11 seconds 00000100:00100000:1.0:1780340857.380405:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961187456 00000100:00100000:1.0:1780340857.380415:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961187456 00000100:00100000:1.0:1780340857.380485:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1780340857.380495:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961187456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340857.380672:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961187456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340857.380681:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1780340857.380805:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f52a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961187456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340857.387523:0:89283:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89283:1866818961187584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340857.387650:0:89283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340857.387718:0:89283:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0476541f00 going to sleep for 11 seconds 00000100:00100000:3.0:1780340857.388370:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961187584 00000100:00100000:3.0:1780340857.388382:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961187584 00000100:00100000:3.0:1780340857.388452:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1780340857.388463:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:89283:x1866818961187584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340857.388663:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:89283:x1866818961187584:12345-0@lo:502:llog_process_th.0 Request processed in 201us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340857.388672:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1780340857.388923:0:89283:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89283:1866818961187584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780340857.388968:0:89283:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340857.388983:0:89283:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340857.388986:0:89283:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:2.0:1780340857.388993:0:89283:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:2.0:1780340857.389073:0:89283:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00080000:10000000:2.0:1780340857.392195:0:89283:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x50:0x0] (8/32) registered 00000100:00100000:0.0:1780340857.393036:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340857.393187:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940461696 00000100:00100000:1.0:1780340857.393202:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940461696 00000100:00100000:1.0:1780340857.393287:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 91 00000100:00100000:1.0:1780340857.393299:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940461696:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340857.393319:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340857.393344:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453122a00/0xa24651432774ecf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2543 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.393382:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453122a00/0xa24651432774ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2543 expref: 9 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.393395:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453122a00/0xa24651432774ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2543 expref: 9 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.393406:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122a00, rc 0) 00000100:00100000:1.0:1780340857.393482:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940461696:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 185us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340857.393490:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 91 00080000:10000000:2.0:1780340857.400208:0:89283:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00080000:10000000:1.0:1780340857.403586:0:89283:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00000100:00100000:1.0:1780340857.408585:0:89283:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89283:1866818961187712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340857.408930:0:89283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340857.408988:0:89283:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0442a3acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340857.409123:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961187712 00000100:00100000:3.0:1780340857.409132:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961187712 00000100:00100000:3.0:1780340857.409188:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1780340857.409206:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:89283:x1866818961187712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340857.409535:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:89283:x1866818961187712:12345-0@lo:502:llog_process_th.0 Request processed in 328us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340857.409545:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1780340857.410040:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340857.410142:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940461824 00000100:00100000:3.0:1780340857.410149:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940461824 00000100:00100000:3.0:1780340857.410194:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 93 00000100:00100000:3.0:1780340857.410203:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940461824:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340857.410391:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940461824:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 181us (347us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780340857.410400:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 93 00000100:00100000:0.0:1780340857.412059:0:89283:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89283:1866818961187712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340857.412408:0:89283:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89283:1866818961187840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340857.412513:0:89283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340857.412620:0:89283:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0442a3acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340857.413030:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961187840 00000100:00100000:3.0:1780340857.413039:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961187840 00000100:00100000:0.0:1780340857.413217:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1780340857.413236:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:89283:x1866818961187840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340857.413416:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:89283:x1866818961187840:12345-0@lo:502:llog_process_th.0 Request processed in 182us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340857.413425:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1780340857.413519:0:89283:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89283:1866818961187840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780340857.413549:0:89283:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340857.413559:0:89283:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340857.413561:0:89283:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0000-m new lustre.pool_134 00000040:00080000:1.0:1780340857.413567:0:89283:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:2.0:1780340857.414120:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:2.0:1780340857.414153:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1780340857.414167:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f9e00/0xa24651432774ec1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774ec8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340857.414182:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c03476f9e00/0xa24651432774ec1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774ec8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340857.414193:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1780340857.414196:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c045f0c4800 from 52 10000000:01000000:2.0:1780340857.414199:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780340857.414239:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa24651432774ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340857.414247:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa24651432774ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340857.414256:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa24651432774ed6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340857.414291:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961187968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340857.414340:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340857.414635:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340857.414936:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961187968 00000100:00100000:3.0:1780340857.414944:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961187968 00000100:00100000:3.0:1780340857.414987:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1780340857.414997:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961187968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340857.415011:0:88671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340857.415026:0:88671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f9000/0xa24651432774edd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774ed6 expref: -99 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.415054:0:88671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f9000/0xa24651432774edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774ed6 expref: 17 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.415066:0:88671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f9000/0xa24651432774edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774ed6 expref: 17 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.415075:0:88671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9000, rc 0) 00000100:00100000:3.0:1780340857.415177:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961187968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340857.415184:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1780340857.415567:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961187968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340857.415651:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa24651432774ed6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774edd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340857.415735:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa24651432774ed6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774edd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340857.416043:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961188096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340857.416083:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340857.416167:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340857.416202:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961188096 00000100:00100000:3.0:1780340857.416209:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961188096 00000100:00100000:3.0:1780340857.416454:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1780340857.416463:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961188096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340857.416632:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961188096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340857.416641:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1780340857.416835:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961188096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340857.416873:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961188224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340857.416933:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340857.417292:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340857.417497:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961188224 00000100:00100000:3.0:1780340857.417504:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961188224 00000100:00100000:3.0:1780340857.417533:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1780340857.417543:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03499e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961188224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340857.417975:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03499e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961188224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 433us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340857.417983:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1780340857.418201:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961188224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340857.419111:0:89284:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89284:1866818961188352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340857.419185:0:89284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340857.419217:0:89284:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1780340857.419354:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961188352 00000100:00100000:3.0:1780340857.419361:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961188352 00000100:00100000:3.0:1780340857.419407:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1780340857.419418:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:89284:x1866818961188352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340857.419557:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:89284:x1866818961188352:12345-0@lo:502:llog_process_th.0 Request processed in 140us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340857.419565:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1780340857.420124:0:89284:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89284:1866818961188352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340857.420197:0:89284:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89284:1866818961188480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340857.420247:0:89284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340857.420387:0:89284:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1780340857.422998:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961188480 00000100:00100000:0.0:1780340857.423016:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961188480 00000100:00100000:1.0:1780340857.423481:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1780340857.423494:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:89284:x1866818961188480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340857.423795:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:89284:x1866818961188480:12345-0@lo:502:llog_process_th.0 Request processed in 295us (3538us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340857.423804:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1780340857.424154:0:89284:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89284:1866818961188480:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1780340857.424204:0:89284:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1780340857.424527:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1780340857.424554:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780340857.424576:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa24651432774ed6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774edd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340857.424599:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa24651432774ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774edd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340857.424611:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1780340857.424614:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1780340857.424617:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1780340857.424670:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4c00/0xa24651432774ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340857.424679:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4c00/0xa24651432774ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340857.424697:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4c00/0xa24651432774ee4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340857.424725:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961188608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340857.424831:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340857.432460:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acb9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1780340857.437656:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961188608 00000100:00100000:2.0:1780340857.437678:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961188608 00000100:00100000:3.0:1780340857.439236:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1780340857.439741:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961188608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340857.439984:0:88671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340857.440012:0:88671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f8000/0xa24651432774eeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774ee4 expref: -99 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.440054:0:88671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f8000/0xa24651432774eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774ee4 expref: 18 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.440068:0:88671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f8000/0xa24651432774eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774ee4 expref: 18 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.440078:0:88671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8000, rc 0) 00000100:00100000:3.0:1780340857.440888:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961188608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1624us (16043us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340857.440899:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1780340857.441127:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961188608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340857.441154:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4c00/0xa24651432774ee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774eeb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340857.441168:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4c00/0xa24651432774ee4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774eeb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340857.441345:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961188736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340857.441397:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340857.441460:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acb9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1780340857.441740:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961188736 00000100:00100000:2.0:1780340857.441749:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961188736 00000100:00100000:2.0:1780340857.441845:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1780340857.441855:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961188736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340857.442048:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961188736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340857.442068:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1780340857.442365:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961188736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340857.442411:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961188864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340857.442462:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340857.442497:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04775bbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340857.442730:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961188864 00000100:00100000:0.0:1780340857.442736:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961188864 00000100:00100000:0.0:1780340857.442795:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1780340857.442803:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961188864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340857.442915:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961188864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 113us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340857.442922:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1780340857.444189:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f51500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961188864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340857.460596:0:89285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89285:1866818961188992:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340857.461465:0:89285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340857.461612:0:89285:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0442a3a000 going to sleep for 11 seconds 00000100:00100000:2.0:1780340857.465392:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961188992 00000100:00100000:2.0:1780340857.465412:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961188992 00000100:00100000:2.0:1780340857.465561:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1780340857.465576:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:89285:x1866818961188992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340857.466425:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:89285:x1866818961188992:12345-0@lo:502:llog_process_th.0 Request processed in 848us (4959us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340857.466435:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1780340857.467477:0:89285:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89285:1866818961188992:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780340857.467533:0:89285:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780340857.467551:0:89285:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340857.467554:0:89285:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0001-m new lustre.pool_134 00000020:00000080:1.0:1780340857.467559:0:89285:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1780340857.467645:0:89285:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:1.0:1780340857.467709:0:89285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89285:1866818961189120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340857.467841:0:89285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340857.468363:0:89285:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04765410c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340857.468508:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961189120 00000100:00100000:3.0:1780340857.468517:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961189120 00000100:00100000:3.0:1780340857.468569:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1780340857.468578:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:89285:x1866818961189120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340857.468993:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:89285:x1866818961189120:12345-0@lo:502:llog_process_th.0 Request processed in 415us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340857.469003:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1780340857.469203:0:89285:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89285:1866818961189120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340857.469334:0:89285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89285:1866818961189248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340857.469391:0:89285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340857.469424:0:89285:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0442a3a000 going to sleep for 11 seconds 00000100:00100000:3.0:1780340857.469526:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961189248 00000100:00100000:3.0:1780340857.469532:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961189248 00000100:00100000:3.0:1780340857.469559:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1780340857.469567:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:89285:x1866818961189248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340857.469668:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:89285:x1866818961189248:12345-0@lo:502:llog_process_th.0 Request processed in 100us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340857.469674:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1780340857.469979:0:89285:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89285:1866818961189248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780340857.470002:0:89285:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340857.470011:0:89285:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340857.470014:0:89285:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0001-m new lustre.pool_134 00000040:00080000:1.0:1780340857.470019:0:89285:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 50 count 49 00000020:01000000:2.0:1780340857.470370:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-49 (rc=0) 10000000:01000000:2.0:1780340857.470403:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1780340857.470416:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4c00/0xa24651432774ee4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774eeb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340857.470430:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4c00/0xa24651432774ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774eeb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340857.470443:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1780340857.470446:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c04773ad000 from 52 10000000:01000000:2.0:1780340857.470450:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780340857.470485:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa24651432774ef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340857.470495:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa24651432774ef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340857.470506:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa24651432774ef2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340857.470535:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961189376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340857.470582:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340857.470629:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8780 going to sleep for 11 seconds 00000100:00100000:3.0:1780340857.470794:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961189376 00000100:00100000:3.0:1780340857.470800:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961189376 00000100:00100000:3.0:1780340857.470852:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1780340857.470862:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961189376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340857.471024:0:88671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340857.471042:0:88671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f9800/0xa24651432774ef9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774ef2 expref: -99 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.471074:0:88671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f9800/0xa24651432774ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774ef2 expref: 19 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.471087:0:88671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f9800/0xa24651432774ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774ef2 expref: 19 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.471097:0:88671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9800, rc 0) 00000100:00100000:3.0:1780340857.471157:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961189376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 297us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340857.471164:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1780340857.471250:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961189376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340857.471275:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa24651432774ef2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774ef9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340857.471286:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa24651432774ef2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774ef9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340857.471354:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961189504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340857.471383:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340857.471403:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b2e8780 going to sleep for 11 seconds 00000100:00100000:1.0:1780340857.471618:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961189504 00000100:00100000:1.0:1780340857.471624:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961189504 00000100:00100000:1.0:1780340857.471951:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1780340857.471963:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961189504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340857.472348:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961189504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 387us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340857.472357:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1780340857.474472:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961189504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340857.474566:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f51180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961189632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340857.474750:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340857.484434:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04509be480 going to sleep for 11 seconds 00000100:00100000:2.0:1780340857.493137:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961189632 00000100:00100000:2.0:1780340857.493156:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961189632 00000100:00100000:2.0:1780340857.493342:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1780340857.493354:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961189632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340857.493628:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961189632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 276us (18879us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340857.493638:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1780340857.493859:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f51180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961189632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340857.494585:0:89286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89286:1866818961189760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340857.494743:0:89286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340857.494914:0:89286:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acb99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340857.495064:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961189760 00000100:00100000:2.0:1780340857.495072:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961189760 00000100:00100000:2.0:1780340857.495127:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1780340857.495137:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:89286:x1866818961189760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340857.495402:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:89286:x1866818961189760:12345-0@lo:502:llog_process_th.0 Request processed in 266us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340857.495417:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1780340857.495512:0:89286:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89286:1866818961189760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340857.495565:0:89286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89286:1866818961189888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340857.495603:0:89286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340857.495626:0:89286:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acb99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340857.495682:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961189888 00000100:00100000:3.0:1780340857.495687:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961189888 00000100:00100000:3.0:1780340857.495731:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1780340857.495739:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:89286:x1866818961189888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340857.495856:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:89286:x1866818961189888:12345-0@lo:502:llog_process_th.0 Request processed in 117us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340857.495863:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1780340857.499011:0:89286:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89286:1866818961189888:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1780340857.499076:0:89286:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1780340857.499548:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1780340857.499580:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780340857.499592:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa24651432774ef2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774ef9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.499606:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa24651432774ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774ef9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340857.499808:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1780340857.499869:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1780340857.499873:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1780340857.499989:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5400/0xa24651432774f00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340857.499999:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5400/0xa24651432774f00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340857.500009:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5400/0xa24651432774f00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340857.500054:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961190016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340857.500136:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340857.500186:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acb99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340857.500250:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961190016 00000100:00100000:2.0:1780340857.500260:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961190016 00000100:00100000:2.0:1780340857.500394:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1780340857.500405:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961190016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340857.500420:0:88671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340857.500436:0:88671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c6000/0xa24651432774f07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774f00 expref: -99 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340857.500465:0:88671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c6000/0xa24651432774f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774f00 expref: 20 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340857.500477:0:88671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c6000/0xa24651432774f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774f00 expref: 20 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340857.500487:0:88671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6000, rc 0) 00000100:00100000:2.0:1780340857.500540:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961190016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340857.500548:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1780340857.500636:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961190016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340857.500729:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5400/0xa24651432774f00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f07 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340857.500741:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5400/0xa24651432774f00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774f07 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340857.500977:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961190144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340857.501008:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340857.501035:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acb99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340857.501094:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961190144 00000100:00100000:2.0:1780340857.501099:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961190144 00000100:00100000:2.0:1780340857.501135:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1780340857.501143:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961190144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340857.501988:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961190144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 840us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340857.501998:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1780340857.502105:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961190144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340857.502154:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961190272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340857.502211:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340857.502243:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0442a3a000 going to sleep for 11 seconds 00000100:00100000:3.0:1780340857.502429:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961190272 00000100:00100000:3.0:1780340857.502435:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961190272 00000100:00100000:3.0:1780340857.502476:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1780340857.502484:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961190272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340857.502596:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961190272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340857.502603:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1780340857.502965:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961190272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780340857.504353:0:89287:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1780340857.504594:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1780340857.504623:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1780340857.504636:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5400/0xa24651432774f00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f07 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340857.504650:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5400/0xa24651432774f00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f07 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340857.504739:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780340857.504742:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c047b065000 from 52 10000000:01000000:0.0:1780340857.504745:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780340857.505042:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432774f0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.505053:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432774f0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.505082:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432774f0e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340857.505110:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961190400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340857.505183:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340857.505284:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446e320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340857.505375:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961190400 00000100:00100000:2.0:1780340857.505391:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961190400 00000100:00100000:2.0:1780340857.505450:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1780340857.505459:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961190400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340857.505474:0:88672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340857.505489:0:88672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c7600/0xa24651432774f15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774f0e expref: -99 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340857.505516:0:88672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c7600/0xa24651432774f15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774f0e expref: 21 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340857.505527:0:88672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c7600/0xa24651432774f15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774f0e expref: 21 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340857.505537:0:88672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7600, rc 0) 00000100:00100000:2.0:1780340857.505613:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961190400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340857.505620:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1780340857.506115:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961190400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340857.506132:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432774f0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f15 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.506142:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432774f0e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774f15 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340857.506223:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961190528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340857.506255:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340857.506297:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446e320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340857.506401:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961190528 00000100:00100000:2.0:1780340857.506407:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961190528 00000100:00100000:2.0:1780340857.506445:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1780340857.506454:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961190528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340857.506755:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961190528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 301us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340857.506792:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1780340857.507197:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961190528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340857.507338:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f51180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961190656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340857.507396:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340857.507466:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04509bee40 going to sleep for 11 seconds 00000100:00100000:1.0:1780340857.507510:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961190656 00000100:00100000:1.0:1780340857.507518:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961190656 00000100:00100000:1.0:1780340857.507603:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1780340857.507612:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961190656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340857.507744:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961190656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340857.507751:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1780340857.507860:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f51180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961190656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340857.509087:0:89288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f51180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89288:1866818961190784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340857.509163:0:89288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340857.509328:0:89288:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04509be900 going to sleep for 11 seconds 00000100:00100000:2.0:1780340857.509464:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961190784 00000100:00100000:2.0:1780340857.509473:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961190784 00000100:00100000:2.0:1780340857.509516:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1780340857.509525:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:89288:x1866818961190784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340857.509865:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:89288:x1866818961190784:12345-0@lo:502:llog_process_th.0 Request processed in 340us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340857.509874:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1780340857.510109:0:89288:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f51180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89288:1866818961190784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340857.510171:0:89288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f51180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89288:1866818961190912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340857.510216:0:89288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340857.510248:0:89288:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04509be900 going to sleep for 11 seconds 00000100:00100000:1.0:1780340857.510350:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961190912 00000100:00100000:1.0:1780340857.510356:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961190912 00000100:00100000:1.0:1780340857.510385:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1780340857.510400:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:89288:x1866818961190912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340857.510480:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479ddc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:89288:x1866818961190912:12345-0@lo:502:llog_process_th.0 Request processed in 81us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340857.510487:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1780340857.510559:0:89288:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f51180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89288:1866818961190912:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1780340857.510576:0:89288:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:1.0:1780340857.510968:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:1.0:1780340857.510995:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1780340857.511007:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432774f0e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f15 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.511020:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432774f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f15 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340857.511032:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1780340857.511035:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1780340857.511038:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1780340857.511070:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa24651432774f1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.511078:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa24651432774f1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.511088:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa24651432774f1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340857.511104:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961191040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340857.511140:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340857.511154:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446e320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340857.511382:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961191040 00000100:00100000:2.0:1780340857.511388:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961191040 00000100:00100000:2.0:1780340857.511416:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1780340857.511424:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961191040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340857.511437:0:88672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340857.511454:0:88672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c6800/0xa24651432774f23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774f1c expref: -99 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340857.511480:0:88672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c6800/0xa24651432774f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774f1c expref: 22 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340857.511492:0:88672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c6800/0xa24651432774f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774f1c expref: 22 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340857.511501:0:88672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6800, rc 0) 00000100:00100000:2.0:1780340857.511545:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479ddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961191040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340857.511553:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1780340857.511623:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961191040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340857.511663:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa24651432774f1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f23 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.511674:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa24651432774f1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774f23 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340857.511751:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961191168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340857.511836:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340857.511859:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446e320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340857.512078:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961191168 00000100:00100000:2.0:1780340857.512083:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961191168 00000100:00100000:2.0:1780340857.512105:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1780340857.512112:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0479ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961191168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340857.512246:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0479ddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961191168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340857.512340:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1780340857.512519:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961191168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340857.512558:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961191296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340857.512608:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340857.512638:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446e320c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340857.512703:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961191296 00000100:00100000:2.0:1780340857.512707:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961191296 00000100:00100000:2.0:1780340857.512739:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1780340857.512746:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034de95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961191296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340857.513044:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034de95c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961191296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 297us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340857.513051:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1780340857.513128:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961191296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780340857.515134:0:89289:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1780340857.517102:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1780340857.517153:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1780340857.517169:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa24651432774f1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f23 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.517186:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa24651432774f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f23 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340857.517201:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1780340857.517204:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8c0471e119c0 from 1 10000000:01000000:1.0:1780340857.517209:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1780340857.517409:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa24651432774f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.517419:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa24651432774f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.517451:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa24651432774f2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340857.517486:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961191424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340857.517574:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340857.517634:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a85d600 going to sleep for 11 seconds 00000100:00100000:3.0:1780340857.517746:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961191424 00000100:00100000:3.0:1780340857.517756:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961191424 00000100:00100000:3.0:1780340857.517855:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1780340857.517867:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034de94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961191424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340857.518033:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340857.518051:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f9c00/0xa24651432774f31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774f2a expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.518079:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f9c00/0xa24651432774f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774f2a expref: 23 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.518102:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f9c00/0xa24651432774f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774f2a expref: 23 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.518111:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9c00, rc 0) 00000100:00100000:3.0:1780340857.518174:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034de94c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961191424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 309us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340857.518181:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1780340857.521598:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961191424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340857.521635:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa24651432774f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f31 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.521661:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa24651432774f2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774f31 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340857.521812:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961191552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340857.522598:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340857.522662:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a85d600 going to sleep for 11 seconds 00000100:00100000:2.0:1780340857.522740:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961191552 00000100:00100000:2.0:1780340857.522750:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961191552 00000100:00100000:2.0:1780340857.522845:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1780340857.522857:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034de97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961191552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340857.522993:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034de97850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961191552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (408us total) trans 0 rc -2/-2 00000100:00100000:2.0:1780340857.523001:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1780340857.523510:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961191552:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1780340857.523554:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1780340857.523566:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa24651432774f2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f31 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340857.523579:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa24651432774f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f31 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340857.739170:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340858.250531:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961191936:0@lo:400:kworker.0 00000100:00100000:0.0:1780340858.251351:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961191808:0@lo:400:kworker.0 00000100:00100000:0.0:1780340858.251467:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340858.251530:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961192320:0@lo:400:kworker.0 00000100:00100000:0.0:1780340858.251563:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340858.251590:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961192832:0@lo:400:kworker.0 00000100:00100000:0.0:1780340858.251613:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340858.251650:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1780340858.251659:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961191680:0@lo:400:kworker.0 00000100:00100000:0.0:1780340858.251719:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340858.251854:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961191680 00000100:00100000:2.0:1780340858.251854:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961191808 00000100:00100000:2.0:1780340858.251864:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961191808 00000100:00100000:3.0:1780340858.251865:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961191680 00000100:00100000:2.0:1780340858.251932:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:3.0:1780340858.251933:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1780340858.251946:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034de94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961191680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340858.251948:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818961191808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.252389:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340858.252416:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ac7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961192448:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.252443:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340858.252461:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961192960:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.252514:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340858.252535:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1780340858.252542:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961192064:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.252562:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340858.252774:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961192576:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.252802:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340858.252822:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961193088:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.252846:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340858.252892:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961192320 00000100:00100000:1.0:1780340858.252897:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961192320 00000100:00100000:1.0:1780340858.252933:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961192832 00000100:00100000:1.0:1780340858.252937:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961192832 00000100:00100000:1.0:1780340858.252959:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3906 00000100:00100000:1.0:1780340858.252966:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961192320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.253030:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961192320:12345-0@lo:400:kworker.0 Request processed in 65us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340858.253038:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3906 00000100:00100000:1.0:1780340858.253059:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907 00000100:00100000:1.0:1780340858.253066:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961192832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.253095:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961192832:12345-0@lo:400:kworker.0 Request processed in 30us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340858.253111:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907 00000100:00080000:1.0:1780340858.253175:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340858.253265:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961192448 00000100:00100000:1.0:1780340858.253270:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961192448 00000100:00100000:1.0:1780340858.253306:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961192960 00000100:00100000:1.0:1780340858.253308:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961192960 00000100:00100000:1.0:1780340858.253330:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961192576 00000100:00100000:1.0:1780340858.253333:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961192576 00000100:00100000:1.0:1780340858.253353:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961193088 00000100:00100000:1.0:1780340858.253355:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961193088 00000100:00100000:1.0:1780340858.253377:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:1.0:1780340858.253383:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961192448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.253423:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961192448:12345-0@lo:400:kworker.0 Request processed in 40us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340858.253430:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00100000:1.0:1780340858.253441:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:1.0:1780340858.253447:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961192960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.253475:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961192960:12345-0@lo:400:kworker.0 Request processed in 28us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340858.253480:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:1.0:1780340858.253706:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:1.0:1780340858.253713:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961192576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.253747:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961192576:12345-0@lo:400:kworker.0 Request processed in 35us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340858.253752:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:1.0:1780340858.253795:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:1.0:1780340858.253802:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961193088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.253852:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961193088:12345-0@lo:400:kworker.0 Request processed in 51us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340858.253859:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:1.0:1780340858.253885:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961191936 00000100:00100000:1.0:1780340858.253890:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961191936 00000100:00100000:1.0:1780340858.253919:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961192064 00000100:00100000:1.0:1780340858.253922:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961192064 00000100:00100000:1.0:1780340858.253937:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:1.0:1780340858.253942:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961191936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.253976:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961191936:12345-0@lo:400:kworker.0 Request processed in 34us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340858.253983:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00100000:1.0:1780340858.253994:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:1.0:1780340858.254000:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961192064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.254027:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961192064:12345-0@lo:400:kworker.0 Request processed in 27us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340858.254033:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:1.0:1780340858.254070:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340858.254083:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961193344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340858.254119:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780340858.254148:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780340858.254151:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780340858.254155:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340858.254157:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340858.254188:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961193344 00000100:00100000:1.0:1780340858.254268:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961193344 00000100:00100000:1.0:1780340858.254296:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908 00000100:00100000:1.0:1780340858.254302:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961193344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780340858.254342:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445171200 avail 1298931712 00000100:00100000:1.0:1780340858.254385:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961193344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340858.254392:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908 00000100:00100000:1.0:1780340858.254439:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961193344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340858.254987:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961192064:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.255003:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961192576:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.255013:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961193088:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.255026:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961191936:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.255038:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ac7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961192448:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.255050:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961192960:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.255166:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780340858.255179:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961193472:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340858.255300:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340858.255433:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961193600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340858.255458:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340858.255866:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961193728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340858.255899:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340858.255936:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961193728 00000100:00100000:1.0:1780340858.255944:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961193728 00000100:00100000:1.0:1780340858.255987:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3909 00000100:00100000:1.0:1780340858.255996:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961193728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780340858.256050:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445478400 avail 1299238912 00000100:00100000:1.0:1780340858.256098:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961193728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340858.256106:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3909 00000100:00100000:1.0:1780340858.256151:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961193728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340858.258976:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961192192:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.259073:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340858.259124:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961192192 00000100:00100000:1.0:1780340858.259134:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961192192 00000100:00100000:1.0:1780340858.259285:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:1.0:1780340858.259295:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961192192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.259351:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961192192:12345-0@lo:400:kworker.0 Request processed in 58us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340858.259359:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00080000:1.0:1780340858.259383:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340858.259423:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961192192:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.259433:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961192704:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.259456:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340858.259477:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961192704 00000100:00100000:1.0:1780340858.259481:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961192704 00000100:00100000:1.0:1780340858.259666:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:1.0:1780340858.259672:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818961192704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.259716:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818961192704:12345-0@lo:400:kworker.0 Request processed in 44us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340858.259722:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:1.0:1780340858.259757:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961192704:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.259790:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961193216:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.259823:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340858.259841:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961193216 00000100:00100000:1.0:1780340858.259844:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961193216 00000100:00100000:1.0:1780340858.259866:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:1.0:1780340858.259872:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961193216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.259903:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961193216:12345-0@lo:400:kworker.0 Request processed in 31us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340858.259909:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:1.0:1780340858.259937:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961193216:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.259956:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961192320:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.259970:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961192832:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.260046:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961193472 00000100:00100000:1.0:1780340858.260051:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961193472 00000100:00100000:1.0:1780340858.260085:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961193600 00000100:00100000:1.0:1780340858.260089:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961193600 00000100:00100000:1.0:1780340858.260111:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104 00000100:00100000:1.0:1780340858.260118:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961193472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340858.260150:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340858.262699:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034de94450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961191680:12345-0@lo:400:kworker.0 Request processed in 10732us (10961us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340858.262719:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1780340858.262851:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961191680:0@lo:400:kworker.0 00000100:00100000:3.0:1780340858.262931:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105 00000100:00100000:3.0:1780340858.262950:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961193600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340858.262992:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780340858.263044:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961193600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (7586us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340858.263051:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105 00000100:00100000:2.0:1780340858.263491:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818961191808:12345-0@lo:400:kworker.0 Request processed in 11544us (12021us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340858.263504:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:3.0:1780340858.263667:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961191808:0@lo:400:kworker.0 00000100:00100000:1.0:1780340858.263737:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961193472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3618us (8435us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340858.263746:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104 00000100:00100000:1.0:1780340858.263924:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961193600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340858.263949:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961193472:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1780340858.763923:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340858.764098:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340858.764132:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961193856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340858.764219:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340858.764269:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961193856 00000100:00100000:3.0:1780340858.764277:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961193856 00000100:00100000:3.0:1780340858.764326:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2106 00000100:00100000:3.0:1780340858.764334:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961193856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340858.764360:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340858.764402:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961193856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340858.764410:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2106 00000100:00100000:3.0:1780340858.764487:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961193856:0@lo:13:osp-pre-1-0.0 00000020:00080000:3.0:1780340858.765219:0:72681:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411387 batchid updated 00000020:00080000:2.0:1780340858.765274:0:72701:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411387 00000004:00080000:2.0:1780340858.765350:0:72701:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c034b093900 with version 12 00000020:00080000:2.0:1780340858.765371:0:72701:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411387 cancel update log [0x2000088d1:0x2:0x0].3: rc = 0 00000020:00080000:2.0:1780340858.765474:0:72701:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411387 cancel update log [0x2400090a0:0x2:0x0].3: rc = 0 00000020:00080000:2.0:1780340858.765481:0:72701:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411387 00000004:00080000:3.0:1780340858.765514:0:72687:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c034acb9780 version 12 rpc_version 12 00000020:00100000:3.0:1780340858.765544:0:72687:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1780340858.765553:0:72687:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c0346f51180 x1866818961194112/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340858.765587:0:72687:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f51180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72687:1866818961194112:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1780340858.765639:0:72687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340858.765669:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acd8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1780340858.765790:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961194112 00000100:00100000:2.0:1780340858.765796:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961194112 00000100:00100000:2.0:1780340858.765841:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3910 00000100:00100000:2.0:1780340858.765848:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:72687:x1866818961194112:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1780340858.765990:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:72687:x1866818961194112:12345-0@lo:1000:osp_up0-1.0 Request processed in 142us (351us total) trans 115964116995 rc 0/0 00000100:00100000:2.0:1780340858.765998:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3910 00000100:00100000:2.0:1780340858.766041:0:72687:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f51180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72687:1866818961194112:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1780340858.774693:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340858.774721:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961194240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340858.774825:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340858.774883:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961194240 00000100:00100000:0.0:1780340858.774891:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961194240 00000100:00100000:0.0:1780340858.774946:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107 00000100:00100000:0.0:1780340858.774956:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961194240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340858.774985:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340858.775034:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961194240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340858.775043:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107 00000100:00100000:0.0:1780340858.775099:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961194240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340859.434599:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340859.434643:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340859.434713:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940461952 00000100:00100000:1.0:1780340859.434724:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940461952 00000100:00100000:1.0:1780340859.434799:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 125 00000100:00100000:1.0:1780340859.434809:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034de96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2410:x1866818940461952:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340859.434880:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034de96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2410:x1866818940461952:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 72us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340859.434888:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 125 00000100:00100000:3.0:1780340859.435049:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940462208 00000100:00100000:3.0:1780340859.435054:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940462208 00000100:00100000:3.0:1780340859.435109:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1382 00000100:00100000:3.0:1780340859.435117:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2410:x1866818940462208:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340859.435200:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2410:x1866818940462208:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 83us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340859.435206:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1382 00000100:00080000:1.0:1780340859.435371:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340859.437576:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340859.437618:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340859.438379:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940462336 00000100:00100000:3.0:1780340859.438389:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940462336 00000100:00100000:3.0:1780340859.438454:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2603 00000100:00100000:3.0:1780340859.438463:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2409:x1866818940462336:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340859.438526:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2409:x1866818940462336:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 65us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340859.438534:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2603 00000100:00080000:0.0:1780340859.438670:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340859.438895:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940462080 00000100:00100000:2.0:1780340859.438900:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940462080 00000100:00100000:2.0:1780340859.438953:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1383 00000100:00100000:2.0:1780340859.438962:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2409:x1866818940462080:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340859.439002:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2409:x1866818940462080:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 42us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340859.439009:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1383 00000100:00080000:0.0:1780340859.439191:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1780340859.790504:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1780340860.204524:0:89387:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffe7e02f0f0 20000000:00000080:1.0:1780340860.204540:0:89387:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8c0470f4e000 uarg=0000000000000000 00000040:00100000:1.0:1780340860.205422:0:89387:0:(llog.c:1067:llog_reverse_process()) index 54 : idx 49 20000000:01000000:1.0:1780340860.205430:0:89387:0:(mgs_llog.c:959:mgs_search_pool_cb()) Matched pool rec 53 cmd:0xce020 lustre.pool_134 00000040:00080000:1.0:1780340860.205508:0:89387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].55, 224 off17736 20000000:01000000:1.0:1780340860.205539:0:89387:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-clilov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1780340860.205556:0:89387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].56, 136 off17872 00000040:00080000:1.0:1780340860.205569:0:89387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].57, 224 off18096 00000040:00080000:1.0:1780340860.206017:0:89387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].50, 224 off16832 20000000:01000000:1.0:1780340860.206028:0:89387:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1780340860.206046:0:89387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].51, 144 off16976 00000040:00080000:1.0:1780340860.206062:0:89387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].52, 224 off17200 00000040:00080000:1.0:1780340860.206114:0:89387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].50, 224 off16832 20000000:01000000:1.0:1780340860.206121:0:89387:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1780340860.206133:0:89387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].51, 144 off16976 00000040:00080000:1.0:1780340860.206146:0:89387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].52, 224 off17200 10000000:01000000:1.0:1780340860.206156:0:89387:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1780340860.206174:0:89387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0453122c00/0xa24651432774f38 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.206263:0:89387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0453123000/0xa24651432774eac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced253c expref: 8 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.206340:0:89387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c03476f8400/0xa24651432774eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774eb3 expref: 22 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.206347:0:89387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0453122600/0xa24651432774ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774ec1 expref: 22 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.206353:0:89387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0453122a00/0xa24651432774ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2543 expref: 8 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.206358:0:89387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c03476f9000/0xa24651432774edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774ed6 expref: 22 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.206364:0:89387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c03476f8000/0xa24651432774eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774ee4 expref: 22 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.206370:0:89387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c03476f9800/0xa24651432774ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774ef2 expref: 22 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.206377:0:89387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c04754c6000/0xa24651432774f07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774f00 expref: 22 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.206383:0:89387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c04754c7600/0xa24651432774f15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774f0e expref: 22 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.206389:0:89387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c04754c6800/0xa24651432774f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774f1c expref: 22 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.206395:0:89387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c03476f9c00/0xa24651432774f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774f2a expref: 22 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.206413:0:89387:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c0453122c00/0xa24651432774f38 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.206453:0:89387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c03476f9c00/0xa24651432774f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774f2a expref: 22 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.206468:0:89387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c03476f9c00/0xa24651432774f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774f2a expref: 22 pid: 88673 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340860.206482:0:89387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b65880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961194368:0@lo:104: 00000100:00100000:1.0:1780340860.206547:0:89387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1780340860.206667:0:89387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c04754c6800/0xa24651432774f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774f1c expref: 22 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.206684:0:89387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c04754c6800/0xa24651432774f23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774f1c expref: 22 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340860.206692:0:89387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b65500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961194496:0@lo:104: 00000100:00100000:1.0:1780340860.206716:0:89387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1780340860.206749:0:89387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c04754c7600/0xa24651432774f15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774f0e expref: 22 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.206780:0:89387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c04754c7600/0xa24651432774f15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774f0e expref: 22 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340860.206791:0:89387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b65180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961194624:0@lo:104: 00000100:00100000:0.0:1780340860.206810:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961194368 00000100:00100000:1.0:1780340860.206817:0:89387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340860.206819:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961194368 00010000:00010000:1.0:1780340860.206851:0:89387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c04754c6000/0xa24651432774f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774f00 expref: 22 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340860.206864:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961194496 00000100:00100000:0.0:1780340860.206868:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961194496 00000100:00100000:0.0:1780340860.206879:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961194624 00000100:00100000:0.0:1780340860.206881:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961194624 00000100:00100000:0.0:1780340860.206894:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1780340860.206903:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+5:89387:x1866818961194368:12345-0@lo:104: 00010000:00010000:0.0:1780340860.206914:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa24651432774f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774f31 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340860.206964:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1780340860.206969:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+5:89387:x1866818961194368:12345-0@lo:104: Request processed in 68us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340860.206977:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1780340860.206993:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1780340860.206999:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:89387:x1866818961194496:12345-0@lo:104: 00010000:00010000:0.0:1780340860.207007:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa24651432774f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774f23 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.207028:0:89387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c04754c6000/0xa24651432774f07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774f00 expref: 22 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340860.207039:0:89387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b67800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961194752:0@lo:104: 00010000:00010000:0.0:1780340860.207048:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1780340860.207055:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:89387:x1866818961194496:12345-0@lo:104: Request processed in 56us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340860.207061:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1780340860.207070:0:89387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340860.207076:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961194752 00000100:00100000:0.0:1780340860.207080:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961194752 00010000:00010000:1.0:1780340860.207096:0:89387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c03476f9800/0xa24651432774ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774ef2 expref: 22 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340860.207101:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1780340860.207111:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:89387:x1866818961194624:12345-0@lo:104: 00010000:00010000:1.0:1780340860.207114:0:89387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c03476f9800/0xa24651432774ef9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774ef2 expref: 22 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340860.207121:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432774f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774f15 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340860.207126:0:89387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b64700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961194880:0@lo:104: 00000100:00100000:1.0:1780340860.207153:0:89387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1780340860.207180:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1780340860.207186:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:89387:x1866818961194624:12345-0@lo:104: Request processed in 76us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340860.207192:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1780340860.207203:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961194880 00000100:00100000:0.0:1780340860.207206:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961194880 00000100:00100000:0.0:1780340860.207218:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1780340860.207222:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:89387:x1866818961194752:12345-0@lo:104: 00010000:00010000:0.0:1780340860.207230:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5400/0xa24651432774f00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774f07 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.207248:0:89387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c03476f8000/0xa24651432774eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774ee4 expref: 22 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.207259:0:89387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c03476f8000/0xa24651432774eeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774ee4 expref: 22 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340860.207260:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1780340860.207269:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:89387:x1866818961194752:12345-0@lo:104: Request processed in 46us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340860.207275:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1780340860.207286:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1780340860.207291:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:89387:x1866818961194880:12345-0@lo:104: 00010000:00010000:0.0:1780340860.207298:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa24651432774ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774ef9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340860.207337:0:89387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b66d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961195008:0@lo:104: 00010000:00010000:0.0:1780340860.207341:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1780340860.207348:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:89387:x1866818961194880:12345-0@lo:104: Request processed in 56us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340860.207354:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1780340860.207370:0:89387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1780340860.207398:0:89387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c03476f9000/0xa24651432774edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774ed6 expref: 22 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.207407:0:89387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c03476f9000/0xa24651432774edd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774ed6 expref: 22 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340860.207407:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1780340860.207420:0:89387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961195136:0@lo:104: 00000100:00100000:0.0:1780340860.207422:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961195008 00000100:00100000:0.0:1780340860.207433:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961195008 00000100:00100000:0.0:1780340860.207455:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1780340860.207460:0:89387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340860.207464:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:89387:x1866818961195008:12345-0@lo:104: 00010000:00010000:0.0:1780340860.207473:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4c00/0xa24651432774ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774eeb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.207486:0:89387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0453122a00/0xa24651432774ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2543 expref: 8 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.207496:0:89387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0453122a00/0xa24651432774ecf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2543 expref: 8 pid: 88673 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340860.207507:0:89387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961195264:192.168.203.16@tcp:104: 00010000:00010000:0.0:1780340860.207509:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1780340860.207516:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:89387:x1866818961195008:12345-0@lo:104: Request processed in 55us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340860.207522:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1780340860.207548:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961195136 00000100:00100000:0.0:1780340860.207551:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961195136 00010000:00010000:1.0:1780340860.207568:0:89387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0453122600/0xa24651432774ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774ec1 expref: 22 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340860.207572:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1780340860.207581:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:89387:x1866818961195136:12345-0@lo:104: 00010000:00010000:0.0:1780340860.207587:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa24651432774ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774edd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340860.207612:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1780340860.207616:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:89387:x1866818961195136:12345-0@lo:104: Request processed in 37us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340860.207621:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00010000:00010000:1.0:1780340860.207654:0:89387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0453122600/0xa24651432774ec8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774ec1 expref: 22 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340860.207664:0:89387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445595500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961195392:0@lo:104: 00000100:00100000:1.0:1780340860.207698:0:89387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1780340860.207723:0:89387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c03476f8400/0xa24651432774eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432774eb3 expref: 22 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.207732:0:89387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c03476f8400/0xa24651432774eba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432774eb3 expref: 22 pid: 88673 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340860.207741:0:89387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961195520:0@lo:104: 00000100:00100000:0.0:1780340860.207745:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961195392 00000100:00100000:0.0:1780340860.207750:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961195392 00000100:00100000:1.0:1780340860.207793:0:89387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340860.207799:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1780340860.207812:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445596d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:89387:x1866818961195392:12345-0@lo:104: 00010000:00010000:0.0:1780340860.207820:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c03476f9e00/0xa24651432774ec1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774ec8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.207827:0:89387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0453123000/0xa24651432774eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced253c expref: 8 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340860.207838:0:89387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0453123000/0xa24651432774eac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced253c expref: 8 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340860.207851:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1780340860.207864:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445596d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:89387:x1866818961195392:12345-0@lo:104: Request processed in 57us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340860.207870:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1780340860.207880:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961195520 00000100:00100000:0.0:1780340860.207883:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961195520 00000100:00100000:0.0:1780340860.207896:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1780340860.207901:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445597480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:89387:x1866818961195520:12345-0@lo:104: 00010000:00010000:0.0:1780340860.207909:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4800/0xa24651432774eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774eba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340860.207935:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:0.0:1780340860.207939:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445597480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:89387:x1866818961195520:12345-0@lo:104: Request processed in 39us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340860.207944:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1780340860.207973:0:89387:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445594e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961195648:192.168.203.16@tcp:104: 00000100:00100000:1.0:1780340860.208016:0:89387:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0442a3a000 going to sleep for 11 seconds 00000100:00100000:1.0:1780340860.208038:0:89387:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b65880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961194368:0@lo:104: 00000100:00100000:1.0:1780340860.208047:0:89387:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b65500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961194496:0@lo:104: 00000100:00100000:1.0:1780340860.208057:0:89387:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b65180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961194624:0@lo:104: 00000100:00100000:1.0:1780340860.208065:0:89387:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b67800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961194752:0@lo:104: 00000100:00100000:1.0:1780340860.208080:0:89387:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b64700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961194880:0@lo:104: 00000100:00100000:1.0:1780340860.208089:0:89387:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b66d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961195008:0@lo:104: 00000100:00100000:1.0:1780340860.208096:0:89387:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961195136:0@lo:104: 00000100:00100000:1.0:1780340860.208102:0:89387:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445595500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961195392:0@lo:104: 00000100:00100000:1.0:1780340860.208109:0:89387:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961195520:0@lo:104: 00010000:00010000:3.0:1780340860.208700:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1780340860.208708:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa24651432774f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774f31 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.208717:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123e00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340860.208721:0:41205:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa24651432774f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774f31 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.208729:0:41205:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa24651432774f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774f31 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340860.208736:0:41205:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa24651432774f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774f31 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340860.208741:0:41205:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780340860.208855:0:41205:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa24651432774f2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774f31 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.208863:0:41205:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340860.208886:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa24651432774f2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774f31 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.208893:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa24651432774f2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774f31 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.208951:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1780340860.208955:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa24651432774f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774f23 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.208960:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123200 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340860.208963:0:41205:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa24651432774f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774f23 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.208969:0:41205:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa24651432774f1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774f23 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340860.208975:0:41205:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa24651432774f1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774f23 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340860.208980:0:41205:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780340860.208994:0:41205:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa24651432774f1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774f23 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209000:0:41205:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340860.209016:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa24651432774f1c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774f23 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209022:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa24651432774f1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774f23 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209031:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1780340860.209034:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432774f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774f15 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209050:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122000 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340860.209053:0:41205:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432774f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774f15 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209059:0:41205:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432774f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774f15 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340860.209065:0:41205:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432774f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774f15 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340860.209070:0:41205:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780340860.209083:0:41205:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432774f0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774f15 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209089:0:41205:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340860.209096:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432774f0e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774f15 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209101:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432774f0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774f15 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209110:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1780340860.209113:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5400/0xa24651432774f00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774f07 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209118:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5400 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340860.209121:0:41205:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5400/0xa24651432774f00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774f07 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209137:0:41205:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5400/0xa24651432774f00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774f07 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340860.209143:0:41205:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5400/0xa24651432774f00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774f07 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340860.209148:0:41205:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780340860.209161:0:41205:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5400/0xa24651432774f00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774f07 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209166:0:41205:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340860.209172:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5400/0xa24651432774f00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774f07 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209178:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5400/0xa24651432774f00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774f07 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209189:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1780340860.209192:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa24651432774ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774ef9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209197:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7400 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340860.209200:0:41205:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa24651432774ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774ef9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209206:0:41205:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa24651432774ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774ef9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340860.209212:0:41205:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa24651432774ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774ef9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340860.209224:0:41205:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780340860.209239:0:41205:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa24651432774ef2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774ef9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209245:0:41205:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340860.209250:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa24651432774ef2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774ef9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209256:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa24651432774ef2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774ef9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209266:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780340860.209269:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4c00/0xa24651432774ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774eeb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209274:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4c00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340860.209277:0:41205:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4c00/0xa24651432774ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774eeb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209283:0:41205:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4c00/0xa24651432774ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774eeb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340860.209288:0:41205:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4c00/0xa24651432774ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774eeb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340860.209292:0:41205:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780340860.209303:0:41205:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4c00/0xa24651432774ee4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774eeb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209308:0:41205:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340860.209318:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4c00/0xa24651432774ee4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774eeb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209324:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4c00/0xa24651432774ee4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774eeb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209344:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780340860.209347:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa24651432774ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774edd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209354:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7200 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340860.209356:0:41205:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa24651432774ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774edd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209362:0:41205:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa24651432774ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774edd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340860.209368:0:41205:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa24651432774ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774edd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340860.209373:0:41205:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780340860.209386:0:41205:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa24651432774ed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774edd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209396:0:41205:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340860.209401:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa24651432774ed6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774edd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209407:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04754c7200/0xa24651432774ed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774edd expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209415:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340860.209423:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c03476f9e00/0xa24651432774ec1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774ec8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209431:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9e00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340860.209434:0:41205:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c03476f9e00/0xa24651432774ec1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774ec8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209440:0:41205:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c03476f9e00/0xa24651432774ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774ec8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340860.209445:0:41205:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c03476f9e00/0xa24651432774ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774ec8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340860.209450:0:41205:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780340860.209463:0:41205:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c03476f9e00/0xa24651432774ec1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774ec8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209469:0:41205:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340860.209474:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c03476f9e00/0xa24651432774ec1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774ec8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209480:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c03476f9e00/0xa24651432774ec1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774ec8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209488:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340860.209491:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4800/0xa24651432774eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432774eba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209496:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4800 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340860.209498:0:41205:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4800/0xa24651432774eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432774eba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209513:0:41205:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4800/0xa24651432774eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432774eba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340860.209519:0:41205:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4800/0xa24651432774eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432774eba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340860.209524:0:41205:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780340860.209537:0:41205:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4800/0xa24651432774eb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774eba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209542:0:41205:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340860.209547:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4800/0xa24651432774eb3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774eba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209552:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4800/0xa24651432774eb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432774eba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.209565:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340860.209567:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340860.209568:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340860.209690:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961196160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340860.209736:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340860.209785:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961196672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340860.209806:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340860.209827:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1780340860.209833:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961195776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340860.209853:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340860.209871:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961196288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340860.209899:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340860.209916:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961196800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340860.209933:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340860.209961:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961195904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340860.209983:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340860.209998:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961196416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340860.210019:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340860.210035:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1780340860.210040:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961196032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340860.210058:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340860.210067:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961196544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340860.210084:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340860.210111:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961196160 00000100:00100000:3.0:1780340860.210117:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961196160 00010000:00010000:3.0:1780340860.210146:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c04754c6000/0xa24651432774f07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774f00 expref: 23 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340860.210164:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961196672 00000100:00100000:3.0:1780340860.210166:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961196672 00010000:00010000:3.0:1780340860.210175:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0453122600/0xa24651432774ec8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774ec1 expref: 24 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340860.210186:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961195776 00000100:00100000:3.0:1780340860.210188:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961195776 00010000:00010000:3.0:1780340860.210197:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c03476f9c00/0xa24651432774f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774f2a expref: 25 pid: 88673 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340860.210206:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961196288 00000100:00100000:3.0:1780340860.210214:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961196288 00010000:00010000:3.0:1780340860.210226:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c03476f9800/0xa24651432774ef9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774ef2 expref: 26 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340860.210237:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961196800 00000100:00100000:3.0:1780340860.210239:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961196800 00010000:00010000:3.0:1780340860.210250:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c03476f8400/0xa24651432774eba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774eb3 expref: 27 pid: 88673 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340860.210259:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961195904 00000100:00100000:3.0:1780340860.210262:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961195904 00010000:00010000:3.0:1780340860.210270:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c04754c6800/0xa24651432774f23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774f1c expref: 28 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340860.210280:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961196416 00000100:00100000:3.0:1780340860.210282:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961196416 00010000:00010000:3.0:1780340860.210291:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c03476f8000/0xa24651432774eeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774ee4 expref: 29 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340860.210299:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961196032 00000100:00100000:3.0:1780340860.210301:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961196032 00010000:00010000:3.0:1780340860.210309:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c04754c7600/0xa24651432774f15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774f0e expref: 30 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340860.210318:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961196544 00000100:00100000:3.0:1780340860.210320:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961196544 00010000:00010000:3.0:1780340860.210329:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c03476f9000/0xa24651432774edd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774ed6 expref: 31 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340860.210341:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:3.0:1780340860.210348:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+31:3659:x1866818961196160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340860.210359:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340860.210370:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c04754c6000/0xa24651432774f07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774f00 expref: 31 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.210379:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c04754c6000/0xa24651432774f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774f00 expref: 31 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.210391:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04754c6000/0xa24651432774f07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774f00 expref: 31 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.210403:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340860.210439:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+30:3659:x1866818961196160:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340860.210446:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:3.0:1780340860.210463:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:3.0:1780340860.210469:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+29:3659:x1866818961196672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340860.210476:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340860.210480:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0453122600/0xa24651432774ec8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774ec1 expref: 29 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.210487:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0453122600/0xa24651432774ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774ec1 expref: 29 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.210496:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453122600/0xa24651432774ec8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774ec1 expref: 29 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.210504:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340860.210524:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+28:3659:x1866818961196672:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340860.210531:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:3.0:1780340860.210544:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:3.0:1780340860.210556:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+27:3659:x1866818961195776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340860.210564:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340860.210567:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c03476f9c00/0xa24651432774f31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774f2a expref: 27 pid: 88673 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.210576:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c03476f9c00/0xa24651432774f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774f2a expref: 27 pid: 88673 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.210585:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f9c00/0xa24651432774f31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774f2a expref: 27 pid: 88673 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.210594:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340860.210616:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+26:3659:x1866818961195776:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340860.210623:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00100000:3.0:1780340860.210636:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:3.0:1780340860.210641:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+25:3659:x1866818961196288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340860.210648:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340860.210652:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c03476f9800/0xa24651432774ef9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774ef2 expref: 25 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.210659:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c03476f9800/0xa24651432774ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774ef2 expref: 25 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.210680:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f9800/0xa24651432774ef9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774ef2 expref: 25 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.210689:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340860.210711:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+24:3659:x1866818961196288:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340860.210723:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00100000:3.0:1780340860.210736:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00000100:00100000:3.0:1780340860.210743:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961196800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340860.210749:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340860.210753:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c03476f8400/0xa24651432774eba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774eb3 expref: 23 pid: 88673 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.210876:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c03476f8400/0xa24651432774eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774eb3 expref: 23 pid: 88673 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.210885:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f8400/0xa24651432774eba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774eb3 expref: 23 pid: 88673 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.210893:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340860.210917:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3659:x1866818961196800:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340860.210922:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00100000:3.0:1780340860.210934:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:3.0:1780340860.210940:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04757d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:3661:x1866818961195904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340860.210947:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340860.210950:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c04754c6800/0xa24651432774f23 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774f1c expref: 21 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.210959:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c04754c6800/0xa24651432774f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774f1c expref: 21 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.210967:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04754c6800/0xa24651432774f23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774f1c expref: 21 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.210985:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340860.211013:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04757d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3661:x1866818961195904:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340860.211019:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00100000:3.0:1780340860.211050:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:3.0:1780340860.211057:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:3661:x1866818961196416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340860.211064:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340860.211067:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c03476f8000/0xa24651432774eeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774ee4 expref: 19 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.211075:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c03476f8000/0xa24651432774eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774ee4 expref: 19 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.211083:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f8000/0xa24651432774eeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774ee4 expref: 19 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.211091:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340860.211111:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:3661:x1866818961196416:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340860.211117:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:3.0:1780340860.211129:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:3.0:1780340860.211135:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:3661:x1866818961196032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340860.211142:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340860.211146:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c04754c7600/0xa24651432774f15 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774f0e expref: 17 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.211154:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c04754c7600/0xa24651432774f15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774f0e expref: 17 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.211169:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04754c7600/0xa24651432774f15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774f0e expref: 17 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.211177:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340860.211200:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:3661:x1866818961196032:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340860.211206:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00000100:00100000:3.0:1780340860.211218:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:3.0:1780340860.211224:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:3661:x1866818961196544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340860.211231:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340860.211235:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c03476f9000/0xa24651432774edd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432774ed6 expref: 15 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.211242:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c03476f9000/0xa24651432774edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432774ed6 expref: 15 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.211250:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f9000/0xa24651432774edd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432774ed6 expref: 15 pid: 88671 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.211259:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340860.211279:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a846300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:3661:x1866818961196544:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340860.211284:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00100000:3.0:1780340860.211343:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961196032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340860.211351:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961196544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340860.211357:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961195904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340860.211371:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961196416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340860.211407:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961195776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340860.211414:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961196288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340860.211420:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961196800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340860.211426:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961196160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340860.211432:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961196672:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340860.211655:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340860.211661:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340860.211665:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340860.211678:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340860.211778:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340860.211806:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340860.211824:0:6503:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940462464 00000100:00100000:2.0:1780340860.211829:0:6503:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940462464 00010000:00010000:2.0:1780340860.211848:0:6503:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0453123000/0xa24651432774eac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced253c expref: 9 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340860.211875:0:6503:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940462592 00000100:00100000:2.0:1780340860.211878:0:6503:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940462592 00010000:00010000:2.0:1780340860.211891:0:6503:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0453122a00/0xa24651432774ecf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2543 expref: 10 pid: 88673 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340860.211909:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2575 00000100:00100000:2.0:1780340860.211915:0:6503:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:540506f4-4e8e-4fb6-b537-f45d44291964+10:2408:x1866818940462464:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780340860.211924:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340860.211928:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0453123000/0xa24651432774eac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced253c expref: 10 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340860.211936:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0453123000/0xa24651432774eac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced253c expref: 10 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340860.211947:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340860.211983:0:6503:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:540506f4-4e8e-4fb6-b537-f45d44291964+10:2408:x1866818940462464:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 68us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340860.211990:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2575 00000100:00100000:2.0:1780340860.212005:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2576 00000100:00100000:2.0:1780340860.212011:0:6503:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940462592:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780340860.212018:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340860.212022:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0453122a00/0xa24651432774ecf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2543 expref: 9 pid: 88673 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340860.212031:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0453122a00/0xa24651432774ecf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2543 expref: 9 pid: 88673 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340860.212052:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c0453122c00/0xa24651432774f38 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340860.212060:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453122c00/0xa24651432774f38 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340860.212074:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0453122c00/0xa24651432774f38 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340860.212081:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0453122c00/0xa24651432774f38 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340860.212087:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0453122c00/0xa24651432774f38 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340860.212093:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0453122c00/0xa24651432774f38 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340860.212099:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340860.212102:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0453122c00/0xa24651432774f38 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340860.212109:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0453122c00/0xa24651432774f38 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340860.212117:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0453122c00/0xa24651432774f38 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340860.212125:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340860.212145:0:6503:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940462592:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 134us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340860.212158:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2576 00010000:00010000:3.0:1780340860.216028:0:89387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453122a00/0xa24651432774ecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2543 expref: 8 pid: 88673 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340860.216049:0:89387:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961195264:192.168.203.16@tcp:104: 00010000:00010000:3.0:1780340860.216064:0:89387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453123000/0xa24651432774eac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced253c expref: 7 pid: 88672 timeout: 3740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340860.216074:0:89387:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445594e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89387:1866818961195648:192.168.203.16@tcp:104: 00010000:00010000:3.0:1780340860.216122:0:89387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c0453122c00/0xa24651432774f38 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.216131:0:89387:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c0453122c00/0xa24651432774f38 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.216137:0:89387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0453122c00/0xa24651432774f38 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.216143:0:89387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453122c00/0xa24651432774f38 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340860.810127:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1780340861.517673:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1780340861.517680:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c0471e4b800 from 55 10000000:01000000:2.0:1780340861.517685:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780340861.517730:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa24651432774f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340861.517742:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa24651432774f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340861.517752:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa24651432774f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340861.517796:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961196928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340861.517860:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340861.517906:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b058c00 going to sleep for 11 seconds 00000100:00100000:0.0:1780340861.517985:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961196928 00000100:00100000:0.0:1780340861.517993:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961196928 00000100:00100000:0.0:1780340861.518045:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1780340861.518054:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034de97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:6514:x1866818961196928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340861.518067:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340861.518081:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa5a00/0xa24651432774f46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774f3f expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.518103:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa5a00/0xa24651432774f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774f3f expref: 15 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.518113:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa5a00/0xa24651432774f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774f3f expref: 15 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.518121:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5a00, rc 0) 00000100:00100000:0.0:1780340861.518180:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034de97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961196928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340861.518187:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1780340861.518436:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961196928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340861.518449:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa24651432774f3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340861.518458:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa24651432774f3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774f46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340861.518517:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961197056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340861.518544:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340861.518564:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b058c00 going to sleep for 11 seconds 00000100:00100000:0.0:1780340861.518782:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961197056 00000100:00100000:0.0:1780340861.518787:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961197056 00000100:00100000:0.0:1780340861.518823:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1780340861.518830:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034de97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961197056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340861.518954:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034de97450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961197056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340861.518962:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1780340861.519130:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961197056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340861.519173:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961197184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340861.519211:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340861.519240:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b058c00 going to sleep for 11 seconds 00000100:00100000:0.0:1780340861.519494:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961197184 00000100:00100000:0.0:1780340861.519499:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961197184 00000100:00100000:0.0:1780340861.519533:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1780340861.519541:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961197184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340861.519750:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961197184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340861.519756:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1780340861.529484:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961197184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340861.530318:0:89388:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445594e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89388:1866818961197312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340861.530400:0:89388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340861.530440:0:89388:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04515b23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340861.530547:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961197312 00000100:00100000:2.0:1780340861.530553:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961197312 00000100:00100000:2.0:1780340861.530605:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1780340861.530615:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:89388:x1866818961197312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340861.530778:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:89388:x1866818961197312:12345-0@lo:502:llog_process_th.0 Request processed in 144us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340861.530787:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1780340861.532402:0:89388:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445594e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89388:1866818961197312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340861.532484:0:89388:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445594e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89388:1866818961197440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340861.532546:0:89388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340861.532599:0:89388:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0442a119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340861.533133:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961197440 00000100:00100000:3.0:1780340861.533140:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961197440 00000100:00100000:3.0:1780340861.533193:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1780340861.533201:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:89388:x1866818961197440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340861.533334:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:89388:x1866818961197440:12345-0@lo:502:llog_process_th.0 Request processed in 133us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340861.533342:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1780340861.533927:0:89388:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445594e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89388:1866818961197440:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1780340861.533977:0:89388:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1780340861.534203:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:2.0:1780340861.534229:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1780340861.534239:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa24651432774f3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340861.534250:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa24651432774f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340861.534260:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1780340861.534262:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 50 10000000:01000000:2.0:1780340861.534265:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1780340861.534292:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6a00/0xa24651432774f4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340861.534300:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04754c6a00/0xa24651432774f4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340861.534333:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04754c6a00/0xa24651432774f4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340861.534352:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961197568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340861.534390:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340861.534424:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b0583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340861.534564:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961197568 00000100:00100000:0.0:1780340861.534569:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961197568 00000100:00100000:0.0:1780340861.534628:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1780340861.534636:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961197568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340861.534646:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340861.534668:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa5000/0xa24651432774f54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774f4d expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.534700:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa5000/0xa24651432774f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774f4d expref: 16 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.534709:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa5000/0xa24651432774f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774f4d expref: 16 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.534717:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5000, rc 0) 00000100:00100000:0.0:1780340861.534751:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961197568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340861.534795:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1780340861.534980:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961197568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340861.534991:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04754c6a00/0xa24651432774f4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340861.534999:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04754c6a00/0xa24651432774f4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774f54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340861.535049:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961197696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340861.535076:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340861.535103:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b0583c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340861.535453:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961197696 00000100:00100000:1.0:1780340861.535459:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961197696 00000100:00100000:1.0:1780340861.535494:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1780340861.535502:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961197696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340861.535648:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961197696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340861.535655:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1780340861.535971:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961197696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340861.536006:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961197824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340861.536046:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340861.536074:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047a9013c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340861.536181:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961197824 00000100:00100000:2.0:1780340861.536186:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961197824 00000100:00100000:2.0:1780340861.536218:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1780340861.536224:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961197824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340861.536314:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961197824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340861.536321:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1780340861.536487:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961197824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340861.538496:0:89389:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89389:1866818961197952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340861.538573:0:89389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340861.538845:0:89389:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348388b40 going to sleep for 11 seconds 00000100:00100000:2.0:1780340861.538957:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961197952 00000100:00100000:2.0:1780340861.538964:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961197952 00000100:00100000:2.0:1780340861.553450:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1780340861.553484:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:89389:x1866818961197952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340861.553680:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:89389:x1866818961197952:12345-0@lo:502:llog_process_th.0 Request processed in 204us (15106us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340861.553688:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1780340861.553902:0:89389:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89389:1866818961197952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780340861.553948:0:89389:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780340861.553959:0:89389:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340861.553961:0:89389:0:(obd_config.c:1561:class_process_config()) marker 47 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1780340861.553967:0:89389:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1780340861.553981:0:89389:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000020:01000004:3.0:1780340861.558074:0:89390:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0471e4b800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1780340861.558082:0:89390:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c0471e4b800 4 00000100:00100000:2.0:1780340861.558252:0:89389:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89389:1866818961198080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340861.558350:0:89389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340861.558393:0:89389:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b058d80 going to sleep for 11 seconds 00000100:00100000:1.0:1780340861.558517:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961198080 00000100:00100000:1.0:1780340861.558524:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961198080 00000100:00100000:1.0:1780340861.558574:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1780340861.558584:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:89389:x1866818961198080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340861.558726:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:89389:x1866818961198080:12345-0@lo:502:llog_process_th.0 Request processed in 143us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340861.558734:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1780340861.558972:0:89389:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89389:1866818961198080:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780340861.559003:0:89389:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780340861.559010:0:89389:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340861.559017:0:89389:0:(obd_config.c:1561:class_process_config()) marker 47 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1780340861.559022:0:89389:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:0.0:1780340861.559232:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 50-52 (rc=0) 10000000:01000000:0.0:1780340861.559261:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1780340861.559271:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6a00/0xa24651432774f4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.559284:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04754c6a00/0xa24651432774f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340861.559293:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780340861.559296:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c045f0c4800 from 55 10000000:01000000:0.0:1780340861.559299:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780340861.559338:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5e00/0xa24651432774f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.559346:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5e00/0xa24651432774f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.559354:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5e00/0xa24651432774f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340861.559383:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961198208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340861.559418:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340861.559448:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0442a3a000 going to sleep for 11 seconds 00000100:00100000:3.0:1780340861.559602:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961198208 00000100:00100000:3.0:1780340861.559608:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961198208 00000100:00100000:3.0:1780340861.559648:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1780340861.559656:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961198208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340861.559675:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340861.559687:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f9000/0xa24651432774f62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774f5b expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.559707:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f9000/0xa24651432774f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774f5b expref: 17 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.559717:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f9000/0xa24651432774f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774f5b expref: 17 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.559724:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9000, rc 0) 00000100:00100000:3.0:1780340861.559792:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961198208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340861.559799:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1780340861.560057:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961198208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340861.560069:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5e00/0xa24651432774f5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.560078:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5e00/0xa24651432774f5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774f62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340861.560129:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961198336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340861.560158:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340861.560186:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0442a3a000 going to sleep for 11 seconds 00000100:00100000:1.0:1780340861.560283:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961198336 00000100:00100000:1.0:1780340861.560288:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961198336 00000100:00100000:1.0:1780340861.560320:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1780340861.560328:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b5a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961198336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340861.560430:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b5a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961198336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340861.560436:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1780340861.560542:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961198336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340861.560566:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961198464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340861.560607:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340861.560636:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0442a3a000 going to sleep for 11 seconds 00000100:00100000:3.0:1780340861.560799:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961198464 00000100:00100000:3.0:1780340861.560803:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961198464 00000100:00100000:3.0:1780340861.560822:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1780340861.560829:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961198464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340861.560903:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961198464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340861.560909:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1780340861.561047:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961198464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340861.564866:0:89391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89391:1866818961198592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340861.564969:0:89391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340861.565009:0:89391:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0442a3a000 going to sleep for 11 seconds 00000100:00100000:3.0:1780340861.565124:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961198592 00000100:00100000:3.0:1780340861.565133:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961198592 00000100:00100000:3.0:1780340861.565192:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1780340861.565201:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:89391:x1866818961198592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340861.565345:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:89391:x1866818961198592:12345-0@lo:502:llog_process_th.0 Request processed in 145us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340861.565353:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1780340861.567459:0:89391:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89391:1866818961198592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340861.567554:0:89391:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89391:1866818961198720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340861.567643:0:89391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340861.567686:0:89391:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446ff2540 going to sleep for 11 seconds 00000100:00100000:2.0:1780340861.567879:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961198720 00000100:00100000:2.0:1780340861.567887:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961198720 00000100:00100000:2.0:1780340861.567949:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1780340861.567958:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:89391:x1866818961198720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340861.568077:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:89391:x1866818961198720:12345-0@lo:502:llog_process_th.0 Request processed in 119us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340861.568086:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1780340861.568272:0:89391:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89391:1866818961198720:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1780340861.568295:0:89391:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1780340861.568507:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:3.0:1780340861.568527:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780340861.568538:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5e00/0xa24651432774f5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.568549:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5e00/0xa24651432774f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340861.568559:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1780340861.568561:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 50 10000000:01000000:3.0:1780340861.568564:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1780340861.568588:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f8000/0xa24651432774f69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.568597:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c03476f8000/0xa24651432774f69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.568605:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c03476f8000/0xa24651432774f69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340861.568632:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961198848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340861.568674:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340861.568696:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446e32000 going to sleep for 11 seconds 00000100:00100000:2.0:1780340861.569399:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961198848 00000100:00100000:2.0:1780340861.569406:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961198848 00000100:00100000:2.0:1780340861.569453:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1780340861.569462:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045228d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961198848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340861.569475:0:88672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340861.569489:0:88672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c6400/0xa24651432774f70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774f69 expref: -99 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340861.569510:0:88672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c6400/0xa24651432774f70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774f69 expref: 18 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340861.569520:0:88672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c6400/0xa24651432774f70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774f69 expref: 18 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340861.569544:0:88672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6400, rc 0) 00000100:00100000:2.0:1780340861.569863:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045228d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961198848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 401us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340861.569871:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1780340861.575540:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961198848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340861.575581:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c03476f8000/0xa24651432774f69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.575595:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c03476f8000/0xa24651432774f69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774f70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340861.578349:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961198976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340861.578420:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340861.578464:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446e32000 going to sleep for 11 seconds 00000100:00100000:0.0:1780340861.578512:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961198976 00000100:00100000:0.0:1780340861.578520:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961198976 00000100:00100000:0.0:1780340861.578560:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1780340861.578568:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961198976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340861.578719:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448376050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961198976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340861.578727:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1780340861.579575:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961198976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340861.579631:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961199104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340861.579864:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340861.579900:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446e32000 going to sleep for 11 seconds 00000100:00100000:2.0:1780340861.580133:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961199104 00000100:00100000:2.0:1780340861.580138:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961199104 00000100:00100000:2.0:1780340861.580185:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1780340861.580194:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961199104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340861.580316:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448374c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961199104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340861.580323:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1780340861.580381:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961199104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340861.593176:0:89392:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89392:1866818961199232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340861.593275:0:89392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340861.593326:0:89392:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446ff2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1780340861.593376:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961199232 00000100:00100000:3.0:1780340861.593383:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961199232 00000100:00100000:3.0:1780340861.593428:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1780340861.593437:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:89392:x1866818961199232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340861.593555:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448377050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:89392:x1866818961199232:12345-0@lo:502:llog_process_th.0 Request processed in 119us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340861.593562:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1780340861.593949:0:89392:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89392:1866818961199232:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1780340861.593984:0:89392:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1780340861.593995:0:89392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340861.593997:0:89392:0:(obd_config.c:1561:class_process_config()) marker 48 (0x1) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:0.0:1780340861.594003:0:89392:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1780340861.594020:0:89392:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:0.0:1780340861.594040:0:89392:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89392:1866818961199360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340861.594075:0:89392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340861.594104:0:89392:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04775bb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340861.594146:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961199360 00000100:00100000:3.0:1780340861.594150:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961199360 00000100:00100000:3.0:1780340861.594181:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1780340861.594189:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:89392:x1866818961199360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340861.594259:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:89392:x1866818961199360:12345-0@lo:502:llog_process_th.0 Request processed in 71us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340861.594266:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1780340861.595906:0:89392:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89392:1866818961199360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1780340861.595949:0:89392:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780340861.595968:0:89392:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340861.595970:0:89392:0:(obd_config.c:1561:class_process_config()) marker 48 (0x2) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1780340861.595976:0:89392:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000020:01000000:3.0:1780340861.596149:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 50-52 (rc=0) 10000000:01000000:3.0:1780340861.596174:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1780340861.596185:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f8000/0xa24651432774f69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.596196:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c03476f8000/0xa24651432774f69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340861.596206:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1780340861.596208:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c04773ad000 from 55 10000000:01000000:3.0:1780340861.596211:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1780340861.596241:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa24651432774f77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.596248:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa24651432774f77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.596256:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa24651432774f77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340861.596277:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961199488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340861.596326:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340861.596366:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0476541cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340861.596497:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961199488 00000100:00100000:0.0:1780340861.596504:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961199488 00000100:00100000:0.0:1780340861.596548:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1780340861.596555:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961199488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340861.596567:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340861.596588:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa4200/0xa24651432774f7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774f77 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.596612:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa4200/0xa24651432774f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774f77 expref: 19 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.596635:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa4200/0xa24651432774f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774f77 expref: 19 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.596644:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4200, rc 0) 00000100:00100000:0.0:1780340861.596689:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961199488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340861.596696:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1780340861.602433:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961199488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340861.602461:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa24651432774f77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f7e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.602490:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa24651432774f77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774f7e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340861.602572:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961199616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340861.602652:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340861.602711:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0476541cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340861.602724:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961199616 00000100:00100000:0.0:1780340861.602739:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961199616 00000100:00100000:0.0:1780340861.602806:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1780340861.602815:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961199616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340861.602939:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448376c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961199616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340861.602946:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1780340861.603216:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961199616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340861.603247:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961199744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340861.603295:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340861.603321:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b058300 going to sleep for 11 seconds 00000100:00100000:3.0:1780340861.603373:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961199744 00000100:00100000:3.0:1780340861.603378:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961199744 00000100:00100000:3.0:1780340861.603414:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1780340861.603421:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961199744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340861.603500:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448375850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961199744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340861.603507:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1780340861.603592:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961199744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340861.605595:0:89393:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89393:1866818961199872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340861.605688:0:89393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340861.605777:0:89393:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b058300 going to sleep for 11 seconds 00000100:00100000:3.0:1780340861.607573:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961199872 00000100:00100000:3.0:1780340861.607599:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961199872 00000100:00100000:3.0:1780340861.607680:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1780340861.607689:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:89393:x1866818961199872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340861.607881:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448375c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:89393:x1866818961199872:12345-0@lo:502:llog_process_th.0 Request processed in 193us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340861.607889:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1780340861.608441:0:89393:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89393:1866818961199872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340861.608514:0:89393:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89393:1866818961200000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340861.608560:0:89393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340861.608595:0:89393:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c03483880c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340861.608896:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961200000 00000100:00100000:3.0:1780340861.608902:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961200000 00000100:00100000:3.0:1780340861.608980:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1780340861.608988:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:89393:x1866818961200000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340861.609072:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:89393:x1866818961200000:12345-0@lo:502:llog_process_th.0 Request processed in 85us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340861.609085:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1780340861.609319:0:89393:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89393:1866818961200000:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1780340861.609347:0:89393:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1780340861.609596:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:3.0:1780340861.610086:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780340861.610097:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa24651432774f77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f7e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.610110:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa24651432774f77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f7e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340861.610119:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1780340861.610122:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1780340861.610124:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1780340861.610154:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f9800/0xa24651432774f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.610162:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c03476f9800/0xa24651432774f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.610170:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c03476f9800/0xa24651432774f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340861.610190:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961200128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340861.610231:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340861.610267:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348210780 going to sleep for 11 seconds 00000100:00100000:0.0:1780340861.610314:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961200128 00000100:00100000:0.0:1780340861.610330:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961200128 00000100:00100000:0.0:1780340861.610371:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1780340861.610379:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961200128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340861.610391:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340861.610403:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa5800/0xa24651432774f8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774f85 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.610424:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa5800/0xa24651432774f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774f85 expref: 20 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.610432:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa5800/0xa24651432774f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774f85 expref: 20 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.610440:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5800, rc 0) 00000100:00100000:0.0:1780340861.610472:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448374850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961200128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340861.610478:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1780340861.610540:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961200128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340861.610551:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c03476f9800/0xa24651432774f85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f8c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340861.610559:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c03476f9800/0xa24651432774f85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774f8c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340861.610626:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961200256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340861.610651:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340861.610675:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c03483880c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340861.610785:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961200256 00000100:00100000:0.0:1780340861.610789:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961200256 00000100:00100000:0.0:1780340861.610806:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1780340861.610811:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961200256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340861.610914:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448374450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961200256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340861.610920:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1780340861.611104:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961200256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340861.611129:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961200384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340861.611167:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340861.611184:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c03483880c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340861.611223:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961200384 00000100:00100000:0.0:1780340861.611227:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961200384 00000100:00100000:0.0:1780340861.611244:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1780340861.611249:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961200384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340861.611338:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448374050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961200384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340861.611345:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1780340861.611461:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961200384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780340861.612462:0:89394:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1780340861.614046:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1780340861.614083:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1780340861.614096:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f9800/0xa24651432774f85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f8c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.614131:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c03476f9800/0xa24651432774f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f8c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340861.614141:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1780340861.614144:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c047b065000 from 55 10000000:01000000:3.0:1780340861.614147:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1780340861.614182:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f9c00/0xa24651432774f93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.614189:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c03476f9c00/0xa24651432774f93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.614201:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c03476f9c00/0xa24651432774f93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340861.614225:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961200512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340861.614286:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340861.614363:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348210a80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340861.622971:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961200512 00000100:00100000:0.0:1780340861.622986:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961200512 00000100:00100000:0.0:1780340861.623094:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1780340861.623105:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961200512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340861.623122:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340861.623141:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa5c00/0xa24651432774f9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774f93 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.623168:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa5c00/0xa24651432774f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774f93 expref: 21 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.623179:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa5c00/0xa24651432774f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774f93 expref: 21 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340861.623188:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5c00, rc 0) 00000100:00100000:0.0:1780340861.623261:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961200512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (8975us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340861.623268:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1780340861.623896:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961200512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340861.623917:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c03476f9c00/0xa24651432774f93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340861.623943:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c03476f9c00/0xa24651432774f93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774f9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340861.624020:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961200640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340861.624057:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340861.642649:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961200640 00000100:00100000:3.0:1780340861.642673:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961200640 00000100:00100000:3.0:1780340861.642735:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1780340861.642745:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961200640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340861.643628:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961200640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 882us (19568us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340861.643638:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1780340861.647164:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04515aa180 going to sleep for 11 seconds 00000100:00100000:2.0:1780340861.647211:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961200640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340861.647301:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961200768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340861.647374:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340861.647415:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04515aa180 going to sleep for 11 seconds 00000100:00100000:3.0:1780340861.649434:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961200768 00000100:00100000:3.0:1780340861.649449:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961200768 00000100:00100000:3.0:1780340861.649518:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1780340861.649545:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961200768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340861.649708:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961200768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (2333us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340861.649715:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1780340861.650022:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961200768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340861.650488:0:89395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89395:1866818961200896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340861.650534:0:89395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340861.650568:0:89395:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04515aa840 going to sleep for 11 seconds 00000100:00100000:3.0:1780340861.650705:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961200896 00000100:00100000:3.0:1780340861.650710:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961200896 00000100:00100000:3.0:1780340861.650744:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1780340861.650751:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:89395:x1866818961200896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340861.650885:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:89395:x1866818961200896:12345-0@lo:502:llog_process_th.0 Request processed in 134us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340861.650892:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1780340861.651074:0:89395:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89395:1866818961200896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340861.651114:0:89395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89395:1866818961201024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340861.651145:0:89395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340861.651172:0:89395:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a85d600 going to sleep for 11 seconds 00000100:00100000:1.0:1780340861.651266:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961201024 00000100:00100000:1.0:1780340861.651271:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961201024 00000100:00100000:1.0:1780340861.651290:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1780340861.651296:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:89395:x1866818961201024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340861.651358:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:89395:x1866818961201024:12345-0@lo:502:llog_process_th.0 Request processed in 62us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340861.651364:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1780340861.651431:0:89395:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:89395:1866818961201024:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1780340861.651450:0:89395:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1780340861.651599:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:1.0:1780340861.651625:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1780340861.651634:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f9c00/0xa24651432774f93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340861.651644:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c03476f9c00/0xa24651432774f93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340861.651652:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1780340861.651655:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1780340861.651669:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1780340861.651692:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123600/0xa24651432774fa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340861.651698:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453123600/0xa24651432774fa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340861.651705:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453123600/0xa24651432774fa1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340861.651718:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961201152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340861.651745:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340861.651787:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348388840 going to sleep for 11 seconds 00000100:00100000:2.0:1780340861.651846:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961201152 00000100:00100000:2.0:1780340861.651850:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961201152 00000100:00100000:2.0:1780340861.651870:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1780340861.651908:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961201152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340861.651917:0:88672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340861.651930:0:88672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c7800/0xa24651432774fa8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774fa1 expref: -99 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340861.651949:0:88672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c7800/0xa24651432774fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774fa1 expref: 22 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340861.651959:0:88672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c7800/0xa24651432774fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774fa1 expref: 22 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340861.651967:0:88672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7800, rc 0) 00000100:00100000:2.0:1780340861.651995:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961201152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340861.652001:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1780340861.652185:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961201152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340861.652196:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453123600/0xa24651432774fa1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774fa8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340861.652204:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453123600/0xa24651432774fa1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774fa8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340861.652247:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961201280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340861.652278:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340861.652299:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348388840 going to sleep for 11 seconds 00000100:00100000:3.0:1780340861.652357:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961201280 00000100:00100000:3.0:1780340861.652361:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961201280 00000100:00100000:3.0:1780340861.652382:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1780340861.652388:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045317e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961201280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340861.652496:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045317e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961201280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340861.652503:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1780340861.652586:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961201280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340861.652611:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961201408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340861.652645:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340861.652681:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348388840 going to sleep for 11 seconds 00000100:00100000:2.0:1780340861.656312:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961201408 00000100:00100000:2.0:1780340861.656328:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961201408 00000100:00100000:2.0:1780340861.656393:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1780340861.656404:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03499e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961201408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340861.656574:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03499e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961201408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (3927us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340861.656582:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1780340861.656744:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961201408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780340861.657669:0:89396:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1780340861.657898:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1780340861.657920:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1780340861.657941:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123600/0xa24651432774fa1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774fa8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340861.657953:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453123600/0xa24651432774fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774fa8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340861.657963:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1780340861.657965:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8c0471e119c0 from 1 10000000:01000000:1.0:1780340861.657968:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1780340861.657998:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432774faf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340861.658005:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432774faf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340861.658014:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432774faf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340861.658034:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961201536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340861.658096:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340861.658127:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348388840 going to sleep for 11 seconds 00000100:00100000:2.0:1780340861.658294:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961201536 00000100:00100000:2.0:1780340861.658301:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961201536 00000100:00100000:2.0:1780340861.658343:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1780340861.658350:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961201536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340861.658361:0:88673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340861.658372:0:88673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c7600/0xa24651432774fb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432774faf expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340861.658402:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c7600/0xa24651432774fb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774faf expref: 23 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340861.658412:0:88673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c7600/0xa24651432774fb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774faf expref: 23 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340861.658421:0:88673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7600, rc 0) 00000100:00100000:2.0:1780340861.658469:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961201536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340861.658475:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1780340861.658906:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961201536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340861.658919:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432774faf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774fb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.658928:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432774faf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774fb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340861.658995:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961201664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340861.659027:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340861.659062:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348210a80 going to sleep for 11 seconds 00000100:00100000:1.0:1780340861.659126:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961201664 00000100:00100000:1.0:1780340861.659131:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961201664 00000100:00100000:1.0:1780340861.659168:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1780340861.659175:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961201664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340861.659252:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961201664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (224us total) trans 0 rc -2/-2 00000100:00100000:1.0:1780340861.659259:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1780340861.659340:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961201664:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1780340861.659364:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1780340861.659370:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432774faf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774fb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340861.659379:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432774faf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774fb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340861.835826:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340862.057755:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340862.057957:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940462720 00000100:00100000:1.0:1780340862.057967:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940462720 00000100:00100000:1.0:1780340862.058025:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 164 00000100:00100000:1.0:1780340862.058035:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+7:70274:x1866818940462720:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340862.058050:0:88672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340862.058069:0:88672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453122c00/0xa24651432774fbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced254a expref: -99 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340862.058097:0:88672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453122c00/0xa24651432774fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced254a expref: 8 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340862.058107:0:88672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453122c00/0xa24651432774fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced254a expref: 8 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340862.058115:0:88672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122c00, rc 0) 00000100:00100000:1.0:1780340862.058174:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940462720:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 141us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340862.058181:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 164 00000100:00100000:2.0:1780340862.063603:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340862.063919:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940462848 00000100:00100000:0.0:1780340862.063930:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940462848 00000100:00100000:0.0:1780340862.064029:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 165 00000100:00100000:0.0:1780340862.064040:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940462848:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340862.064196:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940462848:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 158us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340862.064215:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 165 00000100:00100000:3.0:1780340862.067087:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340862.067531:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940462976 00000100:00100000:2.0:1780340862.067539:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940462976 00000100:00100000:1.0:1780340862.067858:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 166 00000100:00100000:1.0:1780340862.067871:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940462976:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340862.068059:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940462976:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 191us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340862.068067:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 166 00000100:00100000:3.0:1780340862.072092:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340862.072439:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940463104 00000100:00100000:0.0:1780340862.072450:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940463104 00000100:00100000:0.0:1780340862.072557:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 167 00000100:00100000:0.0:1780340862.072567:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+8:71266:x1866818940463104:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1780340862.072751:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+8:71266:x1866818940463104:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 184us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340862.072788:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 167 00000100:00100000:2.0:1780340862.075557:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340862.079864:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940463232 00000100:00100000:1.0:1780340862.079879:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940463232 00000100:00100000:1.0:1780340862.080007:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 168 00000100:00100000:1.0:1780340862.080017:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:71266:x1866818940463232:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1780340862.080167:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:71266:x1866818940463232:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 151us (4617us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340862.080175:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 168 00000100:00100000:3.0:1780340862.084114:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340862.084356:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940463360 00000100:00100000:1.0:1780340862.084366:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940463360 00000100:00100000:1.0:1780340862.084421:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 169 00000100:00100000:1.0:1780340862.084431:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940463360:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340862.084448:0:88672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340862.084464:0:88672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453123000/0xa24651432774fc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2551 expref: -99 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340862.084491:0:88672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453123000/0xa24651432774fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2551 expref: 9 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340862.084501:0:88672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453123000/0xa24651432774fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2551 expref: 9 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340862.084509:0:88672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123000, rc 0) 00000100:00100000:1.0:1780340862.084637:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940463360:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 207us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340862.084645:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 169 00000100:00100000:2.0:1780340862.089095:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340862.091826:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940463488 00000100:00100000:3.0:1780340862.091841:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940463488 00000100:00100000:3.0:1780340862.091908:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 170 00000100:00100000:3.0:1780340862.091918:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940463488:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340862.092041:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940463488:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 123us (2953us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780340862.092049:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 170 00010000:00010000:1.0:1780340862.860001:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340863.370285:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340863.370305:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961202048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340863.370375:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340863.370421:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961202048 00000100:00100000:2.0:1780340863.370428:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961202048 00000100:00100000:2.0:1780340863.370481:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108 00000100:00100000:2.0:1780340863.370490:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961202048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340863.370519:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340863.370573:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961202048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340863.370580:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108 00000100:00080000:2.0:1780340863.370605:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340863.370638:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047b36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961202048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340863.371379:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961201792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780340863.371418:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340863.371452:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340863.371468:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961202176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340863.371497:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340863.371523:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961202176 00000100:00100000:3.0:1780340863.371526:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961202176 00000100:00100000:3.0:1780340863.371574:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2109 00000100:00100000:3.0:1780340863.371583:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961202176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340863.371603:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780340863.371639:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a845500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961202176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340863.371657:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2109 00000100:00100000:3.0:1780340863.371692:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a845880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961202176:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1780340863.371783:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340863.371933:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961201792 00000100:00100000:1.0:1780340863.371937:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961201792 00000100:00100000:1.0:1780340863.371965:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3911 00000100:00100000:1.0:1780340863.371972:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961201792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780340863.371995:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445478400 avail 1299238912 00000100:00100000:1.0:1780340863.372027:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a845180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961201792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 56us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340863.372034:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3911 00000100:00100000:2.0:1780340863.372144:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961202304:0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.372191:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340863.372224:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961202816:0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.372247:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340863.372265:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961203328:0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.372288:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340863.372313:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445595500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961201792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340863.372326:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1780340863.372332:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961201920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340863.372355:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340863.372372:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961202432:0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.372393:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340863.372410:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961202944:0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.372427:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340863.372444:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961203456:0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.372464:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340863.372489:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961202816 00000100:00100000:2.0:1780340863.372492:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961202816 00000100:00100000:2.0:1780340863.372523:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961202432 00000100:00100000:2.0:1780340863.372526:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961202432 00000100:00100000:2.0:1780340863.372559:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961203456 00000100:00100000:2.0:1780340863.372562:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961203456 00000100:00100000:2.0:1780340863.372578:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:2.0:1780340863.372593:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961202816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.372631:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961202816:12345-0@lo:400:kworker.0 Request processed in 39us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340863.372638:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00100000:2.0:1780340863.372663:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:2.0:1780340863.372670:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961202432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.372699:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961202432:12345-0@lo:400:kworker.0 Request processed in 30us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340863.372705:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:2.0:1780340863.372714:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:2.0:1780340863.372719:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ef33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961203456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.372741:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ef33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961203456:12345-0@lo:400:kworker.0 Request processed in 22us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340863.372745:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:2.0:1780340863.372785:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961201920 00000100:00100000:2.0:1780340863.372789:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961201920 00000100:00100000:2.0:1780340863.372808:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961202944 00000100:00100000:2.0:1780340863.372811:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961202944 00000100:00100000:2.0:1780340863.372827:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3912 00000100:00100000:2.0:1780340863.372832:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3661:x1866818961201920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780340863.372853:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445171200 avail 1298931712 00000100:00100000:2.0:1780340863.372879:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3661:x1866818961201920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340863.372885:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3912 00000100:00100000:2.0:1780340863.372897:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913 00000100:00100000:2.0:1780340863.372903:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3661:x1866818961202944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.372936:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3661:x1866818961202944:12345-0@lo:400:kworker.0 Request processed in 34us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340863.372942:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913 00000100:00080000:2.0:1780340863.372974:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780340863.372977:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340863.372986:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961202688:0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.373009:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340863.373025:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961203200:0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.373045:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340863.373060:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1780340863.373065:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961202560:0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.373083:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340863.373096:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961203072:0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.373114:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340863.373137:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961202688 00000100:00100000:2.0:1780340863.373140:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961202688 00000100:00100000:2.0:1780340863.373165:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961202560 00000100:00100000:2.0:1780340863.373168:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961202560 00000100:00100000:2.0:1780340863.373183:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961203072 00000100:00100000:2.0:1780340863.373186:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961203072 00000100:00100000:2.0:1780340863.373199:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:2.0:1780340863.373205:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ef31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961202688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.373237:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ef31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961202688:12345-0@lo:400:kworker.0 Request processed in 33us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340863.373243:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:2.0:1780340863.373254:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:2.0:1780340863.373260:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961202560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.373295:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961202560:12345-0@lo:400:kworker.0 Request processed in 36us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340863.373301:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:2.0:1780340863.373314:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:2.0:1780340863.373320:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961203072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.373344:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961203072:12345-0@lo:400:kworker.0 Request processed in 25us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340863.373348:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00080000:2.0:1780340863.373365:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340863.373368:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780340863.373386:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961202560:0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.373394:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961203072:0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.373401:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961202688:0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.373429:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961201920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340863.373438:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961202432:0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.373445:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961202944:0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.373454:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961203456:0@lo:400:kworker.0 00000100:00100000:2.0:1780340863.373463:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961202816:0@lo:400:kworker.0 00000100:00100000:1.0:1780340863.373677:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961202304 00000100:00100000:1.0:1780340863.373681:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961202304 00000100:00100000:1.0:1780340863.373716:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1780340863.373723:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961202304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340863.373782:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961202304:12345-0@lo:400:kworker.0 Request processed in 60us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340863.373789:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1780340863.373822:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961202304:0@lo:400:kworker.0 00000100:00100000:3.0:1780340863.374712:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961203328 00000100:00100000:3.0:1780340863.374719:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961203328 00000100:00100000:3.0:1780340863.374778:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961203200 00000100:00100000:3.0:1780340863.374781:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961203200 00000100:00100000:3.0:1780340863.374805:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00100000:3.0:1780340863.374812:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961203328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340863.374861:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961203328:12345-0@lo:400:kworker.0 Request processed in 50us (2572us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340863.374867:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00100000:3.0:1780340863.374879:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00000100:00100000:3.0:1780340863.374886:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961203200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340863.374918:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444227b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961203200:12345-0@lo:400:kworker.0 Request processed in 34us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340863.374924:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00000100:00080000:3.0:1780340863.374953:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340863.374956:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340863.374999:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961203200:0@lo:400:kworker.0 00000100:00100000:3.0:1780340863.375024:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961203328:0@lo:400:kworker.0 00000100:00100000:3.0:1780340863.461869:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340863.461946:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940463616 00000100:00100000:2.0:1780340863.461956:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940463616 00000100:00100000:2.0:1780340863.462027:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1370 00000100:00100000:2.0:1780340863.462037:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:71286:x1866818940463616:12345-192.168.203.16@tcp:101:mkdir.0 00010000:00010000:2.0:1780340863.462070:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340863.462089:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432774fcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2558 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.462170:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6e00/0xa24651432774fd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.462186:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6e00/0xa24651432774fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.462199:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6e00/0xa24651432774fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340863.462245:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1780340863.462249:0:64454:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780340863.462288:0:64454:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6e00/0xa24651432774fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.462315:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432774fcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2558 expref: 8 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.462330:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6e00/0xa24651432774fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2558 expref: 7 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.462338:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:2.0:1780340863.462341:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780340863.462345:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6e00, rc 0) 00000100:00100000:2.0:1780340863.462398:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a845880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:71286:x1866818940463616:12345-192.168.203.16@tcp:101:mkdir.0 Request processed in 363us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340863.462405:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1370 00000100:00080000:3.0:1780340863.462797:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340863.467723:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340863.469458:0:88638:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940463744 00000100:00100000:3.0:1780340863.469470:0:88638:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940463744 00000100:00100000:3.0:1780340863.469529:0:88638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00100000:3.0:1780340863.469539:0:88638:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:71286:x1866818940463744:12345-192.168.203.16@tcp:700:mkdir.0 00000100:00100000:3.0:1780340863.469620:0:88638:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:71286:x1866818940463744:12345-192.168.203.16@tcp:700:mkdir.0 Request processed in 83us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340863.469628:0:88638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 15 00000100:00100000:2.0:1780340863.473471:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340863.474212:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940464000 00000100:00100000:1.0:1780340863.474224:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940464000 00000100:00100000:1.0:1780340863.474279:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1371 00000100:00100000:1.0:1780340863.474290:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:71286:x1866818940464000:12345-192.168.203.16@tcp:36:mkdir.0 00010000:00010000:1.0:1780340863.474344:0:70100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340863.474379:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6e00/0xa24651432774fd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2558 expref: 7 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.474396:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:1.0:1780340863.474401:0:70100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780340863.474475:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432774fd9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.474495:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432774fd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.474505:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432774fd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.474520:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123800/0xa24651432774fe0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.474528:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123800/0xa24651432774fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.474534:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123800/0xa24651432774fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.478728:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774fe7 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.478748:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774fe7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.478773:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774fe7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340863.478793:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002953a863 reply state 000000005890f6e7 transno 115964116996 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774fe7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.478811:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774fe7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.478819:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff8c04495cd000) 00010000:00010000:1.0:1780340863.478822:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340863.478827:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1780340863.478833:0:70100:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1780340863.478841:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432774fd9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.478848:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432774fd9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.478856:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432774fd9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.478862:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340863.478866:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432774fd9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.478873:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432774fd9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.478883:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:1.0:1780340863.478886:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340863.478889:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432774fd9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.478895:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432774fd9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340863.478916:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002953a863 reply state 000000005890f6e7 transno 115964116996 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123800/0xa24651432774fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.478925:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123800/0xa24651432774fe0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.478931:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff8c04495cdd00) 00010000:00010000:1.0:1780340863.478934:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340863.478936:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1780340863.479047:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:71286:x1866818940464000:12345-192.168.203.16@tcp:36:mkdir.0 Request processed in 4756us (5580us total) trans 115964116996 rc 0/0 00000100:00100000:1.0:1780340863.479056:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1371 00000100:00100000:0.0:1780340863.490750:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340863.490860:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940464128 00000100:00100000:2.0:1780340863.490870:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940464128 00000100:00100000:2.0:1780340863.490926:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1372 00000100:00100000:2.0:1780340863.490935:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:71286:x1866818940464128:12345-192.168.203.16@tcp:101:mkdir.0 00010000:00010000:2.0:1780340863.490955:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340863.490974:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432774fee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced255f expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.491039:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa24651432774ff5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.491054:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa24651432774ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.491065:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa24651432774ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340863.491182:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1780340863.491187:0:63710:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780340863.491210:0:63710:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa24651432774ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.491235:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432774fee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced255f expref: 10 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.491252:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa24651432774ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced255f expref: 9 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.491260:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:2.0:1780340863.491273:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780340863.491278:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7e00, rc 0) 00000100:00100000:2.0:1780340863.491338:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:71286:x1866818940464128:12345-192.168.203.16@tcp:101:mkdir.0 Request processed in 404us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340863.491346:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1372 00000100:00100000:1.0:1780340863.496822:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340863.496965:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940464384 00000100:00100000:2.0:1780340863.496977:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940464384 00000100:00100000:2.0:1780340863.497211:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1373 00000100:00100000:2.0:1780340863.497223:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:71286:x1866818940464384:12345-192.168.203.16@tcp:101:mkdir.0 00010000:00010000:2.0:1780340863.497243:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340863.497262:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6600/0xa24651432774ffc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2566 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497336:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa24651432775003 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497351:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa24651432775003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497362:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa24651432775003 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497372:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277500a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497379:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277500a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497385:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277500a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340863.497522:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1780340863.497595:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa24651432775003 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497603:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa24651432775003 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497609:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa24651432775003 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497615:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa24651432775003 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497621:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340863.497625:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa24651432775003 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497633:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa24651432775003 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497655:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:2.0:1780340863.497658:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340863.497662:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa24651432775003 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497668:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa24651432775003 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497680:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277500a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497686:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277500a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497698:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277500a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497703:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340863.497706:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277500a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497712:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277500a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497720:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff8c04495cdd00) 00010000:00010000:2.0:1780340863.497722:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340863.497725:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277500a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497731:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277500a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497881:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6600/0xa24651432774ffc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2566 expref: 11 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497891:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:2.0:1780340863.497894:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780340863.497897:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6600/0xa24651432774ffc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2566 expref: 11 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.497905:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6600, rc 0) 00000100:00100000:2.0:1780340863.497968:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:71286:x1866818940464384:12345-192.168.203.16@tcp:101:mkdir.0 Request processed in 747us (1155us total) trans 115964116997 rc 301/301 00000100:00100000:2.0:1780340863.497984:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1373 00000100:00100000:3.0:1780340863.507275:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340863.507352:0:63721:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940464512 00000100:00100000:1.0:1780340863.507362:0:63721:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940464512 00000100:00100000:1.0:1780340863.507433:0:63721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00100000:1.0:1780340863.507443:0:63721:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:71286:x1866818940464512:12345-192.168.203.16@tcp:900:mkdir.0 00000100:00100000:1.0:1780340863.507524:0:63721:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:71286:x1866818940464512:12345-192.168.203.16@tcp:900:mkdir.0 Request processed in 82us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340863.507532:0:63721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 14 00000100:00080000:3.0:1780340863.507698:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340863.512056:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340863.512144:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940464768 00000100:00100000:0.0:1780340863.512154:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940464768 00000100:00100000:0.0:1780340863.512210:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 241 00000100:00100000:0.0:1780340863.512220:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034af3bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:71286:x1866818940464768:12345-192.168.203.16@tcp:35:mkdir.0 00000100:00100000:0.0:1780340863.512454:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034af3bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:71286:x1866818940464768:12345-192.168.203.16@tcp:35:mkdir.0 Request processed in 235us (406us total) trans 115964116998 rc 0/0 00000100:00100000:0.0:1780340863.512462:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 241 00000100:00100000:0.0:1780340863.517519:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340863.517621:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940465024 00000100:00100000:1.0:1780340863.517632:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940465024 00000100:00100000:1.0:1780340863.517703:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1374 00000100:00100000:1.0:1780340863.517713:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:71286:x1866818940465024:12345-192.168.203.16@tcp:36:mkdir.0 00000100:00100000:1.0:1780340863.517879:0:70100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961203584:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1780340863.517927:0:70100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340863.517979:0:70100:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04774046c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340863.518052:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961203584 00000100:00100000:3.0:1780340863.518056:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961203584 00000100:00100000:3.0:1780340863.518118:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3914 00000100:00100000:3.0:1780340863.518126:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:70100:x1866818961203584:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1780340863.518193:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:70100:x1866818961203584:12345-0@lo:1000:mdt00_004.0 Request processed in 68us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340863.518201:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3914 00000100:00100000:1.0:1780340863.518660:0:70100:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961203584:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1780340863.518728:0:70100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961203712:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1780340863.518794:0:70100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340863.518812:0:70100:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04774046c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340863.518881:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961203712 00000100:00100000:2.0:1780340863.518886:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961203712 00000100:00100000:2.0:1780340863.518916:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915 00000100:00100000:2.0:1780340863.518924:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:70100:x1866818961203712:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1780340863.518995:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:70100:x1866818961203712:12345-0@lo:1000:mdt00_004.0 Request processed in 72us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340863.519002:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3915 00000100:00100000:3.0:1780340863.519095:0:70100:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961203712:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1780340863.519148:0:70100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961203840:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1780340863.519176:0:70100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340863.519192:0:70100:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348210540 going to sleep for 11 seconds 00000100:00100000:3.0:1780340863.519214:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961203840 00000100:00100000:3.0:1780340863.519218:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961203840 00000100:00100000:3.0:1780340863.519240:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916 00000100:00100000:3.0:1780340863.519247:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:70100:x1866818961203840:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1780340863.519316:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:70100:x1866818961203840:12345-0@lo:1000:mdt00_004.0 Request processed in 69us (139us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780340863.519323:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916 00000100:00100000:3.0:1780340863.519348:0:70100:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961203840:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1780340863.519396:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.519406:0:70100:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.519416:0:70100:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340863.519428:0:70100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f50700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961203968:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1780340863.519451:0:70100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340863.519466:0:70100:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348210a80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340863.519476:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961203968 00000100:00100000:3.0:1780340863.519479:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961203968 00000100:00100000:3.0:1780340863.519494:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3917 00000100:00100000:3.0:1780340863.519499:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:70100:x1866818961203968:12345-0@lo:101:mdt00_004.0 00010000:00010000:3.0:1780340863.519508:0:26074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340863.519522:0:26074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277501f lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa24651432775018 expref: -99 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.519541:0:26074:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774fe7 lrc: 2/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.519557:0:26074:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277501f lrc: 4/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775018 expref: 9 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.519571:0:26074:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774fe7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:3.0:1780340863.519594:0:26074:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:3.0:1780340863.519623:0:26074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277501f lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775018 expref: 9 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.519632:0:26074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff8c04495cd000) 00010000:00010000:3.0:1780340863.519635:0:26074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340863.519638:0:26074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277501f lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775018 expref: 9 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.519660:0:26074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9e00, rc 0) 00000100:00100000:3.0:1780340863.519690:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:70100:x1866818961203968:12345-0@lo:101:mdt00_004.0 Request processed in 191us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340863.519695:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3917 00000100:00100000:3.0:1780340863.519987:0:70100:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f50700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961203968:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1780340863.520000:0:70100:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.520009:0:70100:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1780340863.528369:0:88666:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116998 is committed 00000001:00080000:3.0:1780340863.528411:0:88666:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116995 is committed 00010000:00010000:1.0:1780340863.528568:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123800/0xa24651432774fe0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.528582:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123800/0xa24651432774fe0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.528590:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123800/0xa24651432774fe0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.528596:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340863.528600:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123800/0xa24651432774fe0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.528608:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123800/0xa24651432774fe0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.528623:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff8c04495cdd00) 00010000:00010000:1.0:1780340863.528626:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340863.528631:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123800/0xa24651432774fe0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.528637:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123800/0xa24651432774fe0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.528665:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774fe7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.528683:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774fe7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.528688:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774fe7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.528692:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340863.528695:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774fe7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.528700:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774fe7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.528708:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff8c04495cd000) 00010000:00010000:1.0:1780340863.528710:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340863.528717:0:3646:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277501f lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775018 expref: 7 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.528728:0:3646:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277501f lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xa24651432775018 expref: 7 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.528737:0:3646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277501f lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xa24651432775018 expref: 7 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.528836:0:3646:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277501f lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775018 expref: 7 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340863.528852:0:3646:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace5180 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3646:1866818961204096:0@lo:105: 00000100:00100000:1.0:1780340863.528913:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340863.528965:0:3646:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04774040c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340863.529020:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961204096 00000100:00100000:0.0:1780340863.529027:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961204096 00000100:00100000:0.0:1780340863.529077:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1780340863.529086:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3646:x1866818961204096:12345-0@lo:105: 00010000:00010000:0.0:1780340863.529095:0:6500:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.529104:0:6500:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.529131:0:6500:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.529138:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 5/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.529145:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.529153:0:6500:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.529181:0:6500:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8c03476f9200) 00000100:00100000:0.0:1780340863.529222:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3646:x1866818961204096:12345-0@lo:105: Request processed in 137us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340863.529229:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00010000:2.0:1780340863.529370:0:70100:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.529380:0:70100:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1780340863.529405:0:70100:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:2.0:1780340863.529441:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c6600/0xa24651432775026 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.529448:0:70100:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c6600/0xa24651432775026 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.529458:0:70100:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c6600/0xa24651432775026 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340863.529473:0:70100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961204224:0@lo:101:mdt00_004.0 00000100:00100000:2.0:1780340863.529504:0:70100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340863.529520:0:70100:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acd8840 going to sleep for 11 seconds 00000100:00100000:0.0:1780340863.529572:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961204224 00000100:00100000:0.0:1780340863.529576:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961204224 00000100:00100000:0.0:1780340863.529610:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3918 00000100:00100000:0.0:1780340863.529617:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:70100:x1866818961204224:12345-0@lo:101:mdt00_004.0 00010000:00010000:0.0:1780340863.529632:0:26074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340863.529658:0:26074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa2465143277502d lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa24651432775026 expref: -99 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.529677:0:26074:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa2465143277502d lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775026 expref: 9 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.529700:0:26074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa2465143277502d lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775026 expref: 9 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.529707:0:26074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff8c045a87a100) 00010000:00010000:0.0:1780340863.529709:0:26074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340863.529712:0:26074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5400, rc 0) 00000100:00100000:0.0:1780340863.529745:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:70100:x1866818961204224:12345-0@lo:101:mdt00_004.0 Request processed in 129us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340863.529751:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3918 00000100:00100000:0.0:1780340863.529804:0:70100:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116995 gen 3 00000004:00080000:0.0:1780340863.529809:0:70100:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 115964116995 committed transno 115964116995 00000100:00100000:0.0:1780340863.529826:0:70100:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ae680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961204224:0@lo:101:mdt00_004.0 00010000:00010000:0.0:1780340863.529837:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c6600/0xa24651432775026 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa2465143277502d expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.529846:0:70100:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c6600/0xa24651432775026 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa2465143277502d expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780340863.529857:0:70100:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:0.0:1780340863.529883:0:70100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961204352:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340863.529905:0:70100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340863.529918:0:70100:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446ff2540 going to sleep for 11 seconds 00000100:00100000:0.0:1780340863.529932:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961204352 00000100:00100000:0.0:1780340863.529935:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961204352 00000100:00100000:0.0:1780340863.529958:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919 00000100:00100000:0.0:1780340863.529964:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:70100:x1866818961204352:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340863.530030:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:70100:x1866818961204352:12345-0@lo:1000:mdt00_004.0 Request processed in 65us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340863.530036:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919 00000100:00100000:0.0:1780340863.530068:0:70100:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961204352:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340863.530102:0:70100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961204480:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340863.530137:0:70100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340863.530150:0:70100:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446ff2180 going to sleep for 11 seconds 00000100:00100000:0.0:1780340863.530160:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961204480 00000100:00100000:0.0:1780340863.530163:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961204480 00000100:00100000:0.0:1780340863.530181:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3920 00000100:00100000:0.0:1780340863.530188:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:70100:x1866818961204480:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340863.530251:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:70100:x1866818961204480:12345-0@lo:1000:mdt00_004.0 Request processed in 64us (113us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780340863.530257:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3920 00000100:00100000:0.0:1780340863.530280:0:70100:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961204480:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340863.530348:0:70100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961204608:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340863.530368:0:70100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340863.530381:0:70100:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446ff2540 going to sleep for 11 seconds 00000100:00100000:0.0:1780340863.530391:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961204608 00000100:00100000:0.0:1780340863.530394:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961204608 00000100:00100000:0.0:1780340863.530415:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3921 00000100:00100000:0.0:1780340863.530420:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:70100:x1866818961204608:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340863.530469:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:70100:x1866818961204608:12345-0@lo:1000:mdt00_004.0 Request processed in 48us (99us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780340863.530474:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3921 00000100:00100000:0.0:1780340863.530507:0:70100:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961204608:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340863.530548:0:70100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961204736:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340863.530569:0:70100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340863.530581:0:70100:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446ff2180 going to sleep for 11 seconds 00000100:00100000:0.0:1780340863.530591:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961204736 00000100:00100000:0.0:1780340863.530594:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961204736 00000100:00100000:0.0:1780340863.530612:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3922 00000100:00100000:0.0:1780340863.530618:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:70100:x1866818961204736:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340863.530675:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:70100:x1866818961204736:12345-0@lo:1000:mdt00_004.0 Request processed in 57us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340863.530681:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3922 00000100:00100000:0.0:1780340863.530704:0:70100:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961204736:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340863.530738:0:70100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961204864:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340863.530783:0:70100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340863.530796:0:70100:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446ff2540 going to sleep for 11 seconds 00000100:00100000:0.0:1780340863.530808:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961204864 00000100:00100000:0.0:1780340863.530811:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961204864 00000100:00100000:0.0:1780340863.530829:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3923 00000100:00100000:0.0:1780340863.530834:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:70100:x1866818961204864:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340863.530887:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:70100:x1866818961204864:12345-0@lo:1000:mdt00_004.0 Request processed in 52us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340863.530892:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3923 00000100:00100000:0.0:1780340863.530918:0:70100:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961204864:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340863.530951:0:70100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961204992:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340863.530971:0:70100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340863.530992:0:70100:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0446ff2180 going to sleep for 11 seconds 00000100:00100000:0.0:1780340863.531002:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961204992 00000100:00100000:0.0:1780340863.531005:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961204992 00000100:00100000:0.0:1780340863.531025:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3924 00000100:00100000:0.0:1780340863.531031:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:70100:x1866818961204992:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340863.531081:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:70100:x1866818961204992:12345-0@lo:1000:mdt00_004.0 Request processed in 50us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340863.531087:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924 00000100:00100000:0.0:1780340863.531111:0:70100:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:70100:1866818961204992:0@lo:1000:mdt00_004.0 00000040:00080000:0.0:1780340863.531503:0:70100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].4, 968 off37320 00000040:00080000:0.0:1780340863.531554:0:70100:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].4, 1120 off37904 00000004:00080000:0.0:1780340863.531560:0:70100:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c0446ff2180 with version 13 00000004:00080000:0.0:1780340863.531579:0:72687:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c034acb9780 version 13 rpc_version 13 00000020:00100000:0.0:1780340863.531597:0:72687:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1780340863.531605:0:72687:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c0444225880 x1866818961205248/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2392/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340863.531619:0:72687:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0444225880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72687:1866818961205248:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1780340863.531661:0:72687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340863.531676:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0347591d80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340863.531690:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961205248 00000100:00100000:0.0:1780340863.531693:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961205248 00000100:00100000:0.0:1780340863.531715:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925 00000100:00100000:0.0:1780340863.531721:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:72687:x1866818961205248:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1780340863.532056:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:72687:x1866818961205248:12345-0@lo:1000:osp_up0-1.0 Request processed in 335us (394us total) trans 115964116999 rc 0/0 00000100:00100000:0.0:1780340863.532064:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925 00000100:00100000:0.0:1780340863.532105:0:72687:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0444225880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72687:1866818961205248:0@lo:1000:osp_up0-1.0 00010000:00010000:0.0:1780340863.532169:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4600/0xa24651432775034 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.532184:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4600/0xa24651432775034 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.532196:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4600/0xa24651432775034 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340863.532214:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000086d066b0 reply state 00000000a5fe6630 transno 81604378755 ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4600/0xa24651432775034 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.532225:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4600/0xa24651432775034 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.532232:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff8c045a87a600) 00010000:00010000:0.0:1780340863.532235:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340863.532239:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1780340863.532244:0:70100:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00080000:0.0:1780340863.532251:0:70100:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:0.0:1780340863.532259:0:70100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.532268:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.532274:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.532293:0:70100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1780340863.532297:0:70100:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:0.0:1780340863.532308:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c6600/0xa24651432775026 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa2465143277502d expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.532316:0:70100:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c6600/0xa24651432775026 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa2465143277502d expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340863.532383:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:71286:x1866818940465024:12345-192.168.203.16@tcp:36:mkdir.0 Request processed in 14670us (14872us total) trans 81604378755 rc 0/0 00000100:00100000:0.0:1780340863.532390:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1374 00010000:00010000:0.0:1780340863.532411:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340863.532417:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.532424:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9200 already unused, calling callback (ffffffffc18205b0) 00010000:00010000:0.0:1780340863.532429:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340863.532436:0:23160:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.532462:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.532468:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780340863.532483:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 1/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.532489:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f9200/0xa24651432775018 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa2465143277501f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.532517:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340863.532519:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340863.532520:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340863.532885:0:3646:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace5180 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_001:lustre-MDT0000_UUID:3646:1866818961204096:0@lo:105: 00010000:00010000:1.0:1780340863.532902:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774fe7 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.532909:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432774fe7 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340863.532990:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961205376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340863.533029:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340863.533374:0:19125:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961205376 00000100:00100000:1.0:1780340863.533380:0:19125:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961205376 00000100:00100000:1.0:1780340863.533422:0:19125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1780340863.533430:0:19125:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3659:x1866818961205376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340863.533443:0:19125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340863.533459:0:19125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277501f lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432775018 expref: 10 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.533469:0:19125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff8c04495cd000) 00010000:00010000:1.0:1780340863.533477:0:19125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340863.533518:0:19125:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3659:x1866818961205376:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340863.533535:0:19125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:2.0:1780340863.533631:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961205376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340863.539014:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340863.539509:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940465280 00000100:00100000:3.0:1780340863.539519:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940465280 00000100:00100000:3.0:1780340863.539579:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1375 00000100:00100000:3.0:1780340863.539589:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:71286:x1866818940465280:12345-192.168.203.16@tcp:36:mkdir.0 00010000:00010000:3.0:1780340863.539661:0:64454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340863.539689:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa24651432774ff5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced255f expref: 7 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.539707:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:3.0:1780340863.539713:0:64454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340863.539883:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:71286:x1866818940465280:12345-192.168.203.16@tcp:36:mkdir.0 Request processed in 295us (877us total) trans 0 rc -17/-17 00000100:00100000:3.0:1780340863.539891:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1375 00000100:00100000:3.0:1780340863.541944:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340863.542025:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940465408 00000100:00100000:2.0:1780340863.542035:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940465408 00000100:00100000:2.0:1780340863.542095:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1376 00000100:00100000:2.0:1780340863.542105:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:71286:x1866818940465408:12345-192.168.203.16@tcp:101:mkdir.0 00010000:00010000:2.0:1780340863.542124:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340863.542144:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277503b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced256d expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.542203:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa24651432775042 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.542217:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa24651432775042 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.542227:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa24651432775042 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340863.542268:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1780340863.542271:0:63712:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780340863.542289:0:63712:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa24651432775042 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.542311:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277503b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced256d expref: 8 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.542328:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa24651432775042 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced256d expref: 7 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.542337:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:2.0:1780340863.542352:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780340863.542356:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7000, rc 0) 00000100:00100000:2.0:1780340863.542415:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:71286:x1866818940465408:12345-192.168.203.16@tcp:101:mkdir.0 Request processed in 311us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340863.542422:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1376 00000100:00100000:1.0:1780340863.557655:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340863.557787:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940465536 00000100:00100000:0.0:1780340863.557798:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940465536 00000100:00100000:0.0:1780340863.557858:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1377 00000100:00100000:0.0:1780340863.557867:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:71286:x1866818940465536:12345-192.168.203.16@tcp:101:mkdir.0 00010000:00010000:0.0:1780340863.557887:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340863.557907:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa24651432775049 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2574 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.557970:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa24651432775050 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.557985:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa24651432775050 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.557996:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa24651432775050 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558011:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4a00/0xa24651432775057 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558017:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4a00/0xa24651432775057 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558023:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4a00/0xa24651432775057 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558117:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa2465143277505e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558126:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa2465143277505e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558132:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa2465143277505e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340863.558166:0:70100:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780340863.558169:0:70100:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780340863.558187:0:70100:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa2465143277505e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558197:0:70100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa24651432775050 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558203:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa24651432775050 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558209:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa24651432775050 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558215:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa24651432775050 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558220:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340863.558224:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa24651432775050 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558231:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa24651432775050 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558250:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:0.0:1780340863.558253:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340863.558259:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa24651432775050 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558265:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa24651432775050 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558280:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4a00/0xa24651432775057 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558286:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4a00/0xa24651432775057 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558290:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4a00/0xa24651432775057 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558295:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340863.558297:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4a00/0xa24651432775057 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558302:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4a00/0xa24651432775057 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558309:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff8c045a87a800) 00010000:00010000:0.0:1780340863.558311:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340863.558314:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4a00/0xa24651432775057 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558320:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4a00/0xa24651432775057 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558359:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa24651432775049 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2574 expref: 9 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558371:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa2465143277505e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2574 expref: 8 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.558377:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff8c045a87af00) 00010000:00010000:0.0:1780340863.558379:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780340863.558381:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5600, rc 0) 00000100:00100000:0.0:1780340863.560784:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:71286:x1866818940465536:12345-192.168.203.16@tcp:101:mkdir.0 Request processed in 2885us (3113us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340863.560797:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1377 00000100:00100000:1.0:1780340863.571656:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340863.571795:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940465792 00000100:00100000:2.0:1780340863.571806:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940465792 00000100:00100000:2.0:1780340863.571867:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1378 00000100:00100000:2.0:1780340863.571877:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:71286:x1866818940465792:12345-192.168.203.16@tcp:36:mkdir.0 00000100:00100000:2.0:1780340863.571992:0:63711:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961205504:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1780340863.572044:0:63711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340863.572082:0:63711:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acd8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340863.572186:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961205504 00000100:00100000:3.0:1780340863.572191:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961205504 00000100:00100000:3.0:1780340863.572224:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3926 00000100:00100000:3.0:1780340863.572231:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63711:x1866818961205504:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1780340863.572309:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63711:x1866818961205504:12345-0@lo:1000:mdt00_001.0 Request processed in 78us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340863.572316:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3926 00000100:00100000:2.0:1780340863.572433:0:63711:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445596680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961205504:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1780340863.572480:0:63711:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961205632:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1780340863.572503:0:63711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340863.572611:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961205632 00000100:00100000:0.0:1780340863.572615:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961205632 00000100:00100000:0.0:1780340863.572660:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3927 00000100:00100000:0.0:1780340863.572667:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63711:x1866818961205632:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780340863.572732:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63711:x1866818961205632:12345-0@lo:1000:mdt00_001.0 Request processed in 65us (227us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780340863.572738:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3927 00000100:00100000:2.0:1780340863.572854:0:63711:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acd8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1780340863.572868:0:63711:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961205632:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1780340863.572915:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.572926:0:63711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.572935:0:63711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340863.572947:0:63711:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961205760:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1780340863.572987:0:63711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340863.573079:0:63711:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acd8180 going to sleep for 11 seconds 00000100:00100000:0.0:1780340863.576915:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961205760 00000100:00100000:0.0:1780340863.576933:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961205760 00000100:00100000:0.0:1780340863.576998:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3928 00000100:00100000:0.0:1780340863.577008:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63711:x1866818961205760:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1780340863.577028:0:26074:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340863.577053:0:26074:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277506c lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa24651432775065 expref: -99 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.577104:0:26074:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa2465143277505e lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2574 expref: 7 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.577115:0:26074:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277506c lrc: 4/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775065 expref: 10 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.577152:0:26074:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa2465143277505e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2574 expref: 7 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.577165:0:26074:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa2465143277505e lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2574 expref: 7 pid: 70100 timeout: 3743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340863.577192:0:26074:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b67800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:26074:1866818961205888:192.168.203.16@tcp:104: 00000100:00100000:0.0:1780340863.577340:0:26074:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a89fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1780340863.583796:0:26074:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b67800 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:26074:1866818961205888:192.168.203.16@tcp:104: 00010000:00010000:0.0:1780340863.583828:0:26074:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277506c lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775065 expref: 10 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.583841:0:26074:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff8c045a87af00) 00010000:00010000:0.0:1780340863.583844:0:26074:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340863.583848:0:26074:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277506c lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775065 expref: 10 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.583859:0:26074:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4000, rc 0) 00000100:00100000:0.0:1780340863.583913:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63711:x1866818961205760:12345-0@lo:101:mdt00_001.0 Request processed in 6907us (10926us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340863.583934:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3928 00000100:00100000:2.0:1780340863.584059:0:63711:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961205760:0@lo:101:mdt00_001.0 00010000:00010000:2.0:1780340863.584076:0:63711:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.584086:0:63711:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340863.584365:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340863.584688:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940465920 00000100:00100000:3.0:1780340863.584695:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940465920 00010000:00010000:3.0:1780340863.584727:0:25498:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa2465143277505e lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2574 expref: 8 pid: 70100 timeout: 3743 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340863.584801:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2577 00000100:00100000:3.0:1780340863.584810:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04757c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2407:x1866818940465920:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780340863.584823:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340863.584829:0:25498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa2465143277505e lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2574 expref: 8 pid: 70100 timeout: 3743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.584840:0:25498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa2465143277505e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2574 expref: 8 pid: 70100 timeout: 3743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.584858:0:25498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa2465143277505e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2574 expref: 8 pid: 70100 timeout: 3743 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.584872:0:25498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff8c045a87af00) 00010000:00010000:3.0:1780340863.584877:0:25498:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277506c lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775065 expref: 9 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.584887:0:25498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277506c lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xa24651432775065 expref: 9 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.584895:0:25498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277506c lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xa24651432775065 expref: 9 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.584921:0:25498:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277506c lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775065 expref: 9 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340863.584935:0:25498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346f50700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:25498:1866818961206016:0@lo:105: 00000100:00100000:3.0:1780340863.584975:0:25498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340863.585004:0:25498:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348210a80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340863.585055:0:9471:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961206016 00000100:00100000:0.0:1780340863.585059:0:9471:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961206016 00000100:00100000:0.0:1780340863.585098:0:9471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1780340863.585104:0:9471:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:25498:x1866818961206016:12345-0@lo:105: 00010000:00010000:0.0:1780340863.585114:0:9471:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.585122:0:9471:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.585130:0:9471:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.585137:0:9471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 5/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.585143:0:9471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.585151:0:9471:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.585183:0:9471:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff8c04754c7400) 00000100:00100000:0.0:1780340863.585221:0:9471:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:25498:x1866818961206016:12345-0@lo:105: Request processed in 117us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340863.585227:0:9471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1780340863.585266:0:25498:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346f50700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000_UUID:25498:1866818961206016:0@lo:105: 00010000:00010000:0.0:1780340863.585280:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340863.585315:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04757c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940465920:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 507us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340863.585322:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2577 00010000:00010000:3.0:1780340863.585453:0:63711:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.585463:0:63711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1780340863.585483:0:63711:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:3.0:1780340863.585515:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f8800/0xa24651432775073 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.585522:0:63711:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f8800/0xa24651432775073 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.585542:0:63711:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f8800/0xa24651432775073 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340863.585558:0:63711:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961206144:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1780340863.585586:0:63711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340863.585609:0:63711:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348210540 going to sleep for 11 seconds 00000100:00100000:0.0:1780340863.585778:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961206144 00000100:00100000:0.0:1780340863.585783:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961206144 00000100:00100000:0.0:1780340863.585812:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3929 00000100:00100000:0.0:1780340863.585819:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63711:x1866818961206144:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1780340863.585834:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340863.585848:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4a00/0xa2465143277507a lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa24651432775073 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.585866:0:8410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4a00/0xa2465143277507a lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775073 expref: 11 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.585877:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4a00/0xa2465143277507a lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775073 expref: 11 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.585884:0:8410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff8c045a87a800) 00010000:00010000:0.0:1780340863.585887:0:8410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340863.585890:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4a00, rc 0) 00000100:00100000:0.0:1780340863.585927:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63711:x1866818961206144:12345-0@lo:101:mdt00_001.0 Request processed in 109us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340863.585933:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3929 00000100:00100000:1.0:1780340863.586000:0:63711:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961206144:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1780340863.586012:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f8800/0xa24651432775073 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa2465143277507a expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.586020:0:63711:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f8800/0xa24651432775073 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa2465143277507a expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780340863.586038:0:63711:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:1.0:1780340863.586068:0:63711:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961206272:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780340863.586095:0:63711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340863.586118:0:63711:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04774046c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340863.586207:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961206272 00000100:00100000:3.0:1780340863.586212:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961206272 00000100:00100000:3.0:1780340863.586236:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3930 00000100:00100000:3.0:1780340863.586242:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63711:x1866818961206272:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1780340863.586301:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63711:x1866818961206272:12345-0@lo:1000:mdt00_001.0 Request processed in 59us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340863.586308:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3930 00000100:00100000:1.0:1780340863.586422:0:63711:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961206272:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780340863.586461:0:63711:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ace6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961206400:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780340863.586488:0:63711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340863.586508:0:63711:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04774046c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340863.586629:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961206400 00000100:00100000:0.0:1780340863.586633:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961206400 00000100:00100000:0.0:1780340863.586682:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931 00000100:00100000:0.0:1780340863.586698:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63711:x1866818961206400:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780340863.586786:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63711:x1866818961206400:12345-0@lo:1000:mdt00_001.0 Request processed in 90us (297us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780340863.586794:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931 00000100:00100000:0.0:1780340863.586819:0:63711:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ace6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961206400:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780340863.586883:0:63711:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b67800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961206528:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780340863.586908:0:63711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340863.586920:0:63711:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c03475916c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340863.586930:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961206528 00000100:00100000:0.0:1780340863.586933:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961206528 00000100:00100000:0.0:1780340863.586947:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3932 00000100:00100000:0.0:1780340863.586952:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63711:x1866818961206528:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780340863.586996:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485812450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63711:x1866818961206528:12345-0@lo:1000:mdt00_001.0 Request processed in 43us (86us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780340863.587001:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3932 00000100:00100000:0.0:1780340863.587704:0:63711:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b67800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961206528:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780340863.587839:0:63711:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b67800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961206656:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780340863.587904:0:63711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340863.587927:0:63711:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04412edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1780340863.588070:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961206656 00000100:00100000:3.0:1780340863.588081:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961206656 00000100:00100000:3.0:1780340863.588114:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3933 00000100:00100000:3.0:1780340863.588122:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63711:x1866818961206656:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1780340863.588191:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63711:x1866818961206656:12345-0@lo:1000:mdt00_001.0 Request processed in 70us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340863.588197:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3933 00000100:00100000:0.0:1780340863.588341:0:63711:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b67800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961206656:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780340863.588379:0:63711:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b67800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961206784:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1780340863.588400:0:63711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340863.588458:0:63711:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c03475916c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340863.598669:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961206784 00000100:00100000:1.0:1780340863.598686:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961206784 00000100:00100000:1.0:1780340863.598754:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934 00000100:00100000:1.0:1780340863.598782:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63711:x1866818961206784:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780340863.598911:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63711:x1866818961206784:12345-0@lo:1000:mdt00_001.0 Request processed in 132us (10509us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340863.598919:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934 00000100:00100000:1.0:1780340863.598969:0:63711:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b67800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961206784:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780340863.599041:0:63711:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961206912:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780340863.599072:0:63711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340863.599090:0:63711:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04774046c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340863.599102:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961206912 00000100:00100000:1.0:1780340863.599106:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961206912 00000100:00100000:1.0:1780340863.599127:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3935 00000100:00100000:1.0:1780340863.599133:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63711:x1866818961206912:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1780340863.599190:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63711:x1866818961206912:12345-0@lo:1000:mdt00_001.0 Request processed in 57us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340863.599208:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3935 00000100:00100000:1.0:1780340863.599235:0:63711:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63711:1866818961206912:0@lo:1000:mdt00_001.0 00000040:00080000:1.0:1780340863.600856:0:63711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].5, 968 off38288 00000040:00080000:1.0:1780340863.600926:0:63711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].5, 1120 off39024 00000004:00080000:1.0:1780340863.600934:0:63711:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c03475916c0 with version 14 00000004:00080000:0.0:1780340863.601008:0:72687:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c034acb9780 version 14 rpc_version 14 00000020:00100000:0.0:1780340863.601049:0:72687:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1780340863.601058:0:72687:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c0446b66d80 x1866818961207168/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2136/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340863.601079:0:72687:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b66d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72687:1866818961207168:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1780340863.601130:0:72687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340863.601363:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04412edc00 going to sleep for 11 seconds 00000100:00100000:1.0:1780340863.601618:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961207168 00000100:00100000:1.0:1780340863.601624:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961207168 00000100:00100000:1.0:1780340863.601681:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3936 00000100:00100000:1.0:1780340863.601690:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:72687:x1866818961207168:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1780340863.603358:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:72687:x1866818961207168:12345-0@lo:1000:osp_up0-1.0 Request processed in 1661us (2218us total) trans 115964117000 rc 0/0 00000100:00100000:1.0:1780340863.603370:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3936 00000100:00100000:0.0:1780340863.605704:0:72687:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b66d80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72687:1866818961207168:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1780340863.605851:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123a00/0xa24651432775081 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.605869:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123a00/0xa24651432775081 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.605881:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123a00/0xa24651432775081 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340863.605903:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007e307ed0 reply state 0000000052297b3f transno 81604378756 ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123a00/0xa24651432775081 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.605913:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123a00/0xa24651432775081 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.605920:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff8c04495cd000) 00010000:00010000:1.0:1780340863.605923:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340863.605938:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1780340863.605944:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00080000:1.0:1780340863.605957:0:63711:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:1.0:1780340863.605968:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.605976:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.605983:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.606006:0:63711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1780340863.606012:0:63711:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:1.0:1780340863.606017:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f8800/0xa24651432775073 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa2465143277507a expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.606023:0:63711:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f8800/0xa24651432775073 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa2465143277507a expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340863.606123:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:71286:x1866818940465792:12345-192.168.203.16@tcp:36:mkdir.0 Request processed in 34246us (34482us total) trans 81604378756 rc 0/0 00000100:00100000:1.0:1780340863.606132:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1378 00010000:00010000:2.0:1780340863.607659:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340863.607671:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.607682:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7400 already unused, calling callback (ffffffffc18205b0) 00010000:00010000:2.0:1780340863.607687:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340863.607696:0:7442:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.607734:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.607741:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1780340863.607802:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961207296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340863.607859:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1780340863.607952:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 1/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.607960:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c7400/0xa24651432775065 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa2465143277506c expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.607998:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340863.608000:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340863.608001:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340863.608061:0:7443:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961207296 00000100:00100000:0.0:1780340863.608068:0:7443:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961207296 00000100:00100000:0.0:1780340863.608120:0:7443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:0.0:1780340863.608130:0:7443:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+12:3660:x1866818961207296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780340863.608142:0:7443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340863.608169:0:7443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa2465143277506c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432775065 expref: 12 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.608182:0:7443:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff8c045a87af00) 00010000:00010000:0.0:1780340863.608191:0:7443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340863.609789:0:7443:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+11:3660:x1866818961207296:12345-0@lo:103:ldlm_bl.0 Request processed in 1653us (1922us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340863.609800:0:7443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:2.0:1780340863.609916:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961207296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340863.656177:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340863.656341:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940466048 00000100:00100000:3.0:1780340863.656352:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940466048 00000100:00100000:3.0:1780340863.656415:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1379 00000100:00100000:3.0:1780340863.656426:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:71287:x1866818940466048:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1780340863.656447:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340863.656466:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432775088 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced257b expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656526:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277508f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656540:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277508f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656552:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277508f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656566:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775096 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656573:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775096 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656593:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775096 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656677:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa2465143277509d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656686:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa2465143277509d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656693:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa2465143277509d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340863.656730:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1780340863.656733:0:63710:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780340863.656804:0:63710:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa2465143277509d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656815:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277508f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656822:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277508f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656827:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277508f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656833:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277508f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656838:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340863.656842:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277508f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656855:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277508f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656866:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:3.0:1780340863.656869:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340863.656874:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277508f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656879:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277508f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656892:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775096 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656897:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775096 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656902:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775096 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656907:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340863.656909:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775096 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656914:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775096 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656920:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff8c0444f27d00) 00010000:00010000:3.0:1780340863.656922:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340863.656924:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775096 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656939:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775096 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656969:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432775088 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced257b expref: 9 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656980:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa2465143277509d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced257b expref: 8 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.656987:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff8c0444f27600) 00010000:00010000:3.0:1780340863.656989:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1780340863.656991:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8a00, rc 0) 00000100:00100000:3.0:1780340863.657057:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:71287:x1866818940466048:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 632us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340863.657063:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1379 00000100:00100000:3.0:1780340863.662872:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340863.662952:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940466176 00000100:00100000:0.0:1780340863.662962:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940466176 00000100:00100000:0.0:1780340863.663023:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1380 00000100:00100000:0.0:1780340863.663034:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:71287:x1866818940466176:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1780340863.663054:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340863.663073:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa246514327750a4 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2582 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.663170:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa246514327750ab lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.663184:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa246514327750ab lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.663194:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa246514327750ab lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.663204:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa246514327750b2 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.663212:0:70100:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa2465143277502d lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775026 expref: 10 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.663220:0:70100:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa246514327750b2 lrc: 4/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.663250:0:70100:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa2465143277502d lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432775026 expref: 10 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340863.663265:0:70100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b65500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:70100:1866818961207424:0@lo:104: 00000100:00100000:0.0:1780340863.663307:0:70100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340863.663359:0:70100:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04412edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1780340863.663949:0:6499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961207424 00000100:00100000:3.0:1780340863.663956:0:6499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961207424 00000100:00100000:3.0:1780340863.663990:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1780340863.663996:0:6499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:70100:x1866818961207424:12345-0@lo:104: 00010000:00010000:3.0:1780340863.664008:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c6600/0xa24651432775026 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xa2465143277502d expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.664074:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1780340863.664079:0:6499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:70100:x1866818961207424:12345-0@lo:104: Request processed in 84us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340863.664085:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00010000:00010000:2.0:1780340863.664198:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340863.664205:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c6600/0xa24651432775026 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xa2465143277502d expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.664213:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6600 already unused, calling callback (ffffffffc18205b0) 00010000:00010000:2.0:1780340863.664217:0:41205:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c6600/0xa24651432775026 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xa2465143277502d expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340863.664225:0:41205:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c6600/0xa24651432775026 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xa2465143277502d expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.664252:0:41205:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c6600/0xa24651432775026 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa2465143277502d expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.664258:0:41205:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780340863.664285:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c6600/0xa24651432775026 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa2465143277502d expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.664293:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c04754c6600/0xa24651432775026 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa2465143277502d expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.664310:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340863.664312:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340863.664322:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340863.664343:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780340863.664355:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961207552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340863.664388:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340863.664422:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961207552 00000100:00100000:2.0:1780340863.664426:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961207552 00010000:00010000:2.0:1780340863.664444:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa2465143277502d lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xa24651432775026 expref: 11 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340863.664465:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:2.0:1780340863.664472:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3662:x1866818961207552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340863.664481:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1780340863.665023:0:70100:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b65500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:70100:1866818961207424:0@lo:104: 00010000:00010000:1.0:1780340863.665042:0:70100:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa246514327750b2 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1780340863.666578:0:88666:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117000 is committed 00010000:00010000:2.0:1780340863.667536:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa2465143277502d lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432775026 expref: 9 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.667558:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff8c045a87a100) 00010000:00010000:2.0:1780340863.667563:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa246514327750b2 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.667573:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa246514327750b2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.667581:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa246514327750b2 lrc: 4/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.667613:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340863.667693:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3662:x1866818961207552:12345-0@lo:103:ldlm_bl.0 Request processed in 3220us (3303us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340863.667702:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:2.0:1780340863.667772:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961207552:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340863.668300:0:70100:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa246514327750b2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.668310:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa246514327750b2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340863.668547:0:70100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:70100:1866818961207680:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1780340863.668590:0:70100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340863.668623:0:70100:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348210540 going to sleep for 11 seconds 00000100:00100000:2.0:1780340863.670673:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961207680 00000100:00100000:2.0:1780340863.670685:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961207680 00000100:00100000:2.0:1780340863.670737:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3937 00000100:00100000:2.0:1780340863.670745:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:70100:x1866818961207680:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1780340863.670859:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:70100:x1866818961207680:12345-0@lo:1000:mdt00_004.0 Request processed in 115us (2268us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340863.670866:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3937 00000100:00100000:3.0:1780340863.671259:0:70100:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:70100:1866818961207680:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1780340863.671320:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327750b9 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671337:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327750b9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671348:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327750b9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340863.671375:0:70100:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327750b9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671389:0:70100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa246514327750ab lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671395:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa246514327750ab lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671401:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa246514327750ab lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671423:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa246514327750ab lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671430:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340863.671434:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa246514327750ab lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671441:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa246514327750ab lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671452:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff8c0444f27600) 00010000:00010000:3.0:1780340863.671455:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340863.671459:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa246514327750ab lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671465:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa246514327750ab lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671481:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa246514327750b2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671487:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa246514327750b2 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671493:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa246514327750b2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671497:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340863.671500:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa246514327750b2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671515:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa246514327750b2 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671524:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff8c045a87a100) 00010000:00010000:3.0:1780340863.671526:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340863.671529:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa246514327750b2 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671535:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5600/0xa246514327750b2 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671574:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4000/0xa246514327750a4 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2582 expref: 10 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671587:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327750b9 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2582 expref: 9 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.671594:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff8c0444f27c00) 00010000:00010000:3.0:1780340863.671597:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1780340863.671599:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9a00, rc 0) 00000100:00100000:3.0:1780340863.671656:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:71287:x1866818940466176:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 8614us (8782us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340863.671664:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1380 00000100:00100000:2.0:1780340863.675098:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340863.675167:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940466304 00000100:00100000:1.0:1780340863.675189:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940466304 00000100:00100000:1.0:1780340863.675243:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1381 00000100:00100000:1.0:1780340863.675253:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:71287:x1866818940466304:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:1.0:1780340863.675277:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340863.675296:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122000/0xa246514327750c0 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2589 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.675352:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122600/0xa246514327750c7 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.675367:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122600/0xa246514327750c7 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.675379:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122600/0xa246514327750c7 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340863.675422:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:1.0:1780340863.675426:0:63711:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:1.0:1780340863.675461:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122000/0xa246514327750c0 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2589 expref: 11 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.675479:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122600/0xa246514327750c7 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2589 expref: 10 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.675487:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff8c045a87a600) 00010000:00010000:1.0:1780340863.675489:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1780340863.675493:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122600, rc 0) 00000100:00100000:1.0:1780340863.675562:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:71287:x1866818940466304:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 310us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340863.675569:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1381 00000100:00100000:1.0:1780340863.687856:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340863.687992:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940466560 00000100:00100000:0.0:1780340863.688002:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940466560 00000100:00100000:0.0:1780340863.688064:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1382 00000100:00100000:0.0:1780340863.688074:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:71287:x1866818940466560:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1780340863.688109:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340863.688132:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4c00/0xa246514327750ce lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2590 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340863.688238:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1780340863.688337:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4c00/0xa246514327750ce lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2590 expref: 12 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.688352:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff8c045a87af00) 00010000:00010000:0.0:1780340863.688355:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1780340863.688360:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4c00/0xa246514327750ce lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2590 expref: 12 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340863.688379:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4c00, rc 0) 00000100:00100000:0.0:1780340863.688440:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:71287:x1866818940466560:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 368us (592us total) trans 81604378757 rc 301/301 00000100:00100000:0.0:1780340863.688447:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1382 00000100:00100000:2.0:1780340863.696256:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340863.696350:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940466816 00000100:00100000:3.0:1780340863.696360:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940466816 00000100:00100000:3.0:1780340863.696419:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1383 00000100:00100000:3.0:1780340863.696429:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:71287:x1866818940466816:12345-192.168.203.16@tcp:36:lfs.0 00010000:00010000:3.0:1780340863.696500:0:70100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340863.696694:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453122600/0xa246514327750c7 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2589 expref: 11 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.696715:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff8c045a87a600) 00010000:00010000:3.0:1780340863.696720:0:70100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340863.696742:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327750dc lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.696755:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327750dc lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.696820:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327750dc lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340863.697014:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008b28cb0b reply state 000000009bdc29f1 transno 81604378758 ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327750dc lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.697027:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327750dc lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.697032:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff8c045a87a600) 00010000:00010000:3.0:1780340863.697035:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1780340863.697038:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1780340863.697044:0:70100:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000100:00100000:3.0:1780340863.697209:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:71287:x1866818940466816:12345-192.168.203.16@tcp:36:lfs.0 Request processed in 780us (969us total) trans 81604378758 rc 0/0 00000100:00100000:3.0:1780340863.697218:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1383 00000100:00100000:1.0:1780340863.700363:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340863.700598:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940467072 00000100:00100000:2.0:1780340863.700608:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940467072 00000100:00100000:2.0:1780340863.700717:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 242 00000100:00100000:2.0:1780340863.700727:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:71287:x1866818940467072:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:2.0:1780340863.700972:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:71287:x1866818940467072:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 246us (617us total) trans 81604378759 rc 0/0 00000100:00100000:2.0:1780340863.700980:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 242 00000100:00100000:1.0:1780340863.743637:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340863.743749:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940467200 00000100:00100000:3.0:1780340863.743790:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940467200 00000100:00100000:3.0:1780340863.743857:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1384 00000100:00100000:3.0:1780340863.743866:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:71288:x1866818940467200:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1780340863.743889:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340863.743909:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327750e3 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2597 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.743971:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa246514327750ea lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.743985:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa246514327750ea lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.743995:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa246514327750ea lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.744004:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327750f1 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.744013:0:63710:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4a00/0xa2465143277507a lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775073 expref: 7 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.744021:0:63710:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327750f1 lrc: 4/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340863.744054:0:63710:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4a00/0xa2465143277507a lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432775073 expref: 7 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340863.744080:0:63710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:63710:1866818961207808:0@lo:104: 00000100:00100000:3.0:1780340863.744517:0:63710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340863.744556:0:63710:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348210540 going to sleep for 11 seconds 00000100:00100000:1.0:1780340863.744633:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1780340863.744654:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961207808 00000100:00100000:1.0:1780340863.744658:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961207808 00000100:00100000:1.0:1780340863.744697:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1780340863.744704:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:63710:x1866818961207808:12345-0@lo:104: 00010000:00010000:1.0:1780340863.744716:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f8800/0xa24651432775073 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xa2465143277507a expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.744811:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1780340863.744818:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ee2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:63710:x1866818961207808:12345-0@lo:104: Request processed in 114us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340863.744824:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00010000:00010000:1.0:1780340863.744861:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340863.744866:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f8800/0xa24651432775073 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xa2465143277507a expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.744874:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8800 already unused, calling callback (ffffffffc18205b0) 00010000:00010000:1.0:1780340863.744878:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f8800/0xa24651432775073 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xa2465143277507a expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340863.744886:0:6504:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f8800/0xa24651432775073 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xa2465143277507a expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.744912:0:6504:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f8800/0xa24651432775073 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa2465143277507a expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.744930:0:6504:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340863.744952:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f8800/0xa24651432775073 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa2465143277507a expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.744960:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c03476f8800/0xa24651432775073 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa2465143277507a expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.744978:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340863.744980:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340863.744982:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340863.744989:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340863.745000:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961207936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340863.745031:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340863.745060:0:25499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961207936 00000100:00100000:1.0:1780340863.745063:0:25499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961207936 00010000:00010000:1.0:1780340863.745080:0:25499:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4a00/0xa2465143277507a lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xa24651432775073 expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340863.745100:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:2.0:1780340863.745584:0:63710:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:63710:1866818961207808:0@lo:104: 00010000:00010000:2.0:1780340863.745603:0:63710:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327750f1 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340863.745658:0:25499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+8:3661:x1866818961207936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340863.745669:0:25499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340863.752828:0:25499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4a00/0xa2465143277507a lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432775073 expref: 8 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.752849:0:25499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff8c045a87a800) 00010000:00010000:1.0:1780340863.752855:0:25499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327750f1 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.752886:0:25499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327750f1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.752894:0:25499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327750f1 lrc: 4/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340863.752932:0:25499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340863.753029:0:25499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961207936:12345-0@lo:103:ldlm_bl.0 Request processed in 7921us (7995us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340863.753039:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00010000:00010000:2.0:1780340863.753140:0:63710:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327750f1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.753149:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327750f1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340863.753278:0:63710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:63710:1866818961208064:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1780340863.753326:0:63710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340863.753346:0:63710:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034acd8840 going to sleep for 11 seconds 00000100:00100000:3.0:1780340863.753495:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961207936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780340863.753573:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961208064 00000100:00100000:0.0:1780340863.753580:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961208064 00000100:00100000:0.0:1780340863.753625:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3938 00000100:00100000:0.0:1780340863.753634:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63710:x1866818961208064:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1780340863.753722:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63710:x1866818961208064:12345-0@lo:1000:mdt00_000.0 Request processed in 88us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340863.753728:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3938 00000100:00100000:2.0:1780340863.753802:0:63710:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:63710:1866818961208064:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1780340863.753845:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6600/0xa246514327750f8 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.753858:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6600/0xa246514327750f8 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.753867:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6600/0xa246514327750f8 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340863.753890:0:63710:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6600/0xa246514327750f8 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.753903:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa246514327750ea lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.753910:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa246514327750ea lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.753917:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa246514327750ea lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.753924:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa246514327750ea lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.753930:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340863.753933:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa246514327750ea lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.753941:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa246514327750ea lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.753959:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff8c0444f27600) 00010000:00010000:2.0:1780340863.753962:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340863.753966:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa246514327750ea lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.753972:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa246514327750ea lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.753984:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327750f1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.753991:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327750f1 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.753997:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327750f1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.754003:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340863.754006:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327750f1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.754012:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327750f1 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.754019:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff8c045a87a800) 00010000:00010000:2.0:1780340863.754021:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340863.754025:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327750f1 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.754031:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327750f1 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.754076:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327750e3 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2597 expref: 11 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.754089:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6600/0xa246514327750f8 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2597 expref: 10 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.754097:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff8c045247c200) 00010000:00010000:2.0:1780340863.754099:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780340863.754102:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6600, rc 0) 00000100:00100000:2.0:1780340863.754173:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:71288:x1866818940467200:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 10308us (10545us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340863.754181:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1384 00000100:00100000:3.0:1780340863.766869:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340863.768561:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940467328 00000100:00100000:2.0:1780340863.768575:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940467328 00000100:00100000:2.0:1780340863.768653:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1385 00000100:00100000:2.0:1780340863.768665:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:71288:x1866818940467328:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1780340863.768689:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340863.768708:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa246514327750ff lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced259e expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.768781:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6e00/0xa24651432775106 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.768795:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6e00/0xa24651432775106 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.768807:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6e00/0xa24651432775106 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340863.768857:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1780340863.768860:0:63712:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1780340863.768892:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa246514327750ff lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced259e expref: 15 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.768906:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6e00/0xa24651432775106 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced259e expref: 14 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.768914:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff8c04495cd000) 00010000:00010000:2.0:1780340863.768916:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1780340863.768920:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6e00, rc 0) 00000100:00100000:2.0:1780340863.768996:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+14:71288:x1866818940467328:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 334us (2136us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340863.769003:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1385 00000100:00100000:3.0:1780340863.783900:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340863.788737:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940467584 00000100:00100000:2.0:1780340863.788753:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940467584 00000100:00100000:2.0:1780340863.788862:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1386 00000100:00100000:2.0:1780340863.788872:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+14:71288:x1866818940467584:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:2.0:1780340863.788892:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340863.788917:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa2465143277510d lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced25a5 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340863.789013:0:70100:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1780340863.789118:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa2465143277510d lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25a5 expref: 16 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.789153:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff8c045247c700) 00010000:00010000:2.0:1780340863.789156:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780340863.789163:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa2465143277510d lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25a5 expref: 16 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.789181:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7e00, rc 0) 00000100:00100000:2.0:1780340863.789258:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+15:71288:x1866818940467584:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 387us (5366us total) trans 81604378760 rc 301/301 00000100:00100000:2.0:1780340863.789265:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1386 00000001:00080000:3.0:1780340863.796036:0:72681:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378760 is committed 00010000:00010000:2.0:1780340863.796147:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4600/0xa24651432775034 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796160:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4600/0xa24651432775034 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796168:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4600/0xa24651432775034 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796175:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340863.796179:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4600/0xa24651432775034 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796187:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4600/0xa24651432775034 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796204:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff8c045a87a600) 00010000:00010000:2.0:1780340863.796207:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340863.796211:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4600/0xa24651432775034 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796230:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4600/0xa24651432775034 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796252:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123a00/0xa24651432775081 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796259:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123a00/0xa24651432775081 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796264:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123a00/0xa24651432775081 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796269:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340863.796272:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123a00/0xa24651432775081 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796277:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123a00/0xa24651432775081 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796285:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff8c04495cd000) 00010000:00010000:2.0:1780340863.796287:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340863.796290:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123a00/0xa24651432775081 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796295:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0453123a00/0xa24651432775081 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796305:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327750dc lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796311:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327750dc lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796326:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327750dc lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796331:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340863.796334:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327750dc lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796340:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327750dc lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796347:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff8c045a87a600) 00010000:00010000:2.0:1780340863.796350:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780340863.796352:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327750dc lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.796357:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327750dc lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340863.797123:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340863.799016:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940467840 00000100:00100000:2.0:1780340863.799030:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940467840 00000100:00100000:2.0:1780340863.799090:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1387 00000100:00100000:2.0:1780340863.799100:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:71288:x1866818940467840:12345-192.168.203.16@tcp:36:lfs.0 00010000:00010000:2.0:1780340863.799161:0:63710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340863.799187:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6e00/0xa24651432775106 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced259e expref: 6 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.799207:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff8c04495cd000) 00010000:00010000:2.0:1780340863.799218:0:63710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340863.799267:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa2465143277511b lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.799281:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa2465143277511b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.799290:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa2465143277511b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340863.799436:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c73b7654 reply state 0000000060d6eda0 transno 81604378761 ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa2465143277511b lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.799449:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa2465143277511b lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340863.799454:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff8c045247c600) 00010000:00010000:2.0:1780340863.799456:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1780340863.799458:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1780340863.799464:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000100:00100000:2.0:1780340863.799562:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:71288:x1866818940467840:12345-192.168.203.16@tcp:36:lfs.0 Request processed in 463us (2444us total) trans 81604378761 rc 0/0 00000100:00100000:2.0:1780340863.799571:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1387 00000100:00100000:1.0:1780340863.802886:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340863.803134:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940468096 00000100:00100000:3.0:1780340863.803145:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940468096 00000100:00100000:3.0:1780340863.803207:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 243 00000100:00100000:3.0:1780340863.803217:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:71288:x1866818940468096:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:3.0:1780340863.803870:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:71288:x1866818940468096:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 653us (991us total) trans 81604378762 rc 0/0 00000100:00100000:3.0:1780340863.803878:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 243 00010000:00010000:1.0:1780340863.882455:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340863.882717:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961208192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340863.882829:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340863.882971:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961208192 00000100:00100000:0.0:1780340863.882979:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961208192 00000100:00100000:0.0:1780340863.883030:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2110 00000100:00100000:0.0:1780340863.883051:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961208192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340863.883074:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340863.883138:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961208192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340863.883145:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2110 00000100:00100000:1.0:1780340863.883566:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961208192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340863.883920:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961208320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340863.883959:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340863.884030:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961208320 00000100:00100000:0.0:1780340863.884034:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961208320 00000100:00100000:0.0:1780340863.884069:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2111 00000100:00100000:0.0:1780340863.884077:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961208320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780340863.884092:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340863.884145:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961208320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340863.884152:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2111 00000100:00100000:1.0:1780340863.884534:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961208320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340864.558476:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340864.558527:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340864.558556:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340864.558585:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340864.558664:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940468480 00000100:00100000:0.0:1780340864.558673:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940468480 00000100:00100000:0.0:1780340864.558723:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940468352 00000100:00100000:0.0:1780340864.558726:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940468352 00000100:00100000:0.0:1780340864.558746:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1390 00000100:00100000:0.0:1780340864.558755:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2407:x1866818940468480:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340864.558857:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2407:x1866818940468480:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 103us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340864.558864:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1390 00000100:00100000:0.0:1780340864.558880:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1391 00000100:00100000:0.0:1780340864.558886:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2407:x1866818940468352:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340864.558906:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2407:x1866818940468352:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 21us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340864.558927:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1391 00000100:00100000:0.0:1780340864.558946:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940468608 00000100:00100000:0.0:1780340864.558949:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940468608 00000100:00100000:0.0:1780340864.558985:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2606 00000100:00100000:0.0:1780340864.558991:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940468608:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340864.559018:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940468608:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 27us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340864.559024:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2606 00000100:00080000:0.0:1780340864.559124:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340864.559320:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940468224 00000100:00100000:2.0:1780340864.559324:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940468224 00000100:00100000:2.0:1780340864.559363:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 172 00000100:00100000:2.0:1780340864.559370:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c044d6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940468224:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340864.559400:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c044d6ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940468224:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 31us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340864.559414:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 172 00000001:00080000:3.0:1780340864.751426:0:72681:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378762 is committed 00010000:00010000:1.0:1780340864.751492:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa2465143277511b lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340864.751513:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa2465143277511b lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340864.751523:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa2465143277511b lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340864.751531:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340864.751537:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa2465143277511b lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340864.751546:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa2465143277511b lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340864.751596:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff8c045247c600) 00010000:00010000:1.0:1780340864.751600:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1780340864.751607:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa2465143277511b lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340864.751613:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa2465143277511b lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340864.862351:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340864.862401:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940468736 00000100:00100000:0.0:1780340864.862411:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940468736 00000100:00100000:0.0:1780340864.862525:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1388 00000100:00100000:0.0:1780340864.862537:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:71297:x1866818940468736:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:0.0:1780340864.862586:0:63712:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00000100:00100000:0.0:1780340864.862737:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:71297:x1866818940468736:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 201us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340864.862746:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1388 00000100:00100000:1.0:1780340864.868196:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340864.868474:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940468864 00000100:00100000:2.0:1780340864.868485:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940468864 00000100:00100000:2.0:1780340864.868549:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1389 00000100:00100000:2.0:1780340864.868560:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:71297:x1866818940468864:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:2.0:1780340864.868600:0:70100:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:2.0:1780340864.868679:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:71297:x1866818940468864:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 121us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340864.868686:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1389 00000100:00100000:3.0:1780340864.874799:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340864.875269:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940468992 00000100:00100000:0.0:1780340864.875279:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940468992 00000100:00100000:0.0:1780340864.875332:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2112 00000100:00100000:0.0:1780340864.875342:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:71297:x1866818940468992:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:0.0:1780340864.875369:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340864.875436:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:71297:x1866818940468992:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 96us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340864.875444:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2112 00000100:00100000:3.0:1780340864.878890:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340864.879707:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940469120 00000100:00100000:2.0:1780340864.879727:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940469120 00000100:00100000:2.0:1780340864.879797:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5920 00000100:00100000:2.0:1780340864.879806:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2406:x1866818940469120:12345-192.168.203.16@tcp:8:lfs.0 00010000:00080000:2.0:1780340864.880253:0:25491:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0001: connection from 7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp t0 exp 0000000000000000 cur 3644 last 0 00000020:00000080:2.0:1780340864.880282:0:25491:0:(genops.c:1406:class_connect()) connect: client 7d14eb83-fa7c-40d9-843e-6367bec0a7b4, cookie 0xa24651432775122 00002000:00100000:2.0:1780340864.880294:0:25491:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7d14eb83-fa7c-40d9-843e-6367bec0a7b4/ffff8c0349151800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211351c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1780340864.880305:0:25491:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1780340864.880376:0:25491:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1780340864.880406:0:25491:0:(import.c:65:import_set_state_nolock()) ffff8c0349152800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340864.880476:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2406:x1866818940469120:12345-192.168.203.16@tcp:8:lfs.0 Request processed in 669us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340864.880484:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5920 00000100:00100000:2.0:1780340864.889893:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340864.890266:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940469248 00000100:00100000:3.0:1780340864.890277:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940469248 00000100:00100000:3.0:1780340864.890359:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2113 00000100:00100000:3.0:1780340864.890371:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:71297:x1866818940469248:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:3.0:1780340864.890396:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340864.890473:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:71297:x1866818940469248:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 105us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340864.890481:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2113 00000100:00080000:1.0:1780340864.890722:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1780340864.913036:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340864.990308:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340864.990344:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940469504 00000100:00100000:2.0:1780340864.990365:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940469504 00000100:00100000:2.0:1780340864.990422:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1390 00000100:00100000:2.0:1780340864.990433:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:71304:x1866818940469504:12345-192.168.203.16@tcp:36:mcreate.0 00010000:00010000:2.0:1780340864.990489:0:64454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340864.990517:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa24651432775042 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced256d expref: 10 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340864.992929:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:2.0:1780340864.992934:0:64454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340864.992996:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775129 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340864.993012:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775129 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340864.993023:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775129 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340864.993040:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775130 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340864.993046:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775130 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340864.993051:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775130 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340864.998428:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775129 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340864.998445:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775129 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340864.998462:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775129 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340864.998469:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775129 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340864.998475:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340864.998480:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775129 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340864.998487:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775129 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340864.998502:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:2.0:1780340864.998505:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340864.998510:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775129 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340864.998515:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775129 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340864.998530:0:64454:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e8b617b6 reply state 000000002ce6634c transno 115964117001 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775130 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340864.998542:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775130 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340864.998549:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c044120f400) 00010000:00010000:2.0:1780340864.998552:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340864.998555:0:64454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340864.998677:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:71304:x1866818940469504:12345-192.168.203.16@tcp:36:mcreate.0 Request processed in 8243us (8373us total) trans 115964117001 rc 0/0 00000100:00100000:2.0:1780340864.998691:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1390 00000100:00100000:0.0:1780340865.025249:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340865.025358:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940469632 00000100:00100000:1.0:1780340865.025369:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940469632 00000100:00100000:1.0:1780340865.025429:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1391 00000100:00100000:1.0:1780340865.025439:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:71307:x1866818940469632:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:1.0:1780340865.025464:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340865.025483:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa24651432775137 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced25ac expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340865.025551:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa2465143277513e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340865.025564:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa2465143277513e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340865.025575:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa2465143277513e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340865.025616:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1780340865.025628:0:63712:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780340865.025660:0:63712:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa2465143277513e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340865.025681:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa24651432775137 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25ac expref: 13 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340865.025698:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa2465143277513e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25ac expref: 12 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340865.025716:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:1.0:1780340865.025719:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1780340865.025723:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123c00, rc 0) 00000100:00100000:1.0:1780340865.025804:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:71307:x1866818940469632:12345-192.168.203.16@tcp:101:rm.0 Request processed in 367us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340865.025812:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1391 00000100:00080000:0.0:1780340865.026165:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340865.037010:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340865.037078:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940469760 00000100:00100000:2.0:1780340865.037088:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940469760 00000100:00100000:2.0:1780340865.037141:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1392 00000100:00100000:2.0:1780340865.037151:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:71307:x1866818940469760:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:2.0:1780340865.037181:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340865.037200:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775145 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced25b3 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037262:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277514c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037277:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277514c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037288:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277514c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037299:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775153 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037307:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037314:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037380:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa2465143277515a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037406:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa2465143277515a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037413:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa2465143277515a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340865.037451:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x3:0x0]: returning size 0 00000004:00200000:2.0:1780340865.037455:0:63710:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780340865.037472:0:63710:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa2465143277515a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037482:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa2465143277515a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037491:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277514c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037497:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277514c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037502:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277514c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037509:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277514c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037515:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340865.037529:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277514c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037537:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277514c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037558:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:2.0:1780340865.037561:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340865.037566:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277514c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037572:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277514c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037583:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037589:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775153 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037595:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775153 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037600:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340865.037602:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775153 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037608:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775153 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037614:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c044120f400) 00010000:00010000:2.0:1780340865.037616:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340865.037619:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775153 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037625:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775153 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037671:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775145 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25b3 expref: 14 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037683:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa2465143277515a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25b3 expref: 13 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.037689:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff8c044120fe00) 00010000:00010000:2.0:1780340865.037691:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340865.037693:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7e00, rc 0) 00000100:00100000:2.0:1780340865.037754:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:71307:x1866818940469760:12345-192.168.203.16@tcp:101:rm.0 Request processed in 605us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340865.037785:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1392 00000100:00100000:1.0:1780340865.049064:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340865.049141:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940470016 00000100:00100000:2.0:1780340865.049152:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940470016 00000100:00100000:2.0:1780340865.049273:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1393 00000100:00100000:2.0:1780340865.049283:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:71307:x1866818940470016:12345-192.168.203.16@tcp:36:rm.0 00010000:00010000:2.0:1780340865.049334:0:64454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1780340865.049360:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7e00/0xa2465143277515a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25b3 expref: 13 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.049377:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff8c044120fe00) 00010000:00010000:2.0:1780340865.049471:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa2465143277513e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25ac expref: 12 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.049482:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:2.0:1780340865.049495:0:64454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340865.049593:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775161 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.049607:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775161 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.049616:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775161 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.049625:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775168 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.049641:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775168 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.049648:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775168 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.050269:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277516f lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.050281:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277516f lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.050289:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277516f lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.050723:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6e00/0xa24651432775176 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.050732:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6e00/0xa24651432775176 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.050739:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6e00/0xa24651432775176 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.050756:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6e00/0xa24651432775176 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051477:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6e00/0xa24651432775176 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051484:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6e00/0xa24651432775176 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051609:0:64454:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340865.051641:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277516f lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051648:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277516f lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051654:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277516f lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051660:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340865.051664:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277516f lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051671:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277516f lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051683:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff8c044120fd00) 00010000:00010000:2.0:1780340865.051685:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1780340865.051689:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277516f lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051718:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7000/0xa2465143277516f lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051739:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775161 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051745:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775161 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051750:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775161 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051783:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775161 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051789:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340865.051792:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775161 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051799:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775161 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051807:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:2.0:1780340865.051809:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340865.051812:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775161 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051824:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775161 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340865.051835:0:64454:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b3544766 reply state 00000000cfd06802 transno 115964117002 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775168 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051851:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775168 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340865.051858:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c044120f400) 00010000:00010000:2.0:1780340865.051860:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340865.051864:0:64454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340865.051943:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:71307:x1866818940470016:12345-192.168.203.16@tcp:36:rm.0 Request processed in 2659us (2884us total) trans 115964117002 rc 0/0 00000100:00100000:2.0:1780340865.051951:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1393 00010000:00010000:0.0:1780340865.055291:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340865.055303:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6e00/0xa24651432775176 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340865.055315:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340865.055319:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6e00/0xa24651432775176 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340865.055328:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6e00/0xa24651432775176 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340865.055345:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff8c044120fd00) 00010000:00010000:0.0:1780340865.055348:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1780340865.055353:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6e00/0xa24651432775176 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340865.055359:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6e00/0xa24651432775176 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340865.055383:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340865.055384:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340865.055386:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340865.938275:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340866.954027:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340867.979341:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340868.490062:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961208704:0@lo:400:kworker.0 00000100:00100000:1.0:1780340868.490131:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340868.490161:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ac7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961209216:0@lo:400:kworker.0 00000100:00100000:1.0:1780340868.490185:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340868.490202:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961209728:0@lo:400:kworker.0 00000100:00100000:1.0:1780340868.490224:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340868.490248:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1780340868.490254:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961208832:0@lo:400:kworker.0 00000100:00100000:1.0:1780340868.490285:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340868.490301:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961209344:0@lo:400:kworker.0 00000100:00100000:1.0:1780340868.490320:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340868.490335:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961209856:0@lo:400:kworker.0 00000100:00100000:1.0:1780340868.490352:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340868.490384:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961208704 00000100:00100000:1.0:1780340868.490391:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961208704 00000100:00100000:1.0:1780340868.490438:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961208832 00000100:00100000:1.0:1780340868.490441:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961208832 00000100:00100000:1.0:1780340868.490461:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:1.0:1780340868.490469:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961208704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340868.490513:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961208704:12345-0@lo:400:kworker.0 Request processed in 44us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340868.490519:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:1.0:1780340868.490534:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:1.0:1780340868.490539:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961208832:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1780340868.490552:0:70100:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0349339880 x1866818961208832/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:294/0 lens 224/224 e 0 to 0 dl 1780340879 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340868.490575:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961208832:12345-0@lo:400:kworker.0 Request processed in 36us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340868.490581:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00100000:1.0:1780340868.490597:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961209216 00000100:00100000:1.0:1780340868.490600:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961209216 00000100:00100000:1.0:1780340868.490637:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961209728 00000100:00100000:1.0:1780340868.490640:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961209728 00000100:00100000:1.0:1780340868.490657:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961209344 00000100:00100000:1.0:1780340868.490660:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961209344 00000100:00100000:1.0:1780340868.490686:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961209856 00000100:00100000:1.0:1780340868.490688:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961209856 00000100:00100000:1.0:1780340868.490706:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607 00000100:00100000:1.0:1780340868.490712:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961209216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340868.490741:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961209216:12345-0@lo:400:kworker.0 Request processed in 29us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340868.490746:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607 00000100:00100000:1.0:1780340868.490756:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00100000:2.0:1780340868.490897:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961208448:0@lo:400:kworker.0 00000100:00100000:2.0:1780340868.490934:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340868.490958:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961208960:0@lo:400:kworker.0 00000100:00100000:2.0:1780340868.490977:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340868.490991:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961209472:0@lo:400:kworker.0 00000100:00100000:2.0:1780340868.491008:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340868.491020:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961209984:0@lo:400:kworker.0 00000100:00100000:2.0:1780340868.491039:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340868.491050:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1780340868.491056:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961208576:0@lo:400:kworker.0 00000100:00100000:2.0:1780340868.491073:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340868.491083:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961209088:0@lo:400:kworker.0 00000100:00100000:2.0:1780340868.491101:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340868.491117:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961209600:0@lo:400:kworker.0 00000100:00100000:2.0:1780340868.491146:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340868.491172:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961208960 00000100:00100000:2.0:1780340868.491176:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961208960 00000100:00100000:2.0:1780340868.491196:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961209472 00000100:00100000:2.0:1780340868.491199:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961209472 00000100:00100000:2.0:1780340868.491209:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961209984 00000100:00100000:2.0:1780340868.491211:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961209984 00000100:00100000:2.0:1780340868.491220:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961208576 00000100:00100000:2.0:1780340868.491223:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961208576 00000100:00100000:2.0:1780340868.491236:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:2.0:1780340868.491242:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961208960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340868.491275:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961208960:12345-0@lo:400:kworker.0 Request processed in 34us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340868.491282:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:2.0:1780340868.491293:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:2.0:1780340868.491298:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961209472:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340868.491308:0:63710:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0445594000 x1866818961209472/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:294/0 lens 224/224 e 0 to 0 dl 1780340879 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340868.491329:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961209472:12345-0@lo:400:kworker.0 Request processed in 32us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340868.491335:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:2.0:1780340868.491344:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:2.0:1780340868.491350:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961209984:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340868.491359:0:63710:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0445597b80 x1866818961209984/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:294/0 lens 224/224 e 0 to 0 dl 1780340879 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340868.491381:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961209984:12345-0@lo:400:kworker.0 Request processed in 31us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340868.491395:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00100000:2.0:1780340868.491406:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:2.0:1780340868.491412:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961208576:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340868.491422:0:63710:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0445595500 x1866818961208576/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:294/0 lens 224/224 e 0 to 0 dl 1780340879 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340868.491445:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961208576:12345-0@lo:400:kworker.0 Request processed in 34us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340868.491450:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:2.0:1780340868.491519:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961208448 00000100:00100000:2.0:1780340868.491524:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961208448 00000100:00100000:2.0:1780340868.491547:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1780340868.491552:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961208448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340868.491580:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961208448:12345-0@lo:400:kworker.0 Request processed in 28us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340868.491585:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1780340868.491845:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961209088 00000100:00100000:2.0:1780340868.491849:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961209088 00000100:00100000:2.0:1780340868.491873:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961209600 00000100:00100000:2.0:1780340868.491876:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961209600 00000100:00100000:2.0:1780340868.491893:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3939 00000100:00100000:2.0:1780340868.491899:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961209088:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1780340868.491917:0:8410:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0445597100 x1866818961209088/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:294/0 lens 224/224 e 0 to 0 dl 1780340879 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340868.491944:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445597100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961209088:12345-0@lo:400:kworker.0 Request processed in 46us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340868.491951:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3939 00000100:00100000:2.0:1780340868.491969:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3940 00000100:00100000:2.0:1780340868.491975:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961209600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340868.492000:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961209600:12345-0@lo:400:kworker.0 Request processed in 26us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340868.492005:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3940 00000100:00100000:2.0:1780340868.492025:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961210368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340868.492049:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340868.492069:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340868.492074:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961210240:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340868.492093:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340868.492308:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961210112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340868.492336:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340868.492419:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961209728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340868.492455:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961209728:12345-0@lo:400:kworker.0 Request processed in 40us (2230us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340868.492460:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00000100:00100000:1.0:1780340868.492474:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00000100:00100000:1.0:1780340868.492480:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961209344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340868.492505:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349339180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961209344:12345-0@lo:400:kworker.0 Request processed in 26us (2184us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340868.492510:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00000100:00100000:1.0:1780340868.492520:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2610 00000100:00100000:1.0:1780340868.492527:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961209856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340868.492550:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961209856:12345-0@lo:400:kworker.0 Request processed in 24us (2197us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340868.492555:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2610 00000100:00080000:1.0:1780340868.492581:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340868.492585:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780340868.492589:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780340868.492591:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340868.492637:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961208832:0@lo:400:kworker.0 00000100:00100000:1.0:1780340868.492658:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349338e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961209344:0@lo:400:kworker.0 00000100:00100000:1.0:1780340868.492667:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349339f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961209856:0@lo:400:kworker.0 00000100:00100000:1.0:1780340868.492676:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961208704:0@lo:400:kworker.0 00000100:00100000:1.0:1780340868.492685:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ac7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961209216:0@lo:400:kworker.0 00000100:00100000:1.0:1780340868.492693:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961209728:0@lo:400:kworker.0 00000100:00100000:2.0:1780340868.492993:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961210240 00000100:00100000:2.0:1780340868.492998:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961210240 00000100:00100000:2.0:1780340868.493020:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961210112 00000100:00100000:2.0:1780340868.493023:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961210112 00000100:00100000:2.0:1780340868.493035:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3941 00000100:00100000:2.0:1780340868.493042:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961210240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340868.493067:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:2.0:1780340868.493106:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961210240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340868.493113:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3941 00000100:00100000:2.0:1780340868.493125:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3942 00000100:00100000:2.0:1780340868.493130:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961210112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780340868.493145:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00010000:00000080:2.0:1780340868.493154:0:22660:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0446b65c00 x1866818961210112/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:294/0 lens 224/368 e 0 to 0 dl 1780340879 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340868.493187:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961210112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340868.493199:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3942 00000100:00100000:2.0:1780340868.493221:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961210368 00000100:00100000:2.0:1780340868.493225:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961210368 00000100:00100000:2.0:1780340868.493250:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114 00000100:00100000:2.0:1780340868.493256:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961210368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340868.493274:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340868.493301:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961210368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340868.493307:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114 00000100:00100000:2.0:1780340868.493344:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961210112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340868.493377:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961208576:0@lo:400:kworker.0 00000100:00100000:2.0:1780340868.493386:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961209088:0@lo:400:kworker.0 00000100:00100000:2.0:1780340868.493395:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961209600:0@lo:400:kworker.0 00000100:00100000:2.0:1780340868.493404:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961208448:0@lo:400:kworker.0 00000100:00100000:2.0:1780340868.493415:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961208960:0@lo:400:kworker.0 00000100:00100000:2.0:1780340868.493424:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961209472:0@lo:400:kworker.0 00000100:00100000:2.0:1780340868.493433:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961209984:0@lo:400:kworker.0 00000100:00100000:1.0:1780340868.494940:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961210240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340868.494962:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961210368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340868.497806:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340868.497836:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961210496:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340868.497910:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340868.498056:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961210496 00000100:00100000:2.0:1780340868.498064:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961210496 00000100:00100000:2.0:1780340868.498116:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115 00000100:00100000:2.0:1780340868.498125:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961210496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340868.498153:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780340868.498210:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961210496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340868.498216:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115 00000100:00100000:2.0:1780340868.498260:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961210496:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1780340869.001937:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340869.002732:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780340869.002753:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961210624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340869.002839:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340869.002892:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961210624 00000100:00100000:0.0:1780340869.002911:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961210624 00000100:00100000:0.0:1780340869.002959:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116 00000100:00100000:0.0:1780340869.002968:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961210624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780340869.002992:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340869.003035:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961210624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340869.003043:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116 00000100:00100000:0.0:1780340869.003086:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961210624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340869.004509:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340869.004524:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961210752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340869.004578:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340869.004784:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961210752 00000100:00100000:2.0:1780340869.004790:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961210752 00000100:00100000:2.0:1780340869.004831:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00100000:2.0:1780340869.004839:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961210752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780340869.004857:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780340869.004893:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961210752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340869.004899:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000100:00100000:3.0:1780340869.005505:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961210752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340869.686650:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340869.686698:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340869.686810:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340869.686832:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340869.686857:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340869.686925:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940470272 00000100:00100000:1.0:1780340869.686935:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940470272 00000100:00100000:1.0:1780340869.686990:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940470400 00000100:00100000:1.0:1780340869.686995:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940470400 00000100:00100000:1.0:1780340869.687019:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1398 00000100:00100000:1.0:1780340869.687029:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:2408:x1866818940470272:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000080:1.0:1780340869.687058:0:63710:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0446b67b80 x1866818940470272/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:295/0 lens 224/224 e 0 to 0 dl 1780340880 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340869.687131:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:2408:x1866818940470272:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 102us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340869.687139:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1398 00000100:00100000:1.0:1780340869.687169:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1399 00000100:00100000:1.0:1780340869.687186:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2408:x1866818940470400:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340869.687214:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2408:x1866818940470400:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 30us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340869.687221:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1399 00000100:00080000:1.0:1780340869.687243:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780340869.687246:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340869.688659:0:88671:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940470144 00000100:00100000:1.0:1780340869.688670:0:88671:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940470144 00000100:00100000:1.0:1780340869.688719:0:88671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 174 00000100:00100000:1.0:1780340869.688728:0:88671:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940470144:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340869.688802:0:88671:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940470144:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 75us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340869.688810:0:88671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 174 00000100:00100000:3.0:1780340869.705690:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940470528 00000100:00100000:3.0:1780340869.705705:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940470528 00000100:00100000:3.0:1780340869.705814:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940470656 00000100:00100000:3.0:1780340869.705818:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940470656 00000100:00100000:3.0:1780340869.705847:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2611 00000100:00100000:3.0:1780340869.705859:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2408:x1866818940470528:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340869.706065:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2408:x1866818940470528:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 208us (19365us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340869.706074:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2611 00000100:00100000:3.0:1780340869.706094:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2612 00000100:00100000:3.0:1780340869.706101:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2408:x1866818940470656:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340869.706127:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2408:x1866818940470656:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 27us (19269us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340869.706132:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2612 00000100:00080000:0.0:1780340869.707414:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340869.707422:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1780340870.026032:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340871.056072:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1780340871.056679:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000001:00080000:2.0:1780340871.374208:0:88666:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117002 is committed 00010000:00010000:1.0:1780340871.375155:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775130 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340871.375179:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775130 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340871.375190:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775130 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340871.375197:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340871.375201:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775130 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340871.375209:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775130 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340871.375242:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c044120f400) 00010000:00010000:1.0:1780340871.375246:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340871.375251:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775130 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340871.375256:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775130 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340871.375275:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775168 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340871.375281:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775168 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340871.375286:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775168 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340871.375290:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340871.375292:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775168 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340871.375298:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775168 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340871.375305:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c044120f400) 00010000:00010000:1.0:1780340871.375307:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340871.375310:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775168 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340871.375314:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa24651432775168 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340872.074307:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1780340872.627215:0:89845:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1780340872.712132:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340872.712199:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940470784 00000100:00100000:2.0:1780340872.712209:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940470784 00000100:00100000:2.0:1780340872.712280:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1394 00000100:00100000:2.0:1780340872.712291:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:71374:x1866818940470784:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:2.0:1780340872.712311:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340872.712330:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7a00/0xa2465143277517d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced25ba expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.712391:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775184 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.712405:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.712426:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340872.712479:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1780340872.712483:0:63712:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780340872.712516:0:63712:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775184 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.712540:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7a00/0xa2465143277517d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25ba expref: 11 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.712556:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775184 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25ba expref: 10 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.712563:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c0477219c00) 00010000:00010000:2.0:1780340872.712566:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780340872.712570:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7400, rc 0) 00010000:00000080:2.0:1780340872.712586:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0349339f80 x1866818940470784/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:298/0 lens 576/688 e 0 to 0 dl 1780340883 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340872.712646:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:71374:x1866818940470784:12345-192.168.203.16@tcp:101:touch.0 Request processed in 357us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340872.712653:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1394 00000100:00080000:1.0:1780340872.713084:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780340872.715926:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340872.716193:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940470912 00000100:00100000:1.0:1780340872.716204:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940470912 00000100:00100000:1.0:1780340872.716259:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1395 00000100:00100000:1.0:1780340872.716269:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:71374:x1866818940470912:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:1.0:1780340872.716288:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340872.716309:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa2465143277518b lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced25c1 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716371:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432775192 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716386:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432775192 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716397:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432775192 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716410:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122a00/0xa24651432775199 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716417:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122a00/0xa24651432775199 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716424:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122a00/0xa24651432775199 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716488:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122000/0xa246514327751a0 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716508:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122000/0xa246514327751a0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716515:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122000/0xa246514327751a0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340872.716538:0:70100:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122000/0xa246514327751a0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716550:0:70100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432775192 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716557:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432775192 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716562:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432775192 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716568:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432775192 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716574:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340872.716587:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432775192 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716595:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432775192 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716606:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff8c0444f27600) 00010000:00010000:1.0:1780340872.716609:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340872.716614:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432775192 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716627:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123a00/0xa24651432775192 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716639:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122a00/0xa24651432775199 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716645:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122a00/0xa24651432775199 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716651:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122a00/0xa24651432775199 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716657:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340872.716660:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122a00/0xa24651432775199 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716666:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122a00/0xa24651432775199 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716673:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff8c046091c600) 00010000:00010000:1.0:1780340872.716675:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340872.716687:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122a00/0xa24651432775199 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716693:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122a00/0xa24651432775199 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716724:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa2465143277518b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25c1 expref: 12 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716734:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122000/0xa246514327751a0 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25c1 expref: 11 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340872.716747:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff8c0444f27c00) 00010000:00010000:1.0:1780340872.716749:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1780340872.716752:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122000, rc 0) 00010000:00000080:1.0:1780340872.716779:0:70100:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0477585880 x1866818940470912/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:298/0 lens 576/584 e 0 to 0 dl 1780340883 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340872.717067:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:71374:x1866818940470912:12345-192.168.203.16@tcp:101:touch.0 Request processed in 570us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340872.717075:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1395 00000100:00100000:1.0:1780340872.725669:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340872.727129:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340872.727272:0:6502:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940471168 00000100:00100000:3.0:1780340872.727283:0:6502:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940471168 00000100:00100000:3.0:1780340872.727344:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 719 00000100:00100000:3.0:1780340872.727364:0:6502:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2407:x1866818940471168:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780340872.727381:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340872.727406:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122000/0xa246514327751a0 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25c1 expref: 11 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.727422:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff8c0444f27c00) 00010000:00010000:3.0:1780340872.727427:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340872.727491:0:6502:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2407:x1866818940471168:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 130us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340872.727498:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 719 00000100:00100000:2.0:1780340872.733643:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940471040 00000100:00100000:2.0:1780340872.733659:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940471040 00000100:00100000:2.0:1780340872.733751:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1396 00000100:00100000:2.0:1780340872.733778:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:71374:x1866818940471040:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:2.0:1780340872.733798:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340872.733825:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7a00/0xa246514327751a7 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced25c8 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.733898:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa246514327751ae lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.733914:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa246514327751ae lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.733927:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa246514327751ae lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340872.733973:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1780340872.733976:0:64454:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1780340872.734030:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7a00/0xa246514327751a7 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25c8 expref: 7 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.734045:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7e00/0xa246514327751ae lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25c8 expref: 6 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.734054:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff8c044120fc00) 00010000:00010000:2.0:1780340872.734057:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1780340872.734061:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7e00, rc 0) 00000100:00100000:2.0:1780340872.734129:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:71374:x1866818940471040:12345-192.168.203.16@tcp:101:touch.0 Request processed in 369us (8469us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340872.734137:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1396 00000100:00080000:1.0:1780340872.734697:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340872.743215:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340872.743293:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940471424 00000100:00100000:3.0:1780340872.743303:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940471424 00000100:00100000:3.0:1780340872.743362:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1397 00000100:00100000:3.0:1780340872.743372:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:71374:x1866818940471424:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:3.0:1780340872.743392:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340872.743412:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9600/0xa246514327751b5 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced25cf expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.743524:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa246514327751bc lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.743539:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa246514327751bc lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.743551:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa246514327751bc lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.743568:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327751c3 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.743594:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327751c3 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.743601:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327751c3 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340872.743956:0:63710:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0477584380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63710:1866818961210880:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1780340872.744012:0:63710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340872.744040:0:63710:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047a30b900 going to sleep for 11 seconds 00000100:00100000:0.0:1780340872.744168:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961210880 00000100:00100000:0.0:1780340872.744174:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961210880 00000100:00100000:0.0:1780340872.744214:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3943 00000100:00100000:0.0:1780340872.744222:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:63710:x1866818961210880:12345-0@lo:1000:mdt00_000.0 00010000:00000080:0.0:1780340872.744258:0:22660:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0477586a00 x1866818961210880/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:298/0 lens 328/4320 e 0 to 0 dl 1780340883 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340872.744302:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477586a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:63710:x1866818961210880:12345-0@lo:1000:mdt00_000.0 Request processed in 81us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340872.744309:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943 00000100:00100000:3.0:1780340872.744391:0:63710:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0477584380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63710:1866818961210880:0@lo:1000:mdt00_000.0 00000004:00080000:3.0:1780340872.744646:0:63710:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x492:0x0], count =400 00000004:00080000:3.0:1780340872.744653:0:63710:0:(osp_object.c:1640:osp_create()) Writing gap [0x2c0000400:0x492:0x0]+400 in llog 00000004:00080000:3.0:1780340872.744665:0:63710:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x622:0x0], index 1: 0 00010000:00010000:3.0:1780340872.745449:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9200/0xa246514327751ca lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.745477:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9200/0xa246514327751ca lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.745488:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9200/0xa246514327751ca lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.745524:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa246514327751bc lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.745532:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa246514327751bc lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.745539:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa246514327751bc lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.745552:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa246514327751bc lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.745557:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340872.745561:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa246514327751bc lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.745568:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa246514327751bc lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.745589:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff8c044120fc00) 00010000:00010000:3.0:1780340872.745592:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340872.745597:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa246514327751bc lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.745604:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa246514327751bc lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340872.745615:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003c406bb0 reply state 000000007fb9214f transno 81604378763 ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327751c3 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.745626:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327751c3 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.745632:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff8c04506cfd00) 00010000:00010000:3.0:1780340872.745635:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340872.745638:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1780340872.745672:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9600/0xa246514327751b5 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25cf expref: 9 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.749666:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9200/0xa246514327751ca lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25cf expref: 8 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.749700:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff8c04506cf300) 00010000:00010000:3.0:1780340872.749703:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780340872.749707:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9200, rc 0) 00000100:00100000:3.0:1780340872.749805:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:71374:x1866818940471424:12345-192.168.203.16@tcp:101:touch.0 Request processed in 6433us (6598us total) trans 81604378763 rc 0/0 00000100:00100000:3.0:1780340872.749815:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1397 00000100:00100000:2.0:1780340872.757269:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340872.757350:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940471680 00000100:00100000:3.0:1780340872.757361:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940471680 00000100:00100000:3.0:1780340872.757418:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1398 00000100:00100000:3.0:1780340872.757428:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:71374:x1866818940471680:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:3.0:1780340872.757489:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340872.757515:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9200/0xa246514327751ca lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25cf expref: 9 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.757534:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff8c04506cf300) 00010000:00010000:3.0:1780340872.757544:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340872.757600:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8c00/0xa246514327751d8 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.757612:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8c00/0xa246514327751d8 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.757622:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8c00/0xa246514327751d8 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340872.757733:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000aaaf399e reply state 00000000648b30e9 transno 81604378764 ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8c00/0xa246514327751d8 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.757790:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8c00/0xa246514327751d8 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.757797:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff8c04506cf400) 00010000:00010000:3.0:1780340872.757800:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340872.757803:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780340872.757887:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:71374:x1866818940471680:12345-192.168.203.16@tcp:36:touch.0 Request processed in 461us (625us total) trans 81604378764 rc 0/0 00000100:00100000:3.0:1780340872.757894:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1398 00000100:00100000:3.0:1780340872.767428:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340872.767518:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940471808 00000100:00100000:0.0:1780340872.767528:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940471808 00000100:00100000:0.0:1780340872.767598:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1399 00000100:00100000:0.0:1780340872.767609:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:71374:x1866818940471808:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:0.0:1780340872.767633:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340872.767654:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4800/0xa246514327751df lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced25d6 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340872.767722:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4800/0xa246514327751df lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25d6 expref: 11 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340872.767736:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0475fa4800/0xa246514327751df lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25d6 expref: 11 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340872.767756:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff8c04506cf400) 00010000:00010000:0.0:1780340872.767779:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1780340872.767782:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4800, rc 0) 00000100:00100000:0.0:1780340872.767848:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477584380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:71374:x1866818940471808:12345-192.168.203.16@tcp:101:touch.0 Request processed in 230us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340872.767855:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1399 00000100:00100000:0.0:1780340872.777910:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340872.778024:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940471936 00000100:00100000:3.0:1780340872.778035:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940471936 00000100:00100000:3.0:1780340872.778105:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5921 00000100:00100000:3.0:1780340872.778119:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2410:x1866818940471936:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:3.0:1780340872.778352:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2410:x1866818940471936:12345-192.168.203.16@tcp:2:touch.0 Request processed in 235us (453us total) trans 4294969455 rc 0/0 00000100:00100000:3.0:1780340872.778360:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5921 00000100:00080000:1.0:1780340872.778537:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340872.783740:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340872.783948:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940472192 00000100:00100000:2.0:1780340872.783957:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940472192 00000100:00100000:2.0:1780340872.784017:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 244 00000100:00100000:2.0:1780340872.784026:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:71374:x1866818940472192:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:2.0:1780340872.784346:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:71374:x1866818940472192:12345-192.168.203.16@tcp:35:touch.0 Request processed in 321us (614us total) trans 81604378765 rc 0/0 00000100:00100000:2.0:1780340872.784354:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 244 00000100:00100000:0.0:1780340872.801243:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340872.802927:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940472320 00000100:00100000:2.0:1780340872.802940:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940472320 00000100:00100000:2.0:1780340872.803031:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1400 00000100:00100000:2.0:1780340872.803042:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:71375:x1866818940472320:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:2.0:1780340872.803064:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340872.803083:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7a00/0xa246514327751e6 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced25dd expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803150:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa246514327751ed lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803166:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa246514327751ed lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803177:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa246514327751ed lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803192:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa246514327751f4 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803199:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa246514327751f4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803205:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa246514327751f4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803263:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa246514327751fb lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803273:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa246514327751fb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803279:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa246514327751fb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340872.803299:0:63710:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa246514327751fb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803311:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa246514327751ed lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803318:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa246514327751ed lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803323:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa246514327751ed lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803329:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa246514327751ed lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803334:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340872.803338:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa246514327751ed lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803355:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa246514327751ed lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803367:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff8c0444f27600) 00010000:00010000:2.0:1780340872.803376:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340872.803381:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa246514327751ed lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803387:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7200/0xa246514327751ed lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803723:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa246514327751f4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803729:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa246514327751f4 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803735:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa246514327751f4 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803739:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340872.803742:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa246514327751f4 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803748:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa246514327751f4 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803775:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff8c044120f200) 00010000:00010000:2.0:1780340872.803779:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340872.803782:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa246514327751f4 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803787:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa246514327751f4 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803823:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7a00/0xa246514327751e6 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25dd expref: 12 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803847:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa246514327751fb lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25dd expref: 11 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.803855:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff8c045247c200) 00010000:00010000:2.0:1780340872.803858:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1780340872.803861:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6000, rc 0) 00010000:00000080:2.0:1780340872.803868:0:63710:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c034a205500 x1866818940472320/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:298/0 lens 576/584 e 0 to 0 dl 1780340883 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340872.803938:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a205500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:71375:x1866818940472320:12345-192.168.203.16@tcp:101:touch.0 Request processed in 898us (2703us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340872.803945:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1400 00000100:00100000:0.0:1780340872.808023:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340872.808063:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340872.808138:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940472448 00000100:00100000:2.0:1780340872.808148:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940472448 00000100:00100000:2.0:1780340872.808203:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1401 00000100:00100000:2.0:1780340872.808214:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a205880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:71375:x1866818940472448:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:2.0:1780340872.808239:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340872.808261:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6e00/0xa24651432775202 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced25e4 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.808337:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa24651432775209 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.808352:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa24651432775209 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.808363:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa24651432775209 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340872.808413:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1780340872.808417:0:64454:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1780340872.808862:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c6e00/0xa24651432775202 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25e4 expref: 14 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.808877:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c04754c7c00/0xa24651432775209 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25e4 expref: 13 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.808886:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff8c044120fa00) 00010000:00010000:2.0:1780340872.808888:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1780340872.808892:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7c00, rc 0) 00000100:00100000:2.0:1780340872.808951:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a205880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:71375:x1866818940472448:12345-192.168.203.16@tcp:101:touch.0 Request processed in 739us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340872.808958:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1401 00000100:00100000:3.0:1780340872.809727:0:19125:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940472576 00000100:00100000:3.0:1780340872.809735:0:19125:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940472576 00000100:00100000:2.0:1780340872.810717:0:19125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 720 00000100:00100000:2.0:1780340872.810733:0:19125:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a204e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2407:x1866818940472576:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780340872.810751:0:19125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340872.810803:0:19125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa246514327751fb lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25dd expref: 11 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340872.810821:0:19125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff8c045247c200) 00010000:00010000:2.0:1780340872.810825:0:19125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340872.810879:0:19125:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a204e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2407:x1866818940472576:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 151us (2813us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340872.810886:0:19125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 720 00000100:00100000:1.0:1780340872.819152:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340872.820564:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940472832 00000100:00100000:3.0:1780340872.820587:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940472832 00000100:00100000:3.0:1780340872.820650:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1402 00000100:00100000:3.0:1780340872.820661:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:71375:x1866818940472832:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:3.0:1780340872.820681:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340872.820700:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9200/0xa24651432775210 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced25eb expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.820840:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9600/0xa24651432775217 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.820857:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9600/0xa24651432775217 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.820868:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9600/0xa24651432775217 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.820883:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa2465143277521e lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.820890:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa2465143277521e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.820896:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa2465143277521e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1780340872.821194:0:70100:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x623:0x0], index 1: 0 00010000:00010000:3.0:1780340872.821331:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9e00/0xa24651432775225 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.821341:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9e00/0xa24651432775225 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.821348:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9e00/0xa24651432775225 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.821381:0:70100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9600/0xa24651432775217 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.821399:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9600/0xa24651432775217 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.821406:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9600/0xa24651432775217 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.821412:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9600/0xa24651432775217 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.821417:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340872.821421:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9600/0xa24651432775217 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.821429:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9600/0xa24651432775217 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.821456:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff8c044120fa00) 00010000:00010000:3.0:1780340872.821460:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340872.821465:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9600/0xa24651432775217 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.821471:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9600/0xa24651432775217 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340872.821483:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000928af685 reply state 00000000e8031242 transno 81604378766 ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa2465143277521e lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.821492:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa2465143277521e lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.821498:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff8c04506cf300) 00010000:00010000:3.0:1780340872.821506:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340872.821509:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1780340872.821539:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9200/0xa24651432775210 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25eb expref: 16 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.821553:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9e00/0xa24651432775225 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25eb expref: 15 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.821560:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff8c04506cff00) 00010000:00010000:3.0:1780340872.821562:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780340872.821564:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9e00, rc 0) 00000100:00100000:3.0:1780340872.821642:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349338a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+16:71375:x1866818940472832:12345-192.168.203.16@tcp:101:touch.0 Request processed in 982us (2499us total) trans 81604378766 rc 0/0 00000100:00100000:3.0:1780340872.821649:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1402 00000100:00100000:3.0:1780340872.830999:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340872.833847:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940473088 00000100:00100000:3.0:1780340872.833863:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940473088 00000100:00100000:3.0:1780340872.833926:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1403 00000100:00100000:3.0:1780340872.833938:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+16:71375:x1866818940473088:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:3.0:1780340872.834002:0:63710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340872.834030:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f9e00/0xa24651432775225 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25eb expref: 16 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.834049:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff8c04506cff00) 00010000:00010000:3.0:1780340872.834061:0:63710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340872.834109:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8800/0xa24651432775233 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.834133:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8800/0xa24651432775233 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.834143:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8800/0xa24651432775233 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340872.834248:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c6baf3dd reply state 00000000fcd1826d transno 81604378767 ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8800/0xa24651432775233 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.834260:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8800/0xa24651432775233 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.834267:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff8c04506cf100) 00010000:00010000:3.0:1780340872.834270:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340872.834273:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780340872.834368:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477587480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+17:71375:x1866818940473088:12345-192.168.203.16@tcp:36:touch.0 Request processed in 432us (3377us total) trans 81604378767 rc 0/0 00000100:00100000:3.0:1780340872.834375:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1403 00000100:00100000:2.0:1780340872.843891:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340872.845942:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940473216 00000100:00100000:3.0:1780340872.845958:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940473216 00000100:00100000:3.0:1780340872.846016:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1404 00000100:00100000:3.0:1780340872.846026:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+17:71375:x1866818940473216:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:3.0:1780340872.846048:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340872.846067:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c047a8b2800/0xa2465143277523a lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced25f2 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.846123:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c047a8b2800/0xa2465143277523a lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25f2 expref: 18 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.846150:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c047a8b2800/0xa2465143277523a lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25f2 expref: 18 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340872.846171:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff8c04506cf100) 00010000:00010000:3.0:1780340872.846174:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780340872.846178:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a8b2800, rc 0) 00000100:00100000:3.0:1780340872.846238:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+18:71375:x1866818940473216:12345-192.168.203.16@tcp:101:touch.0 Request processed in 213us (2358us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340872.846244:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1404 00000100:00100000:3.0:1780340872.852338:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340872.852819:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940473344 00000100:00100000:0.0:1780340872.852829:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940473344 00000100:00100000:0.0:1780340872.852879:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5922 00000100:00100000:0.0:1780340872.852896:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2408:x1866818940473344:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:0.0:1780340872.853095:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477585500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940473344:12345-192.168.203.16@tcp:2:touch.0 Request processed in 200us (765us total) trans 4294969456 rc 0/0 00000100:00100000:0.0:1780340872.853103:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5922 00000100:00100000:0.0:1780340872.859000:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340872.859034:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940473600 00000100:00100000:0.0:1780340872.859046:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940473600 00000100:00100000:0.0:1780340872.859099:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 245 00000100:00100000:0.0:1780340872.859110:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+18:71375:x1866818940473600:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:0.0:1780340872.859390:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+19:71375:x1866818940473600:12345-192.168.203.16@tcp:35:touch.0 Request processed in 281us (396us total) trans 81604378768 rc 0/0 00000100:00100000:0.0:1780340872.859399:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 245 00010000:00010000:3.0:1780340873.098623:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340873.610872:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340873.610894:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961211136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340873.610960:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340873.611008:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961211136 00000100:00100000:3.0:1780340873.611015:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961211136 00000100:00100000:3.0:1780340873.611064:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3944 00000100:00100000:3.0:1780340873.611074:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961211136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340873.611122:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445154816 avail 1298915328 00010000:00000080:3.0:1780340873.611138:0:8411:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046b993800 x1866818961211136/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:299/0 lens 224/368 e 0 to 0 dl 1780340884 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340873.611179:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b993800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961211136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340873.611186:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3944 00000100:00100000:3.0:1780340873.611232:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961211136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340873.611655:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961211008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340873.611692:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340873.612874:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961211008 00000100:00100000:2.0:1780340873.612884:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961211008 00000100:00100000:2.0:1780340873.612958:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118 00000100:00100000:2.0:1780340873.612969:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961211008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340873.612997:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780340873.613066:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961211008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340873.613072:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118 00000100:00080000:0.0:1780340873.613192:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340873.613232:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961211008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340873.616005:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961211648:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.616071:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340873.616101:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961212160:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.616125:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340873.616148:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1780340873.616154:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a07ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961211264:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.616177:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340873.616202:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961211776:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.616230:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340873.616245:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961212288:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.616266:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340873.616296:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961211648 00000100:00100000:0.0:1780340873.616303:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961211648 00000100:00100000:0.0:1780340873.616352:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961211776 00000100:00100000:0.0:1780340873.616355:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961211776 00000100:00100000:0.0:1780340873.616377:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1780340873.616384:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961211648:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1780340873.616406:0:63711:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0348a69500 x1866818961211648/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:299/0 lens 224/224 e 0 to 0 dl 1780340884 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340873.616444:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961211648:12345-0@lo:400:kworker.0 Request processed in 61us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340873.616452:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1780340873.616469:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:0.0:1780340873.616475:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961211776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.616501:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961211776:12345-0@lo:400:kworker.0 Request processed in 26us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340873.616507:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:0.0:1780340873.616524:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961212160 00000100:00100000:0.0:1780340873.616528:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961212160 00000100:00100000:0.0:1780340873.616550:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3945 00000100:00100000:0.0:1780340873.616556:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961212160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.616598:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961212160:12345-0@lo:400:kworker.0 Request processed in 43us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340873.616604:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3945 00000100:00100000:0.0:1780340873.616630:0:88673:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961211264 00000100:00100000:0.0:1780340873.616633:0:88673:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961211264 00000100:00100000:0.0:1780340873.616658:0:88673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1780340873.616664:0:88673:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961211264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.616693:0:88673:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961211264:12345-0@lo:400:kworker.0 Request processed in 30us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340873.616699:0:88673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1780340873.616725:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961212288 00000100:00100000:0.0:1780340873.616728:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961212288 00000100:00100000:0.0:1780340873.616753:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00000100:00100000:0.0:1780340873.616785:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961212288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.616813:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961212288:12345-0@lo:400:kworker.0 Request processed in 55us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340873.616819:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00000100:00100000:0.0:1780340873.616850:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961211392:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.616874:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340873.616890:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961211904:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.616908:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340873.616924:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961212416:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.616942:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340873.616960:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1780340873.616966:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961211520:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.616986:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340873.617000:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961212032:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.617016:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340873.617030:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961212544:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.617055:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340873.617078:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961211904 00000100:00100000:0.0:1780340873.617082:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961211904 00000100:00100000:0.0:1780340873.617103:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961212416 00000100:00100000:0.0:1780340873.617106:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961212416 00000100:00100000:0.0:1780340873.617126:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614 00000100:00100000:0.0:1780340873.617131:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961211904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.617161:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961211904:12345-0@lo:400:kworker.0 Request processed in 30us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340873.617166:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614 00000100:00100000:0.0:1780340873.617178:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2615 00000100:00100000:0.0:1780340873.617184:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961212416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.617205:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961212416:12345-0@lo:400:kworker.0 Request processed in 22us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340873.617209:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2615 00000100:00100000:0.0:1780340873.617230:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961211392 00000100:00100000:0.0:1780340873.617233:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961211392 00000100:00100000:0.0:1780340873.617248:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961211520 00000100:00100000:0.0:1780340873.617250:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961211520 00000100:00100000:0.0:1780340873.617257:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961212032 00000100:00100000:0.0:1780340873.617259:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961212032 00000100:00100000:0.0:1780340873.617267:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961212544 00000100:00100000:0.0:1780340873.617268:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961212544 00000100:00100000:0.0:1780340873.617277:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:0.0:1780340873.617282:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961211392:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1780340873.617294:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0348a68a80 x1866818961211392/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:299/0 lens 224/224 e 0 to 0 dl 1780340884 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340873.617317:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961211392:12345-0@lo:400:kworker.0 Request processed in 35us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340873.617328:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:0.0:1780340873.617339:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:0.0:1780340873.617345:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961211520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.617369:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961211520:12345-0@lo:400:kworker.0 Request processed in 26us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340873.617374:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:0.0:1780340873.617384:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1780340873.617389:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961212032:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1780340873.617398:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0348a68700 x1866818961212032/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:299/0 lens 224/224 e 0 to 0 dl 1780340884 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340873.617417:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961212032:12345-0@lo:400:kworker.0 Request processed in 29us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340873.617423:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1780340873.617431:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1780340873.617436:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961212544:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1780340873.617444:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0348a6ad80 x1866818961212544/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:299/0 lens 224/224 e 0 to 0 dl 1780340884 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340873.617463:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961212544:12345-0@lo:400:kworker.0 Request processed in 27us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340873.617468:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00080000:0.0:1780340873.617483:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340873.617487:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340873.617489:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340873.617491:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780340873.617519:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961211520:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.617535:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961212032:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.617541:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961212544:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.617549:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961211392:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.617557:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961211904:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.617564:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961212416:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.617612:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a07ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961211264:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.617621:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961211776:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.617630:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961212288:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.617639:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961211648:0@lo:400:kworker.0 00000100:00100000:0.0:1780340873.617647:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961212160:0@lo:400:kworker.0 00000100:00100000:2.0:1780340873.619811:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961212672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340873.619869:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340873.619919:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961212672 00000100:00100000:2.0:1780340873.619926:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961212672 00000100:00100000:2.0:1780340873.619971:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119 00000100:00100000:2.0:1780340873.619979:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961212672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340873.620009:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340873.620062:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961212672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340873.620070:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119 00000100:00100000:2.0:1780340873.620118:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961212672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340873.623814:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961212800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340873.623884:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340873.623944:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961212800 00000100:00100000:1.0:1780340873.623951:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961212800 00000100:00100000:1.0:1780340873.623992:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3946 00000100:00100000:1.0:1780340873.623999:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961212800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780340873.624030:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:1.0:1780340873.625001:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961212800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 997us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340873.625012:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946 00000100:00100000:1.0:1780340873.625140:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961212800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340874.122294:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961212928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340874.122364:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340874.122410:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340874.122417:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961213056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340874.122439:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340874.122486:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961212928 00000100:00100000:0.0:1780340874.122494:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961212928 00000100:00100000:0.0:1780340874.122534:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961213056 00000100:00100000:0.0:1780340874.122538:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961213056 00000100:00100000:0.0:1780340874.122557:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1780340874.122575:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961212928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340874.122607:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340874.122648:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961212928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340874.122656:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1780340874.122678:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121 00000100:00100000:0.0:1780340874.122685:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961213056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780340874.122695:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340874.122720:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961213056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340874.122726:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121 00000100:00100000:0.0:1780340874.122781:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961213056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340874.122796:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961212928:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1780340874.122848:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340874.795166:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340874.795291:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940473856 00000100:00100000:1.0:1780340874.795311:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940473856 00000100:00100000:1.0:1780340874.795379:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1406 00000100:00100000:1.0:1780340874.795390:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2408:x1866818940473856:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000080:1.0:1780340874.795417:0:63712:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0348a6b480 x1866818940473856/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:300/0 lens 224/224 e 0 to 0 dl 1780340885 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340874.795474:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2408:x1866818940473856:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 87us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340874.795481:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1406 00000100:00100000:0.0:1780340874.795942:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340874.795972:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340874.795993:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340874.796015:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340874.796040:0:88672:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940473728 00000100:00100000:0.0:1780340874.796056:0:88672:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940473728 00000100:00100000:0.0:1780340874.796094:0:88672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 176 00000100:00100000:0.0:1780340874.796102:0:88672:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0443ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940473728:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340874.796141:0:88672:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0443ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940473728:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 40us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340874.796147:0:88672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 176 00000100:00100000:0.0:1780340874.796184:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940473984 00000100:00100000:0.0:1780340874.796187:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940473984 00000100:00100000:0.0:1780340874.796379:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1407 00000100:00100000:0.0:1780340874.796387:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+19:2408:x1866818940473984:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340874.796420:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+19:2408:x1866818940473984:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 35us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340874.796426:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1407 00000100:00100000:1.0:1780340874.796535:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940474112 00000100:00100000:1.0:1780340874.796540:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940474112 00000100:00100000:1.0:1780340874.796578:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940474240 00000100:00100000:1.0:1780340874.796581:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940474240 00000100:00100000:1.0:1780340874.796601:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2616 00000100:00100000:1.0:1780340874.796607:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2408:x1866818940474112:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340874.796633:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2408:x1866818940474112:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 26us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340874.796639:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2616 00000100:00100000:1.0:1780340874.796650:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2617 00000100:00100000:1.0:1780340874.796656:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940474240:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340874.796679:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940474240:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340874.796685:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2617 00000100:00080000:3.0:1780340874.797281:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340874.797286:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340874.797530:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780340874.797535:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:2.0:1780340874.869152:0:89942:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1780340874.869204:0:89942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa24651432774f3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.869219:0:89942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa24651432774f3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774f46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.869245:0:89942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa24651432774f3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432774f46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.869252:0:89942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa24651432774f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432774f46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.869274:0:89942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1780340874.869280:0:89942:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1780340874.869308:0:89942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1780340874.869312:0:89942:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1780340874.869316:0:89942:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1780340874.869339:0:89942:0:(import.c:65:import_set_state_nolock()) ffff8c047b1f8800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1780340874.869432:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340874.869447:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa24651432774f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432774f46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340874.869455:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6200 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:0.0:1780340874.869459:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa24651432774f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432774f46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340874.869468:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa24651432774f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432774f46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340874.869475:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa24651432774f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432774f46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340874.869481:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1780340874.869483:0:7442:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1780340874.869486:0:7442:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1780340874.869504:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961213184:0@lo:39:umount.0 00010000:00010000:0.0:1780340874.869509:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa24651432774f3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432774f46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340874.869514:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780340874.869544:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa24651432774f3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432774f46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340874.869569:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04754c6200/0xa24651432774f3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432774f46 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340874.869579:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340874.869581:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1780340874.869581:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340874.869583:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340874.869682:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340874.869693:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a07ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961213312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340874.869722:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340874.869786:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961213184 00000100:00100000:3.0:1780340874.869792:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961213184 00000100:00100000:3.0:1780340874.869836:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:3.0:1780340874.869845:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1866818961213184:12345-0@lo:39:umount.0 00000020:00000080:3.0:1780340874.869868:0:70100:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774baa 00000100:00080000:3.0:1780340874.869883:0:70100:0:(import.c:65:import_set_state_nolock()) ffff8c04506d1800 : changing import state from FULL to CLOSED 00010000:00000080:3.0:1780340874.869906:0:70100:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0349339500 x1866818961213184/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:300/0 lens 224/224 e 0 to 0 dl 1780340885 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340874.869946:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3658:x1866818961213184:12345-0@lo:39:umount.0 Request processed in 103us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340874.869953:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000020:00000080:3.0:1780340874.869964:0:70100:0:(genops.c:906:class_export_put()) final put ffff8c04506d1000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1780340874.870002:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1780340874.870026:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c047b1f8800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1780340874.870035:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961213184:0@lo:39:umount.0 00000020:00000080:3.0:1780340874.870055:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04506d1000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1780340874.870096:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c04506d1800 for lustre-MDT0000 00000100:00080000:2.0:1780340874.870214:0:89942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1780340874.870217:0:89942:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1780340874.870220:0:89942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1780340874.871155:0:89942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6a00/0xa24651432774f4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774f54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.871168:0:89942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6a00/0xa24651432774f4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774f54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.871175:0:89942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6a00/0xa24651432774f4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432774f54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.871183:0:89942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c04754c6a00/0xa24651432774f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432774f54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.871200:0:89942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340874.871214:0:89942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0347785800/0xa24651432774aae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774ab5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.871221:0:89942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0347785800/0xa24651432774aae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774ab5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.871227:0:89942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0347785800/0xa24651432774aae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432774ab5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.871233:0:89942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c0347785800/0xa24651432774aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432774ab5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.871243:0:89942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780340874.871248:0:89942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432774a7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432774a84 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.871254:0:89942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432774a7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432774a84 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.871260:0:89942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432774a7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432774a84 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.871266:0:89942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432774a7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa24651432774a84 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.871276:0:89942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1780340874.871280:0:89942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722ae800/0xa2465143277499d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327749a4 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.871287:0:89942:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722ae800/0xa2465143277499d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327749a4 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.871296:0:89942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04722ae800/0xa2465143277499d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa246514327749a4 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.871303:0:89942:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c04722ae800/0xa2465143277499d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa246514327749a4 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340874.871311:0:89942:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:2.0:1780340874.871313:0:89942:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1780340874.871335:0:89942:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1780340874.871338:0:89942:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1780340874.871342:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1780340874.871347:0:89942:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1780340874.872176:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1780340874.872192:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04754c6a00/0xa24651432774f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432774f54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872201:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6a00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340874.872205:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c6a00/0xa24651432774f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432774f54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872213:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04754c6a00/0xa24651432774f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432774f54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340874.872220:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c6a00/0xa24651432774f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432774f54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340874.872226:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1780340874.872229:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1780340874.872231:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1780340874.872261:0:6504:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c04754c6a00/0xa24651432774f4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432774f54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872267:0:6504:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340874.872289:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04754c6a00/0xa24651432774f4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432774f54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872296:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04754c6a00/0xa24651432774f4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432774f54 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872309:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1780340874.872312:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0347785800/0xa24651432774aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432774ab5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872318:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0347785800 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340874.872326:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0347785800/0xa24651432774aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432774ab5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872333:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0347785800/0xa24651432774aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432774ab5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340874.872340:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0347785800/0xa24651432774aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432774ab5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340874.872345:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1780340874.872347:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1780340874.872348:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1780340874.872362:0:6504:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0347785800/0xa24651432774aae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432774ab5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872367:0:6504:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340874.872382:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0347785800/0xa24651432774aae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432774ab5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872389:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0347785800/0xa24651432774aae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432774ab5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872398:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780340874.872401:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432774a7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432774a84 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872407:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722aee00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340874.872409:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432774a7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa24651432774a84 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872415:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432774a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa24651432774a84 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340874.872428:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432774a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa24651432774a84 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340874.872433:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1780340874.872435:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1780340874.872437:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1780340874.872451:0:6504:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432774a7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432774a84 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872457:0:6504:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340874.872463:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432774a7d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432774a84 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872469:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04722aee00/0xa24651432774a7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa24651432774a84 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872478:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340874.872481:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04722ae800/0xa2465143277499d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa246514327749a4 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872486:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae800 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340874.872488:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04722ae800/0xa2465143277499d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa246514327749a4 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872495:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04722ae800/0xa2465143277499d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa246514327749a4 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340874.872501:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04722ae800/0xa2465143277499d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa246514327749a4 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340874.872517:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1780340874.872519:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1780340874.872520:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1780340874.872533:0:6504:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c04722ae800/0xa2465143277499d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327749a4 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872539:0:6504:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340874.872545:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04722ae800/0xa2465143277499d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327749a4 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872551:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04722ae800/0xa2465143277499d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa246514327749a4 expref: -99 pid: 88665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872571:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340874.872573:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340874.872575:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340874.872590:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961213824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340874.872644:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340874.872684:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340874.872690:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961213440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340874.872711:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340874.872736:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961213568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340874.872775:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340874.872791:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340874.872796:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047ac7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961213696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340874.872814:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340874.872843:0:25499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961213312 00000100:00100000:1.0:1780340874.872856:0:25499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961213312 00000004:00000080:2.0:1780340874.872874:0:89942:0:(mdt_handler.c:8186:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000100:00100000:1.0:1780340874.872894:0:25499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961213824 00000100:00100000:1.0:1780340874.872897:0:25499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961213824 00000100:00100000:1.0:1780340874.872913:0:25499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961213440 00000100:00100000:1.0:1780340874.872915:0:25499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961213440 00000100:00100000:1.0:1780340874.872926:0:25499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961213568 00000100:00100000:1.0:1780340874.872927:0:25499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961213568 00000100:00100000:1.0:1780340874.872937:0:25499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961213696 00000100:00100000:1.0:1780340874.872939:0:25499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961213696 00000100:00100000:1.0:1780340874.872950:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:1.0:1780340874.872957:0:25499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b991880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+27:3662:x1866818961213312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340874.872967:0:25499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340874.872979:0:25499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5a00/0xa24651432774f46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774f3f expref: 27 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.872992:0:25499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340874.873019:0:25499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b991880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+26:3662:x1866818961213312:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (3296us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340874.873026:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:1.0:1780340874.873040:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000020:00000080:2.0:1780340874.873043:0:89942:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000100:00100000:1.0:1780340874.873045:0:25499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04757c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+25:3661:x1866818961213824:12345-0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1780340874.873048:0:89942:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c046bae6800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1780340874.873052:0:25499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:2.0:1780340874.873053:0:89942:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c046bae2800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780340874.873057:0:89942:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c046bae0000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1780340874.873059:0:25499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04722af000/0xa246514327749a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa2465143277499d expref: 25 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1780340874.873063:0:89942:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c0345f1f800 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 192.168.203.16@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 115964117002 stale:0 00000020:00080000:2.0:1780340874.873068:0:89942:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8c0345f1f000 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 115964117000 stale:0 00000020:00080000:2.0:1780340874.873073:0:89942:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff8c0445ba19c0) has exports, disconnecting them 00000020:00080000:2.0:1780340874.873076:0:89942:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c046bae6800), last request at 1780340842 00000020:00000080:2.0:1780340874.873082:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774ba3 00000100:00080000:2.0:1780340874.873089:0:89942:0:(import.c:65:import_set_state_nolock()) ffff8c046bae6000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780340874.873104:0:89942:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c046bae6800): rc 0 00000020:00000080:2.0:1780340874.873107:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c046bae6800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1780340874.873114:0:89942:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c046bae2800), last request at 1780340873 00000020:00000080:2.0:1780340874.873124:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774b9c 00000100:00080000:2.0:1780340874.873128:0:89942:0:(import.c:65:import_set_state_nolock()) ffff8c046bae1800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780340874.873138:0:89942:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c046bae2800): rc 0 00000020:00000080:2.0:1780340874.873140:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c046bae2800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1780340874.873144:0:89942:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c046bae0000), last request at 1780340873 00010000:00010000:1.0:1780340874.873145:0:25499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:2.0:1780340874.873147:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774b95 00000100:00080000:2.0:1780340874.873151:0:89942:0:(import.c:65:import_set_state_nolock()) ffff8c046bae4000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780340874.873156:0:89942:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c046bae0000): rc 0 00000020:00000080:2.0:1780340874.873157:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c046bae0000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1780340874.873162:0:89942:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.203.16@tcp (ffff8c0345f1f800), last request at 1780340874 00000020:00000080:2.0:1780340874.873168:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327749ff 00000100:00100000:1.0:1780340874.873170:0:25499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04757c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+24:3661:x1866818961213824:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (527us total) trans 0 rc 0/0 00000020:00010000:2.0:1780340874.873176:0:89942:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c0345f1f800: total 3 00000100:00100000:1.0:1780340874.873176:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00080000:2.0:1780340874.873179:0:89942:0:(import.c:65:import_set_state_nolock()) ffff8c0445b42000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780340874.873209:0:89942:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.16@tcp (ffff8c0345f1f800): rc 0 00000020:00080000:2.0:1780340874.873212:0:89942:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c0345f1f000), last request at 1780340837 00000100:00100000:1.0:1780340874.873214:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000020:00000080:2.0:1780340874.873215:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327749f8 00000020:00010000:2.0:1780340874.873218:0:89942:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c0345f1f000: total 3 00000100:00080000:2.0:1780340874.873220:0:89942:0:(import.c:65:import_set_state_nolock()) ffff8c0445b44800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780340874.873225:0:89942:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0345f1f000): rc 0 00000100:00100000:1.0:1780340874.873226:0:25499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961213440:12345-0@lo:103:ldlm_bl.0 00000004:00000080:2.0:1780340874.873231:0:89942:0:(mdd_device.c:2374:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff992741827ae0 00010000:00010000:1.0:1780340874.873232:0:25499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340874.873240:0:25499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5000/0xa24651432774f54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774f4d expref: 23 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1780340874.873247:0:89942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00010000:00010000:1.0:1780340874.873248:0:25499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340874.873250:0:89942:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00100000:1.0:1780340874.873267:0:25499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3661:x1866818961213440:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340874.873273:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:1.0:1780340874.873285:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1780340874.873290:0:25499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:3659:x1866818961213568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340874.873296:0:25499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340874.873303:0:25499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04722ae000/0xa24651432774ab5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774aae expref: 21 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.873311:0:25499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340874.873331:0:25499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3659:x1866818961213568:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340874.873336:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:1.0:1780340874.873347:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:1.0:1780340874.873352:0:25499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:3659:x1866818961213696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340874.873358:0:25499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340874.873365:0:25499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453122400/0xa24651432774a84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774a7d expref: 19 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.873373:0:25499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340874.873388:0:25499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:3659:x1866818961213696:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340874.873399:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:1.0:1780340874.873441:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047ac7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961213696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340874.873448:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961213568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340874.873471:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961213440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340874.873477:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961213824:0@lo:103:ldlm_bl.0 00000020:00010000:1.0:1780340874.873487:0:6504:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c0345f1f800: total 3 00010000:00010000:1.0:1780340874.873518:0:6504:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c0345f1f800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1780340874.873542:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa246514327750b9 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2582 expref: 5 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.873578:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa2465143277509d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced257b expref: 4 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.873594:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775184 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25ba expref: 3 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.873606:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6600/0xa246514327750f8 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2597 expref: 2 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340874.873618:0:6504:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c0345f1f800, canceled 4 locks, left on hash table 0. 00000020:00010000:3.0:1780340874.873840:0:6505:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c0345f1f000: total 3 00010000:00010000:3.0:1780340874.873879:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c0345f1f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1780340874.873899:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122200/0xa24651432774bc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774bbf expref: 2 pid: 26074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340874.873922:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c0345f1f000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1780340874.874595:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340874.874663:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780340874.877735:0:89942:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1780340874.877784:0:89942:0:(import.c:65:import_set_state_nolock()) ffff8c044d438000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1780340874.877950:0:89942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1780340874.877954:0:89942:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969455 gen 3 00000004:00080000:2.0:1780340874.877970:0:89942:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:2.0:1780340874.878029:0:89942:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1780340874.878039:0:89942:0:(import.c:65:import_set_state_nolock()) ffff8c047570b000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1780340874.878059:0:89942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1780340874.878061:0:89942:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 3 00000004:00080000:2.0:1780340874.878069:0:89942:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00080000:2.0:1780340874.878124:0:89942:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1780340874.878132:0:89942:0:(import.c:65:import_set_state_nolock()) ffff8c046b90b800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1780340874.879298:0:89942:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8c0445ba19c0) has no exports 00010000:00010000:2.0:1780340874.879816:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340874.879860:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a07ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961213312:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1780340874.881528:0:89942:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8c0445ba19c0) has no exports 00000020:00000080:0.0:1780340874.882279:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046bae6800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1780340874.882336:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046bae2800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1780340874.882356:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046bae0000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1780340874.882373:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c046bae6000 for lustre-MDT0000 00000020:00000080:0.0:1780340874.882376:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c046bae1800 for lustre-MDT0000 00000020:00000080:0.0:1780340874.882379:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c046bae4000 for lustre-MDT0000 00000100:00100000:0.0:1780340874.895952:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961213952:0@lo:39:umount.0 00000100:00100000:0.0:1780340874.896024:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340874.896059:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961214080:0@lo:9:umount.0 00000100:00100000:0.0:1780340874.896082:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340874.896100:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961214208:0@lo:9:umount.0 00000100:00100000:0.0:1780340874.896119:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340874.896160:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961213952 00000100:00100000:0.0:1780340874.896178:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961213952 00000100:00100000:0.0:1780340874.896225:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3947 00000100:00100000:0.0:1780340874.896233:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818961213952:12345-0@lo:39:umount.0 00000020:00000080:0.0:1780340874.896263:0:22660:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774a37 00000100:00080000:0.0:1780340874.896271:0:22660:0:(import.c:65:import_set_state_nolock()) ffff8c0442c0f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1780340874.896305:0:22660:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378768 00000100:00100000:0.0:1780340874.896460:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3658:x1866818961213952:12345-0@lo:39:umount.0 Request processed in 227us (435us total) trans 81604378769 rc 0/0 00000100:00100000:0.0:1780340874.896467:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3947 00010000:00010000:0.0:1780340874.896488:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1780340874.896518:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c044d438000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1780340874.896524:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961213952:0@lo:39:umount.0 00000100:00100000:0.0:1780340874.898851:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961214080 00000100:00100000:0.0:1780340874.898866:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961214080 00000100:00100000:0.0:1780340874.898930:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961214208 00000100:00100000:0.0:1780340874.898934:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961214208 00000100:00100000:0.0:1780340874.898959:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5923 00000100:00100000:0.0:1780340874.898968:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818961214080:12345-0@lo:9:umount.0 00000020:00000080:0.0:1780340874.898997:0:25490:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774a4c 00000100:00080000:0.0:1780340874.899005:0:25490:0:(import.c:65:import_set_state_nolock()) ffff8c0458281800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1780340874.899049:0:25490:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969456 00000100:00100000:0.0:1780340874.899281:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2:3658:x1866818961214080:12345-0@lo:9:umount.0 Request processed in 313us (3196us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340874.899289:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5923 00000100:00100000:0.0:1780340874.899303:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5924 00000100:00100000:0.0:1780340874.899309:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818961214208:12345-0@lo:9:umount.0 00000020:00000080:0.0:1780340874.899320:0:25490:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774a68 00000100:00080000:0.0:1780340874.899325:0:25490:0:(import.c:65:import_set_state_nolock()) ffff8c0475492000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1780340874.899409:0:25490:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969456 00000100:00100000:0.0:1780340874.899553:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2:3658:x1866818961214208:12345-0@lo:9:umount.0 Request processed in 244us (3432us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340874.899569:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5924 00010000:00010000:0.0:1780340874.899607:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340874.899613:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1780340874.899647:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c047570b000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1780340874.899658:0:3658:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:0.0:1780340874.899660:0:3658:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:0.0:1780340874.899663:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961214080:0@lo:9:umount.0 00000100:00080000:0.0:1780340874.899674:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c046b90b800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1780340874.899681:0:3658:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000004:00080000:0.0:1780340874.899682:0:3658:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:0.0:1780340874.899684:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961214208:0@lo:9:umount.0 00000020:00000080:1.0:1780340874.933506:0:6504:0:(genops.c:906:class_export_put()) final put ffff8c0345f1f800/7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000020:00000080:0.0:1780340874.933640:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0345f1f800/7d14eb83-fa7c-40d9-843e-6367bec0a7b4 for lustre-MDT0000 00000020:00000080:0.0:1780340874.933700:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0445b42000 for lustre-MDT0000 00010000:00010000:0.0:1780340874.933711:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340874.933714:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340874.933716:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1780340874.939407:0:6505:0:(genops.c:906:class_export_put()) final put ffff8c0345f1f000/lustre-MDT0001-mdtlov_UUID 00010000:00010000:3.0:1780340874.942603:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340874.942609:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340874.942611:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1780340874.945280:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0345f1f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1780340874.945858:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0445b44800 for lustre-MDT0000 00000020:00000080:2.0:1780340874.972147:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774a14 00000020:00000080:2.0:1780340874.972160:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c0475fac000/lustre-QMT0000_UUID 00000020:01000000:2.0:1780340874.972250:0:89942:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1780340874.972315:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0475fac000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1780340874.972371:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340874.972391:0:89942:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1780340874.972396:0:89942:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff8c047658cd40) has no exports 00000020:00000080:1.0:1780340874.972916:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774a0d 00000020:00000080:1.0:1780340874.972922:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c044d43a800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1780340874.972977:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c044d43a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780340874.973036:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340874.973044:0:89942:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1780340874.973047:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c044d43a000/lustre-QMT0000_UUID 00000020:00000080:1.0:1780340874.973049:0:89942:0:(genops.c:865:class_export_destroy()) destroying export ffff8c044d43a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1780340874.973056:0:89942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1780340874.973267:0:89942:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c047a94d8a0 - data ffff8c044d100288/ffff8c046b9d1c00 00000020:01000000:1.0:1780340874.973391:0:89942:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c044418bea0 - data ffff8c044d0b3360/ffff8c0476ed5800 00000100:00080000:2.0:1780340875.049303:0:89942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1780340875.049312:0:89942:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1780340875.049338:0:89942:0:(client.c:3140:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8c034cc8f100 x1866818961213952/t81604378769(81604378769) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340884 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340875.049369:0:89942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1780340875.053629:0:89942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1780340875.053636:0:89942:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969455 gen 4 00000004:00080000:2.0:1780340875.053656:0:89942:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780340875.053658:0:89942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1780340875.054243:0:88683:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1780340875.054248:0:88683:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6c:0x0] index 1 count 1 00000040:00080000:0.0:1780340875.054260:0:88683:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 27 count 2 00000100:00080000:2.0:1780340875.054729:0:89942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1780340875.054733:0:89942:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 4 00000004:00080000:2.0:1780340875.054751:0:89942:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780340875.054753:0:89942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1780340875.055909:0:88685:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1780340875.055914:0:88685:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6e:0x0] index 1 count 1 00000040:00080000:0.0:1780340875.055924:0:88685:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 27 count 2 00000020:00000080:2.0:1780340875.057418:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327749c7 00000020:00000080:2.0:1780340875.057428:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c047a0a0800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1780340875.058013:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327749dc 00000020:00000080:2.0:1780340875.058020:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c0346fd0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780340875.058025:0:89942:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1780340875.058043:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780340875.058052:0:89942:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1780340875.058056:0:89942:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8c047ac74d40) has no exports 00000004:01000000:2.0:1780340875.058557:0:89942:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1780340875.058576:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774a61 00000020:00000080:2.0:1780340875.058580:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c045f0c6000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780340875.058585:0:89942:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1780340875.058590:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780340875.058595:0:89942:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1780340875.058598:0:89942:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8c0445ba3380) has no exports 00000020:00000080:2.0:1780340875.058604:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774a5a 00000020:00000080:2.0:1780340875.058607:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c045f0c0800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1780340875.058996:0:89942:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1780340875.059002:0:89942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1780340875.059005:0:89942:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969454 gen 5 00000004:00080000:2.0:1780340875.059011:0:89942:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780340875.059013:0:89942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780340875.059045:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780340875.059051:0:89942:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1780340875.059057:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774a45 00000020:00000080:2.0:1780340875.059062:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c045f0c4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340875.059167:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047a0a0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780340875.059176:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0346fd0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1780340875.059181:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045f0c6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1780340875.059185:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045f0c0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780340875.059189:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c046b90b800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1780340875.059194:0:80497:0:(genops.c:906:class_export_put()) final put ffff8c045f0c6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340875.059218:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045f0c6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1780340875.059222:0:80497:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1780340875.059727:0:89942:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1780340875.059733:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780340875.059738:0:89942:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1780340875.059742:0:89942:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8c047ac70000) has no exports 00000020:00000080:2.0:1780340875.059747:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774a3e 00000020:00000080:2.0:1780340875.059751:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c047570d000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1780340875.060527:0:89942:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1780340875.060532:0:89942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1780340875.060535:0:89942:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969455 gen 5 00000004:00080000:2.0:1780340875.060541:0:89942:0:(osp_dev.c:1627:osp_import_event()) got inactive 00000100:00100000:2.0:1780340875.060543:0:89942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780340875.060593:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780340875.060601:0:89942:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1780340875.060612:0:89942:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1780340875.060617:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774a29 00000020:00000080:2.0:1780340875.060622:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c047570d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1780340875.060626:0:89942:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1780340875.060630:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780340875.060633:0:89942:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1780340875.060636:0:89942:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8c0476588000) has no exports 00000020:00000080:2.0:1780340875.060640:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774a22 00000020:00000080:2.0:1780340875.060643:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c044d43f000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1780340875.065333:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045f0c4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1780340875.065347:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047570d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780340875.065354:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047570b000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1780340875.065362:0:80497:0:(genops.c:906:class_export_put()) final put ffff8c0475708800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340875.065364:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0475708800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1780340875.065369:0:80497:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340875.065451:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047570d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1780340875.065456:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c044d43f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1780340875.073315:0:89942:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1780340875.073324:0:89942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1780340875.073342:0:89942:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1780340875.073349:0:89942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1780340875.073409:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340875.073421:0:89942:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340875.073446:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340875.073449:0:89942:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340875.073455:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c0475496000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1780340875.073459:0:89942:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0475496000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1780340875.073468:0:89942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340875.073581:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327749e3 00000020:00000080:0.0:1780340875.073588:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c0346fd5800/lustre-MDD0000_UUID 00000020:01000000:0.0:1780340875.073593:0:89942:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1780340875.073597:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780340875.073602:0:89942:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1780340875.073605:0:89942:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8c0445ba0000) has no exports 00000020:00000080:0.0:1780340875.073625:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340875.073628:0:89942:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1780340875.073644:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327749ea 00000020:00000080:0.0:1780340875.073648:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c0346fd1800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1780340875.073655:0:89942:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0471e4b800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1780340875.073658:0:89942:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c0471e4b800 3 00000020:01000004:0.0:1780340875.073661:0:89942:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c0471e4b800 from lustre-MDT0000 00000020:00000080:0.0:1780340875.073680:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340875.073683:0:89942:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1780340875.073685:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c0475491800/lustre-MDT0000_UUID 00000020:00000080:0.0:1780340875.073688:0:89942:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0475491800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1780340875.073693:0:89942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1780340875.073721:0:89942:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1780340875.073724:0:89942:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1780340875.073726:0:89942:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1780340875.073729:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780340875.073732:0:89942:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1780340875.073739:0:89942:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8c0452441800 540506f4-4e8e-4fb6-b537-f45d44291964 192.168.203.16@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1780340875.073746:0:89942:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8c047651e800 f26f7947-2bb0-4491-8dd4-005fa8e64f3a 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1780340875.073750:0:89942:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8c0445ba4d40) has exports, disconnecting them 00000020:00080000:0.0:1780340875.073754:0:89942:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.203.16@tcp (ffff8c0452441800), last request at 1780340838 00000020:00000080:0.0:1780340875.073791:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774b72 00000020:00010000:0.0:1780340875.073795:0:89942:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c0452441800: total 2 00000100:00080000:0.0:1780340875.073799:0:89942:0:(import.c:65:import_set_state_nolock()) ffff8c0452443000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1780340875.073810:0:89942:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.16@tcp (ffff8c0452441800): rc 0 00000020:00080000:0.0:1780340875.073813:0:89942:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8c047651e800), last request at 1780340837 00000020:00010000:0.0:1780340875.073855:0:23160:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c0452441800: total 2 00010000:00010000:0.0:1780340875.073859:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340875.073880:0:23160:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c0452441800, canceled 0 locks, left on hash table 4. 00010000:00010000:0.0:1780340875.073906:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453123000/0xa24651432774fc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2551 expref: 5 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340875.073931:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453122c00/0xa24651432774fbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced254a expref: 4 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340875.073942:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f8200/0xa24651432774b79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24da expref: 3 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340875.073952:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f9400/0xa24651432774b87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced24e8 expref: 2 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340875.073960:0:23160:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c0452441800, canceled 4 locks, left on hash table 0. 00000020:00000080:0.0:1780340875.073977:0:23160:0:(genops.c:906:class_export_put()) final put ffff8c0452441800/540506f4-4e8e-4fb6-b537-f45d44291964 00010000:00010000:0.0:1780340875.073981:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340875.073983:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340875.073985:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1780340875.073995:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277498f 00000020:00010000:0.0:1780340875.073998:0:89942:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c047651e800: total 3 00000100:00080000:0.0:1780340875.074001:0:89942:0:(import.c:65:import_set_state_nolock()) ffff8c047651f800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1780340875.074009:0:89942:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c047651e800): rc 0 00000020:00080000:0.0:1780340875.074012:0:89942:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8c0445ba4d40) has no exports 00000020:00010000:0.0:1780340875.074018:0:7442:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c047651e800: total 3 00010000:00010000:0.0:1780340875.074034:0:7442:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c047651e800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1780340875.074048:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f9000/0xa24651432774f62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774f5b expref: 14 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340875.074059:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c045ec6d000/0xa24651432774afb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774af4 expref: 13 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1780340875.074167:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c044d438000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1780340875.074174:0:80497:0:(genops.c:906:class_export_put()) final put ffff8c047b435000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1780340875.074176:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047b435000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1780340875.074185:0:80497:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780340875.074249:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0346fd5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1780340875.074253:0:80497:0:(genops.c:906:class_export_put()) final put ffff8c046b908800/lustre-MDD0000_UUID 00000020:00000080:1.0:1780340875.074255:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b908800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1780340875.074259:0:80497:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1780340875.074284:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0346fd1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1780340875.074288:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0452441800/540506f4-4e8e-4fb6-b537-f45d44291964 for MGS 00000020:00000080:1.0:1780340875.074313:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0452443000 for MGS 00000100:00100000:1.0:1780340875.074391:0:88672:0:(service.c:3186:ptlrpc_main()) ll_mgs_0001: service thread [ffff8c045ee68200:88672] 1 exiting: rc = 0 00000100:00100000:1.0:1780340875.074476:0:88671:0:(service.c:3186:ptlrpc_main()) ll_mgs_0000: service thread [ffff8c047575e600:88671] 0 exiting: rc = 1 00000100:00100000:1.0:1780340875.074533:0:88673:0:(service.c:3186:ptlrpc_main()) ll_mgs_0002: service thread [ffff8c045ee68600:88673] 2 exiting: rc = 0 00000100:00100000:1.0:1780340875.074595:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074603:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074610:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074617:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074621:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074635:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074640:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074645:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074650:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074656:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074661:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074666:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074671:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074675:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074680:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074686:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074691:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074697:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074703:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074708:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074714:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074718:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074723:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074727:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074732:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074737:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074742:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074748:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074754:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074775:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074782:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074788:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074793:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074799:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074804:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074810:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074815:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074821:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074826:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074831:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074843:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074849:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074854:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074859:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074865:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074871:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074876:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074882:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074887:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074892:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074897:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074904:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074909:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074915:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074920:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074925:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074931:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074937:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074944:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074950:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074956:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074961:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074967:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1780340875.074973:0:89942:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:1.0:1780340875.078358:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04754c6400/0xa24651432774f70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774f69 expref: 12 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340875.078382:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c045ec6c800/0xa24651432774b25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774b1e expref: 11 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340875.078393:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa4200/0xa24651432774f7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774f77 expref: 10 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340875.078403:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5800/0xa24651432774f8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774f85 expref: 9 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340875.078435:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5c00/0xa24651432774f9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774f93 expref: 8 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340875.078446:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04722af800/0xa24651432774ad1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774aca expref: 7 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340875.078458:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0347784a00/0xa24651432774b4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774b48 expref: 6 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340875.078468:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c045ec6c600/0xa24651432774b5d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774b56 expref: 5 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340875.078477:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04754c7600/0xa24651432774fb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774faf expref: 4 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340875.078487:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453123400/0xa24651432774aed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774ae6 expref: 3 pid: 88671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340875.078500:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04754c7800/0xa24651432774fa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432774fa1 expref: 2 pid: 88672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340875.078509:0:7442:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c047651e800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1780340875.078546:0:7442:0:(genops.c:906:class_export_put()) final put ffff8c047651e800/f26f7947-2bb0-4491-8dd4-005fa8e64f3a 00010000:00010000:1.0:1780340875.078576:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340875.078579:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340875.078581:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1780340875.078855:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047651e800/f26f7947-2bb0-4491-8dd4-005fa8e64f3a for MGS 00000020:00000080:0.0:1780340875.078889:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047651f800 for MGS 00000020:01000000:1.0:1780340875.082550:0:89942:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c04772e7e40 - data ffff8c044d1f3870/ffff8c047157dc00 00000020:01000000:1.0:1780340875.082701:0:89942:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c0347d8e1e0 - data ffff8c044d03e870/ffff8c045f0e9000 00000020:00000080:1.0:1780340875.083138:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774988 00000020:00000080:1.0:1780340875.083159:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c046b9ab000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1780340875.083183:0:89942:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0471e4b800 from MGS, refs=2 00000020:01000004:1.0:1780340875.083187:0:89942:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c0471e4b800 2 00000020:01000004:1.0:1780340875.083189:0:89942:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c0471e4b800 from MGS 00000020:00000080:1.0:1780340875.083400:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340875.083409:0:89942:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1780340875.083412:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c046b9a9000/MGS 00000020:00000080:1.0:1780340875.083416:0:89942:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b9a9000/MGS for MGS 00000020:01000000:1.0:1780340875.083423:0:89942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1780340875.083497:0:89942:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1780340875.083500:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1780340875.083507:0:89942:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1780340875.083513:0:89942:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8c045310e800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1780340875.083518:0:89942:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff8c03482b3380) has exports, disconnecting them 00000020:00080000:1.0:1780340875.083523:0:89942:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8c045310e800), last request at 1780340837 00000020:00000080:1.0:1780340875.083527:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774aa0 00000020:00080000:1.0:1780340875.083538:0:89942:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c045310e800): rc 0 00000020:00000080:1.0:1780340875.083543:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c045310e800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1780340875.085056:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b9ab000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780340875.085088:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c045310e800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1780340875.088832:0:89942:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1780340875.088841:0:89942:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1780340875.088845:0:89942:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1780340875.088851:0:89942:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1780340875.088884:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047b1f8800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1780340875.089017:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340875.089025:0:89942:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1780340875.089031:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c047a28b000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1780340875.089035:0:89942:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047a28b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1780340875.089040:0:89942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1780340875.089129:0:89942:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c0471e4b800 1 00000020:00000080:0.0:1780340875.089135:0:89942:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277497a 00000020:00000080:0.0:1780340875.089140:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c046b9a8000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1780340875.089149:0:89942:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1780340875.089156:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c046b9a8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1780340875.089176:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1780340875.089181:0:89942:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1780340875.089184:0:89942:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8c047658b380) has no exports 00010000:00010000:0.0:1780340875.146377:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1780340875.232157:0:89942:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1780340875.232170:0:89942:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1780340875.232176:0:89942:0:(genops.c:906:class_export_put()) final put ffff8c0471e4b000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1780340875.232181:0:89942:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0471e4b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1780340875.232192:0:89942:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1780340875.232311:0:89942:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8c0471e4e800 00000020:02000400:0.0:1780340875.232552:0:89942:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1780340876.169966:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340877.193981:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340878.218003:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340878.730404:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961214464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340878.730665:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340878.731131:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961214976:0@lo:400:kworker.0 00000100:00100000:2.0:1780340878.731161:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340878.731186:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961215488:0@lo:400:kworker.0 00000100:00100000:2.0:1780340878.731208:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340878.731226:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1780340878.731309:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961214592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340878.731399:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340878.731691:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961214336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340878.731725:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340878.731746:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961214848:0@lo:400:kworker.0 00000100:00100000:1.0:1780340878.731786:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340878.731803:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961215360:0@lo:400:kworker.0 00000100:00100000:1.0:1780340878.731820:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340878.731836:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1780340878.731842:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961214720:0@lo:400:kworker.0 00000400:00000100:1.0:1780340878.731859:0:3662:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961214720 offset 0 length 224: 4 00000100:00100000:1.0:1780340878.731878:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961215232:0@lo:400:kworker.0 00000100:00100000:1.0:1780340878.731910:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340878.731927:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961215744:0@lo:400:kworker.0 00000100:00100000:1.0:1780340878.731946:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340878.731982:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961214336 00000100:00100000:1.0:1780340878.731990:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961214336 00000100:00100000:1.0:1780340878.732020:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961215360 00000100:00100000:1.0:1780340878.732022:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961215360 00000100:00100000:1.0:1780340878.732038:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3948 00000100:00100000:1.0:1780340878.732045:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3662:x1866818961214336:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1780340878.732053:0:8411:0:(tgt_handler.c:804:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780340878.732088:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3662:x1866818961214336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 43us (363us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780340878.732096:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3948 00000100:00100000:1.0:1780340878.732109:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3949 00000100:00100000:1.0:1780340878.732113:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3662:x1866818961215360:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1780340878.732118:0:8411:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780340878.732137:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3662:x1866818961215360:12345-0@lo:400:kworker.0 Request processed in 22us (316us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780340878.732142:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3949 00000100:00100000:1.0:1780340878.732158:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961214976 00000100:00100000:1.0:1780340878.732161:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961214976 00000100:00100000:1.0:1780340878.732194:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961214848 00000100:00100000:1.0:1780340878.732197:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961214848 00000100:00100000:1.0:1780340878.732204:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961215232 00000100:00100000:1.0:1780340878.732206:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961215232 00000100:00100000:1.0:1780340878.732218:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961215744 00000100:00100000:1.0:1780340878.732236:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961215744 00000100:00100000:1.0:1780340878.732250:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:1.0:1780340878.732256:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961214976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340878.732299:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961214976:12345-0@lo:400:kworker.0 Request processed in 44us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340878.732306:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:1.0:1780340878.732330:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:1.0:1780340878.732336:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961215232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340878.732362:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961215232:12345-0@lo:400:kworker.0 Request processed in 27us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340878.732368:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:1.0:1780340878.732379:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:1.0:1780340878.732384:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3662:x1866818961214848:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1780340878.732388:0:63711:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780340878.732408:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3662:x1866818961214848:12345-0@lo:400:kworker.0 Request processed in 23us (621us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780340878.732413:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:1.0:1780340878.732422:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:1.0:1780340878.732779:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ac7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3662:x1866818961215744:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1780340878.732786:0:63711:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780340878.732814:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ac7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3662:x1866818961215744:12345-0@lo:400:kworker.0 Request processed in 386us (866us total) trans 0 rc -107/-107 00000100:00100000:1.0:1780340878.732821:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:1.0:1780340878.732872:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961215232:0@lo:400:kworker.0 00000100:00080000:1.0:1780340878.732884:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1780340878.732888:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1780340878.732892:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1780340878.732897:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340878.732907:0:3662:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3622 00000100:00080000:1.0:1780340878.732914:0:3662:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340878.732939:0:3662:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046b84d500 x1866818961215872/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340878.732961:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961215744:0@lo:400:kworker.0 00000100:02020000:1.0:1780340878.732974:0:3662:0:(client.c:1491:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:0.0:1780340878.734707:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961215872:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1780340878.734787:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340878.734985:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961215872 00000100:00100000:0.0:1780340878.734992:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961215872 00000100:00100000:0.0:1780340878.735026:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:0.0:1780340878.735032:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961215872:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:0.0:1780340878.735053:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340878.735094:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961215872:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 61us (307us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340878.735102:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00080000:0.0:1780340878.735136:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340878.735141:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340878.735144:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961215872:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1780340878.735195:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961215488 00000100:00100000:0.0:1780340878.735200:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961215488 00000100:00100000:0.0:1780340878.735388:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00100000:0.0:1780340878.735396:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961215488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340878.736652:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961215488:12345-0@lo:400:kworker.0 Request processed in 1253us (5437us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340878.736663:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00080000:0.0:1780340878.737094:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340878.737100:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340878.740237:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961215104:0@lo:400:kworker.0 00000100:00100000:2.0:1780340878.740295:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340878.741824:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961215104 00000100:00100000:2.0:1780340878.741841:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961215104 00000100:00100000:2.0:1780340878.741893:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:2.0:1780340878.741901:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1866818961215104:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1780340878.741909:0:63712:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1780340878.742049:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1866818961215104:12345-0@lo:400:kworker.0 Request processed in 147us (1753us total) trans 0 rc -107/-107 00000100:00100000:2.0:1780340878.742068:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00080000:2.0:1780340878.744111:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1780340878.744118:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1780340878.744123:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1780340878.744128:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340878.744132:0:3659:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3622 00000100:00080000:2.0:1780340878.744140:0:3659:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340878.745569:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034759fb80 x1866818961216000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340878.745611:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961215104:0@lo:400:kworker.0 00000100:00100000:2.0:1780340878.745630:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961216000:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1780340878.745701:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340878.745755:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961216000 00000100:00100000:2.0:1780340878.745779:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961216000 00000100:00100000:2.0:1780340878.745814:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:2.0:1780340878.745821:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961216000:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1780340878.745842:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340878.745884:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961216000:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 61us (181us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340878.745891:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00080000:2.0:1780340878.745926:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340878.745931:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340878.745934:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961216000:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1780340878.745976:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961215616:0@lo:400:kworker.0 00000100:00100000:2.0:1780340878.746005:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340878.746027:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961215616 00000100:00100000:2.0:1780340878.746031:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961215616 00000100:00100000:2.0:1780340878.746082:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:2.0:1780340878.746089:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961215616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340878.746124:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961215616:12345-0@lo:400:kworker.0 Request processed in 36us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340878.746130:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00080000:2.0:1780340878.746144:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340878.746308:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961214464 00000100:00100000:0.0:1780340878.746329:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961214592 00000100:00100000:0.0:1780340878.746335:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961214592 00000100:00100000:2.0:1780340878.746580:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961215616:0@lo:400:kworker.0 00000100:00100000:0.0:1780340878.746597:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2122 00000100:00100000:0.0:1780340878.746608:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961214592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340878.746640:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340878.746686:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961214592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (15286us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340878.746693:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2122 00000100:00100000:2.0:1780340878.746748:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961214976:0@lo:400:kworker.0 00000100:00100000:2.0:1780340878.746802:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961215488:0@lo:400:kworker.0 00000100:00100000:2.0:1780340878.746831:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961214592:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340878.746936:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961214464 00000100:00100000:3.0:1780340878.746974:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123 00000100:00100000:3.0:1780340878.746982:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961214464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340878.746999:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340878.747037:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961214464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (16372us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340878.747043:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123 00000100:00100000:0.0:1780340878.748854:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961214464:0@lo:13:osp-pre-1-1.0 00000001:00100000:2.0:1780340878.748977:0:72681:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1780340878.748988:0:72681:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378769 is committed 00000020:00000080:2.0:1780340878.748993:0:72681:0:(genops.c:906:class_export_put()) final put ffff8c0476518800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1780340878.749026:0:72681:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378768 is committed 00010000:00010000:2.0:1780340878.749070:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327751c3 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.749080:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327751c3 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.749088:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327751c3 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.749112:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340878.749117:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327751c3 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.749125:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327751c3 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.749141:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff8c04506cfd00) 00010000:00010000:2.0:1780340878.749144:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340878.749149:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327751c3 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.749156:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8e00/0xa246514327751c3 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.749179:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8c00/0xa246514327751d8 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.749185:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8c00/0xa246514327751d8 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.749192:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8c00/0xa246514327751d8 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.749197:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340878.749200:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8c00/0xa246514327751d8 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.749206:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8c00/0xa246514327751d8 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1780340878.749338:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1780340878.749343:0:9462:0:(genops.c:906:class_export_put()) final put ffff8c0445bcc000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1780340878.749351:0:9462:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969456 is committed 00000020:00000080:0.0:1780340878.749632:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0476518800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1780340878.749686:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0445bcc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1780340878.749706:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0442c0f800 for lustre-MDT0001 00000020:00000080:0.0:1780340878.749711:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0475492000 for lustre-OST0001 00010000:00010000:2.0:1780340878.750812:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff8c04506cf400) 00010000:00010000:2.0:1780340878.750819:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340878.750825:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8c00/0xa246514327751d8 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.750835:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8c00/0xa246514327751d8 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.750857:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa2465143277521e lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.750864:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa2465143277521e lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.750869:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa2465143277521e lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.750875:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340878.750878:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa2465143277521e lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.750884:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa2465143277521e lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.750892:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff8c04506cf300) 00010000:00010000:2.0:1780340878.750894:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340878.750896:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa2465143277521e lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.750902:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa2465143277521e lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.750939:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8800/0xa24651432775233 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.750945:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8800/0xa24651432775233 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.750950:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8800/0xa24651432775233 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.750955:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340878.750958:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8800/0xa24651432775233 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.750964:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8800/0xa24651432775233 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.750971:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff8c04506cf100) 00010000:00010000:2.0:1780340878.750974:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340878.750977:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8800/0xa24651432775233 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340878.750982:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8800/0xa24651432775233 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1780340878.756144:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1780340878.756152:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1780340878.756157:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1780340878.756164:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340878.756168:0:3662:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3622 00000100:00080000:1.0:1780340878.756176:0:3662:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340878.756229:0:3662:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046b84d500 x1866818961216128/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340878.756279:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1780340878.756282:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1780340878.756285:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1780340878.756288:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340878.756291:0:3662:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3622 00000100:00080000:1.0:1780340878.756294:0:3662:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340878.756304:0:3662:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c04467fc380 x1866818961216256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340878.756324:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961214848:0@lo:400:kworker.0 00000100:00080000:1.0:1780340878.756349:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1780340878.756352:0:3662:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8c034a39c800 already not connected (conn 75, was 74): CONNECTING 00000100:00100000:1.0:1780340878.756357:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961215360:0@lo:400:kworker.0 00000100:00100000:0.0:1780340878.757227:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961216128:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1780340878.757289:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340878.757324:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961216256:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1780340878.757344:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340878.757506:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961216256 00000100:00100000:2.0:1780340878.757512:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961216256 00000100:00100000:2.0:1780340878.757553:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:2.0:1780340878.757560:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961216256:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1780340878.757581:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340878.757622:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961216256:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 62us (277us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340878.757637:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00080000:2.0:1780340878.757667:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340878.757671:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340878.757674:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961216256:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1780340878.757965:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961216128 00000100:00100000:1.0:1780340878.757970:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961216128 00000100:00100000:1.0:1780340878.757989:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3950 00000100:00100000:1.0:1780340878.757994:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961216128:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1780340878.758005:0:8411:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340878.758037:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961216128:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 42us (748us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340878.758042:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3950 00000100:00080000:1.0:1780340878.758062:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340878.758066:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1780340878.758068:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961216128:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1780340879.242264:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340879.911722:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340879.911804:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000400:00000100:1.0:1780340879.911822:0:3654:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940474368 offset 0 length 224: 4 00000100:00100000:1.0:1780340879.911840:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340879.911884:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340879.911958:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940474496 00000100:00100000:0.0:1780340879.911964:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940474752 00000100:00100000:3.0:1780340879.911969:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940474496 00000100:00100000:0.0:1780340879.911970:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940474752 00000100:00100000:3.0:1780340879.912009:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940474624 00000100:00100000:3.0:1780340879.912012:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940474624 00000100:00100000:0.0:1780340879.912035:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940474880 00000100:00100000:0.0:1780340879.912040:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940474880 00000100:00100000:3.0:1780340879.912047:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1410 00000100:00100000:3.0:1780340879.912060:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2407:x1866818940474624:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340879.912073:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2620 00000100:00100000:0.0:1780340879.912083:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940474752:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340879.912138:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2407:x1866818940474624:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 82us (295us total) trans 0 rc 0/0 00000100:00080000:1.0:1780340879.912143:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340879.912148:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1410 00000100:00080000:1.0:1780340879.912149:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780340879.912152:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340879.912186:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1412 00000100:00100000:1.0:1780340879.912187:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2621 00000100:00100000:3.0:1780340879.912194:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2407:x1866818940474496:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340879.912201:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04776c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940474880:12345-192.168.203.16@tcp:400:kworker.0 00000020:00080000:3.0:1780340879.912202:0:63711:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.16@tcp 00000100:00100000:0.0:1780340879.921143:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940474752:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 9050us (9326us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340879.921157:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2620 00000100:00100000:3.0:1780340879.924286:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2407:x1866818940474496:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 12082us (12564us total) trans 0 rc -107/-107 00000100:00100000:3.0:1780340879.924421:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1412 00000100:00100000:0.0:1780340879.928288:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340879.928607:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940475008 00000100:00100000:2.0:1780340879.928618:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940475008 00000100:00100000:2.0:1780340879.928666:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1413 00000100:00100000:2.0:1780340879.928677:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940475008:12345-192.168.203.16@tcp:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1780340879.928700:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340879.928790:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940475008:12345-192.168.203.16@tcp:38:ptlrpcd_00_00.0 Request processed in 116us (511us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340879.928798:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1413 00000100:00100000:1.0:1780340879.934718:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04776c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940474880:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 22510us (22821us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340879.934733:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2621 00010000:00010000:2.0:1780340880.265914:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1780340880.784580:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1780340880.784590:0:8395:0:(genops.c:906:class_export_put()) final put ffff8c0458285800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1780340880.799467:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0458285800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1780340880.799553:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0458281800 for lustre-OST0000 00010000:00010000:0.0:1780340881.289921:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340882.314639:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340883.337918:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780340883.850308:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340883.850315:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340883.850319:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340883.850328:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3658 00000100:00080000:2.0:1780340883.850334:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780340883.850341:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340883.850364:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034759fb80 x1866818961216640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340883.850402:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340883.850418:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340883.850419:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340883.850423:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3658 00000100:00080000:2.0:1780340883.850426:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780340883.850429:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340883.850441:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d877100 x1866818961216896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340883.850455:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340883.850457:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340883.850459:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340883.850462:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3658 00000100:00080000:2.0:1780340883.850465:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780340883.850468:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340883.850480:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d874700 x1866818961217152/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340883.850508:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340883.850511:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340883.850512:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340883.850515:0:71335:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3658 00000100:00080000:2.0:1780340883.850518:0:71335:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780340883.850521:0:71335:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340883.850535:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034cc8e680 x1866818961217536/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340883.850561:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961216768:0@lo:400:kworker.0 00000100:00100000:2.0:1780340883.850632:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340883.850670:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1780340883.850688:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961216512:0@lo:400:kworker.0 00000400:00000100:2.0:1780340883.850709:0:3660:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961216512 offset 0 length 224: 4 00000100:00100000:2.0:1780340883.850731:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961217408:0@lo:400:kworker.0 00000100:00100000:2.0:1780340883.850780:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340883.850809:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034759fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961216640:0@lo:38:kworker.0 00000100:00100000:2.0:1780340883.850832:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340883.850851:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961216896:0@lo:38:kworker.0 00000100:00100000:2.0:1780340883.850871:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340883.850885:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961217152:0@lo:38:kworker.0 00000100:00100000:2.0:1780340883.850906:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340883.850932:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961217536:0@lo:38:kworker.0 00000100:00100000:2.0:1780340883.850951:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340883.850982:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961216768 00000100:00100000:2.0:1780340883.850989:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961216768 00000100:00100000:2.0:1780340883.851032:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961216640 00000100:00100000:2.0:1780340883.851035:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961216640 00000100:00100000:2.0:1780340883.851044:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961216896 00000100:00100000:2.0:1780340883.851046:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961216896 00000100:00100000:2.0:1780340883.851053:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961217536 00000100:00100000:2.0:1780340883.851056:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961217536 00000100:00100000:2.0:1780340883.851066:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:2.0:1780340883.851074:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961216768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340883.851124:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961216768:12345-0@lo:400:kworker.0 Request processed in 51us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340883.851141:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:2.0:1780340883.851157:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:2.0:1780340883.851161:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961216640:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340883.851179:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340883.851209:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961216640:12345-0@lo:38:kworker.0 Request processed in 46us (376us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340883.851215:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:2.0:1780340883.851227:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:2.0:1780340883.851231:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961216896:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340883.851239:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340883.851259:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961216896:12345-0@lo:38:kworker.0 Request processed in 27us (388us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340883.851265:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:2.0:1780340883.851273:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:2.0:1780340883.851277:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961217536:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340883.851285:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340883.851302:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1866818961217536:12345-0@lo:38:kworker.0 Request processed in 24us (350us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340883.851307:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00080000:2.0:1780340883.851341:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340883.851346:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340883.851349:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961216640:0@lo:38:kworker.0 00000100:00080000:2.0:1780340883.851358:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340883.851361:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340883.851370:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961216896:0@lo:38:kworker.0 00000100:00080000:2.0:1780340883.851380:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340883.851383:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340883.851385:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961217536:0@lo:38:kworker.0 00000100:00100000:2.0:1780340883.851427:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961216768:0@lo:400:kworker.0 00000100:00100000:1.0:1780340883.851944:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961216384:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340883.851983:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340883.852008:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961217280:0@lo:400:kworker.0 00000100:00100000:1.0:1780340883.852029:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340883.852049:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340883.852055:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961217024:0@lo:400:kworker.0 00000100:00100000:1.0:1780340883.852076:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780340883.852104:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340883.852116:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961216384 00000100:00100000:1.0:1780340883.852120:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961216384 00000100:00100000:1.0:1780340883.852164:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124 00000100:00100000:1.0:1780340883.852172:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961216384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780340883.852198:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780340883.852236:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961216384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340883.852242:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124 00000100:00080000:1.0:1780340883.852258:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340883.852281:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961216384:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340883.852300:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961217024 00000100:00100000:1.0:1780340883.852303:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961217024 00000100:00100000:1.0:1780340883.852335:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:1.0:1780340883.852342:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961217024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340883.852532:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961217408 00000100:00100000:3.0:1780340883.852536:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961217408 00000100:00100000:3.0:1780340883.852564:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961217280 00000100:00100000:3.0:1780340883.852567:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961217280 00000100:00100000:3.0:1780340883.852585:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622 00000100:00100000:3.0:1780340883.852591:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961217408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340883.852626:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961217408:12345-0@lo:400:kworker.0 Request processed in 36us (1867us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340883.852632:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622 00000100:00100000:3.0:1780340883.852645:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623 00000100:00100000:3.0:1780340883.852651:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961217280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340883.852729:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961217664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340883.852776:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340883.852803:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961217408:0@lo:400:kworker.0 00000100:00100000:2.0:1780340883.852936:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961217664 00000100:00100000:2.0:1780340883.852940:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961217664 00000100:00100000:2.0:1780340883.852968:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125 00000100:00100000:2.0:1780340883.852975:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961217664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340883.852991:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340883.853024:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961217664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340883.853031:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125 00000100:00100000:2.0:1780340883.853058:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961217664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340883.853244:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961217024:12345-0@lo:400:kworker.0 Request processed in 901us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340883.853252:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00080000:1.0:1780340883.853269:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340883.853272:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340883.853518:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961217152 00000100:00100000:0.0:1780340883.853523:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961217152 00000100:00100000:0.0:1780340883.853558:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3951 00000100:00100000:0.0:1780340883.853564:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961217152:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340883.853582:0:22660:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340883.853623:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961217152:12345-0@lo:38:kworker.0 Request processed in 59us (2716us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340883.853629:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3951 00000100:00080000:0.0:1780340883.853666:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340883.853672:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340883.853686:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d874700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961217152:0@lo:38:kworker.0 00000100:00100000:3.0:1780340883.861259:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961217280:12345-0@lo:400:kworker.0 Request processed in 8595us (9216us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340883.861273:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623 00000100:00100000:1.0:1780340883.861522:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961217024:0@lo:400:kworker.0 00000100:00100000:1.0:1780340883.861547:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961217280:0@lo:400:kworker.0 00010000:00010000:1.0:1780340884.362075:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340885.040858:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000400:00000100:0.0:1780340885.040896:0:3653:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940475136 offset 0 length 224: 4 00000100:00100000:0.0:1780340885.040917:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340885.040920:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940475392 00000100:00100000:1.0:1780340885.040931:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940475392 00000100:00100000:0.0:1780340885.040952:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340885.040978:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340885.040999:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940475264 00000100:00100000:1.0:1780340885.041004:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940475264 00000100:00080000:0.0:1780340885.041012:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340885.041028:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1413 00000100:00100000:0.0:1780340885.041036:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940475648 00000100:00100000:1.0:1780340885.041041:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2408:x1866818940475392:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340885.041042:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940475648 00000100:00100000:0.0:1780340885.041078:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940475520 00000100:00100000:0.0:1780340885.041082:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940475520 00000100:00100000:0.0:1780340885.041105:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2624 00000100:00100000:0.0:1780340885.041112:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2408:x1866818940475648:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340885.041220:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2408:x1866818940475392:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 178us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340885.041220:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2408:x1866818940475648:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 103us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340885.041237:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2624 00000100:00100000:1.0:1780340885.041240:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1413 00000100:00100000:1.0:1780340885.041263:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1417 00000100:00100000:1.0:1780340885.041270:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940475264:12345-192.168.203.16@tcp:38:kworker.0 00000100:00100000:0.0:1780340885.041274:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5925 00010000:00020000:1.0:1780340885.041293:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340885.041299:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2406:x1866818940475520:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:0.0:1780340885.041319:0:8830:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432774be9 00000100:00100000:1.0:1780340885.041324:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940475264:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 51us (370us total) trans 0 rc -19/-19 00000100:00080000:0.0:1780340885.041330:0:8830:0:(import.c:65:import_set_state_nolock()) ffff8c047570a000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1780340885.041331:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1417 00000001:00000004:0.0:1780340885.041374:0:8830:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969456 00000100:00080000:1.0:1780340885.041473:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780340885.041476:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1780340885.042528:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340885.042692:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+2:2406:x1866818940475520:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 1393us (1708us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340885.042703:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5925 00010000:00010000:0.0:1780340885.385988:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340886.410509:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340887.433905:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340888.464240:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340888.978611:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961217792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340888.978678:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340888.978742:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961217792 00000100:00100000:0.0:1780340888.978749:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961217792 00000100:00100000:0.0:1780340888.978813:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2126 00000100:00100000:0.0:1780340888.978821:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961217792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340888.978846:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340888.978884:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961217792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340888.978891:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2126 00000100:00080000:0.0:1780340888.978909:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340888.978937:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961217792:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1780340888.986933:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340888.986938:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340888.986943:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340888.986949:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3663 00000100:00080000:0.0:1780340888.986955:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780340888.986961:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340888.986980:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03476f1500 x1866818961218176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340888.987022:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340888.987025:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340888.987027:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340888.987031:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3663 00000100:00080000:0.0:1780340888.987033:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780340888.987037:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340888.987050:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0485a1b100 x1866818961218432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340888.987065:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340888.987067:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340888.987069:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340888.987072:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3663 00000100:00080000:0.0:1780340888.987075:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780340888.987078:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340888.987089:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0485a19880 x1866818961218688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340888.987102:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340888.987105:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340888.987106:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340888.987110:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3663 00000100:00080000:0.0:1780340888.987113:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1780340888.987116:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340888.987126:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0485a18700 x1866818961218944/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340888.987172:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961217920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340888.987232:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340888.987263:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961218816:0@lo:400:kworker.0 00000100:00100000:0.0:1780340888.987287:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340888.987312:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340888.987318:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961218560:0@lo:400:kworker.0 00000100:00100000:0.0:1780340888.987341:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340888.987369:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961218048:0@lo:400:kworker.0 00000400:00000100:0.0:1780340888.987387:0:3659:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961218048 offset 0 length 224: 4 00000100:00100000:0.0:1780340888.987411:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340888.987416:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961218304:0@lo:400:kworker.0 00000100:00100000:0.0:1780340888.987439:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340888.987481:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961218176:0@lo:38:kworker.0 00000100:00100000:0.0:1780340888.987817:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340888.987840:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961218432:0@lo:38:kworker.0 00000100:00100000:0.0:1780340888.987864:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340888.987882:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961218688:0@lo:38:kworker.0 00000100:00100000:0.0:1780340888.987904:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340888.987919:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961218944:0@lo:38:kworker.0 00000100:00100000:0.0:1780340888.987940:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340888.987970:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961217920 00000100:00100000:0.0:1780340888.987978:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961217920 00000100:00100000:0.0:1780340888.988026:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2127 00000100:00100000:0.0:1780340888.988036:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961217920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340888.988069:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340888.988111:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961217920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340888.988118:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2127 00000100:00100000:0.0:1780340888.988142:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961218816 00000100:00100000:0.0:1780340888.988146:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961218816 00000100:00100000:0.0:1780340888.988168:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2625 00000100:00100000:0.0:1780340888.988174:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961218816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340888.988203:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961218816:12345-0@lo:400:kworker.0 Request processed in 29us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340888.988209:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2625 00000100:00100000:0.0:1780340888.988228:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961218560 00000100:00100000:0.0:1780340888.988231:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961218560 00000100:00100000:0.0:1780340888.988250:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961218304 00000100:00100000:0.0:1780340888.988253:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961218304 00000100:00100000:0.0:1780340888.988267:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961218176 00000100:00100000:0.0:1780340888.988270:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961218176 00000100:00100000:0.0:1780340888.988280:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961218432 00000100:00100000:0.0:1780340888.988282:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961218432 00000100:00100000:0.0:1780340888.988289:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961218944 00000100:00100000:0.0:1780340888.988292:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961218944 00000100:00100000:0.0:1780340888.988301:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:0.0:1780340888.988308:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961218560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340888.988336:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961218560:12345-0@lo:400:kworker.0 Request processed in 29us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340888.988342:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:0.0:1780340888.988353:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:0.0:1780340888.988359:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961218304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340888.988399:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961218304:12345-0@lo:400:kworker.0 Request processed in 40us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340888.988405:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:0.0:1780340888.988418:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:0.0:1780340888.988422:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961218176:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340888.988437:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340888.988477:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961218176:12345-0@lo:38:kworker.0 Request processed in 53us (971us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340888.988483:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:0.0:1780340888.988495:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:0.0:1780340888.988499:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961218432:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340888.989609:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340888.989660:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961218432:12345-0@lo:38:kworker.0 Request processed in 1158us (1793us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340888.989669:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:0.0:1780340888.989692:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:0.0:1780340888.989696:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961218944:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340888.989706:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340888.990937:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961218944:12345-0@lo:38:kworker.0 Request processed in 1233us (2989us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340888.990948:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:0.0:1780340888.990996:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961218688 00000100:00100000:0.0:1780340888.991005:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961218688 00000100:00100000:0.0:1780340888.991034:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3952 00000100:00100000:0.0:1780340888.991040:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961218688:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340888.991067:0:8410:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340888.991113:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961218688:12345-0@lo:38:kworker.0 Request processed in 73us (3208us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340888.991120:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3952 00000100:00080000:0.0:1780340888.991141:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340888.991145:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340888.991185:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961218560:0@lo:400:kworker.0 00000100:00100000:0.0:1780340888.991206:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961217920:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340888.991217:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961218816:0@lo:400:kworker.0 00000100:00100000:0.0:1780340888.991264:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961218304:0@lo:400:kworker.0 00000100:00080000:0.0:1780340888.991288:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340888.991292:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340888.991295:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961218176:0@lo:38:kworker.0 00000100:00080000:0.0:1780340888.991302:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340888.991305:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340888.991308:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961218432:0@lo:38:kworker.0 00000100:00080000:0.0:1780340888.991316:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340888.991318:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340888.991321:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961218688:0@lo:38:kworker.0 00000100:00080000:0.0:1780340888.991328:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340888.991331:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340888.991333:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961218944:0@lo:38:kworker.0 00010000:00010000:3.0:1780340889.488005:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340890.156799:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000400:00000100:0.0:1780340890.156834:0:3653:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940475776 offset 0 length 224: 4 00000100:00100000:0.0:1780340890.156857:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340890.156928:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940476160 00000100:00100000:3.0:1780340890.156937:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940476160 00000100:00100000:3.0:1780340890.157014:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2626 00000100:00100000:3.0:1780340890.157025:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2410:x1866818940476160:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340890.157091:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2410:x1866818940476160:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 69us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340890.157098:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2626 00000100:00100000:1.0:1780340890.157322:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940476032 00000100:00100000:1.0:1780340890.157332:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940476032 00000100:00100000:1.0:1780340890.157376:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1416 00000100:00100000:1.0:1780340890.157384:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2410:x1866818940476032:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340890.157421:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2410:x1866818940476032:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 38us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340890.157428:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1416 00000100:00100000:3.0:1780340890.157946:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340890.158016:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940475904 00000100:00100000:3.0:1780340890.158020:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940475904 00000100:00100000:3.0:1780340890.158047:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1421 00000100:00100000:3.0:1780340890.158052:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940475904:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:3.0:1780340890.158072:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340890.158104:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b991f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940475904:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 50us (159us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340890.158223:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1421 00000100:00080000:0.0:1780340890.158360:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340890.158364:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1780340890.505973:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1780340891.024782:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000020:00000080:3.0:1780340891.024799:0:8395:0:(genops.c:906:class_export_put()) final put ffff8c047570e000/7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000020:00000080:0.0:1780340891.024849:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047570e000/7d14eb83-fa7c-40d9-843e-6367bec0a7b4 for lustre-OST0000 00000020:00000080:0.0:1780340891.024902:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047570a000 for lustre-OST0000 00010000:00010000:0.0:1780340891.534828:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340892.557245:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340893.578378:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1780340894.090647:0:3662:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780340878/real 1780340878] req@ffff8c034d877800 x1866818961214720/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780340894 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340894.090679:0:3662:0:(client.c:2524:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8c034d877800 x1866818961214720/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780340894 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340894.090688:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1780340894.090693:0:3662:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.116@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1780340894.090695:0:3662:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.116@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1780340894.090697:0:3662:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1780340894.090701:0:3662:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c034d877800 x1866818961214720/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1780340894 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340894.090710:0:3662:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c034759ed80 x1866818961216512/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340899 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340894.090726:0:3662:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c03476f0e00 x1866818961218048/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340904 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1780340894.090801:0:3662:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1780340894.090805:0:3662:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1780340894.090806:0:3662:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1780340894.090808:0:3662:0:(import.c:418:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:1.0:1780340894.090836:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961214720:0@lo:400:kworker.0 00000100:00100000:2.0:1780340894.091103:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961218048:0@lo:400:kworker.0 00000100:00100000:0.0:1780340894.091550:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034759ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961216512:0@lo:400:kworker.0 00000100:00100000:2.0:1780340894.091723:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340894.091733:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961219072:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340894.091830:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340894.091872:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961219072 00000100:00100000:2.0:1780340894.091879:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961219072 00000100:00100000:2.0:1780340894.091960:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128 00000100:00100000:2.0:1780340894.091970:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961219072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1780340894.091996:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780340894.092040:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961219072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340894.092046:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128 00000100:00080000:2.0:1780340894.092066:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340894.092094:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961219072:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1780340894.092382:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340894.092387:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1780340894.092391:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340894.092395:0:80497:0:(import.c:512:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 3617 00000100:00080000:3.0:1780340894.092402:0:80497:0:(import.c:626:import_select_connection()) MGC192.168.203.116@tcp: import ffff8c0475490800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340894.092431:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046b993480 x1866818961219200/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340894.092446:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340894.092450:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340894.092458:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340894.092461:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3668 00000100:00080000:3.0:1780340894.092465:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1780340894.092469:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340894.092497:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046b990000 x1866818961219328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340894.092517:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340894.092520:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340894.092521:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340894.092524:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3668 00000100:00080000:3.0:1780340894.092526:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1780340894.092529:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340894.092539:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046b990700 x1866818961219584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340894.092557:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340894.092559:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340894.092560:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340894.092564:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3668 00000100:00080000:3.0:1780340894.092566:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1780340894.092568:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340894.092579:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046b992a00 x1866818961219840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340894.092595:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340894.092598:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340894.092604:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340894.092608:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3668 00000100:00080000:3.0:1780340894.092610:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1780340894.092613:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340894.092625:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046b993b80 x1866818961220096/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340894.093262:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961219968:0@lo:400:kworker.0 00000100:00100000:1.0:1780340894.093323:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340894.093359:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340894.093365:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961219712:0@lo:400:kworker.0 00000100:00100000:1.0:1780340894.093400:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340894.093442:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961219712 00000100:00100000:1.0:1780340894.093447:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961219712 00000100:00100000:1.0:1780340894.093499:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1780340894.093512:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961219712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340894.093553:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961219712:12345-0@lo:400:kworker.0 Request processed in 48us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340894.093559:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1780340894.093591:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961219712:0@lo:400:kworker.0 00000100:00100000:0.0:1780340894.093713:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961219200:0@lo:250:kworker.0 00000400:00000100:0.0:1780340894.093746:0:3658:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1866818961219200 offset 0 length 520: 4 00000100:00100000:0.0:1780340894.093812:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961219328:0@lo:38:kworker.0 00000100:00100000:0.0:1780340894.093835:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340894.093851:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961219584:0@lo:38:kworker.0 00000100:00100000:0.0:1780340894.093868:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340894.093889:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961219840:0@lo:38:kworker.0 00000100:00100000:0.0:1780340894.093913:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340894.093941:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961220096:0@lo:38:kworker.0 00000100:00100000:0.0:1780340894.093973:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340894.094009:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961219328 00000100:00100000:0.0:1780340894.094013:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961219328 00000100:00100000:0.0:1780340894.094030:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961219584 00000100:00100000:0.0:1780340894.094032:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961219584 00000100:00100000:0.0:1780340894.094051:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961220096 00000100:00100000:0.0:1780340894.094053:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961220096 00000100:00100000:0.0:1780340894.094061:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:0.0:1780340894.094066:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961219328:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340894.094084:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340894.094118:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961219328:12345-0@lo:38:kworker.0 Request processed in 51us (282us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340894.094124:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:0.0:1780340894.094302:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:0.0:1780340894.094307:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961219584:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340894.094315:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340894.094337:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961219584:12345-0@lo:38:kworker.0 Request processed in 30us (468us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340894.094342:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:0.0:1780340894.094351:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:0.0:1780340894.094354:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961220096:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340894.094361:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340894.094378:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961220096:12345-0@lo:38:kworker.0 Request processed in 23us (405us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340894.094383:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:0.0:1780340894.094432:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961220224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340894.094460:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340894.094489:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340894.094495:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961219456:0@lo:400:kworker.0 00000100:00100000:0.0:1780340894.094512:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340894.094542:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961220224 00000100:00100000:0.0:1780340894.094545:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961220224 00000100:00100000:0.0:1780340894.094570:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129 00000100:00100000:0.0:1780340894.094576:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961220224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340894.094595:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340894.094622:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961220224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340894.094628:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129 00000100:00100000:0.0:1780340894.094656:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961220224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340894.094669:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961219456 00000100:00100000:0.0:1780340894.094672:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961219456 00000100:00100000:0.0:1780340894.094690:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:0.0:1780340894.094695:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961219456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340894.094722:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961219456:12345-0@lo:400:kworker.0 Request processed in 27us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340894.094727:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:0.0:1780340894.094750:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b990380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961219456:0@lo:400:kworker.0 00000100:00080000:0.0:1780340894.094807:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340894.094812:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340894.094815:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b990000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961219328:0@lo:38:kworker.0 00000100:00080000:0.0:1780340894.094822:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340894.094825:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340894.094828:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b990700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961219584:0@lo:38:kworker.0 00000100:00080000:0.0:1780340894.094834:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340894.094837:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1780340894.094845:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b993b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961220096:0@lo:38:kworker.0 00000100:00100000:2.0:1780340894.095100:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961219840 00000100:00100000:2.0:1780340894.095104:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961219840 00000100:00100000:2.0:1780340894.095131:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3953 00000100:00100000:2.0:1780340894.095136:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961219840:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340894.095145:0:26074:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340894.095181:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961219840:12345-0@lo:38:kworker.0 Request processed in 44us (1267us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340894.095186:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3953 00000100:00080000:2.0:1780340894.095201:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340894.095206:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340894.095225:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340894.095228:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340894.095231:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b992a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961219840:0@lo:38:kworker.0 00000100:00100000:3.0:1780340894.095301:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961219968 00000100:00100000:3.0:1780340894.095306:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961219968 00000100:00100000:3.0:1780340894.095342:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00000100:00100000:3.0:1780340894.095349:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961219968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340894.095386:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961219968:12345-0@lo:400:kworker.0 Request processed in 38us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340894.095392:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00100000:1.0:1780340894.096810:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b991880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961219968:0@lo:400:kworker.0 00010000:00010000:3.0:1780340894.602387:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:3.0:1780340895.274558:0:3652:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940476288 offset 0 length 224: 4 00000100:00100000:3.0:1780340895.274603:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340895.274640:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340895.274676:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340895.274707:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940476672 00000100:00100000:3.0:1780340895.274716:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940476672 00000100:00100000:3.0:1780340895.274804:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5926 00000100:00100000:3.0:1780340895.274816:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b993b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2406:x1866818940476672:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:3.0:1780340895.274847:0:25491:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432775122 00000100:00080000:3.0:1780340895.274856:0:25491:0:(import.c:65:import_set_state_nolock()) ffff8c0349152800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1780340895.274900:0:25491:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969456 00000100:00100000:3.0:1780340895.275077:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b993b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+2:2406:x1866818940476672:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 263us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340895.275100:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5926 00000100:00080000:3.0:1780340895.275121:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1780340895.275133:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340895.275566:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940476544 00000100:00100000:1.0:1780340895.275572:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940476544 00000100:00100000:1.0:1780340895.275613:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1419 00000100:00100000:1.0:1780340895.275622:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2408:x1866818940476544:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340895.275665:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b991880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2408:x1866818940476544:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 45us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340895.275683:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1419 00000100:00100000:1.0:1780340895.275697:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940476416 00000100:00100000:1.0:1780340895.275700:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940476416 00000100:00100000:1.0:1780340895.275720:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1425 00000100:00100000:1.0:1780340895.275725:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940476416:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:1.0:1780340895.275744:0:63712:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340895.275791:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b992a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2406:x1866818940476416:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 65us (1150us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340895.275798:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1425 00000100:00080000:3.0:1780340895.276116:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1780340895.625870:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340896.297241:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340896.297386:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940477056 00000100:00100000:0.0:1780340896.297399:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940477056 00000100:00100000:0.0:1780340896.297489:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1420 00000100:00100000:0.0:1780340896.297500:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2409:x1866818940477056:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340896.297610:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b990700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2409:x1866818940477056:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 111us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340896.297618:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1420 00000400:00000100:0.0:1780340896.302284:0:3654:0:(lib-move.c:4258:lnet_parse_put()) Dropping PUT from 12345-192.168.203.16@tcp portal 26 match 1866818940476800 offset 0 length 520: 4 00000100:00100000:0.0:1780340896.302339:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340896.302461:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940476928 00000100:00100000:2.0:1780340896.302474:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940476928 00000100:00100000:2.0:1780340896.302535:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1426 00000100:00100000:2.0:1780340896.302555:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940476928:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:2.0:1780340896.302586:0:63711:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340896.302688:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2406:x1866818940476928:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 133us (347us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340896.302697:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1426 00010000:00010000:0.0:1780340896.666512:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340897.674108:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340898.702021:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340899.210578:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340899.210603:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961220352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340899.210699:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340899.210733:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961220352 00000100:00100000:2.0:1780340899.210745:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961220352 00000100:00100000:1.0:1780340899.210869:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034933b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961220480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340899.210871:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2130 00000100:00100000:2.0:1780340899.210895:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961220352:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340899.210909:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1780340899.210936:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780340899.210959:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961220480 00000100:00100000:1.0:1780340899.210964:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961220480 00000100:00100000:2.0:1780340899.210995:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961220352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 112us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340899.211002:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131 00000100:00100000:1.0:1780340899.211011:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0345eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961220480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340899.211030:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340899.211068:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0345eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961220480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340899.214017:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2130 00000100:00080000:2.0:1780340899.214084:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340899.214091:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340899.214167:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961220352:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1780340899.216443:0:89498:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340899.216451:0:89498:0:(pinger.c:249:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1780340899.216454:0:89498:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340899.216459:0:89498:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340899.216464:0:89498:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340899.216472:0:89498:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3674 00000100:00080000:2.0:1780340899.216479:0:89498:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340899.216487:0:89498:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340899.216534:0:89498:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046fd69180 x1866818961220608/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340899.216584:0:89498:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340899.216596:0:89498:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340899.216598:0:89498:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340899.216603:0:89498:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3674 00000100:00080000:2.0:1780340899.216606:0:89498:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340899.216611:0:89498:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340899.217375:0:89498:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046fd6ad80 x1866818961220864/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340899.217421:0:89498:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340899.217425:0:89498:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340899.217427:0:89498:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340899.217432:0:89498:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3674 00000100:00080000:2.0:1780340899.217435:0:89498:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340899.217440:0:89498:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340899.217456:0:89498:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03476f1f80 x1866818961221120/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1780340899.217466:0:89498:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340899.217470:0:89498:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1780340899.217472:0:89498:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340899.217475:0:89498:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3674 00000100:00080000:2.0:1780340899.217478:0:89498:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1780340899.217481:0:89498:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340899.217492:0:89498:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034cc8e680 x1866818961221248/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340899.217528:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340899.217554:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961220992:0@lo:400:kworker.0 00000100:00100000:1.0:1780340899.217649:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131 00000100:00100000:1.0:1780340899.217697:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961220736:0@lo:400:kworker.0 00000100:00100000:1.0:1780340899.217803:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340899.217902:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034933b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961220480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340899.218006:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340899.218049:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961220736 00000100:00100000:2.0:1780340899.218059:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961220736 00000100:00080000:1.0:1780340899.218105:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340899.218125:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961220992 00000100:00100000:2.0:1780340899.218128:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961220992 00000100:00100000:2.0:1780340899.218217:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:2.0:1780340899.218230:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961220736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340899.218311:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961220736:12345-0@lo:400:kworker.0 Request processed in 83us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340899.218321:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:2.0:1780340899.218341:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:2.0:1780340899.218348:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961220992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340899.218415:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961220992:12345-0@lo:400:kworker.0 Request processed in 67us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340899.218422:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:2.0:1780340899.218468:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961220736:0@lo:400:kworker.0 00000100:00100000:2.0:1780340899.218491:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961220608:0@lo:38:kworker.0 00000100:00100000:2.0:1780340899.218519:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340899.218538:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961220864:0@lo:38:kworker.0 00000100:00100000:2.0:1780340899.218561:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340899.218588:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03476f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961221120:0@lo:38:kworker.0 00000100:00100000:2.0:1780340899.218629:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340899.218650:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961221248:0@lo:38:kworker.0 00000100:00100000:0.0:1780340899.218683:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961220992:0@lo:400:kworker.0 00000100:00080000:1.0:1780340899.219686:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340899.220171:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340899.220516:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961220608 00000100:00100000:2.0:1780340899.220528:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961220608 00000100:00100000:2.0:1780340899.220577:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961220864 00000100:00100000:2.0:1780340899.220582:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961220864 00000100:00100000:2.0:1780340899.220600:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961221248 00000100:00100000:2.0:1780340899.220603:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961221248 00000100:00100000:2.0:1780340899.220616:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:2.0:1780340899.220792:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961220608:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340899.220822:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340899.220900:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961220608:12345-0@lo:38:kworker.0 Request processed in 100us (2368us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340899.225106:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:0.0:1780340899.225125:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961220864:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340899.225158:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340899.225282:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961220864:12345-0@lo:38:kworker.0 Request processed in 160us (6719us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340899.225292:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:0.0:1780340899.225336:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:0.0:1780340899.225341:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961221248:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340899.225351:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340899.225403:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961221248:12345-0@lo:38:kworker.0 Request processed in 59us (5234us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340899.225410:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:0.0:1780340899.226031:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961221120 00000100:00100000:0.0:1780340899.226043:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961221120 00000100:00100000:0.0:1780340899.226084:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3954 00000100:00100000:0.0:1780340899.226090:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961221120:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1780340899.226105:0:8410:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340899.226150:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961221120:12345-0@lo:38:kworker.0 Request processed in 59us (7529us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340899.226157:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3954 00000100:00100000:2.0:1780340899.226746:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00080000:2.0:1780340899.227033:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340899.227041:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340899.227046:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961220608:0@lo:38:kworker.0 00000100:00080000:2.0:1780340899.227060:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340899.227063:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340899.227066:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd6ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961220864:0@lo:38:kworker.0 00000100:00080000:2.0:1780340899.227076:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340899.227080:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340899.227083:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03476f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961221120:0@lo:38:kworker.0 00000100:00080000:2.0:1780340899.227094:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340899.227097:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340899.227101:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961221248:0@lo:38:kworker.0 00010000:00010000:3.0:1780340899.728127:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1780340900.281679:0:90561:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1780340900.281687:0:90561:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1780340900.281706:0:90561:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1780340900.281895:0:90561:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8c0470f7c000 00000020:01000004:2.0:1780340900.281918:0:90561:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1780340900.281937:0:90561:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1780340900.281958:0:90561:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8c047ac74d40) 00000020:00000080:2.0:1780340900.281981:0:90561:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00000100:00100000:3.0:1780340900.333617:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340900.333674:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340900.333835:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940477184 00000100:00100000:1.0:1780340900.333849:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940477184 00000100:00100000:1.0:1780340900.333895:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940477312 00000100:00100000:1.0:1780340900.333898:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940477312 00000100:00100000:1.0:1780340900.333960:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1423 00000100:00100000:1.0:1780340900.333972:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2408:x1866818940477312:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340900.334076:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b990380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2408:x1866818940477312:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 106us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340900.334085:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1423 00000100:00100000:1.0:1780340900.334107:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1430 00000100:00100000:1.0:1780340900.334112:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2406:x1866818940477184:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:1.0:1780340900.334133:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1780340900.334159:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b990000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2406:x1866818940477184:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 45us (556us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340900.334165:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1430 00000100:00080000:1.0:1780340900.334201:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00100000:10000000:2.0:1780340900.609601:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1780340900.617307:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1780340900.641988:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1780340900.642277:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1780340900.642579:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1780340900.643754:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1780340900.644160:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1780340900.644475:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1780340900.650128:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1780340900.651427:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1780340900.651857:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1780340900.652056:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1780340900.652303:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1780340900.654096:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1780340900.658060:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1780340900.658615:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1780340900.660676:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1780340900.661586:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1780340900.663615:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1780340900.666587:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1780340900.667100:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1780340900.667360:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1780340900.667656:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1780340900.667884:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1780340900.668090:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1780340900.669695:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1780340900.670293:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1780340900.670639:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1780340900.671449:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1780340900.671851:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1780340900.672120:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1780340900.672382:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1780340900.672793:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1780340900.673108:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1780340900.675192:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1780340900.675637:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1780340900.676132:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1780340900.676476:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1780340900.677387:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1780340900.677705:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1780340900.678565:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1780340900.679384:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1780340900.679693:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1780340900.680456:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1780340900.682106:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1780340900.683713:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1780340900.694695:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1780340900.695462:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1780340900.700646:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1780340900.701445:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1780340900.701553:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00100000:10000000:0.0:1780340900.701590:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x50:0x0] (8/32) registered 00100000:10000000:0.0:1780340900.701616:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00100000:10000000:0.0:1780340900.706415:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1780340900.708876:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1780340900.710694:0:90561:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:1.0:1780340900.714446:0:90561:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1780340900.714835:0:90561:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1780340900.714847:0:90561:0:(osd_handler.c:8933:osd_obd_connect()) connect #0 00000020:00000080:1.0:1780340900.714863:0:90561:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432775248 00000020:01000004:1.0:1780340900.714872:0:90561:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1780340900.714887:0:90561:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1780340900.714893:0:90561:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c0470f7c000 from MGS 00000020:01000004:1.0:1780340900.714898:0:90561:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1780340900.715055:0:90561:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8c0445ba4d40) 00000020:00000080:1.0:1780340900.715088:0:90561:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1780340900.715176:0:90561:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0470f7c000 from MGS, refs=2 00080000:01000000:1.0:1780340900.715181:0:90561:0:(osd_handler.c:8933:osd_obd_connect()) connect #1 00000020:00000080:1.0:1780340900.715187:0:90561:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432775256 00010000:00010000:1.0:1780340900.715343:0:90561:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1780340900.733095:0:90561:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1780340900.737978:0:90565:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1780340900.738026:0:90561:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1780340900.738108:0:90561:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1780340900.742533:0:90561:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1780340900.742922:0:90561:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1780340900.743128:0:90561:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1780340900.743136:0:90561:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00010000:00010000:2.0:1780340900.746031:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340900.746041:0:90561:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1780340900.746051:0:90561:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1780340900.761912:0:90561:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1780340900.761928:0:90561:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1780340900.765962:0:90561:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1780340900.766000:0:90561:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1780340900.766001:0:90561:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.116@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1780340900.766007:0:90561:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.116@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1780340900.766015:0:90561:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8c0475490800 already not connected (conn 66, was 0): CONNECTING 00000100:00100000:2.0:1780340900.766022:0:90561:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000001:00100000:0.0:1780340900.768957:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000020:00000080:0.0:1780340900.768970:0:9462:0:(genops.c:906:class_export_put()) final put ffff8c0349151800/7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000020:00000080:3.0:1780340900.771973:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0349151800/7d14eb83-fa7c-40d9-843e-6367bec0a7b4 for lustre-OST0001 00000020:00000080:3.0:1780340900.772156:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0349152800 for lustre-OST0001 00000100:00100000:0.0:1780340901.354275:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340901.354414:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340901.354629:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940477568 00000100:00100000:2.0:1780340901.354642:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940477568 00000100:00100000:2.0:1780340901.354708:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940477440 00000100:00100000:2.0:1780340901.354711:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940477440 00000100:00100000:2.0:1780340901.354738:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1424 00000100:00100000:2.0:1780340901.354750:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2410:x1866818940477568:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340901.354880:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2410:x1866818940477568:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 132us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340901.354890:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1424 00000100:00100000:2.0:1780340901.354910:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1431 00000100:00100000:2.0:1780340901.354915:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2406:x1866818940477440:12345-192.168.203.16@tcp:38:kworker.0 00010000:00020000:2.0:1780340901.355287:0:70100:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340901.355320:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2406:x1866818940477440:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 403us (906us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340901.355327:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1431 00010000:00010000:0.0:1780340901.771080:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340902.794071:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340903.818115:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340904.330128:0:3658:0:(client.c:2480:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1780340894/real 1780340894] req@ffff8c046b993480 x1866818961219200/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780340904 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340904.330176:0:3658:0:(client.c:2511:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c046b993480 x1866818961219200/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1780340904 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340904.330205:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340904.330216:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1780340904.330251:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961219200:0@lo:250:kworker.0 00000100:00100000:0.0:1780340904.330385:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340904.330401:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961221376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340904.330488:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340904.330544:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961221376 00000100:00100000:0.0:1780340904.330554:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961221376 00000100:00100000:0.0:1780340904.330623:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132 00000100:00100000:0.0:1780340904.330633:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961221376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340904.330673:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340904.330721:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961221376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340904.330729:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132 00000100:00080000:1.0:1780340904.330797:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340904.330826:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961221376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340904.330844:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961221504:0@lo:13:osp-pre-1-1.0 10000000:01000000:0.0:1780340904.330865:0:90561:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1780340904.330883:0:90561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432774b56 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774b5d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340904.330895:0:90561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432774b56 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774b5d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340904.330902:0:90561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1780340904.330914:0:90561:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340904.330925:0:90561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04722ae600/0xa24651432774b56 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774b5d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.330945:0:90561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5e00/0xa24651432774f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774f62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340904.330946:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1780340904.330951:0:90561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5e00/0xa24651432774f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774f62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340904.330957:0:90561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340904.330960:0:90561:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340904.330965:0:90561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5e00/0xa24651432774f5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774f62 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.330976:0:90561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c03476f8000/0xa24651432774f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774f70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340904.330980:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961221504 10000000:00010000:0.0:1780340904.330982:0:90561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c03476f8000/0xa24651432774f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774f70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340904.330984:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961221504 10000000:01000000:0.0:1780340904.330988:0:90561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340904.330997:0:90561:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340904.331002:0:90561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c03476f8000/0xa24651432774f69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774f70 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.331011:0:90561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa24651432774f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774f7e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340904.331016:0:90561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa24651432774f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774f7e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340904.331021:0:90561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340904.331024:0:90561:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340904.331027:0:90561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c03476f8400/0xa24651432774f77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774f7e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.331036:0:90561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c03476f9800/0xa24651432774f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774f8c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340904.331042:0:90561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c03476f9800/0xa24651432774f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774f8c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340904.331047:0:90561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340904.331050:0:90561:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340904.331053:0:90561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c03476f9800/0xa24651432774f85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774f8c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.331062:0:90561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c03476f9c00/0xa24651432774f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774f9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340904.331068:0:90561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c03476f9c00/0xa24651432774f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774f9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340904.331083:0:90561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340904.331087:0:90561:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340904.331091:0:90561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c03476f9c00/0xa24651432774f93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774f9a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340904.331092:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133 00000100:00100000:1.0:1780340904.331098:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961221504:12345-0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1780340904.331100:0:90561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0453123600/0xa24651432774fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774fa8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340904.331106:0:90561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0453123600/0xa24651432774fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774fa8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340904.331111:0:90561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340904.331113:0:90561:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340904.331116:0:90561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0453123600/0xa24651432774fa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774fa8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:1.0:1780340904.331118:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00010000:00010000:0.0:1780340904.331124:0:90561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432774faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774fb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340904.331131:0:90561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432774faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774fb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340904.331136:0:90561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340904.331139:0:90561:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340904.331143:0:90561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa24651432774faf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774fb6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340904.331148:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961221504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340904.331155:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133 00010000:00010000:0.0:1780340904.331155:0:90561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa24651432774aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774ad1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340904.331171:0:90561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa24651432774aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774ad1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1780340904.331173:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:0.0:1780340904.331177:0:90561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340904.331180:0:90561:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340904.331184:0:90561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c045ec6ce00/0xa24651432774aca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774ad1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340904.331193:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961221504:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1780340904.334727:0:90561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432774ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774aed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340904.334751:0:90561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432774ae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774aed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340904.334776:0:90561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340904.334786:0:90561:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340904.334798:0:90561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04722af200/0xa24651432774ae6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774aed expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.334816:0:90561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0453122e00/0xa24651432774af4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774afb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340904.334823:0:90561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0453122e00/0xa24651432774af4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774afb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340904.334829:0:90561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1780340904.334833:0:90561:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340904.334837:0:90561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0453122e00/0xa24651432774af4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774afb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.334884:0:90561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04722afe00/0xa24651432774b1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774b25 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340904.334892:0:90561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04722afe00/0xa24651432774b1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774b25 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340904.334897:0:90561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1780340904.334902:0:90561:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340904.334907:0:90561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04722afe00/0xa24651432774b1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774b25 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.334916:0:90561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c045ec6de00/0xa24651432774b48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0xa24651432774b4f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340904.334923:0:90561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c045ec6de00/0xa24651432774b48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0xa24651432774b4f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340904.334928:0:90561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1780340904.334931:0:90561:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1780340904.334934:0:90561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c045ec6de00/0xa24651432774b48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0xa24651432774b4f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1780340904.334959:0:90561:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8c0475490800 already not connected (conn 66, was 0): DISCONN 00000100:00080000:0.0:1780340904.334967:0:90561:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340904.334976:0:90561:0:(import.c:512:import_select_connection()) MGC192.168.203.116@tcp: connect to NID 0@lo last attempt 3674 00000100:00080000:0.0:1780340904.334983:0:90561:0:(import.c:591:import_select_connection()) MGC192.168.203.116@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1780340904.335002:0:90561:0:(import.c:626:import_select_connection()) MGC192.168.203.116@tcp: import ffff8c0475490800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340904.335049:0:90561:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0485a1b480 x1866818961221632/t0(0) o250->MGC192.168.203.116@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340904.335088:0:90561:0:(recover.c:337:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:3.0:1780340904.335792:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340904.335798:0:80497:0:(pinger.c:249:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1780340904.335801:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340904.335805:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340904.335808:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340904.335815:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3679 00000100:00080000:3.0:1780340904.335819:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340904.335824:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340904.335854:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046b990e00 x1866818961221760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340904.335917:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340904.335921:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340904.335923:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340904.335928:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3679 00000100:00080000:3.0:1780340904.335930:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340904.335934:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340904.335955:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a8c9880 x1866818961222016/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340904.335986:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340904.336000:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340904.336002:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340904.336006:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3679 00000100:00080000:3.0:1780340904.336008:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340904.336012:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340904.336025:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a8cb480 x1866818961222272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1780340904.336035:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340904.336038:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1780340904.336040:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340904.336043:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3679 00000100:00080000:3.0:1780340904.336045:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1780340904.336049:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340904.336059:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a8c9c00 x1866818961222400/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340904.336132:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340904.336147:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961222144:0@lo:400:kworker.0 00000100:00100000:3.0:1780340904.336528:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340904.336597:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961222144 00000100:00100000:3.0:1780340904.336609:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961222144 00000100:00100000:2.0:1780340904.336730:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961221632:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1780340904.336797:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340904.336826:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961221760:0@lo:38:kworker.0 00000100:00100000:2.0:1780340904.336853:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340904.336883:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961222016:0@lo:38:kworker.0 00000100:00100000:2.0:1780340904.336904:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340904.336920:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961222272:0@lo:38:kworker.0 00000100:00100000:2.0:1780340904.336946:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340904.336964:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961222400:0@lo:38:kworker.0 00000100:00100000:2.0:1780340904.336985:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340904.337032:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961221760 00000100:00100000:2.0:1780340904.337036:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961221760 00000100:00100000:2.0:1780340904.337086:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961222016 00000100:00100000:2.0:1780340904.337090:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961222016 00000100:00100000:2.0:1780340904.337099:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961222400 00000100:00100000:2.0:1780340904.337101:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961222400 00000100:00100000:2.0:1780340904.337117:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:2.0:1780340904.337126:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961221760:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340904.337152:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340904.337844:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:3.0:1780340904.337857:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961222144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340904.337969:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961221760:12345-0@lo:38:kworker.0 Request processed in 841us (1113us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340904.337978:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:2.0:1780340904.338115:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:2.0:1780340904.338121:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961222016:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1780340904.338140:0:63710:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1780340904.338180:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1866818961222016:12345-0@lo:38:kworker.0 Request processed in 58us (1274us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340904.338186:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:3.0:1780340904.338558:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961222144:12345-0@lo:400:kworker.0 Request processed in 705us (2031us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340904.338566:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:3.0:1780340904.338597:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:3.0:1780340904.338602:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961222400:12345-0@lo:38:kworker.0 00000100:00080000:1.0:1780340904.338789:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340904.338805:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1780340904.338825:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961221888:0@lo:400:kworker.0 00000100:00100000:1.0:1780340904.338888:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340904.338929:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961221888 00000100:00100000:1.0:1780340904.338936:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961221888 00000100:00100000:1.0:1780340904.338975:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:1.0:1780340904.338982:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961221888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340904.339035:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961221888:12345-0@lo:400:kworker.0 Request processed in 53us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340904.339057:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00080000:1.0:1780340904.339075:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340904.339113:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b993480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961221888:0@lo:400:kworker.0 00000100:00100000:1.0:1780340904.339528:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961222144:0@lo:400:kworker.0 00000100:00100000:1.0:1780340904.339590:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961222272 00000100:00100000:1.0:1780340904.339597:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961222272 00000100:00100000:0.0:1780340904.339816:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961221632 00000100:00100000:0.0:1780340904.339822:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961221632 00000100:00100000:0.0:1780340904.339851:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1780340904.339857:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3658:x1866818961221632:12345-0@lo:250:mount.lustre.0 00010000:00020000:3.0:1780340904.340169:0:64454:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:2.0:1780340904.340278:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340904.340284:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340904.340289:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b990e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961221760:0@lo:38:kworker.0 00000100:00080000:2.0:1780340904.340304:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340904.340307:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340904.340311:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961222016:0@lo:38:kworker.0 00000100:00100000:1.0:1780340904.340530:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955 00000100:00100000:1.0:1780340904.340536:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961222272:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1780340904.340560:0:26074:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340904.342125:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961222400:12345-0@lo:38:kworker.0 Request processed in 3514us (5132us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340904.342140:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00080000:2.0:1780340904.342355:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340904.342362:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340904.342366:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961222400:0@lo:38:kworker.0 00010000:00080000:0.0:1780340904.342517:0:90567:0:(ldlm_lib.c:1430:target_handle_connect()) MGS: connection from f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo t0 exp 0000000000000000 cur 3684 last 0 00000020:00000080:0.0:1780340904.342559:0:90567:0:(genops.c:1406:class_connect()) connect: client f26f7947-2bb0-4491-8dd4-005fa8e64f3a, cookie 0xa2465143277525d 00000100:00100000:1.0:1780340904.342769:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961222272:12345-0@lo:38:kworker.0 Request processed in 2219us (5809us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340904.342781:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3955 00000100:00080000:0.0:1780340904.346394:0:90567:0:(import.c:65:import_set_state_nolock()) ffff8c0346bbc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340904.346519:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:3658:x1866818961221632:12345-0@lo:250:mount.lustre.0 Request processed in 6658us (9718us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340904.346534:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1780340904.346704:0:3658:0:(client.c:3102:ptlrpc_free_committed()) MGC192.168.203.116@tcp: committing for last_committed 0 gen 28 00000100:00080000:2.0:1780340904.346718:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.203.116@tcp: connect to target with instance 0 00000100:00080000:2.0:1780340904.346728:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.203.116@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1780340904.346736:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1780340904.346740:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0475490800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1780340904.346743:0:3658:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1780340904.346803:0:3658:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1780340904.346814:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3658:1866818961221632:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1780340904.346836:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340904.346841:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340904.346844:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961222272:0@lo:38:kworker.0 00000020:01000000:0.0:1780340904.346973:0:71335:0:(tgt_mount.c:1581:tgt_import_update()) NID #0: 192.168.203.116@tcp 10000000:01000000:0.0:1780340904.346998:0:71335:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:0.0:1780340904.347002:0:71335:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1780340904.347004:0:71335:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1780340904.347006:0:71335:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340904.347007:0:71335:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780340904.347009:0:71335:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340904.347010:0:71335:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340904.347011:0:71335:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1780340904.347014:0:71335:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780340904.347015:0:71335:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1780340904.347071:0:71335:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1780340904.347080:0:71335:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:0.0:1780340904.347082:0:71335:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1780340904.347083:0:71335:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1780340904.347084:0:71335:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340904.347085:0:71335:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780340904.347086:0:71335:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340904.347087:0:71335:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340904.347089:0:71335:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1780340904.347090:0:71335:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780340904.347099:0:71335:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1780340904.347132:0:71335:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:0.0:1780340904.347138:0:71335:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:0.0:1780340904.347141:0:71335:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:0.0:1780340904.347142:0:71335:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1780340904.347143:0:71335:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340904.347144:0:71335:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780340904.347145:0:71335:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340904.347146:0:71335:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340904.347148:0:71335:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780340904.347149:0:71335:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780340904.347150:0:71335:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:0.0:1780340904.347163:0:71335:0:(tgt_mount.c:1592:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:0.0:1780340904.347202:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961222784:0@lo:253:kworker.0 00000100:00100000:3.0:1780340904.347287:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961222528:0@lo:253:kworker.0 00000100:00080000:1.0:1780340904.347315:0:90561:0:(recover.c:348:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1780340904.347329:0:90561:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1780340904.347383:0:90561:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1780340904.347389:0:90561:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.116@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1780340904.347516:0:90561:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 0 is initialized 00000020:01000004:1.0:1780340904.347546:0:90561:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.116@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1780340904.347549:0:90561:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1780340904.347551:0:90561:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780340904.347552:0:90561:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780340904.347553:0:90561:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780340904.347555:0:90561:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780340904.347556:0:90561:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780340904.347557:0:90561:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780340904.347559:0:90561:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780340904.347560:0:90561:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780340904.347561:0:90561:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1780340904.347564:0:90561:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1780340904.347571:0:90561:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1780340904.347572:0:90561:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780340904.347573:0:90561:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780340904.347574:0:90561:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780340904.347575:0:90561:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780340904.347576:0:90561:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780340904.347577:0:90561:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780340904.347578:0:90561:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780340904.347579:0:90561:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780340904.347579:0:90561:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1780340904.347595:0:90561:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1780340904.347606:0:90561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961222912:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1780340904.351321:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340904.351672:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961222528 00000100:00100000:2.0:1780340904.351685:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961222528 00000100:00100000:2.0:1780340904.351752:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1780340904.351784:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:3660:x1866818961222528:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1780340904.351830:0:90570:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:2.0:1780340904.352087:0:90571:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1780340904.352208:0:90570:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 120 00000100:00100000:1.0:1780340904.353326:0:90561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340904.353390:0:90561:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c03483c0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1780340904.353438:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961222656:0@lo:253:kworker.0 00000100:00100000:1.0:1780340904.353480:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340904.353522:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961222912 00000100:00100000:1.0:1780340904.353529:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961222912 00000100:00100000:1.0:1780340904.353564:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961222656 00000100:00100000:1.0:1780340904.353567:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961222656 00000100:00100000:1.0:1780340904.353581:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1780340904.353590:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:90561:x1866818961222912:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1780340904.355654:0:90572:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1780340904.355663:0:90572:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1780340904.355666:0:90572:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1780340904.355669:0:90572:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1780340904.355687:0:90572:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 20000000:01000000:3.0:1780340904.355833:0:90570:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1780340904.355850:0:90570:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1780340904.356124:0:90568:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1780340904.356132:0:90568:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1780340904.356138:0:90568:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:1.0:1780340904.356148:0:90568:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1780340904.356373:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340904.358476:0:90567:0:(service.c:3465:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1780340904.358492:0:90567:0:(service.c:3524:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1780340904.358903:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961222784 00000100:00100000:1.0:1780340904.358916:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961222784 00000100:00100000:3.0:1780340904.359055:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1780340904.359066:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3661:x1866818961222656:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1780340904.359099:0:90573:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1780340904.366927:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:90561:x1866818961222912:12345-0@lo:253:mount.lustre.0 Request processed in 13323us (13592us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340904.366946:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 20000000:01000000:2.0:1780340904.366955:0:90570:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1780340904.366971:0:90570:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1780340904.367010:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1780340904.367046:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:3662:x1866818961222784:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1780340904.367092:0:90568:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1780340904.367114:0:90568:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1780340904.367281:0:90571:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1780340904.367286:0:90571:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1780340904.367314:0:90571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0453123800/0xa24651432775264 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.367335:0:90571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453123800/0xa24651432775264 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1780340904.367359:0:90571:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000073695s 00010000:00010000:1.0:1780340904.367364:0:90571:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0453123800/0xa24651432775264 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.367371:0:90571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0453123800/0xa24651432775264 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.367378:0:90571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0453123800/0xa24651432775264 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.367386:0:90571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0453123800/0xa24651432775264 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.367392:0:90571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340904.367397:0:90571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0453123800/0xa24651432775264 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.367406:0:90571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0453123800/0xa24651432775264 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.367420:0:90571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0453123800/0xa24651432775264 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.367438:0:90571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0453123800/0xa24651432775264 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.367443:0:90571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453123800/0xa24651432775264 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340904.367556:0:90561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961222912:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1780340904.367571:0:90561:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1780340904.367575:0:90561:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1780340904.367576:0:90561:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1780340904.367578:0:90561:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340904.367579:0:90561:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780340904.367581:0:90561:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340904.367582:0:90561:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340904.367583:0:90561:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780340904.367585:0:90561:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1780340904.367587:0:90561:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780340904.367588:0:90561:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1780340904.367617:0:90561:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c0470f7c000 from lustre-MDT0000 10000000:01000000:0.0:1780340904.367657:0:90561:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1780340904.367661:0:90561:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1780340904.367672:0:90561:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c0470f7c000 10000000:01000000:0.0:1780340904.367677:0:90561:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1780340904.367682:0:90561:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8c0470f7c000 10000000:01000000:0.0:1780340904.367685:0:90561:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1780340904.367689:0:90561:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8c0470f7c000 from 1 10000000:01000000:0.0:1780340904.367698:0:90561:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1780340904.367734:0:90561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5e00/0xa2465143277526b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.367744:0:90561:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5e00/0xa2465143277526b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.367755:0:90561:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5e00/0xa2465143277526b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340904.367818:0:90561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349954a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961223040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1780340904.367873:0:90561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340904.367925:0:90561:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471c42480 going to sleep for 11 seconds 00000100:00100000:0.0:1780340904.369489:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:3660:x1866818961222528:12345-0@lo:253:kworker.0 Request processed in 17700us (18171us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340904.369505:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1780340904.369558:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961223040 00000100:00100000:0.0:1780340904.369567:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961223040 00000100:00100000:0.0:1780340904.369604:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1780340904.369612:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:90561:x1866818961223040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340904.369628:0:90570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340904.369652:0:90570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa4e00/0xa24651432775272 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277526b expref: -99 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.369681:0:90570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa4e00/0xa24651432775272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277526b expref: 7 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.369692:0:90570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa4e00/0xa24651432775272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277526b expref: 7 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.369720:0:90570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4e00, rc 0) 00000100:00100000:0.0:1780340904.369789:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:90561:x1866818961223040:12345-0@lo:101:mount.lustre.0 Request processed in 178us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340904.369796:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1780340904.370398:0:90561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349954a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961223040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780340904.370429:0:90561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5e00/0xa2465143277526b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775272 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340904.370441:0:90561:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5e00/0xa2465143277526b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775272 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340904.370463:0:90561:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1780340904.370542:0:90561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5e00/0xa2465143277526b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775272 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340904.370551:0:90561:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5e00/0xa2465143277526b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775272 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340904.370559:0:90561:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1780340904.370567:0:90561:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1780340904.370574:0:90561:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8c0470f7c000 10000000:01000000:2.0:1780340904.370578:0:90561:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1780340904.370582:0:90561:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1780340904.370585:0:90561:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1780340904.370620:0:90561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa24651432775279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340904.370628:0:90561:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa24651432775279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340904.370637:0:90561:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa24651432775279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340904.370657:0:90561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961223168:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1780340904.370713:0:90561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340904.370745:0:90561:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345fe8600 going to sleep for 11 seconds 00000100:00100000:0.0:1780340904.373450:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961223168 00000100:00100000:0.0:1780340904.373470:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961223168 00000100:00100000:0.0:1780340904.373559:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1780340904.373571:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:90561:x1866818961223168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340904.373591:0:90570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340904.373617:0:90570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa4c00/0xa24651432775280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432775279 expref: -99 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.373655:0:90570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa4c00/0xa24651432775280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775279 expref: 8 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.373668:0:90570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa4c00/0xa24651432775280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775279 expref: 8 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.373687:0:90570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4c00, rc 0) 00000100:00100000:0.0:1780340904.373828:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:90561:x1866818961223168:12345-0@lo:101:mount.lustre.0 Request processed in 256us (3110us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340904.373837:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1780340904.373878:0:90561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961223168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780340904.373924:0:90561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa24651432775279 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775280 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340904.373944:0:90561:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa24651432775279 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775280 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340904.374056:0:90561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961223296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780340904.374115:0:90561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340904.374152:0:90561:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345fe8600 going to sleep for 11 seconds 00000100:00100000:3.0:1780340904.374499:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961223296 00000100:00100000:3.0:1780340904.374506:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961223296 00000100:00100000:3.0:1780340904.374545:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1780340904.374553:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:90561:x1866818961223296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780340904.374737:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:90561:x1866818961223296:12345-0@lo:501:mount.lustre.0 Request processed in 184us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340904.374744:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1780340904.375491:0:90561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961223296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780340904.375603:0:90561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961223424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780340904.375656:0:90561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340904.375691:0:90561:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345fe8600 going to sleep for 11 seconds 00000100:00100000:3.0:1780340904.375827:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961223424 00000100:00100000:3.0:1780340904.375833:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961223424 00000100:00100000:3.0:1780340904.375864:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1780340904.375871:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:90561:x1866818961223424:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780340904.375983:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:90561:x1866818961223424:12345-0@lo:503:mount.lustre.0 Request processed in 111us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340904.375990:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1780340904.376059:0:90561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd6ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961223424:0@lo:503:mount.lustre.0 00000020:01000004:1.0:1780340904.376561:0:3660:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1780340904.376566:0:3660:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1780340904.376568:0:3660:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780340904.376570:0:3660:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780340904.376571:0:3660:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780340904.376574:0:3660:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780340904.376585:0:3660:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1780340904.376587:0:3660:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780340904.376589:0:3660:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1780340904.376595:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961222528:0@lo:253:kworker.0 00000100:00100000:0.0:1780340904.378560:0:90574:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349957b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90574:1866818961223552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340904.378642:0:90574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:1.0:1780340904.378704:0:90568:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1780340904.378714:0:90568:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1780340904.378718:0:90574:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471c42000 going to sleep for 11 seconds 20000000:01000000:1.0:1780340904.378800:0:90571:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1780340904.378805:0:90571:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1780340904.378827:0:90571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0453123e00/0xa24651432775287 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.378843:0:90571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453123e00/0xa24651432775287 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1780340904.378851:0:90571:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000073695s 00010000:00010000:1.0:1780340904.378855:0:90571:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0453123e00/0xa24651432775287 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.378862:0:90571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0453123e00/0xa24651432775287 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.378880:0:90571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0453123e00/0xa24651432775287 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.378887:0:90571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0453123e00/0xa24651432775287 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.378893:0:90571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340904.378897:0:90571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0453123e00/0xa24651432775287 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.378905:0:90571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0453123e00/0xa24651432775287 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.378922:0:90571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0453123e00/0xa24651432775287 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.378930:0:90571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0453123e00/0xa24651432775287 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.378937:0:90571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453123e00/0xa24651432775287 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340904.379170:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:3662:x1866818961222784:12345-0@lo:253:kworker.0 Request processed in 12131us (22798us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340904.379181:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1780340904.379212:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961223552 00000100:00100000:1.0:1780340904.379595:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961223552 00000020:01000004:0.0:1780340904.379685:0:3662:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1780340904.379689:0:3662:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1780340904.379697:0:3662:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340904.379699:0:3662:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780340904.379700:0:3662:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340904.379702:0:3662:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340904.379704:0:3662:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1780340904.379706:0:3662:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780340904.379707:0:3662:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1780340904.379711:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961222784:0@lo:253:kworker.0 00000100:00100000:3.0:1780340904.381529:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1780340904.381552:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:90574:x1866818961223552:12345-0@lo:502:llog_process_th.0 20000000:01000000:2.0:1780340904.381560:0:90573:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1780340904.382213:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:90574:x1866818961223552:12345-0@lo:502:llog_process_th.0 Request processed in 669us (3568us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340904.382231:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1780340904.382492:0:90574:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349957b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90574:1866818961223552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780340904.382598:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780340904.382615:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340904.382618:0:90574:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1780340904.382624:0:90574:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1780340904.382626:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780340904.382639:0:90574:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8c0445ba0000) 00000020:00000080:1.0:1780340904.382661:0:90574:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:1.0:1780340904.382666:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1780340904.382748:0:90574:0:(osd_handler.c:8933:osd_obd_connect()) connect #2 00000020:00000080:1.0:1780340904.382754:0:90574:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432775295 00000020:00000080:1.0:1780340904.383173:0:90574:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1780340904.383178:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340904.383182:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340904.383184:0:90574:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1780340904.383187:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780340904.383190:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340904.383192:0:90574:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1780340904.383195:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780340904.383203:0:90574:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8c0445ba19c0) 00000020:00000080:1.0:1780340904.383215:0:90574:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:1.0:1780340904.383218:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1780340904.384606:0:90574:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1780340904.384610:0:90574:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1780340904.384632:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1780340904.384726:0:90574:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0470f7c000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1780340904.384747:0:90574:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8c0445ba3380) 00000020:00000080:1.0:1780340904.384779:0:90574:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:1.0:1780340904.384831:0:90574:0:(lod_dev.c:2290:lod_obd_connect()) connect #0 00000020:00000080:1.0:1780340904.384838:0:90574:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa246514327752aa 00000020:00000080:1.0:1780340904.385641:0:90574:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1780340904.385653:0:90574:0:(mdd_device.c:1668:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1780340904.385661:0:90574:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa246514327752b1 00080000:01000000:1.0:1780340904.385668:0:90574:0:(osd_handler.c:8933:osd_obd_connect()) connect #3 00000020:00000080:1.0:1780340904.385673:0:90574:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa246514327752b8 20000000:01000000:2.0:1780340904.393107:0:90573:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1780340904.393132:0:90573:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1780340904.393521:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:3661:x1866818961222656:12345-0@lo:253:kworker.0 Request processed in 34453us (40034us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340904.393531:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:0.0:1780340904.393949:0:3661:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1780340904.393952:0:3661:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1780340904.393953:0:3661:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340904.393954:0:3661:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780340904.393956:0:3661:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340904.393957:0:3661:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340904.393959:0:3661:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1780340904.393960:0:3661:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780340904.393962:0:3661:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1780340904.393966:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961222656:0@lo:253:kworker.0 20000000:01000000:3.0:1780340904.394385:0:90571:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1780340904.394396:0:90571:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1780340904.394433:0:90571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c047a8b2200/0xa246514327752bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.394474:0:90571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a8b2200/0xa246514327752bf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1780340904.394485:0:90571:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000091905s 00010000:00010000:3.0:1780340904.394491:0:90571:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c047a8b2200/0xa246514327752bf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.394500:0:90571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c047a8b2200/0xa246514327752bf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.394507:0:90571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c047a8b2200/0xa246514327752bf lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.394515:0:90571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c047a8b2200/0xa246514327752bf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.394522:0:90571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b2200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340904.394527:0:90571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c047a8b2200/0xa246514327752bf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.394535:0:90571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c047a8b2200/0xa246514327752bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.394550:0:90571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c047a8b2200/0xa246514327752bf lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.394557:0:90571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c047a8b2200/0xa246514327752bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.394564:0:90571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a8b2200/0xa246514327752bf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340904.526841:0:90574:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1780340904.526970:0:90574:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 111669149700 srv lr: 115964116992 lx: 0 gen 21 00000001:00080000:2.0:1780340904.527012:0:90574:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 idx: 2 lr: 0 srv lr: 115964116992 lx: 0 gen 23 00000001:00000004:2.0:1780340904.527035:0:90574:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 115964116992 00000001:00080000:2.0:1780340904.527129:0:90574:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1780340904.527184:0:90574:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8c0345fe8780: xid 1866818940464768, transno 115964116998, client gen 23, slot idx 0 00000001:00080000:2.0:1780340904.527194:0:90574:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8c0345fe83c0: xid 1866818961207168, transno 115964117000, client gen 21, slot idx 1 00000001:00080000:2.0:1780340904.527199:0:90574:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8c0345fe8240: xid 1866818940464384, transno 115964116997, client gen 23, slot idx 2 00000001:00080000:2.0:1780340904.527204:0:90574:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff8c04453b1d80: xid 1866818961205248, transno 115964116999, client gen 21, slot idx 3 00000020:00000080:2.0:1780340904.527721:0:90574:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8c047ac70000) 00000020:00000080:2.0:1780340904.527740:0:90574:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:2.0:1780340904.527856:0:90574:0:(osd_handler.c:8933:osd_obd_connect()) connect #4 00000020:00000080:2.0:1780340904.527863:0:90574:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa246514327752db 00000020:00000080:2.0:1780340904.535092:0:90574:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1780340904.541307:0:90574:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa246514327752e2 00000020:00000080:2.0:1780340904.541707:0:90574:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1780340904.541719:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340904.541725:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340904.541728:0:90574:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1780340904.541731:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1780340904.541733:0:90574:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1780340904.541735:0:90574:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1780340904.541737:0:90574:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1780340904.541738:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1780340904.541740:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340904.541742:0:90574:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1780340904.541744:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340904.541748:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340904.541750:0:90574:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1780340904.541753:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1780340904.541909:0:90574:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1780340904.541925:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340904.541927:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340904.541929:0:90574:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1780340904.541931:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340904.541935:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340904.541936:0:90574:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1780340904.541939:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1780340904.541944:0:90574:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:00000080:2.0:1780340904.541966:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1780340904.541980:0:90574:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8c047ac73380) 00000020:00000080:2.0:1780340904.541998:0:90574:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1780340904.542007:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1780340904.542060:0:90574:0:(osp_dev.c:1197:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1780340904.542064:0:90574:0:(osd_handler.c:8933:osd_obd_connect()) connect #5 00000020:00000080:2.0:1780340904.542070:0:90574:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa246514327752f0 00010000:00080000:2.0:1780340904.542100:0:90574:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c0450113000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:2.0:1780340904.546833:0:90574:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1780340904.553474:0:90574:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780340904.553495:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1780340904.553533:0:90574:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1780340904.553551:0:90574:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa246514327752f7 00000100:00080000:1.0:1780340904.553560:0:90574:0:(import.c:512:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1780340904.553566:0:90574:0:(import.c:626:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c0450113000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340904.553600:0:90574:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d4ca300 x1866818961223680/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1780340904.553629:0:90574:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1780340904.553686:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340904.553689:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340904.553691:0:90574:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1780340904.553694:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1780340904.553697:0:90574:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1780340904.553698:0:90574:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780340904.553700:0:90574:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780340904.553702:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1780340904.553704:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340904.553706:0:90574:0:(obd_config.c:1561:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1780340904.553708:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1780340904.553713:0:90574:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1780340904.553715:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340904.553717:0:90574:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1780340904.553719:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1780340904.553723:0:90574:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:01000000:1.0:1780340904.553743:0:90574:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1780340904.553746:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1780340904.553786:0:90574:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c0349000000) 00000020:00000080:1.0:1780340904.553805:0:90574:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1780340904.553810:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1780340904.553868:0:90574:0:(osp_dev.c:1197:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1780340904.553873:0:90574:0:(osd_handler.c:8933:osd_obd_connect()) connect #6 00000020:00000080:1.0:1780340904.553886:0:90574:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432775305 00010000:00080000:1.0:1780340904.553917:0:90574:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c046b9a9000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:1.0:1780340904.554112:0:90574:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1780340904.554647:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961223680:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1780340904.554714:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340904.554832:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961223680 00000100:00100000:0.0:1780340904.554840:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961223680 00000100:00100000:0.0:1780340904.554877:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3956 00000100:00100000:0.0:1780340904.554884:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961223680:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1780340904.554910:0:8410:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3684 last 0 00000020:00000080:0.0:1780340904.554944:0:8410:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2465143277530c 00000004:00100000:0.0:1780340904.554959:0:8410:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1780340904.555038:0:8410:0:(import.c:65:import_set_state_nolock()) ffff8c04514b3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340904.555090:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1866818961223680:12345-0@lo:38:llog_process_th.0 Request processed in 204us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340904.555097:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3956 00000100:00100000:3.0:1780340904.555178:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1780340904.555186:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:3.0:1780340904.555194:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1780340904.555200:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1780340904.555203:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0450113000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1780340904.555220:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961223680:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1780340904.555325:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340904.555348:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961223808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780340904.555377:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340904.555489:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961223808 00000100:00100000:0.0:1780340904.555493:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961223808 00000100:00100000:0.0:1780340904.555527:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3957 00000100:00100000:0.0:1780340904.555534:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961223808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780340904.555567:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:0.0:1780340904.555601:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961223808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340904.555607:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3957 00000100:00100000:3.0:1780340904.555667:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349954380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961223808:0@lo:41:osp-pre-1-0.0 00000040:01000000:1.0:1780340904.560418:0:90574:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1780340904.560458:0:90574:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1780340904.562518:0:90574:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 26, last_idx 27 00000040:00080000:1.0:1780340904.564122:0:90574:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1780340904.564161:0:90574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].28, 64 off9984 00000040:00080000:1.0:1780340904.564830:0:90574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].1, 64 off8256 00000040:00080000:0.0:1780340904.572849:0:90580:0:(llog.c:800:llog_process_thread()) index: 27, lh_last_idx: 28 synced_idx: 0 lgh_last_idx: 28 00000040:00080000:0.0:1780340904.572858:0:90580:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1780340904.573037:0:90580:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 27, last_idx 28 00000040:00080000:0.0:1780340904.573061:0:90580:0:(llog_cat.c:1250:llog_cat_cleanup()) cancel plain log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1780340904.573182:0:90580:0:(llog.c:800:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:0.0:1780340904.573185:0:90580:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1780340904.577012:0:90574:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1780340904.577030:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1780340904.577080:0:90574:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1780340904.577101:0:90574:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432775313 00000100:00080000:0.0:1780340904.577111:0:90574:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1780340904.577117:0:90574:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c046b9a9000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340904.577156:0:90574:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0349957800 x1866818961223936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340904.577232:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961223936:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1780340904.577302:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1780340904.577472:0:90574:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1780340904.577539:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780340904.577543:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340904.577545:0:90574:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1780340904.577548:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1780340904.577551:0:90574:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1780340904.577563:0:90574:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1780340904.577565:0:90574:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1780340904.577567:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1780340904.577569:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340904.577571:0:90574:0:(obd_config.c:1561:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1780340904.577587:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1780340904.577591:0:90574:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1780340904.577594:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340904.577595:0:90574:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1780340904.577598:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1780340904.577602:0:90574:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.116@tcp to nid 0x20000c0a8cb74 (192.168.203.116@tcp) 00000020:01000000:0.0:1780340904.577624:0:90574:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1780340904.577626:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1780340904.577639:0:90574:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c03482b3380) 00000020:00000080:0.0:1780340904.577656:0:90574:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:0.0:1780340904.577660:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1780340904.577719:0:90574:0:(osp_dev.c:1197:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1780340904.577724:0:90574:0:(osd_handler.c:8933:osd_obd_connect()) connect #7 00000020:00000080:0.0:1780340904.577730:0:90574:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa24651432775321 00010000:00080000:0.0:1780340904.577785:0:90574:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c046bae0000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.116@tcp at head 00000100:00100000:1.0:1780340904.578023:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961223936 00000100:00100000:1.0:1780340904.578031:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961223936 00000100:00100000:1.0:1780340904.578069:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5927 00000100:00100000:1.0:1780340904.578077:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3658:x1866818961223936:12345-0@lo:8:llog_process_th.0 00010000:00080000:1.0:1780340904.578101:0:25486:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3684 last 0 00000020:00000080:1.0:1780340904.578121:0:25486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432775328 00002000:00100000:1.0:1780340904.578133:0:25486:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c044d43a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211351c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1780340904.578138:0:25486:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1780340904.578140:0:25486:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1780340904.578209:0:25486:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1780340904.578227:0:25486:0:(import.c:65:import_set_state_nolock()) ffff8c044d438000 : changing import state from RECOVER to FULL 00010000:00010000:0.0:1780340904.579549:0:90574:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:0.0:1780340904.579623:0:90574:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1780340904.579637:0:90574:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1780340904.581678:0:90574:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 26, last_idx 27 00000040:00080000:0.0:1780340904.583147:0:90574:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1780340904.583186:0:90574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].28, 64 off9984 00000040:00080000:0.0:1780340904.583368:0:90574:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x72:0x0].1, 64 off8256 00000100:00100000:1.0:1780340904.583493:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3658:x1866818961223936:12345-0@lo:8:llog_process_th.0 Request processed in 5407us (6181us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340904.583508:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5927 00000100:00100000:3.0:1780340904.586085:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1780340904.586098:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1780340904.586107:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1780340904.586114:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1780340904.586117:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c046b9a9000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1780340904.586139:0:3658:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:3.0:1780340904.586148:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961223936:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1780340904.586191:0:90580:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1780340904.586273:0:90580:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3684575512428ns, next at 0ns, rc = 0 00080000:00080000:3.0:1780340904.586279:0:90580:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1780340904.587670:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340904.587688:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961224064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340904.587754:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340904.587818:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961224064 00000100:00100000:1.0:1780340904.587825:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961224064 00000100:00100000:1.0:1780340904.587891:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2134 00000100:00100000:1.0:1780340904.587902:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961224064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780340904.587923:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780340904.587965:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961224064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340904.587973:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2134 00000100:00080000:1.0:1780340904.587996:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340904.588031:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961224064:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1780340904.592732:0:90562:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:2.0:1780340904.593110:0:90582:0:(llog.c:800:llog_process_thread()) index: 27, lh_last_idx: 28 synced_idx: 0 lgh_last_idx: 28 00000040:00080000:2.0:1780340904.593119:0:90582:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1780340904.593361:0:90582:0:(llog_cat.c:1207:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 27, last_idx 28 00000040:00080000:2.0:1780340904.593392:0:90582:0:(llog_cat.c:1250:llog_cat_cleanup()) cancel plain log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000040:00080000:2.0:1780340904.594755:0:90582:0:(llog.c:800:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:2.0:1780340904.594795:0:90582:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1780340904.596271:0:90574:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1780340904.596285:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1780340904.596323:0:90574:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1780340904.596464:0:90574:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa2465143277532f 00000100:00080000:1.0:1780340904.596474:0:90574:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1780340904.596480:0:90574:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c046bae0000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340904.596516:0:90574:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c034d4ca300 x1866818961224192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340904.596591:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961224192:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1780340904.596664:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780340904.596726:0:90574:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1780340904.596807:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340904.596812:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340904.596813:0:90574:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1780340904.596816:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780340904.596820:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340904.596821:0:90574:0:(obd_config.c:1561:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1780340904.596824:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1780340904.596826:0:90574:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1780340904.596828:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340904.596831:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340904.596832:0:90574:0:(obd_config.c:1561:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1780340904.596835:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780340904.596845:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340904.596846:0:90574:0:(obd_config.c:1561:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1780340904.596850:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1780340904.596855:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340904.596858:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340904.596859:0:90574:0:(obd_config.c:1561:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000020:01000000:1.0:1780340904.596861:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780340904.596864:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340904.596866:0:90574:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:1.0:1780340904.596869:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1780340904.596911:0:90574:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:1.0:1780340904.597321:0:90574:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8cb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90574:1866818961224320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340904.598575:0:90574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340904.598620:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961224192 00000100:00100000:1.0:1780340904.598628:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961224320 00000100:00100000:2.0:1780340904.598638:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961224192 00000100:00100000:1.0:1780340904.598638:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961224320 00000100:00100000:2.0:1780340904.598722:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5928 00000100:00100000:1.0:1780340904.598723:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1780340904.598744:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3658:x1866818961224192:12345-0@lo:8:llog_process_th.0 00000100:00100000:1.0:1780340904.598746:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:90574:x1866818961224320:12345-0@lo:502:llog_process_th.0 00010000:00080000:2.0:1780340904.598832:0:8399:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3684 last 0 00000020:00000080:2.0:1780340904.598881:0:8399:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa24651432775336 00002000:00100000:2.0:1780340904.598905:0:8399:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c0452a6e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211351c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1780340904.598910:0:8399:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1780340904.598915:0:8399:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1780340904.598928:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:90574:x1866818961224320:12345-0@lo:502:llog_process_th.0 Request processed in 188us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340904.598937:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1780340904.598998:0:90574:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0349923f00 going to sleep for 11 seconds 00002000:00080000:2.0:1780340904.599025:0:8399:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1780340904.599026:0:90574:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8cb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90574:1866818961224320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1780340904.599062:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:2.0:1780340904.599066:0:8399:0:(import.c:65:import_set_state_nolock()) ffff8c047a1ec800 : changing import state from RECOVER to FULL 00000020:00000080:1.0:1780340904.599069:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340904.599073:0:90574:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:1.0:1780340904.599078:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780340904.599085:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340904.599086:0:90574:0:(obd_config.c:1561:class_process_config()) marker 47 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1780340904.599092:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1780340904.599107:0:90574:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:0.0:1780340904.604112:0:90574:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90574:1866818961224448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340904.604204:0:90574:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340904.604251:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961224448 00000100:00100000:0.0:1780340904.604259:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961224448 00000100:00100000:0.0:1780340904.604308:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1780340904.604317:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:90574:x1866818961224448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340904.604441:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:90574:x1866818961224448:12345-0@lo:502:llog_process_th.0 Request processed in 124us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340904.604457:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1780340904.604505:0:90574:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445f1e300 going to sleep for 11 seconds 00000100:00100000:0.0:1780340904.604526:0:90574:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90574:1866818961224448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1780340904.604563:0:90574:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780340904.604571:0:90574:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340904.604572:0:90574:0:(obd_config.c:1561:class_process_config()) marker 47 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1780340904.604576:0:90574:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000004:1.0:1780340904.604870:0:90584:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0470f7c000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1780340904.604874:0:90584:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c0470f7c000 4 00000020:01000000:0.0:1780340904.604948:0:90561:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-52 (rc=0) 10000000:01000000:0.0:1780340904.604973:0:90561:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1780340904.604996:0:90561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa24651432775279 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775280 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.605008:0:90561:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa24651432775279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775280 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340904.605015:0:90561:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c0470f7c000 from 1 10000000:01000000:0.0:1780340904.605017:0:90561:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1780340904.605042:0:90561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa2465143277533d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.605050:0:90561:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa2465143277533d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.605057:0:90561:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa2465143277533d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340904.605068:0:90561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961224576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1780340904.605093:0:90561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340904.605113:0:90561:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0347fbf240 going to sleep for 11 seconds 00000100:00100000:1.0:1780340904.605171:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961224576 00000100:00100000:1.0:1780340904.605176:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961224576 00000100:00100000:1.0:1780340904.605208:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1780340904.605216:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:90561:x1866818961224576:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780340904.605234:0:90568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340904.605247:0:90568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453123e00/0xa24651432775344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277533d expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.605267:0:90568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453123e00/0xa24651432775344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277533d expref: 8 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.605278:0:90568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453123e00/0xa24651432775344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277533d expref: 8 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.605286:0:90568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123e00, rc 0) 00000100:00100000:1.0:1780340904.605321:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:90561:x1866818961224576:12345-0@lo:101:mount.lustre.0 Request processed in 107us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340904.605327:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1780340904.605458:0:90561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961224576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340904.605468:0:90561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa2465143277533d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775344 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.605476:0:90561:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa2465143277533d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775344 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340904.605577:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1780340904.605584:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1780340904.605590:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1780340904.605594:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1780340904.605598:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c046bae0000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1780340904.605661:0:3658:0:(osp_dev.c:1641:osp_import_event()) got connected 00000100:00100000:2.0:1780340904.605672:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1866818961224192:12345-0@lo:8:llog_process_th.0 Request processed in 6923us (8998us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340904.605673:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961224192:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1780340904.605720:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5928 00000100:00100000:3.0:1780340904.605806:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961224704:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1780340904.605810:0:90582:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1780340904.605844:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1780340904.605922:0:90582:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3684595161882ns, next at 0ns, rc = 0 00080000:00080000:2.0:1780340904.605931:0:90582:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1780340904.606028:0:90561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961224832:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1780340904.606062:0:90561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340904.606081:0:90561:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0347fbf240 going to sleep for 11 seconds 00000100:00100000:1.0:1780340904.606088:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961224832 00000100:00100000:1.0:1780340904.606092:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961224832 00000100:00100000:1.0:1780340904.606123:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1780340904.606130:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:90561:x1866818961224832:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1780340904.606154:0:90570:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1780340904.606172:0:90570:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1780340904.606176:0:90570:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1780340904.606179:0:90570:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1780340904.606181:0:90570:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 123 00000100:00100000:1.0:1780340904.606322:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:90561:x1866818961224832:12345-0@lo:256:mount.lustre.0 Request processed in 192us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340904.606334:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1780340904.606391:0:90561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961224832:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1780340904.607056:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961224704 00000100:00100000:3.0:1780340904.607063:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961224704 00000100:00100000:3.0:1780340904.607106:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135 00000100:00100000:3.0:1780340904.607112:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961224704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340904.607128:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340904.607181:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961224704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340904.607188:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135 10000000:01000000:1.0:1780340904.607498:0:90561:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1780340904.607512:0:90561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa2465143277533d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775344 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.607522:0:90561:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa2465143277533d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775344 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340904.607530:0:90561:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c0470f7c000 from 1 10000000:01000000:1.0:1780340904.607533:0:90561:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1780340904.607559:0:90561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123800/0xa2465143277534b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.607566:0:90561:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453123800/0xa2465143277534b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.607574:0:90561:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453123800/0xa2465143277534b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340904.607590:0:90561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961224960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1780340904.607622:0:90561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340904.607755:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961224960 00000100:00100000:0.0:1780340904.607772:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961224960 00000100:00100000:0.0:1780340904.607799:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1780340904.607806:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:90561:x1866818961224960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340904.607814:0:90567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340904.607827:0:90567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa4a00/0xa24651432775352 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277534b expref: -99 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.607845:0:90567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa4a00/0xa24651432775352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277534b expref: 9 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.607854:0:90567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa4a00/0xa24651432775352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277534b expref: 9 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.607861:0:90567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4a00, rc 0) 00000100:00100000:0.0:1780340904.607887:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:90561:x1866818961224960:12345-0@lo:101:mount.lustre.0 Request processed in 82us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340904.607892:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1780340904.613041:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340904.613111:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961224704:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1780340904.618214:0:90562:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1780340904.618551:0:90561:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345ecfcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340904.618592:0:90561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961224960:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780340904.618616:0:90561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453123800/0xa2465143277534b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775352 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.618629:0:90561:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453123800/0xa2465143277534b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775352 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340904.618725:0:90561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961225088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1780340904.618807:0:90561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340904.619229:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961225088 00000100:00100000:0.0:1780340904.619235:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961225088 00000100:00100000:0.0:1780340904.619283:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1780340904.619293:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:90561:x1866818961225088:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780340904.619446:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:90561:x1866818961225088:12345-0@lo:501:mount.lustre.0 Request processed in 154us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340904.619453:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1780340904.619491:0:90561:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345ecfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340904.619507:0:90561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961225088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1780340904.619542:0:90561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961225216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1780340904.619594:0:90561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340904.619616:0:90561:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a2df480 going to sleep for 11 seconds 00000100:00100000:1.0:1780340904.619899:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961225216 00000100:00100000:1.0:1780340904.619904:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961225216 00000100:00100000:1.0:1780340904.619951:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1780340904.619958:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:90561:x1866818961225216:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780340904.620041:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:90561:x1866818961225216:12345-0@lo:503:mount.lustre.0 Request processed in 83us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340904.620047:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1780340904.620072:0:90561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961225216:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1780340904.620625:0:90585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd69180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90585:1866818961225344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340904.620667:0:90585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340904.620699:0:90585:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348254cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340904.620739:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961225344 00000100:00100000:1.0:1780340904.620743:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961225344 00000100:00100000:1.0:1780340904.620799:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1780340904.620807:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:90585:x1866818961225344:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340904.621411:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:90585:x1866818961225344:12345-0@lo:502:llog_process_th.0 Request processed in 603us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340904.621419:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1780340904.621490:0:90585:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd69180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90585:1866818961225344:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780340904.621513:0:90585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340904.621522:0:90585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340904.621524:0:90585:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1780340904.621531:0:90585:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0470f7c000 00000020:00000080:2.0:1780340904.621533:0:90585:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1780340904.621542:0:90585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340904.621544:0:90585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340904.621545:0:90585:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1780340904.621547:0:90585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340904.621550:0:90585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340904.621551:0:90585:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1780340904.621554:0:90585:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0470f7c000 00000020:00000080:2.0:1780340904.621556:0:90585:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1780340904.621628:0:90585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd69180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90585:1866818961225472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340904.621663:0:90585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340904.621690:0:90585:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348254cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340904.622521:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961225472 00000100:00100000:1.0:1780340904.622530:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961225472 00000100:00100000:1.0:1780340904.622567:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1780340904.622574:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:90585:x1866818961225472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340904.622686:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:90585:x1866818961225472:12345-0@lo:502:llog_process_th.0 Request processed in 112us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340904.622693:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1780340904.622795:0:90585:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd69180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90585:1866818961225472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1780340904.622818:0:90585:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1780340904.622825:0:90585:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1780340904.622826:0:90585:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1780340904.622830:0:90585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1780340904.623018:0:90561:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1780340904.623043:0:90561:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1780340904.623064:0:90561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123800/0xa2465143277534b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775352 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.623076:0:90561:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453123800/0xa2465143277534b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775352 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340904.623122:0:90561:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1780340904.623125:0:90561:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c0470f7c000 10000000:01000000:1.0:1780340904.623128:0:90561:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c0470f7c000 10000000:01000000:1.0:1780340904.623131:0:90561:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1780340904.623136:0:90561:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c0470f7c000 from 1 10000000:01000000:1.0:1780340904.623139:0:90561:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780340904.623166:0:90561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123c00/0xa24651432775359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.623173:0:90561:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453123c00/0xa24651432775359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.623232:0:90561:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453123c00/0xa24651432775359 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340904.623250:0:90561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961225600:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1780340904.623282:0:90561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340904.623316:0:90561:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345ecfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340904.623433:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961225600 00000100:00100000:0.0:1780340904.623439:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961225600 00000100:00100000:0.0:1780340904.623474:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1780340904.623481:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:90561:x1866818961225600:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1780340904.623492:0:90570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340904.623503:0:90570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa5400/0xa24651432775360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432775359 expref: -99 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.623535:0:90570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa5400/0xa24651432775360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775359 expref: 10 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.623544:0:90570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa5400/0xa24651432775360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775359 expref: 10 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340904.623554:0:90570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5400, rc 0) 00000100:00100000:0.0:1780340904.623591:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:90561:x1866818961225600:12345-0@lo:101:mount.lustre.0 Request processed in 110us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340904.623597:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1780340904.623603:0:90561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961225600:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780340904.623614:0:90561:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453123c00/0xa24651432775359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775360 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.623623:0:90561:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453123c00/0xa24651432775359 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775360 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340904.623683:0:90561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961225728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780340904.623707:0:90561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340904.623731:0:90561:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047a9dd900 going to sleep for 11 seconds 00000100:00100000:2.0:1780340904.623807:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961225728 00000100:00100000:2.0:1780340904.623811:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961225728 00000100:00100000:2.0:1780340904.623834:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1780340904.623840:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:90561:x1866818961225728:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1780340904.623941:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:90561:x1866818961225728:12345-0@lo:501:mount.lustre.0 Request processed in 101us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340904.623948:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1780340904.626608:0:90561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961225728:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1780340904.626661:0:90561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961225856:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780340904.626726:0:90561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340904.626780:0:90561:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047a9dd900 going to sleep for 11 seconds 00000100:00100000:1.0:1780340904.627265:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961225856 00000100:00100000:1.0:1780340904.627272:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961225856 00000100:00100000:1.0:1780340904.627325:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1780340904.627335:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:90561:x1866818961225856:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1780340904.627457:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:90561:x1866818961225856:12345-0@lo:503:mount.lustre.0 Request processed in 123us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340904.627473:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1780340904.627614:0:90561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961225856:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1780340904.632432:0:90588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90588:1866818961225984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340904.632505:0:90588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340904.632548:0:90588:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047a9ddf00 going to sleep for 11 seconds 00000100:00100000:1.0:1780340904.633017:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961225984 00000100:00100000:1.0:1780340904.633025:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961225984 00000100:00100000:1.0:1780340904.633075:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1780340904.633085:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:90588:x1866818961225984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340904.633347:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:90588:x1866818961225984:12345-0@lo:502:llog_process_th.0 Request processed in 137us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340904.633356:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1780340904.633465:0:90588:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90588:1866818961225984:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1780340904.633521:0:90588:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1780340904.633535:0:90588:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8c047658b380) 00000020:00000080:3.0:1780340904.633559:0:90588:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1780340904.633723:0:90588:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0470f7c000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1780340904.633727:0:90588:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0470f7c000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1780340904.633730:0:90588:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c0470f7c000 4 00010000:00080000:3.0:1780340904.633779:0:90588:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c0442c0f800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.116@tcp at head 00010000:00010000:3.0:1780340904.640187:0:90588:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:3.0:1780340904.640454:0:90588:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1780340904.640500:0:90588:0:(lwp_dev.c:494:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1780340904.640511:0:90588:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa2465143277536e 00000100:00080000:3.0:1780340904.640521:0:90588:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1780340904.640532:0:90588:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c0442c0f800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340904.640562:0:90588:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c03498db800 x1866818961226112/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340904.640598:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961226112:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1780340904.640660:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1780340904.640705:0:90588:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1780340904.640949:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961226112 00000100:00100000:1.0:1780340904.640956:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961226112 00000100:00100000:1.0:1780340904.640987:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:1.0:1780340904.640993:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961226112:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1780340904.641039:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961226112:12345-0@lo:38:llog_process_th.0 Request processed in 45us (379us total) trans 0 rc -11/-11 00000100:00100000:1.0:1780340904.641046:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:3.0:1780340904.641351:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1780340904.641360:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0442c0f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340904.641364:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1780340904.641368:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961226112:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1780340904.641455:0:90588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90588:1866818961226240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340904.641493:0:90588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340904.641512:0:90588:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047a9ddf00 going to sleep for 11 seconds 00000100:00100000:3.0:1780340904.641527:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961226240 00000100:00100000:3.0:1780340904.641530:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961226240 00000100:00100000:3.0:1780340904.641554:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1780340904.641559:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:90588:x1866818961226240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340904.641654:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:90588:x1866818961226240:12345-0@lo:502:llog_process_th.0 Request processed in 94us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340904.641660:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1780340904.641696:0:90588:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90588:1866818961226240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340904.641723:0:90588:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90588:1866818961226368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340904.641749:0:90588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340904.647243:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961226368 00000100:00100000:1.0:1780340904.647257:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961226368 00000100:00100000:1.0:1780340904.647313:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1780340904.647323:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:90588:x1866818961226368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340904.647542:0:90588:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047a9ddf00 going to sleep for 11 seconds 00000100:00100000:1.0:1780340904.650202:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:90588:x1866818961226368:12345-0@lo:502:llog_process_th.0 Request processed in 2862us (8433us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340904.650225:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1780340904.650656:0:90588:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90588:1866818961226368:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1780340904.650697:0:90588:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:1.0:1780340904.651365:0:90561:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-57 (rc=0) 10000000:01000000:1.0:1780340904.651397:0:90561:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1780340904.651415:0:90561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123c00/0xa24651432775359 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775360 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340904.651442:0:90561:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453123c00/0xa24651432775359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775360 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1780340904.651495:0:90561:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1780340904.651497:0:90561:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780340904.651499:0:90561:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780340904.651500:0:90561:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780340904.651501:0:90561:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780340904.651503:0:90561:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780340904.651504:0:90561:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780340904.651505:0:90561:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780340904.651507:0:90561:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780340904.651508:0:90561:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1780340904.651512:0:90561:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1780340904.651515:0:90561:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1780340904.651516:0:90561:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1780340904.651517:0:90561:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1780340904.651518:0:90561:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1780340904.651519:0:90561:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1780340904.651520:0:90561:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1780340904.651521:0:90561:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1780340904.651522:0:90561:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1780340904.651523:0:90561:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1780340904.651524:0:90561:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1780340904.651547:0:90561:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1780340904.651866:0:90561:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961226496:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1780340904.652002:0:90561:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340904.652074:0:90561:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0450132a80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340904.652476:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961226496 00000100:00100000:3.0:1780340904.652485:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961226496 00000100:00100000:3.0:1780340904.652571:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1780340904.652582:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:90561:x1866818961226496:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1780340904.652614:0:90573:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1780340904.652629:0:90573:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1780340904.654877:0:90573:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1780340904.654903:0:90573:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1780340904.655015:0:90571:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1780340904.655020:0:90571:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1780340904.655043:0:90571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c047a8b2200/0xa24651432775375 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.655060:0:90571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0453123e00/0xa24651432775344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277533d expref: 10 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.655070:0:90571:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c047a8b2200/0xa24651432775375 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.655109:0:90571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0453123e00/0xa24651432775344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2465143277533d expref: 10 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.655126:0:90571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0453123e00/0xa24651432775344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2465143277533d expref: 10 pid: 90568 timeout: 3784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340904.655141:0:90571:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90571:1866818961226624:0@lo:104: 00000100:00100000:3.0:1780340904.655214:0:90571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340904.655249:0:90571:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047a9ddf00 going to sleep for 11 seconds 00000100:00100000:1.0:1780340904.655667:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:90561:x1866818961226496:12345-0@lo:253:mount.lustre.0 Request processed in 3086us (3664us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340904.655679:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1780340904.655806:0:90561:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:90561:1866818961226496:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1780340904.655826:0:90561:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1780340904.655829:0:90561:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1780340904.655831:0:90561:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1780340904.655832:0:90561:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780340904.655833:0:90561:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780340904.655835:0:90561:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780340904.655836:0:90561:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780340904.655837:0:90561:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1780340904.655838:0:90561:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1780340904.655840:0:90561:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780340904.655841:0:90561:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1780340904.655854:0:90561:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1780340904.656684:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961226624 00000100:00100000:2.0:1780340904.656691:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961226624 00000100:00100000:2.0:1780340904.663810:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1780340904.663830:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:90571:x1866818961226624:12345-0@lo:104: 00010000:00010000:2.0:1780340904.663847:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa2465143277533d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775344 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340904.663963:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1780340904.663970:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:90571:x1866818961226624:12345-0@lo:104: Request processed in 149us (8756us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340904.663976:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1780340904.664069:0:90571:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90571:1866818961226624:0@lo:104: 00010000:00010000:0.0:1780340904.664095:0:90571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c047a8b2200/0xa24651432775375 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666202:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340904.666215:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa2465143277533d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775344 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666226:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4600 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340904.666231:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa2465143277533d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432775344 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666241:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa2465143277533d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432775344 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340904.666249:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa2465143277533d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432775344 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340904.666256:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1780340904.666308:0:6504:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa2465143277533d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775344 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666315:0:6504:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340904.666335:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa2465143277533d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775344 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666371:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4600/0xa2465143277533d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775344 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666390:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340904.666392:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340904.666393:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340904.666413:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961226752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340904.666471:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340904.666541:0:6503:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961226752 00000100:00100000:3.0:1780340904.666549:0:6503:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961226752 00010000:00010000:3.0:1780340904.666573:0:6503:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0453123e00/0xa24651432775344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2465143277533d expref: 10 pid: 90568 timeout: 3784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340904.666600:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:3.0:1780340904.666608:0:6503:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:3662:x1866818961226752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340904.666621:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340904.666626:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0453123e00/0xa24651432775344 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2465143277533d expref: 10 pid: 90568 timeout: 3784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666637:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0453123e00/0xa24651432775344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2465143277533d expref: 10 pid: 90568 timeout: 3784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666651:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453123e00/0xa24651432775344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2465143277533d expref: 10 pid: 90568 timeout: 3784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666665:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c047a8b2200/0xa24651432775375 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666685:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a8b2200/0xa24651432775375 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1780340904.666700:0:6503:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011680912s 00010000:00010000:3.0:1780340904.666705:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c047a8b2200/0xa24651432775375 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666713:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c047a8b2200/0xa24651432775375 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666720:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c047a8b2200/0xa24651432775375 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666727:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c047a8b2200/0xa24651432775375 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666733:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b2200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340904.666738:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c047a8b2200/0xa24651432775375 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666745:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c047a8b2200/0xa24651432775375 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666791:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c047a8b2200/0xa24651432775375 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666801:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340904.666835:0:6503:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:3662:x1866818961226752:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340904.666842:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:3.0:1780340904.666886:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961226752:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340904.666908:0:90571:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c047a8b2200/0xa24651432775375 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666916:0:90571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c047a8b2200/0xa24651432775375 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340904.666922:0:90571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a8b2200/0xa24651432775375 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1780340904.694744:0:90561:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444069 00000040:01000000:0.0:1780340904.695684:0:90561:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1780340904.696694:0:90593:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444069 00000020:00080000:3.0:1780340904.696702:0:90593:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444069 00000040:01000000:0.0:1780340904.697175:0:90594:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1780340904.697307:0:90561:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1780340904.697912:0:90594:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1780340904.698280:0:90595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90595:1866818961226880:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1780340904.698359:0:90595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340904.698389:0:90595:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348171480 going to sleep for 11 seconds 00000040:01000000:1.0:1780340904.698805:0:90561:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1780340904.698838:0:90561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1780340904.699749:0:90561:0:(mdd_device.c:556:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1780340904.699779:0:90561:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1780340904.699819:0:90561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1780340904.701544:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961226880 00000100:00100000:2.0:1780340904.701556:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961226880 00000100:00100000:2.0:1780340904.701614:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3958 00000100:00100000:2.0:1780340904.701623:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90595:x1866818961226880:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1780340904.701738:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90595:x1866818961226880:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 116us (3380us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340904.701746:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3958 00000100:00100000:2.0:1780340904.701829:0:90595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90595:1866818961226880:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1780340904.701866:0:90595:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1780340904.701908:0:90595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd69c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90595:1866818961227008:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1780340904.701943:0:90595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340904.701972:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961227008 00000100:00100000:2.0:1780340904.701986:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961227008 00000100:00100000:2.0:1780340904.702008:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3959 00000100:00100000:2.0:1780340904.702013:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90595:x1866818961227008:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1780340904.702099:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90595:x1866818961227008:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 85us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340904.702105:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3959 00000100:00100000:2.0:1780340904.702123:0:90595:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348254e40 going to sleep for 11 seconds 00000100:00100000:2.0:1780340904.702134:0:90595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd69c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90595:1866818961227008:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1780340904.702187:0:90595:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd69c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90595:1866818961227136:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1780340904.702209:0:90595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340904.702239:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961227136 00000100:00100000:2.0:1780340904.702243:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961227136 00000100:00100000:2.0:1780340904.702261:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3960 00000100:00100000:2.0:1780340904.702267:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90595:x1866818961227136:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1780340904.702304:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90595:x1866818961227136:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 37us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340904.702310:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3960 00000100:00100000:2.0:1780340904.702324:0:90595:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04453b1540 going to sleep for 11 seconds 00000100:00100000:2.0:1780340904.702349:0:90595:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd69c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90595:1866818961227136:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1780340904.702388:0:90595:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1780340904.705526:0:90561:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1780340904.711217:0:90561:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1780340904.711328:0:90561:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1780340904.711458:0:90561:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1780340904.711943:0:90561:0:(osd_handler.c:5579:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00000040:00080000:2.0:1780340904.711985:0:90595:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1780340904.712057:0:90595:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1780340904.715356:0:90594:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1780340904.715435:0:90594:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1780340904.715439:0:90594:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1780340904.722384:0:90561:0:(ldlm_lib.c:3035:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 115964117000 00010000:00080000:3.0:1780340904.725453:0:90596:0:(ldlm_lib.c:2838:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 90596 00010000:02000000:3.0:1780340904.725474:0:90596:0:(ldlm_lib.c:2320:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1780340904.725478:0:90596:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1780340904.725482:0:90596:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1780340904.728378:0:90561:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1780340904.728399:0:90561:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.116@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1780340904.728417:0:90561:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=47 00000080:00000004:0.0:1780340904.728449:0:90561:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1780340904.729282:0:90561:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1780340904.729516:0:90561:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1780340904.841891:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340905.871144:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1780340906.123493:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1780340906.123501:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c0470f7c000 from 124 10000000:01000000:1.0:1780340906.123506:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1780340906.123557:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa2465143277537c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340906.123570:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa2465143277537c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340906.123581:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa2465143277537c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340906.123608:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961227264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340906.123673:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340906.123720:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b3633c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340906.123923:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961227264 00000100:00100000:2.0:1780340906.123932:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961227264 00000100:00100000:2.0:1780340906.123985:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1780340906.124007:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:6514:x1866818961227264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340906.124020:0:90570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340906.124034:0:90570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c6200/0xa24651432775383 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277537c expref: -99 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.124060:0:90570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c6200/0xa24651432775383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277537c expref: 10 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.124071:0:90570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c6200/0xa24651432775383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277537c expref: 10 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.124080:0:90570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6200, rc 0) 00000100:00100000:2.0:1780340906.124125:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961227264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340906.124132:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1780340906.124290:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961227264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340906.124304:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa2465143277537c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775383 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.124325:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa2465143277537c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775383 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340906.124400:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961227392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1780340906.124429:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340906.124457:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348171c00 going to sleep for 11 seconds 00000100:00100000:2.0:1780340906.124563:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961227392 00000100:00100000:2.0:1780340906.124568:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961227392 00000100:00100000:2.0:1780340906.124601:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1780340906.124608:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961227392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1780340906.124622:0:90567:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1780340906.124637:0:90567:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1780340906.124640:0:90567:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 124 00000100:00100000:2.0:1780340906.124714:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961227392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340906.124721:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1780340906.124957:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961227392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1780340906.125014:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1780340906.125021:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa2465143277537c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775383 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.125029:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa2465143277537c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775383 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340906.125037:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780340906.125039:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c045f0c4800 from 58 10000000:01000000:0.0:1780340906.125042:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780340906.125058:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5c00/0xa2465143277538a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.125065:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5c00/0xa2465143277538a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.125072:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5c00/0xa2465143277538a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340906.125085:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961227520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.125112:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340906.125146:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034740b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340906.125219:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961227520 00000100:00100000:2.0:1780340906.125224:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961227520 00000100:00100000:2.0:1780340906.125256:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1780340906.125263:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:6514:x1866818961227520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340906.125281:0:90570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340906.125290:0:90570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c6800/0xa24651432775391 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277538a expref: -99 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.125306:0:90570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c6800/0xa24651432775391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277538a expref: 11 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.125325:0:90570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c6800/0xa24651432775391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277538a expref: 11 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.125340:0:90570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6800, rc 0) 00000100:00100000:2.0:1780340906.125379:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961227520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340906.125384:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1780340906.125510:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961227520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340906.125521:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5c00/0xa2465143277538a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775391 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340906.125529:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5c00/0xa2465143277538a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775391 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340906.125598:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961227648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340906.125621:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340906.125644:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b3633c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340906.125697:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961227648 00000100:00100000:0.0:1780340906.125702:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961227648 00000100:00100000:0.0:1780340906.125731:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1780340906.125737:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961227648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.125872:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961227648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340906.125879:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1780340906.125916:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961227648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.125944:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961227776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.125983:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340906.126002:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034740bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340906.126014:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961227776 00000100:00100000:0.0:1780340906.126017:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961227776 00000100:00100000:0.0:1780340906.126038:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1780340906.126044:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961227776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.126118:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961227776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340906.126124:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1780340906.126162:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961227776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780340906.126886:0:90656:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:0.0:1780340906.126948:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:0.0:1780340906.126967:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780340906.126975:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5c00/0xa2465143277538a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775391 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.126984:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5c00/0xa2465143277538a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775391 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340906.126994:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1780340906.126996:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c045f0c4800 from 121 10000000:01000000:0.0:1780340906.126999:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1780340906.127026:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432775398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.127034:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432775398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.127051:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432775398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340906.127067:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961227904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.127100:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340906.127124:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034740b000 going to sleep for 11 seconds 00000100:00100000:0.0:1780340906.127138:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961227904 00000100:00100000:0.0:1780340906.127142:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961227904 00000100:00100000:0.0:1780340906.127171:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1780340906.127178:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+11:6514:x1866818961227904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340906.127187:0:90570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340906.127197:0:90570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa5600/0xa2465143277539f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432775398 expref: -99 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.127214:0:90570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa5600/0xa2465143277539f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775398 expref: 12 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.127222:0:90570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa5600/0xa2465143277539f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775398 expref: 12 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.127230:0:90570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5600, rc 0) 00000100:00100000:0.0:1780340906.127259:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961227904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340906.127266:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1780340906.127303:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961227904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340906.127312:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432775398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277539f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.127324:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432775398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277539f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340906.127383:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961228032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.127409:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340906.127421:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034740b000 going to sleep for 11 seconds 00000100:00100000:0.0:1780340906.127432:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961228032 00000100:00100000:0.0:1780340906.127435:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961228032 00000100:00100000:0.0:1780340906.127455:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1780340906.127461:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961228032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1780340906.127472:0:90570:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1780340906.127488:0:90570:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1780340906.127492:0:90570:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1780340906.127495:0:90570:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1780340906.127498:0:90570:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1780340906.127500:0:90570:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 124 00000100:00100000:0.0:1780340906.127571:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961228032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340906.127578:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1780340906.127607:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961228032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1780340906.127673:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1780340906.127678:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432775398 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277539f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.127684:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432775398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277539f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340906.127698:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1780340906.127700:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:0.0:1780340906.127703:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1780340906.127716:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5200/0xa246514327753a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.127723:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5200/0xa246514327753a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.127730:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5200/0xa246514327753a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340906.127741:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961228160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.127790:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340906.127808:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034740b000 going to sleep for 11 seconds 00000100:00100000:0.0:1780340906.127818:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961228160 00000100:00100000:0.0:1780340906.127821:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961228160 00000100:00100000:0.0:1780340906.127839:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1780340906.127845:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+12:6514:x1866818961228160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340906.127853:0:90570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340906.127861:0:90570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa5800/0xa246514327753ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327753a6 expref: -99 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.127874:0:90570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa5800/0xa246514327753ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327753a6 expref: 13 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.127882:0:90570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa5800/0xa246514327753ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327753a6 expref: 13 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.127898:0:90570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5800, rc 0) 00000100:00100000:0.0:1780340906.127927:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961228160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340906.127933:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1780340906.127963:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961228160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340906.127972:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5200/0xa246514327753a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327753ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.127982:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5200/0xa246514327753a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327753ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340906.128027:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961228288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.128049:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340906.128061:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345c7cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340906.128071:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961228288 00000100:00100000:0.0:1780340906.128074:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961228288 00000100:00100000:0.0:1780340906.128093:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1780340906.128099:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961228288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.128209:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961228288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340906.128216:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1780340906.128243:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961228288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.128268:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961228416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.128303:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340906.128322:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345c7cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340906.128344:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961228416 00000100:00100000:0.0:1780340906.128347:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961228416 00000100:00100000:0.0:1780340906.128366:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1780340906.128371:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961228416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.128450:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961228416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340906.128456:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1780340906.128493:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961228416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780340906.132191:0:90657:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 52 00000020:01000000:0.0:1780340906.139864:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-52 (rc=0) 10000000:01000000:0.0:1780340906.139905:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1780340906.139917:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5200/0xa246514327753a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327753ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.139930:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5200/0xa246514327753a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327753ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340906.139939:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1780340906.139942:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8c045f0c4800 from 1 10000000:01000000:0.0:1780340906.139945:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1780340906.139981:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4200/0xa246514327753b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.139989:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4200/0xa246514327753b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.140000:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4200/0xa246514327753b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340906.140022:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961228544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.140097:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340906.140135:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345c7cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1780340906.140206:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961228544 00000100:00100000:2.0:1780340906.140221:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961228544 00000100:00100000:2.0:1780340906.140265:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1780340906.140273:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+13:6514:x1866818961228544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340906.140285:0:90570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340906.140296:0:90570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c7200/0xa246514327753bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327753b4 expref: -99 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.140325:0:90570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c7200/0xa246514327753bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327753b4 expref: 14 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.140345:0:90570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c7200/0xa246514327753bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327753b4 expref: 14 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.140353:0:90570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7200, rc 0) 00000100:00100000:2.0:1780340906.140409:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:6514:x1866818961228544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340906.140416:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1780340906.140742:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961228544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340906.140755:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4200/0xa246514327753b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327753bb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340906.140779:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4200/0xa246514327753b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327753bb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340906.140793:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1780340906.140797:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4200/0xa246514327753b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327753bb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340906.140804:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4200/0xa246514327753b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327753bb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340906.140810:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1780340906.140812:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c045f0c4800 from 7 10000000:01000000:1.0:1780340906.140814:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1780340906.140827:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122a00/0xa246514327753c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340906.140834:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453122a00/0xa246514327753c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340906.140841:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453122a00/0xa246514327753c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340906.140859:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961228672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340906.140888:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340906.140913:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b3633c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340906.140979:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961228672 00000100:00100000:3.0:1780340906.140984:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961228672 00000100:00100000:3.0:1780340906.141019:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1780340906.141026:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:6514:x1866818961228672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340906.141034:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340906.141042:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a8b2200/0xa246514327753c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327753c2 expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.141057:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a8b2200/0xa246514327753c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327753c2 expref: 15 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.141064:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a8b2200/0xa246514327753c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327753c2 expref: 15 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.141071:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a8b2200, rc 0) 00000100:00100000:3.0:1780340906.141109:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961228672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340906.141116:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1780340906.141343:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961228672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340906.141354:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453122a00/0xa246514327753c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327753c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340906.141363:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453122a00/0xa246514327753c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327753c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340906.141586:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961228800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340906.141614:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340906.141644:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b3633c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340906.141688:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961228800 00000100:00100000:0.0:1780340906.141692:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961228800 00000100:00100000:0.0:1780340906.141725:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1780340906.141732:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961228800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.141872:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961228800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340906.141879:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1780340906.141988:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961228800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340906.142015:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961228928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340906.142056:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340906.142081:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b3633c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340906.142132:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961228928 00000100:00100000:3.0:1780340906.142135:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961228928 00000100:00100000:3.0:1780340906.142166:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1780340906.142173:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961228928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340906.142267:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961228928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340906.142280:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1780340906.142558:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961228928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1780340906.143587:0:90658:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1780340906.143837:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1780340906.143860:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1780340906.143870:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122a00/0xa246514327753c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327753c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.143880:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453122a00/0xa246514327753c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327753c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340906.143889:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780340906.143891:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c04773ad000 from 58 10000000:01000000:0.0:1780340906.143895:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780340906.143924:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa246514327753d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.143931:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa246514327753d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.143939:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa246514327753d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340906.143956:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961229056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.144018:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340906.144051:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961229056 00000100:00100000:2.0:1780340906.144058:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961229056 00000100:00100000:2.0:1780340906.144116:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1780340906.144124:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961229056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340906.144135:0:90568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340906.144148:0:90568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c6a00/0xa246514327753d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327753d0 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.144168:0:90568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c6a00/0xa246514327753d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327753d0 expref: 16 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.144177:0:90568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c6a00/0xa246514327753d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327753d0 expref: 16 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.144185:0:90568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6a00, rc 0) 00000100:00100000:2.0:1780340906.144216:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961229056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340906.144222:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1780340906.148358:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345c7c480 going to sleep for 11 seconds 00000100:00100000:0.0:1780340906.148415:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961229056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340906.148441:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa246514327753d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327753d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.148453:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa246514327753d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327753d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340906.148537:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961229184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.148597:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340906.148625:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345c7c480 going to sleep for 11 seconds 00000100:00100000:2.0:1780340906.148667:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961229184 00000100:00100000:2.0:1780340906.148673:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961229184 00000100:00100000:2.0:1780340906.148729:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1780340906.148739:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961229184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340906.148901:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961229184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340906.148908:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1780340906.149549:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961229184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.149586:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961229312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.149630:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340906.149650:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345c7c480 going to sleep for 11 seconds 00000100:00100000:2.0:1780340906.151583:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961229312 00000100:00100000:2.0:1780340906.151599:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961229312 00000100:00100000:2.0:1780340906.151664:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1780340906.151675:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961229312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340906.152031:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961229312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 358us (2400us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340906.152039:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1780340906.152427:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961229312:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780340906.158730:0:90659:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:2.0:1780340906.159102:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:2.0:1780340906.159128:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1780340906.159139:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa246514327753d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327753d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.159150:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa246514327753d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327753d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340906.159161:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1780340906.159163:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1780340906.159166:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1780340906.159202:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa246514327753de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.159221:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa246514327753de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.159230:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa246514327753de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340906.159256:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961229440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340906.159342:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340906.159399:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034aa82600 going to sleep for 11 seconds 00000100:00100000:0.0:1780340906.159459:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961229440 00000100:00100000:0.0:1780340906.159468:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961229440 00000100:00100000:0.0:1780340906.159518:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1780340906.159527:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961229440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340906.159541:0:90567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340906.159553:0:90567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa5a00/0xa246514327753e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327753de expref: -99 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.159575:0:90567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa5a00/0xa246514327753e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327753de expref: 17 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.159593:0:90567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa5a00/0xa246514327753e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327753de expref: 17 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.159602:0:90567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5a00, rc 0) 00000100:00100000:0.0:1780340906.159649:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961229440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340906.159656:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1780340906.160094:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961229440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340906.160108:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa246514327753de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327753e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.160117:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa246514327753de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327753e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340906.160187:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961229568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340906.160226:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340906.160255:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034aa82600 going to sleep for 11 seconds 00000100:00100000:0.0:1780340906.160303:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961229568 00000100:00100000:0.0:1780340906.160315:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961229568 00000100:00100000:0.0:1780340906.160355:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1780340906.160363:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961229568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.160499:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961229568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340906.160506:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1780340906.160922:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961229568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340906.160954:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046fd69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961229696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340906.160999:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340906.161027:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034aa82600 going to sleep for 11 seconds 00000100:00100000:0.0:1780340906.161067:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961229696 00000100:00100000:0.0:1780340906.161071:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961229696 00000100:00100000:0.0:1780340906.161104:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1780340906.161111:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961229696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340906.162508:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961229696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1391us (1502us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340906.162518:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1780340906.162658:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046fd69c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961229696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340906.164066:0:90660:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1780340906.164295:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1780340906.164339:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1780340906.164349:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa246514327753de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327753e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.164360:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa246514327753de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327753e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340906.164369:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1780340906.164371:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c04773ad000 from 7 10000000:01000000:3.0:1780340906.164374:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1780340906.164563:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3400/0xa246514327753ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.164572:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3400/0xa246514327753ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.164584:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3400/0xa246514327753ec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340906.164607:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961229824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340906.164660:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340906.164697:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0349845cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340906.165548:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961229824 00000100:00100000:2.0:1780340906.165557:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961229824 00000100:00100000:2.0:1780340906.165605:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1780340906.165613:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a99e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961229824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340906.165625:0:90568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340906.165638:0:90568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c6600/0xa246514327753f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327753ec expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.165661:0:90568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c6600/0xa246514327753f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327753ec expref: 18 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.165682:0:90568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c6600/0xa246514327753f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327753ec expref: 18 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.165691:0:90568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6600, rc 0) 00000100:00100000:2.0:1780340906.165736:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a99e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961229824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340906.165743:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1780340906.165862:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961229824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340906.165878:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3400/0xa246514327753ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327753f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.165886:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3400/0xa246514327753ec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327753f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340906.165956:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961229952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.165993:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340906.166017:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345c7c240 going to sleep for 11 seconds 00000100:00100000:2.0:1780340906.166067:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961229952 00000100:00100000:2.0:1780340906.166071:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961229952 00000100:00100000:2.0:1780340906.166102:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1780340906.166109:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a99dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961229952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340906.166210:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a99dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961229952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340906.166217:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1780340906.166360:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961229952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.166545:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961230080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.166585:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340906.166604:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345c7c240 going to sleep for 11 seconds 00000100:00100000:2.0:1780340906.167649:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961230080 00000100:00100000:2.0:1780340906.167659:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961230080 00000100:00100000:2.0:1780340906.167712:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1780340906.167721:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046f953050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961230080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340906.167874:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046f953050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961230080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340906.167883:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1780340906.170247:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961230080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340906.171571:0:90661:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1780340906.174669:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1780340906.174714:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1780340906.174726:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3400/0xa246514327753ec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327753f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340906.174782:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3400/0xa246514327753ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327753f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340906.174795:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1780340906.174797:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c047b065000 from 58 10000000:01000000:1.0:1780340906.174801:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780340906.174839:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122600/0xa246514327753fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340906.174847:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453122600/0xa246514327753fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340906.174857:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453122600/0xa246514327753fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340906.174886:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961230208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340906.174957:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340906.174997:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b3633c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340906.175081:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961230208 00000100:00100000:3.0:1780340906.175095:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961230208 00000100:00100000:3.0:1780340906.175139:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1780340906.175147:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046f953450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961230208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340906.175160:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340906.175172:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c047a8b2400/0xa24651432775401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327753fa expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.175195:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c047a8b2400/0xa24651432775401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327753fa expref: 19 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.175205:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c047a8b2400/0xa24651432775401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327753fa expref: 19 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.175214:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c047a8b2400, rc 0) 00000100:00100000:3.0:1780340906.175261:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046f953450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961230208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340906.175268:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1780340906.175636:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961230208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340906.175649:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453122600/0xa246514327753fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775401 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340906.175658:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453122600/0xa246514327753fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775401 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340906.175713:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961230336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340906.175740:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340906.175836:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b3633c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340906.175884:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961230336 00000100:00100000:2.0:1780340906.175889:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961230336 00000100:00100000:2.0:1780340906.175927:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1780340906.175935:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961230336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340906.176058:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961230336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340906.176065:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1780340906.176127:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961230336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340906.176153:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961230464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340906.176193:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340906.176216:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0349845b40 going to sleep for 11 seconds 00000100:00100000:1.0:1780340906.176256:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961230464 00000100:00100000:1.0:1780340906.176261:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961230464 00000100:00100000:1.0:1780340906.176293:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1780340906.176300:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961230464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340906.176631:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961230464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 331us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340906.176638:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1780340906.176828:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961230464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1780340906.177957:0:90662:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:3.0:1780340906.178181:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:3.0:1780340906.178206:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780340906.178215:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122600/0xa246514327753fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775401 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.178243:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453122600/0xa246514327753fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775401 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340906.178253:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1780340906.178255:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1780340906.178258:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1780340906.178288:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3e00/0xa24651432775408 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.178296:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3e00/0xa24651432775408 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.178317:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3e00/0xa24651432775408 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340906.178349:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961230592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340906.178503:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340906.178544:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0349845b40 going to sleep for 11 seconds 00000100:00100000:1.0:1780340906.178711:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961230592 00000100:00100000:1.0:1780340906.178719:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961230592 00000100:00100000:1.0:1780340906.178782:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1780340906.178792:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961230592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340906.178805:0:90567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340906.178818:0:90567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453122200/0xa2465143277540f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432775408 expref: -99 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340906.178840:0:90567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453122200/0xa2465143277540f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775408 expref: 20 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340906.178849:0:90567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453122200/0xa2465143277540f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775408 expref: 20 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340906.178857:0:90567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122200, rc 0) 00000100:00100000:1.0:1780340906.178904:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961230592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340906.178911:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1780340906.178988:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961230592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340906.179002:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3e00/0xa24651432775408 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277540f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.179010:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3e00/0xa24651432775408 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277540f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340906.179071:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961230720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.179100:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340906.179124:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345c7ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1780340906.179169:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961230720 00000100:00100000:1.0:1780340906.179174:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961230720 00000100:00100000:1.0:1780340906.179200:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1780340906.179215:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961230720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340906.179368:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961230720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340906.179375:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1780340906.179656:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961230720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.179690:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961230848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.179728:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340906.179744:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345c7ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340906.179801:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961230848 00000100:00100000:0.0:1780340906.179805:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961230848 00000100:00100000:0.0:1780340906.179826:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1780340906.179832:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961230848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340906.183660:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961230848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3819us (3922us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340906.183673:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1780340906.183807:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961230848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780340906.184928:0:90663:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1780340906.186991:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1780340906.187035:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1780340906.187048:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3e00/0xa24651432775408 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277540f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.187060:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3e00/0xa24651432775408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277540f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340906.187070:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1780340906.187072:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c047b065000 from 7 10000000:01000000:3.0:1780340906.187076:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1780340906.187123:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2a00/0xa24651432775416 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.187130:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2a00/0xa24651432775416 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.187140:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2a00/0xa24651432775416 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340906.187166:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961230976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340906.187231:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340906.187263:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0349845e40 going to sleep for 11 seconds 00000100:00100000:1.0:1780340906.187347:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961230976 00000100:00100000:1.0:1780340906.187356:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961230976 00000100:00100000:1.0:1780340906.187416:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1780340906.187425:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961230976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340906.187438:0:90570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340906.187449:0:90570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453123000/0xa2465143277541d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432775416 expref: -99 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340906.187472:0:90570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453123000/0xa2465143277541d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775416 expref: 21 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340906.187481:0:90570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453123000/0xa2465143277541d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775416 expref: 21 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340906.187488:0:90570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123000, rc 0) 00000100:00100000:1.0:1780340906.187700:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961230976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 275us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340906.187708:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1780340906.191691:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961230976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340906.191721:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2a00/0xa24651432775416 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277541d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.191734:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2a00/0xa24651432775416 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277541d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340906.191852:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961231104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.191920:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340906.191957:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345c7cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1780340906.192026:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961231104 00000100:00100000:3.0:1780340906.192033:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961231104 00000100:00100000:3.0:1780340906.192073:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1780340906.192083:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961231104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340906.192216:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961231104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340906.192224:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1780340906.192349:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961231104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.192377:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961231232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340906.192601:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340906.192630:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345c7cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1780340906.192673:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961231232 00000100:00100000:3.0:1780340906.192678:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961231232 00000100:00100000:3.0:1780340906.192712:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1780340906.192720:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961231232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340906.192841:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961231232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340906.192849:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1780340906.192967:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349957480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961231232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780340906.193999:0:90664:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1780340906.194231:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1780340906.194255:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1780340906.194277:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2a00/0xa24651432775416 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277541d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.194288:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2a00/0xa24651432775416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277541d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340906.194297:0:6514:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1780340906.194299:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8c0471e119c0 from 1 10000000:01000000:3.0:1780340906.194303:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1780340906.194525:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3c00/0xa24651432775424 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.194534:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3c00/0xa24651432775424 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.194544:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3c00/0xa24651432775424 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340906.194567:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961231360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340906.194616:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340906.194660:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c03498459c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340906.196127:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961231360 00000100:00100000:0.0:1780340906.196139:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961231360 00000100:00100000:0.0:1780340906.196187:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1780340906.196197:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961231360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340906.196210:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340906.196228:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0475fa4600/0xa2465143277542b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432775424 expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.196253:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0475fa4600/0xa2465143277542b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775424 expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.196273:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0475fa4600/0xa2465143277542b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775424 expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340906.196282:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4600, rc 0) 00000100:00100000:0.0:1780340906.196366:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961231360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (1749us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340906.196374:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1780340906.196605:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961231360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340906.196621:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3c00/0xa24651432775424 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277542b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.196631:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3c00/0xa24651432775424 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277542b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340906.196652:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1780340906.196657:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3c00/0xa24651432775424 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277542b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.196671:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3c00/0xa24651432775424 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277542b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340906.196680:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1780340906.196682:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8c0471e119c0 from 1 10000000:01000000:3.0:1780340906.196685:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1780340906.196709:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa24651432775432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.196716:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa24651432775432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.196725:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa24651432775432 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340906.196743:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961231488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340906.196811:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340906.196840:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c03498459c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340906.196950:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961231488 00000100:00100000:2.0:1780340906.196956:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961231488 00000100:00100000:2.0:1780340906.196991:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1780340906.196999:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961231488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340906.197007:0:90568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340906.197016:0:90568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c7600/0xa24651432775439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432775432 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.197031:0:90568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c7600/0xa24651432775439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775432 expref: 23 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.197040:0:90568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c7600/0xa24651432775439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775432 expref: 23 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340906.197047:0:90568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7600, rc 0) 00000100:00100000:2.0:1780340906.197085:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961231488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340906.197092:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1780340906.197164:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961231488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340906.197174:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa24651432775432 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775439 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.197182:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa24651432775432 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775439 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340906.197234:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961231616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340906.197258:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340906.197288:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c03498459c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340906.197423:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961231616 00000100:00100000:1.0:1780340906.197427:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961231616 00000100:00100000:1.0:1780340906.197465:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1780340906.197478:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04505ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961231616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340906.197555:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04505ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961231616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (296us total) trans 0 rc -2/-2 00000100:00100000:1.0:1780340906.197561:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1780340906.197708:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961231616:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1780340906.197734:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1780340906.197740:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa24651432775432 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775439 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340906.197747:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa24651432775432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775439 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340906.474675:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340906.474726:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340906.474794:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340906.474885:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940477696 00000100:00100000:0.0:1780340906.474896:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940477696 00000100:00100000:0.0:1780340906.474950:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 61 00000100:00100000:0.0:1780340906.474958:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04505ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2406:x1866818940477696:12345-192.168.203.16@tcp:250:kworker.0 00010000:00080000:0.0:1780340906.474988:0:90568:0:(ldlm_lib.c:1430:target_handle_connect()) MGS: connection from 540506f4-4e8e-4fb6-b537-f45d44291964@192.168.203.16@tcp t0 exp 0000000000000000 cur 3686 last 0 00000020:00000080:0.0:1780340906.475015:0:90568:0:(genops.c:1406:class_connect()) connect: client 540506f4-4e8e-4fb6-b537-f45d44291964, cookie 0xa24651432775440 00000100:00080000:0.0:1780340906.475140:0:90568:0:(import.c:65:import_set_state_nolock()) ffff8c0346fd0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340906.475204:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04505ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+4:2406:x1866818940477696:12345-192.168.203.16@tcp:250:kworker.0 Request processed in 246us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340906.475212:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 61 00000100:00100000:3.0:1780340906.477300:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940477952 00000100:00100000:3.0:1780340906.477384:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940477952 00000100:00100000:3.0:1780340906.477662:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940477824 00000100:00100000:3.0:1780340906.477666:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940477824 00000100:00100000:3.0:1780340906.477693:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1427 00000100:00100000:3.0:1780340906.477703:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2407:x1866818940477952:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340906.477811:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2407:x1866818940477952:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 108us (3144us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340906.477819:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1427 00000100:00100000:3.0:1780340906.477837:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1436 00000100:00100000:3.0:1780340906.477843:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2406:x1866818940477824:12345-192.168.203.16@tcp:38:kworker.0 00010000:00080000:3.0:1780340906.477868:0:70100:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '7d14eb83-fa7c-40d9-843e-6367bec0a7b4' at ffff8c0475faa800, cookie 0xa246514327752cd 00010000:00080000:3.0:1780340906.477873:0:70100:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from 7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp recovering/t115964117001 exp ffff8c0475faa800 cur 3686 last 1780340904 00010000:02000400:3.0:1780340906.477881:0:70100:0:(ldlm_lib.c:2021:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:3.0:1780340906.477887:0:70100:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:3.0:1780340906.477925:0:70100:0:(mdt_handler.c:7301:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1780340906.478061:0:70100:0:(import.c:65:import_set_state_nolock()) ffff8c0471e4b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340906.478107:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2406:x1866818940477824:12345-192.168.203.16@tcp:38:kworker.0 Request processed in 262us (3313us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340906.478115:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1436 00000100:00100000:0.0:1780340906.483742:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340906.484550:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940469504 00000100:00100000:2.0:1780340906.484561:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940469504 00000100:00100000:2.0:1780340906.484621:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1437 00000100:00100000:2.0:1780340906.484632:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2406:x1866818940469504:12345-192.168.203.16@tcp:36:mcreate.0 00010000:00080000:2.0:1780340906.484651:0:63712:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 115964117001, current: 115964117001, replaying 00000100:00100000:2.0:1780340906.484683:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2406:x1866818940469504:12345-192.168.203.16@tcp:36:mcreate.0 Request processed in 54us (950us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340906.484690:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1437 00010000:00080000:0.0:1780340906.484739:0:90596:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00080000:1.0:1780340906.486070:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1780340906.891624:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340907.507423:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340907.508026:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940478080 00000100:00100000:2.0:1780340907.508037:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940478080 00000100:00100000:2.0:1780340907.508098:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 62 00000100:00100000:2.0:1780340907.508109:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+4:70274:x1866818940478080:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340907.508125:0:90567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340907.508142:0:90567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c6e00/0xa24651432775447 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced25f9 expref: -99 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340907.508171:0:90567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c6e00/0xa24651432775447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25f9 expref: 5 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340907.508195:0:90567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c6e00/0xa24651432775447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25f9 expref: 5 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340907.508204:0:90567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6e00, rc 0) 00000100:00100000:2.0:1780340907.508409:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+5:70274:x1866818940478080:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 302us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340907.508417:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 62 00000100:00100000:0.0:1780340907.515138:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340907.515790:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940478208 00000100:00100000:2.0:1780340907.515800:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940478208 00000100:00100000:2.0:1780340907.515851:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 63 00000100:00100000:2.0:1780340907.515860:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+5:70274:x1866818940478208:12345-192.168.203.16@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1780340907.515886:0:90568:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1780340907.515904:0:90568:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1780340907.515912:0:90568:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1780340907.515915:0:90568:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1780340907.515918:0:90568:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1780340907.515920:0:90568:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 124 00000100:00100000:2.0:1780340907.518128:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+5:70274:x1866818940478208:12345-192.168.203.16@tcp:256:ll_cfg_requeue.0 Request processed in 2259us (2989us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340907.518141:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 63 00000100:00100000:0.0:1780340907.531756:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340907.540224:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940478336 00000100:00100000:2.0:1780340907.540238:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940478336 00000100:00100000:2.0:1780340907.540311:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 64 00000100:00100000:2.0:1780340907.540330:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+5:70274:x1866818940478336:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340907.540346:0:90567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340907.540363:0:90567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c6000/0xa2465143277544e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2600 expref: -99 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340907.540390:0:90567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c6000/0xa2465143277544e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2600 expref: 6 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340907.540409:0:90567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c6000/0xa2465143277544e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2600 expref: 6 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340907.540419:0:90567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6000, rc 0) 00000100:00100000:2.0:1780340907.540485:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+6:70274:x1866818940478336:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 165us (8738us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340907.540491:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 64 00000100:00100000:0.0:1780340907.544028:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340907.548219:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940478464 00000100:00100000:2.0:1780340907.548234:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940478464 00000100:00100000:2.0:1780340907.548329:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 65 00000100:00100000:2.0:1780340907.548340:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+6:70274:x1866818940478464:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340907.548522:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+7:70274:x1866818940478464:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 183us (4501us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340907.548530:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 65 00000100:00100000:3.0:1780340907.554885:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340907.555115:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940478592 00000100:00100000:2.0:1780340907.555125:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940478592 00000100:00100000:2.0:1780340907.555179:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 66 00000100:00100000:2.0:1780340907.555188:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+7:70274:x1866818940478592:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340907.555353:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+7:70274:x1866818940478592:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 166us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340907.555362:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 66 00000100:00100000:3.0:1780340907.567922:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340907.568079:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940478720 00000100:00100000:2.0:1780340907.568089:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940478720 00000100:00100000:2.0:1780340907.568141:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 67 00000100:00100000:2.0:1780340907.568151:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+7:70274:x1866818940478720:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340907.568168:0:90570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340907.568187:0:90570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c04754c7000/0xa24651432775455 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2607 expref: -99 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340907.568217:0:90570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c04754c7000/0xa24651432775455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2607 expref: 8 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340907.568230:0:90570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c04754c7000/0xa24651432775455 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2607 expref: 8 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340907.568238:0:90570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7000, rc 0) 00000100:00100000:2.0:1780340907.568302:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940478720:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 152us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340907.568339:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 67 00000100:00100000:3.0:1780340907.575329:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340907.577517:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940478848 00000100:00100000:1.0:1780340907.577532:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940478848 00000100:00100000:1.0:1780340907.577597:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 68 00000100:00100000:1.0:1780340907.577607:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940478848:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340907.577756:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940478848:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 149us (2443us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340907.577785:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 68 00000100:00100000:1.0:1780340907.582332:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340907.584484:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940478976 00000100:00100000:2.0:1780340907.584497:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940478976 00000100:00100000:2.0:1780340907.584556:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 69 00000100:00100000:2.0:1780340907.584565:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940478976:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340907.584700:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940478976:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 135us (2398us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340907.584707:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 69 00000100:00100000:0.0:1780340907.594586:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340907.599060:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940479104 00000100:00100000:1.0:1780340907.599074:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940479104 00000100:00100000:1.0:1780340907.599218:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 70 00000100:00100000:1.0:1780340907.599229:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940479104:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340907.599245:0:90567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340907.599262:0:90567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453123600/0xa2465143277545c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced260e expref: -99 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340907.599289:0:90567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453123600/0xa2465143277545c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced260e expref: 9 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340907.599334:0:90567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453123600/0xa2465143277545c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced260e expref: 9 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340907.599344:0:90567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123600, rc 0) 00000100:00100000:1.0:1780340907.601586:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940479104:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 2347us (6997us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340907.601599:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 70 00000100:00100000:1.0:1780340907.610156:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340907.611073:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940479232 00000100:00100000:2.0:1780340907.611085:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940479232 00000100:00100000:2.0:1780340907.611139:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 71 00000100:00100000:2.0:1780340907.611150:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940479232:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340907.611276:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940479232:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 128us (1127us total) trans 0 rc -2/-2 00000100:00100000:2.0:1780340907.611285:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 71 00010000:00010000:0.0:1780340907.918942:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340908.943601:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340909.450042:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961231744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340909.450104:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340909.450188:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961231744 00000100:00100000:0.0:1780340909.450204:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961231744 00000100:00100000:0.0:1780340909.450360:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136 00000100:00100000:0.0:1780340909.450369:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961231744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340909.450396:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340909.450436:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961231744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340909.450442:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136 00000100:00100000:1.0:1780340909.451854:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961231872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340909.451903:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340909.451945:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961231872 00000100:00100000:1.0:1780340909.451950:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961231872 00000100:00100000:2.0:1780340909.452744:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961231744:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1780340909.454772:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340909.454781:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340909.459158:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2137 00000100:00100000:1.0:1780340909.459174:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961231872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340909.459209:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340909.459290:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961231872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (7386us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340909.459297:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2137 00000100:00100000:1.0:1780340909.459366:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961231872:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1780340909.829038:0:90830:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1780340909.965358:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340909.965365:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340909.965369:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340909.965377:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3684 00000100:00080000:0.0:1780340909.965382:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340909.965388:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c0470f6a800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340909.965422:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0349956d80 x1866818961232128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340909.965445:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340909.965448:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340909.965450:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340909.965454:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3684 00000100:00080000:0.0:1780340909.965456:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340909.965459:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c0346bb9800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340909.965470:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0349954000 x1866818961232384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340909.965492:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340909.965495:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340909.965508:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340909.965512:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3684 00000100:00080000:0.0:1780340909.965514:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340909.965518:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c034a39c800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340909.965531:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0349955880 x1866818961232640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340909.965540:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340909.965542:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340909.965544:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340909.965547:0:80497:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3684 00000100:00080000:0.0:1780340909.965549:0:80497:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1780340909.965552:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c0346eef800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340909.965561:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0349956300 x1866818961232768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1780340909.965586:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1780340909.965588:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1780340909.965590:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c0442c0f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1780340909.965594:0:80497:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c0442c0f800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:0.0:1780340909.965603:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0349955c00 x1866818961233280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1780340909.965644:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961232256:0@lo:400:kworker.0 00000100:00100000:0.0:1780340909.965701:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340909.965741:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961233152:0@lo:400:kworker.0 00000100:00100000:0.0:1780340909.965791:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340909.966035:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1780340909.966042:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961232000:0@lo:400:kworker.0 00000100:00100000:0.0:1780340909.966070:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340909.966093:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961233024:0@lo:400:kworker.0 00000100:00100000:0.0:1780340909.966114:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340909.966136:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961232896:0@lo:400:kworker.0 00000100:00100000:0.0:1780340909.966162:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340909.966175:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1780340909.966245:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961232512:0@lo:400:kworker.0 00000100:00100000:0.0:1780340909.966268:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340909.966282:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961233408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340909.966298:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340909.966333:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961232000 00000100:00100000:0.0:1780340909.966340:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961232000 00000100:00100000:0.0:1780340909.966381:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1780340909.966436:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961232000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340909.966483:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961232000:12345-0@lo:400:kworker.0 Request processed in 94us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340909.966491:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1780340909.966537:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961232000:0@lo:400:kworker.0 00010000:00010000:2.0:1780340909.966778:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340909.966797:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961232896 00000100:00100000:2.0:1780340909.966802:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961232896 00000100:00100000:2.0:1780340909.966837:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961233408 00000100:00100000:2.0:1780340909.966841:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961233408 00000100:00100000:2.0:1780340909.966861:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3961 00000100:00100000:2.0:1780340909.966868:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3660:x1866818961232896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340909.966934:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b881f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3660:x1866818961232896:12345-0@lo:400:kworker.0 Request processed in 65us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340909.966951:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3961 00000100:00100000:2.0:1780340909.966967:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3962 00000100:00100000:2.0:1780340909.966972:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961233408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340909.966999:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:2.0:1780340909.967033:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b881500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961233408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340909.967038:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3962 00000100:00100000:2.0:1780340909.967163:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961233408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340909.967174:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961232896:0@lo:400:kworker.0 00000100:00100000:3.0:1780340909.968136:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961232128:0@lo:38:kworker.0 00000100:00100000:3.0:1780340909.968183:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340909.968215:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961232384:0@lo:38:kworker.0 00000100:00100000:3.0:1780340909.968239:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340909.968254:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961232640:0@lo:38:kworker.0 00000100:00100000:3.0:1780340909.968279:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340909.968298:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961232768:0@lo:38:kworker.0 00000100:00100000:3.0:1780340909.968331:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340909.968355:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961233280:0@lo:38:kworker.0 00000100:00100000:3.0:1780340909.968379:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340909.968414:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961232256 00000100:00100000:3.0:1780340909.968419:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961232256 00000100:00100000:3.0:1780340909.968454:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961232512 00000100:00100000:3.0:1780340909.968458:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961232512 00000100:00100000:3.0:1780340909.968486:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961232128 00000100:00100000:3.0:1780340909.968489:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961232128 00000100:00100000:2.0:1780340909.968491:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961232384 00000100:00100000:2.0:1780340909.968498:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961232384 00000100:00100000:3.0:1780340909.968499:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961232768 00000100:00100000:3.0:1780340909.968503:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961232768 00000100:00100000:3.0:1780340909.968520:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961233280 00000100:00100000:3.0:1780340909.968523:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961233280 00000100:00100000:2.0:1780340909.968529:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:2.0:1780340909.968539:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961232256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340909.968596:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349954380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961232256:12345-0@lo:400:kworker.0 Request processed in 59us (2893us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340909.968661:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961232640 00000100:00100000:0.0:1780340909.968665:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961232640 00000100:00100000:0.0:1780340909.968685:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3963 00000100:00100000:0.0:1780340909.968690:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1866818961232640:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1780340909.968710:0:8410:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8c0475fad800, cookie 0xa246514327752c6 00010000:00080000:0.0:1780340909.968715:0:8410:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t115964116999 exp ffff8c0475fad800 cur 3689 last 1780340904 00000004:00100000:0.0:1780340909.968748:0:8410:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1780340909.968895:0:8410:0:(import.c:65:import_set_state_nolock()) ffff8c0346fd7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340909.968941:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818961232640:12345-0@lo:38:kworker.0 Request processed in 250us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340909.968948:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3963 00010000:00080000:0.0:1780340909.968968:0:90596:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1780340909.968973:0:90596:0:(ldlm_lib.c:2668:replay_request_or_update()) Waiting for transno 115964117001 00000020:00080000:0.0:1780340909.968977:0:90596:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780340909.968980:0:90596:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 115964117001, next_transno: 115964117001 00010000:00080000:0.0:1780340909.968984:0:90596:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (115964117001) 00000020:00080000:0.0:1780340909.968986:0:90596:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1780340909.968995:0:90596:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940469504 t115964117001 from 192.168.203.16@tcp req@ffff8c0349957480 x1866818940469504/t0(115964117001) o36->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:332/0 lens 528/0 e 0 to 0 dl 1780340917 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1780340909.969476:0:90596:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 439us 00000100:00100000:1.0:1780340909.978602:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961232256:0@lo:400:kworker.0 00000100:00100000:3.0:1780340909.979101:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1780340909.979118:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961232512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340909.979212:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961232512:12345-0@lo:400:kworker.0 Request processed in 101us (12942us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340909.979220:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1780340909.979240:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:3.0:1780340909.979244:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961232128:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1780340909.979267:0:63711:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3689 last 0 00000020:00000080:3.0:1780340909.979312:0:63711:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa24651432775463 00000004:00100000:3.0:1780340909.979328:0:63711:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1780340909.979360:0:63711:0:(import.c:65:import_set_state_nolock()) ffff8c0345c86000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340909.980133:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:2.0:1780340909.980166:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:2.0:1780340909.980172:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961232384:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1780340909.980193:0:64454:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3689 last 0 00000020:00000080:2.0:1780340909.980223:0:64454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa2465143277546a 00000004:00100000:2.0:1780340909.980233:0:64454:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1780340909.980257:0:64454:0:(import.c:65:import_set_state_nolock()) ffff8c034a39e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340909.980367:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1866818961232128:12345-0@lo:38:kworker.0 Request processed in 1120us (12182us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340909.980376:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:3.0:1780340909.981547:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:3.0:1780340909.981556:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1866818961232768:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1780340909.981581:0:63711:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3689 last 0 00000020:00000080:3.0:1780340909.981614:0:63711:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xa24651432775471 00000004:00100000:3.0:1780340909.981627:0:63711:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1780340909.981652:0:63711:0:(import.c:65:import_set_state_nolock()) ffff8c046b90b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1780340909.987080:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:1.0:1780340909.987094:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1866818961233280:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1780340909.987129:0:63712:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3689 last 0 00000020:00000080:1.0:1780340909.987171:0:63712:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa24651432775478 00000004:00100000:1.0:1780340909.987195:0:63712:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1780340909.987231:0:63712:0:(import.c:65:import_set_state_nolock()) ffff8c047a0a0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340909.990444:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1866818961232384:12345-0@lo:38:kworker.0 Request processed in 10261us (22195us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340909.990477:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:2.0:1780340909.990642:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961232512:0@lo:400:kworker.0 00000001:00100000:0.0:1780340909.991835:0:72681:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1780340909.992589:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1866818961232768:12345-0@lo:38:kworker.0 Request processed in 11023us (24248us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340909.992609:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:3.0:1780340909.992660:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961233152 00000100:00100000:3.0:1780340909.992668:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961233152 00000100:00100000:3.0:1780340909.992721:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961233024 00000100:00100000:3.0:1780340909.992724:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961233024 00000100:00100000:3.0:1780340909.992920:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628 00000100:00100000:3.0:1780340909.992930:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961233152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340909.993018:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349957b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961233152:12345-0@lo:400:kworker.0 Request processed in 90us (27225us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340909.993025:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628 00000100:00100000:0.0:1780340909.993052:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629 00000100:00100000:0.0:1780340909.993074:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961233024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340909.993171:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349954a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961233024:12345-0@lo:400:kworker.0 Request processed in 108us (27054us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340909.993506:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1866818961233280:12345-0@lo:38:kworker.0 Request processed in 6411us (25122us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340909.993515:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00080000:3.0:1780340909.993915:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340909.993919:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340909.993923:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340909.995867:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629 00000001:00100000:3.0:1780340909.996992:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1780340909.997073:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961233024:0@lo:400:kworker.0 00000100:00100000:3.0:1780340909.997102:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961233152:0@lo:400:kworker.0 00010000:00080000:3.0:1780340909.997151:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c0349956d80 x1866818961232128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780340909.997167:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000100:00080000:3.0:1780340909.998446:0:3658:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff8c0349956d80 x1866818961232128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340934 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780340909.998459:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1780340909.998463:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1780340909.998467:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1780340909.998472:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961232128:0@lo:38:kworker.0 00010000:00080000:3.0:1780340909.998515:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c0349954000 x1866818961232384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780340909.998528:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 28 00000100:00080000:3.0:1780340910.004040:0:3658:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff8c0349954000 x1866818961232384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340934 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780340910.004054:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1780340910.004059:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346bb9800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1780340910.004063:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1780340910.004070:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1866818961232384:0@lo:38:kworker.0 00000100:00100000:3.0:1780340910.004107:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964117000 gen 3 00000004:00080000:3.0:1780340910.004112:0:3658:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 115964116999 committed transno 115964117000 00000020:00080000:3.0:1780340910.004118:0:3658:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8c0446ff2540 refcount 2 committed 0 result 0 batchid 77309411388 00000020:00080000:3.0:1780340910.004123:0:3658:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c0346a16200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8c0446ff2180 00000020:00080000:3.0:1780340910.004126:0:3658:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].4 00000020:00080000:3.0:1780340910.004129:0:3658:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c0346a16a00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c04755b9000 00000020:00080000:3.0:1780340910.004131:0:3658:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].4 00000004:00080000:3.0:1780340910.004185:0:3658:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 115964117000 committed transno 115964117000 00000020:00080000:3.0:1780340910.004190:0:3658:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff8c04774040c0 refcount 2 committed 0 result 0 batchid 77309411389 00000020:00080000:3.0:1780340910.004194:0:3658:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c04529d2e00 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff8c03475916c0 00000020:00080000:0.0:1780340910.004194:0:72701:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411388 committed batchid 77309411387 00000020:00080000:3.0:1780340910.004200:0:3658:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].5 00000020:00080000:3.0:1780340910.004208:0:3658:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff8c04529d2400 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c04755b8600 00000020:00080000:3.0:1780340910.004210:0:3658:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].5 00000100:00080000:3.0:1780340910.004228:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 28 00000100:00080000:3.0:1780340910.004240:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1780340910.004253:0:3658:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1780340910.004257:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964117000 gen 3 00000100:00080000:3.0:1780340910.004261:0:3658:0:(recover.c:53:ptlrpc_replay_next()) import ffff8c034a39c800 from lustre-MDT0000_UUID committed 115964117000 last 0 00000100:00080000:3.0:1780340910.004264:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00080000:0.0:1780340910.004329:0:72701:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411389 committed batchid 77309411387 00000020:00080000:0.0:1780340910.004359:0:72701:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411387 00000100:00100000:3.0:1780340910.004933:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961232640:0@lo:38:kworker.0 00010000:00080000:3.0:1780340910.004961:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c0349956300 x1866818961232768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1780340910.004967:0:90839:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1780340910.004980:0:90839:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00000100:00080000:3.0:1780340910.004988:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 28 00010000:00010000:0.0:1780340910.004999:0:90839:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1780340910.007109:0:3658:0:(import.c:1330:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff8c0349956300 x1866818961232768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340934 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780340910.007121:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1780340910.007126:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0346eef800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1780340910.007130:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1780340910.007135:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1866818961232768:0@lo:38:kworker.0 00010000:00080000:3.0:1780340910.007244:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c0349955c00 x1866818961233280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780340910.007259:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 28 00000100:00080000:3.0:1780340910.007267:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1780340910.007271:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1780340910.007273:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0442c0f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1780340910.007277:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1866818961233280:0@lo:38:kworker.0 00010000:00010000:0.0:1780340910.007743:0:90839:0:(ldlm_request.c:2848:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6c000/0xa24651432774bbf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa24651432774bc6 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1780340910.007810:0:90839:0:(ldlm_request.c:2898:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000001:00100000:3.0:1780340910.008146:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1780340910.009078:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961233536:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1780340910.017128:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340910.017223:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961233536 00000100:00100000:0.0:1780340910.017239:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961233536 00000100:00100000:0.0:1780340910.017326:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3964 00000100:00100000:0.0:1780340910.017681:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818961233536:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:0.0:1780340910.017720:0:26074:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c03498cb480 x1866818961233536/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:336/0 lens 328/0 e 0 to 0 dl 1780340921 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340910.017738:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1866818961233536:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 63us (611us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340910.031597:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3964 00010000:00010000:2.0:1780340910.044596:0:90596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277547f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.044620:0:90596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277547f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.044637:0:90596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277547f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.044651:0:90596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775486 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.044713:0:90596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775486 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.044722:0:90596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775486 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.045395:0:90596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277547f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.045594:0:90596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277547f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.045604:0:90596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277547f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.045613:0:90596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340910.045618:0:90596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277547f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.045638:0:90596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277547f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.045724:0:90596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:2.0:1780340910.045728:0:90596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340910.045734:0:90596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277547f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.045742:0:90596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa2465143277547f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340910.045818:0:90596:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dcfc215c reply state 00000000b951e915 transno 115964117001 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775486 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.045832:0:90596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775486 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.045842:0:90596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c045247cc00) 00010000:00010000:2.0:1780340910.045845:0:90596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340910.045850:0:90596:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1780340910.050230:0:90596:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:2.0:1780340910.050263:0:90596:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340910.050267:0:90596:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117002 00000020:00080000:2.0:1780340910.050271:0:90596:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340910.050273:0:90596:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117002 00000100:00100000:1.0:1780340910.054163:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340910.054670:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940470016 00000100:00100000:2.0:1780340910.054683:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940470016 00000100:00100000:2.0:1780340910.054755:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1442 00000100:00100000:2.0:1780340910.054787:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2406:x1866818940470016:12345-192.168.203.16@tcp:36:rm.0 00010000:00080000:2.0:1780340910.054817:0:64454:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 115964117002, current: 115964117002, replaying 00000100:00100000:2.0:1780340910.054840:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2406:x1866818940470016:12345-192.168.203.16@tcp:36:rm.0 Request processed in 57us (685us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340910.054847:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1442 00000020:00080000:1.0:1780340910.054954:0:90596:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340910.054968:0:90596:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 115964117002, next_transno: 115964117002 00010000:00080000:1.0:1780340910.054973:0:90596:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (115964117002) 00000020:00080000:1.0:1780340910.054976:0:90596:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340910.054987:0:90596:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940470016 t115964117002 from 192.168.203.16@tcp req@ffff8c047a8c9880 x1866818940470016/t0(115964117002) o36->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:336/0 lens 512/0 e 0 to 0 dl 1780340921 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1780340910.055082:0:90596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa2465143277548d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055099:0:90596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa2465143277548d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055112:0:90596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa2465143277548d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055125:0:90596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa24651432775494 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055133:0:90596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa24651432775494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055141:0:90596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa24651432775494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055237:0:90596:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa2465143277549b lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055246:0:90596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa2465143277549b lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055254:0:90596:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa2465143277549b lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055491:0:90596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa2465143277549b lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055499:0:90596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa2465143277549b lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055507:0:90596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa2465143277549b lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055512:0:90596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340910.055516:0:90596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa2465143277549b lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055524:0:90596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa2465143277549b lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055536:0:90596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff8c04428aaf00) 00010000:00010000:1.0:1780340910.055539:0:90596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1780340910.055544:0:90596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa2465143277549b lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055551:0:90596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa2465143277549b lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055578:0:90596:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa2465143277548d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055584:0:90596:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa2465143277548d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055589:0:90596:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa2465143277548d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055594:0:90596:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340910.055596:0:90596:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa2465143277548d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055601:0:90596:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa2465143277548d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055609:0:90596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c04428aa100) 00010000:00010000:1.0:1780340910.055611:0:90596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340910.055614:0:90596:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa2465143277548d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055619:0:90596:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123200/0xa2465143277548d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340910.055628:0:90596:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000ed241cd reply state 00000000c684126d transno 115964117002 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa24651432775494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055639:0:90596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa24651432775494 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.055644:0:90596:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c045247cc00) 00010000:00010000:1.0:1780340910.055652:0:90596:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340910.055655:0:90596:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1780340910.055739:0:90596:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1780340910.055755:0:90596:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340910.055778:0:90596:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117003 00000020:00080000:1.0:1780340910.055782:0:90596:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1780340910.055784:0:90596:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117003 00000100:00100000:1.0:1780340910.060537:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340910.068499:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940479360 00000100:00100000:2.0:1780340910.068513:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940479360 00000100:00100000:2.0:1780340910.068602:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1430 00000100:00100000:2.0:1780340910.068612:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2406:x1866818940479360:12345-192.168.203.16@tcp:400:ldlm_lock_repla.0 00010000:00080000:2.0:1780340910.068635:0:63712:0:(ldlm_lib.c:3119:target_queue_recovery_request()) @@@ queue final req req@ffff8c046b990e00 x1866818940479360/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:336/0 lens 224/0 e 0 to 0 dl 1780340921 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340910.068658:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b990e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2406:x1866818940479360:12345-192.168.203.16@tcp:400:ldlm_lock_repla.0 Request processed in 49us (8130us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340910.068666:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1430 00000020:00080000:2.0:1780340910.068684:0:90596:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340910.068688:0:90596:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 115964117003 00010000:00080000:2.0:1780340910.068691:0:90596:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1780340910.068694:0:90596:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1780340910.068701:0:90596:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1780340910.068703:0:90596:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780340910.068709:0:90596:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff8c03498cb480 x1866818961233536/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:336/0 lens 328/0 e 0 to 0 dl 1780340921 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1780340910.068726:0:90596:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340910.068750:0:90596:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa246514327754a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa24651432774bbf expref: -99 pid: 90596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.068792:0:90596:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa246514327754a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432774bbf expref: 7 pid: 90596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.068833:0:90596:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6c00/0xa246514327754a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432774bbf expref: 7 pid: 90596 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.068841:0:90596:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6c00, rc 0) 00010000:00080000:2.0:1780340910.068908:0:90596:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1780340910.068919:0:90596:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00010000:3.0:1780340910.069181:0:3658:0:(ldlm_request.c:2765:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff8c045ec6c000/0xa24651432774bbf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa246514327754a2 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1780340910.069201:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1780340910.069253:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961233536:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1780340910.069308:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961233664:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1780340910.069383:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340910.071505:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961233664 00000100:00100000:0.0:1780340910.071530:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961233664 00000100:00100000:0.0:1780340910.071623:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3965 00000100:00100000:0.0:1780340910.071640:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1866818961233664:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:0.0:1780340910.071673:0:22660:0:(ldlm_lib.c:3119:target_queue_recovery_request()) @@@ queue final req req@ffff8c03498c8380 x1866818961233664/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:336/0 lens 224/0 e 0 to 0 dl 1780340921 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340910.071708:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1866818961233664:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 74us (2323us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340910.071716:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3965 00010000:00080000:0.0:1780340910.071963:0:90596:0:(ldlm_lib.c:2270:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1780340910.072114:0:90596:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 120259084288 00000001:00100000:1.0:1780340910.077645:0:90562:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1780340910.077655:0:90562:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000001:00080000:1.0:1780340910.077721:0:90562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117002 is committed 00000001:00080000:3.0:1780340910.080404:0:90596:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1780340910.080483:0:90596:0:(ldlm_lib.c:1981:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1780340910.080510:0:90596:0:(ldlm_lib.c:2922:target_recovery_thread()) @@@ processing final ping from 192.168.203.16@tcp: req@ffff8c046b990e00 x1866818940479360/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:336/0 lens 224/0 e 0 to 0 dl 1780340921 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1780340910.080529:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775486 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.080546:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775486 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.080553:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775486 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.080559:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340910.080564:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775486 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.080572:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775486 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.080589:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c045247cc00) 00010000:00010000:2.0:1780340910.080592:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340910.080597:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775486 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.080603:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775486 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1780340910.080658:0:90596:0:(ldlm_lib.c:2922:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff8c03498c8380 x1866818961233664/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:336/0 lens 224/0 e 0 to 0 dl 1780340921 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1780340910.080752:0:90596:0:(ldlm_lib.c:1853:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:0.0:1780340910.081006:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1780340910.081023:0:3658:0:(client.c:3224:ptlrpc_resend_req()) @@@ going to resend req@ffff8c03498c9880 x1866818961233664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340926 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340910.081041:0:3658:0:(client.c:3233:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff8c03498c9880 x1866818961233664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340926 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340910.081047:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1780340910.081063:0:3658:0:(import.c:1744:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1780340910.081071:0:3658:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007d0ace2e): req@ffff8c046b991500 x1866818961214336/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340894 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340910.081087:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961233664:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:0.0:1780340910.082247:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340910.082267:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961233792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340910.082337:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340910.082552:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961233792 00000100:00100000:1.0:1780340910.082560:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961233792 00000100:00100000:1.0:1780340910.082610:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3966 00000100:00100000:1.0:1780340910.082620:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961233792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780340910.082658:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445179392 avail 1298939904 00000100:00100000:1.0:1780340910.082703:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b883100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961233792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340910.082722:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3966 00000100:00100000:0.0:1780340910.084090:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961233792:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1780340910.084508:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa24651432775494 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.084517:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa24651432775494 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.084525:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa24651432775494 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.084531:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340910.084536:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa24651432775494 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.084544:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa24651432775494 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.084558:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c045247cc00) 00010000:00010000:2.0:1780340910.084561:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340910.084566:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa24651432775494 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.084572:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123e00/0xa24651432775494 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90596 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340910.084871:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340910.084966:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961214336 00000100:00100000:0.0:1780340910.084973:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961214336 00000100:00100000:0.0:1780340910.085020:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3967 00000100:00100000:0.0:1780340910.085029:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961214336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780340910.085055:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445179392 avail 1298939904 00000100:00100000:0.0:1780340910.085098:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961214336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340910.085105:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3967 00000100:00100000:2.0:1780340910.085243:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b991500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961214336:0@lo:41:osp-pre-0-1.0 00000004:00000080:0.0:1780340910.118328:0:90596:0:(mdd_device.c:2374:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9927472afe10 00100000:10000000:0.0:1780340910.118343:0:90596:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1780340910.121188:0:90581:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x302:0x0] 00000100:00100000:3.0:1780340910.121240:0:90581:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498cb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90581:1866818961233920:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1780340910.121312:0:90581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340910.121340:0:90581:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047215b3c0 going to sleep for 11 seconds 00000004:00080000:3.0:1780340910.121355:0:90583:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x303:0x0] 00000100:00100000:3.0:1780340910.121373:0:90583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ca300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90583:1866818961234048:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1780340910.121395:0:90583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340910.121420:0:90583:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047215bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1780340910.121440:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961233920 00000100:00100000:3.0:1780340910.121452:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961233920 00000100:00100000:3.0:1780340910.121492:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961234048 00000100:00100000:3.0:1780340910.121494:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961234048 00000100:00100000:3.0:1780340910.121513:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5929 00000100:00100000:3.0:1780340910.121521:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:90581:x1866818961233920:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1780340910.121547:0:8830:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 865 -> diff = -95 00002000:02000040:3.0:1780340910.121551:0:8830:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:771 to 0x280000401:865) 00000100:00100000:2.0:1780340910.125842:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5930 00000100:00100000:2.0:1780340910.125864:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:90583:x1866818961234048:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1780340910.125911:0:25496:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 865 -> diff = -94 00002000:02000040:2.0:1780340910.125923:0:25496:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:772 to 0x2c0000401:865) 00002000:00010000:3.0:1780340910.138909:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x361:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.138922:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000025963d3/0xa246514327754a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.138939:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.151451:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.151462:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000025963d3/0xa246514327754a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.151484:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000025963d3/0xa246514327754a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.151495:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000025963d3/0xa246514327754a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.151503:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000025963d3/0xa246514327754a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.151683:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780340910.151800:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x360:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1780340910.151900:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340910.151907:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000025963d3/0xa246514327754a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340910.151927:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b2600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340910.151931:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000025963d3/0xa246514327754a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340910.151939:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000025963d3/0xa246514327754a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152005:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c654df7/0xa246514327754b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152021:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.152023:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.152026:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c654df7/0xa246514327754b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152035:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c654df7/0xa246514327754b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152043:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c654df7/0xa246514327754b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152050:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c654df7/0xa246514327754b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152064:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780340910.152099:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x35f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.152104:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028914cf5/0xa246514327754b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152110:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.152112:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.152114:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028914cf5/0xa246514327754b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152123:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028914cf5/0xa246514327754b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152140:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028914cf5/0xa246514327754b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152147:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028914cf5/0xa246514327754b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152158:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1780340910.152187:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x35e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.152191:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcbe6e02/0xa246514327754be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152198:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.152199:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.152202:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcbe6e02/0xa246514327754be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152210:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcbe6e02/0xa246514327754be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152217:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bcbe6e02/0xa246514327754be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152225:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bcbe6e02/0xa246514327754be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152235:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1780340910.152246:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780340910.152250:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c654df7/0xa246514327754b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152257:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b3000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.152260:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c654df7/0xa246514327754b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152267:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c654df7/0xa246514327754b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152281:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c654df7/0xa246514327754b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152289:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c654df7/0xa246514327754b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152314:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340910.152317:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028914cf5/0xa246514327754b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152323:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b2e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.152326:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028914cf5/0xa246514327754b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152334:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028914cf5/0xa246514327754b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152352:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028914cf5/0xa246514327754b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152359:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028914cf5/0xa246514327754b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152369:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.152372:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bcbe6e02/0xa246514327754be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152378:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b3800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.152381:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcbe6e02/0xa246514327754be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152388:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bcbe6e02/0xa246514327754be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152395:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bcbe6e02/0xa246514327754be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152402:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcbe6e02/0xa246514327754be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152410:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.152411:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.152416:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340910.152451:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x35d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.152456:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8631c51/0xa246514327754c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152463:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.152464:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.152467:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8631c51/0xa246514327754c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152476:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8631c51/0xa246514327754c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152483:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8631c51/0xa246514327754c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152491:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8631c51/0xa246514327754c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152503:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780340910.152525:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x35c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.152530:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094894bb9/0xa246514327754cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152536:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.152537:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.152539:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094894bb9/0xa246514327754cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152557:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094894bb9/0xa246514327754cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152565:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094894bb9/0xa246514327754cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152571:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094894bb9/0xa246514327754cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152581:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780340910.152586:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340910.152589:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8631c51/0xa246514327754c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152595:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b3200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.152597:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8631c51/0xa246514327754c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152605:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8631c51/0xa246514327754c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152614:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8631c51/0xa246514327754c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152620:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8631c51/0xa246514327754c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152635:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.152638:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094894bb9/0xa246514327754cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152644:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b3600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.152647:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094894bb9/0xa246514327754cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152654:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094894bb9/0xa246514327754cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152662:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094894bb9/0xa246514327754cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152668:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094894bb9/0xa246514327754cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152677:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.152678:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.152680:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340910.152707:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x35b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.152711:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cdabb58/0xa246514327754d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152718:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.152719:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.152726:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009cdabb58/0xa246514327754d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152735:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009cdabb58/0xa246514327754d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152742:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009cdabb58/0xa246514327754d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152750:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009cdabb58/0xa246514327754d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152779:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340910.152784:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.152787:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009cdabb58/0xa246514327754d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152793:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b2000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.152796:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009cdabb58/0xa246514327754d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.152803:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009cdabb58/0xa246514327754d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340910.152892:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000025963d3/0xa246514327754a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340910.152899:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000025963d3/0xa246514327754a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340910.152913:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340910.152914:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340910.152915:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340910.152920:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340910.154252:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.154800:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009cdabb58/0xa246514327754d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.154896:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009cdabb58/0xa246514327754d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.154915:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.154917:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.154919:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340910.155073:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x35a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.155080:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee52454d/0xa246514327754da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155090:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.155092:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.155096:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee52454d/0xa246514327754da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155106:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee52454d/0xa246514327754da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155115:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee52454d/0xa246514327754da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155123:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee52454d/0xa246514327754da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155144:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780340910.155181:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x359:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.155192:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa246514327754e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155199:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.155201:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.155204:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa246514327754e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155212:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa246514327754e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155219:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa246514327754e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155225:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa246514327754e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155245:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1780340910.155283:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x358:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.155288:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa246514327754e8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155295:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.155297:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.155309:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa246514327754e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155318:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa246514327754e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155331:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa246514327754e8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155338:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa246514327754e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155349:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1780340910.155385:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x357:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.155390:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327754ef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155397:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.155399:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.155401:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327754ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155411:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327754ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155418:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327754ef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155424:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327754ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155436:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1780340910.155450:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780340910.155454:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee52454d/0xa246514327754da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155462:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b3a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.155465:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee52454d/0xa246514327754da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155474:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee52454d/0xa246514327754da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155484:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee52454d/0xa246514327754da lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155491:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee52454d/0xa246514327754da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155505:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780340910.155508:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa246514327754e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155515:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.155518:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa246514327754e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155525:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa246514327754e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155546:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa246514327754e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155553:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa246514327754e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155564:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340910.155567:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa246514327754e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155573:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.155576:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa246514327754e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155583:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa246514327754e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155591:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa246514327754e8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155598:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa246514327754e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155609:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.155612:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327754ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155623:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.155626:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327754ef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155634:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327754ef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155643:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327754ef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155650:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327754ef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155663:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.155664:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.155666:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340910.155703:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x356:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.155708:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327754f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155715:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.155716:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.155719:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327754f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155726:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327754f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155740:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327754f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155746:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327754f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155781:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340910.155789:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.155792:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327754f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.155800:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.155802:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327754f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340910.155899:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340910.156364:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340910.156371:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.157096:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327754f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.157114:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327754f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.157122:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327754f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.157139:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.157146:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.157148:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340910.157222:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x355:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.157227:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa246514327754fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.157236:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.157238:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.157242:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa246514327754fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.157251:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa246514327754fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.157259:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa246514327754fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.157267:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa246514327754fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.158031:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780340910.158089:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x354:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.158095:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa24651432775504 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.158105:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.158107:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.158110:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa24651432775504 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.158132:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa24651432775504 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.158141:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa24651432775504 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.158149:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa24651432775504 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.161335:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780340910.161347:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa246514327754fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.161361:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340910.161365:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa246514327754fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.161388:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa246514327754fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.161408:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa246514327754fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.161416:0:41205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006b3c6ea/0xa246514327754fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.161435:0:41205:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340910.161439:0:41205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa24651432775504 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.161446:0:41205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340910.161449:0:41205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa24651432775504 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.161455:0:41205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa24651432775504 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.161464:0:41205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa24651432775504 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.161471:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340910.161473:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340910.161480:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340910.162749:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340910.162942:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x361:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.162951:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d86fbf77/0xa2465143277550b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.162965:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.162966:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.162971:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d86fbf77/0xa2465143277550b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.162986:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d86fbf77/0xa2465143277550b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.162996:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d86fbf77/0xa2465143277550b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163003:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d86fbf77/0xa2465143277550b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163022:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340910.163113:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x360:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.163117:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002412b72e/0xa24651432775512 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163124:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.163125:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.163127:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002412b72e/0xa24651432775512 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163145:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002412b72e/0xa24651432775512 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163151:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002412b72e/0xa24651432775512 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163158:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002412b72e/0xa24651432775512 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163177:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1780340910.163716:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x35f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.163723:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036c68481/0xa24651432775519 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163733:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.163734:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.163737:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036c68481/0xa24651432775519 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163746:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036c68481/0xa24651432775519 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163753:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036c68481/0xa24651432775519 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163787:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036c68481/0xa24651432775519 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163809:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1780340910.163849:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x35e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.163853:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a00c3152/0xa24651432775520 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163860:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.163862:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.163864:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a00c3152/0xa24651432775520 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163872:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a00c3152/0xa24651432775520 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163880:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a00c3152/0xa24651432775520 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163886:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a00c3152/0xa24651432775520 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163901:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1780340910.163913:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1780340910.163919:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d86fbf77/0xa2465143277550b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163926:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340910.163931:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d86fbf77/0xa2465143277550b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163946:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d86fbf77/0xa2465143277550b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163965:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d86fbf77/0xa2465143277550b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163972:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d86fbf77/0xa2465143277550b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163988:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1780340910.163992:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002412b72e/0xa24651432775512 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.163997:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340910.164000:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002412b72e/0xa24651432775512 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.164007:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002412b72e/0xa24651432775512 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164013:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1780340910.164016:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002412b72e/0xa24651432775512 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164020:0:8830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa24651432775504 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.164029:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002412b72e/0xa24651432775512 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164054:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340910.164060:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036c68481/0xa24651432775519 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.164062:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340910.164069:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a00c3152/0xa24651432775520 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164071:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.164076:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036c68481/0xa24651432775519 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.164083:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340910.164088:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a00c3152/0xa24651432775520 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164091:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036c68481/0xa24651432775519 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.164109:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a00c3152/0xa24651432775520 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164113:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036c68481/0xa24651432775519 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.164123:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a00c3152/0xa24651432775520 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164132:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036c68481/0xa24651432775519 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.164135:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a00c3152/0xa24651432775520 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164155:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.164157:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340910.164159:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.164160:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340910.164163:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340910.164166:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340910.164331:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x353:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.164336:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775527 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164344:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.164346:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.164349:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775527 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164360:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775527 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164369:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775527 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164376:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775527 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340910.164381:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x35d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.164388:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce0f722f/0xa2465143277552e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164391:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340910.164400:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340910.164401:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.164411:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.164412:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775527 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.164416:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce0f722f/0xa2465143277552e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164425:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.164431:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775527 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.164435:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce0f722f/0xa2465143277552e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164446:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775527 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.164449:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce0f722f/0xa2465143277552e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.164463:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce0f722f/0xa2465143277552e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164464:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775527 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164483:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775527 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.164489:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340910.164499:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.164503:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce0f722f/0xa2465143277552e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164509:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.164512:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce0f722f/0xa2465143277552e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164520:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce0f722f/0xa2465143277552e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164540:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce0f722f/0xa2465143277552e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164546:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce0f722f/0xa2465143277552e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.164559:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.164561:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340910.164610:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340910.164655:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x35c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.164661:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1a3b091/0xa24651432775535 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.164669:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.164671:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.164674:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a3b091/0xa24651432775535 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.164683:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1a3b091/0xa24651432775535 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.164690:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1a3b091/0xa24651432775535 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.164705:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1a3b091/0xa24651432775535 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167057:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.167069:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1a3b091/0xa24651432775535 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167083:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.167088:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1a3b091/0xa24651432775535 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167098:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1a3b091/0xa24651432775535 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167117:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1a3b091/0xa24651432775535 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167126:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.167127:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.167129:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340910.167240:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x352:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.167257:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277553c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167268:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.167270:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.167275:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277553c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167286:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277553c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167294:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277553c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167312:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277553c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167330:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340910.167336:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340910.167340:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.167344:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277553c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.167344:0:25496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1a3b091/0xa24651432775535 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167367:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.167370:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277553c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167378:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277553c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.167389:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.167403:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277553c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167411:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa2465143277553c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167430:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.167432:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.167435:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1780340910.167446:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x35b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.167452:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd19e2c8/0xa24651432775543 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.167462:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.167464:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.167467:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd19e2c8/0xa24651432775543 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.167477:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd19e2c8/0xa24651432775543 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780340910.167480:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x351:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.167488:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd19e2c8/0xa24651432775543 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167490:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277554a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167502:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.167503:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.167506:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277554a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167515:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277554a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167522:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277554a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167529:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277554a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167555:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340910.167562:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.167566:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277554a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167574:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.167577:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277554a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167584:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277554a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167594:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277554a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167601:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277554a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167614:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.167616:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.167619:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340910.167630:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd19e2c8/0xa24651432775543 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780340910.167659:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x350:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.167663:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340910.167669:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775551 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167678:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.167686:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.167689:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775551 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167700:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775551 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167708:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775551 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340910.167710:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x35a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.167720:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000f38035/0xa24651432775558 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167722:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775551 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.167741:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.167743:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.167745:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340910.167746:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000f38035/0xa24651432775558 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167751:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd19e2c8/0xa24651432775543 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167781:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.167784:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd19e2c8/0xa24651432775543 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167791:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd19e2c8/0xa24651432775543 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167800:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd19e2c8/0xa24651432775543 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167808:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd19e2c8/0xa24651432775543 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167828:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.167829:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.167831:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.167840:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340910.167846:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.167850:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775551 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167856:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.167859:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775551 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167866:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775551 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167876:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775551 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167884:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775551 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.167895:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.167897:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.167898:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340910.167937:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x34f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.169069:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000f38035/0xa24651432775558 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169086:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000f38035/0xa24651432775558 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169094:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000f38035/0xa24651432775558 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169359:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340910.169440:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x359:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.169446:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000385bbee7/0xa24651432775566 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169456:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.169458:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.169471:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000385bbee7/0xa24651432775566 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169482:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000385bbee7/0xa24651432775566 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169489:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000385bbee7/0xa24651432775566 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169495:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000385bbee7/0xa24651432775566 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169635:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780340910.169649:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2f83c7a/0xa2465143277555f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.169669:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.169671:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.169674:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f83c7a/0xa2465143277555f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340910.169677:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x358:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.169686:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d7c06ab/0xa2465143277556d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.169687:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2f83c7a/0xa2465143277555f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169707:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.169708:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2f83c7a/0xa2465143277555f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169710:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.169715:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d7c06ab/0xa2465143277556d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.169719:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2f83c7a/0xa2465143277555f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169734:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d7c06ab/0xa2465143277556d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.169743:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1780340910.169743:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d7c06ab/0xa2465143277556d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.169750:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000f38035/0xa24651432775558 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169785:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d7c06ab/0xa2465143277556d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169795:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1780340910.169831:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x357:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.169836:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f1de53d/0xa24651432775574 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169843:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.169844:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.169846:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f1de53d/0xa24651432775574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169854:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f1de53d/0xa24651432775574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169873:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f1de53d/0xa24651432775574 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169881:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f1de53d/0xa24651432775574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169888:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1780340910.169892:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.169900:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000f38035/0xa24651432775558 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.169911:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000f38035/0xa24651432775558 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340910.169923:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x356:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.169926:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000f38035/0xa24651432775558 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169929:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046b7e531/0xa2465143277557b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169955:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.169957:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.169960:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046b7e531/0xa2465143277557b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169968:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046b7e531/0xa2465143277557b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169975:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046b7e531/0xa2465143277557b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169981:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046b7e531/0xa2465143277557b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.169989:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1780340910.170025:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x355:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.170030:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f384f2f9/0xa24651432775582 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170037:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.170039:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.170042:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f384f2f9/0xa24651432775582 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170050:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f384f2f9/0xa24651432775582 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170068:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f384f2f9/0xa24651432775582 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170075:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f384f2f9/0xa24651432775582 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170084:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1780340910.170118:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x354:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.170122:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432775589 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170128:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.170129:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.170132:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432775589 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170139:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432775589 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170145:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432775589 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170151:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432775589 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170157:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1780340910.170194:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x353:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.170198:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432775590 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170204:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.170205:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.170208:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432775590 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170216:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432775590 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170223:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432775590 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170230:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432775590 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170238:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:3.0:1780340910.170250:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000f38035/0xa24651432775558 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340910.170273:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x352:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.170274:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1780340910.170280:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000385bbee7/0xa24651432775566 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170280:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432775597 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170312:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:2.0:1780340910.170313:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.170316:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000385bbee7/0xa24651432775566 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170316:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.170320:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432775597 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170331:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000385bbee7/0xa24651432775566 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170336:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432775597 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170344:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000385bbee7/0xa24651432775566 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170358:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000385bbee7/0xa24651432775566 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170358:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432775597 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170380:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432775597 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170385:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1780340910.170389:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1780340910.170390:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d7c06ab/0xa2465143277556d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170399:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.170409:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d7c06ab/0xa2465143277556d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170417:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d7c06ab/0xa2465143277556d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340910.170427:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x351:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.170428:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d7c06ab/0xa2465143277556d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170435:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa2465143277559e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170440:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d7c06ab/0xa2465143277556d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170449:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.170452:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.170456:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa2465143277559e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170461:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1780340910.170466:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f1de53d/0xa24651432775574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170470:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa2465143277559e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170479:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.170484:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f1de53d/0xa24651432775574 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.170486:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa2465143277559e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170500:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f1de53d/0xa24651432775574 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170510:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f1de53d/0xa24651432775574 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170516:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f1de53d/0xa24651432775574 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170538:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1780340910.170542:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046b7e531/0xa2465143277557b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170548:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.170551:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046b7e531/0xa2465143277557b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170558:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046b7e531/0xa2465143277557b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170568:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046b7e531/0xa2465143277557b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170575:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046b7e531/0xa2465143277557b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170586:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780340910.170588:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f384f2f9/0xa24651432775582 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170594:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.170597:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f384f2f9/0xa24651432775582 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170614:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f384f2f9/0xa24651432775582 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170624:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f384f2f9/0xa24651432775582 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170631:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f384f2f9/0xa24651432775582 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170643:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780340910.170646:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432775589 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170652:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.170655:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432775589 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170661:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432775589 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170670:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432775589 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170676:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d3488a4/0xa24651432775589 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170698:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340910.170701:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432775590 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170708:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.170710:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432775590 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170717:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432775590 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170726:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432775590 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170733:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad294175/0xa24651432775590 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170744:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.170746:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432775597 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170752:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.170755:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432775597 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170794:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432775597 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.170804:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432775597 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172280:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d371d84c/0xa24651432775597 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172313:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.172315:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.172317:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.172332:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.172346:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340910.172357:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.172361:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2f83c7a/0xa2465143277555f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172368:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.172371:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2f83c7a/0xa2465143277555f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172379:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2f83c7a/0xa2465143277555f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172393:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2f83c7a/0xa2465143277555f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172408:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2f83c7a/0xa2465143277555f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172426:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.172427:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.172429:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340910.172508:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x34e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.172514:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327755a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172524:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.172526:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.172530:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327755a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172541:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327755a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172549:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327755a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172557:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327755a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172569:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340910.172575:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.172584:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327755a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172590:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.172593:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327755a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172600:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327755a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172610:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327755a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172617:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005419894f/0xa246514327755a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172630:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.172632:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.172633:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340910.172674:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x34d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.172679:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327755ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172686:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.172687:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.172690:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327755ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172708:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327755ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172716:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327755ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172723:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327755ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172735:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340910.172742:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.172745:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327755ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172752:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.172755:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327755ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172780:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327755ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172790:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327755ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.172796:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa246514327755ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173111:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa2465143277559e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173128:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340910.173193:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x350:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.173198:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000547a855/0xa246514327755b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173206:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.173208:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.173211:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000547a855/0xa246514327755b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173221:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000547a855/0xa246514327755b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173228:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000547a855/0xa246514327755b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173234:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000547a855/0xa246514327755b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173243:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1780340910.173279:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x34f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.173285:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000824213ca/0xa246514327755ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173292:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.173293:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.173296:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000824213ca/0xa246514327755ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173316:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000824213ca/0xa246514327755ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173330:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000824213ca/0xa246514327755ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173336:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000824213ca/0xa246514327755ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173344:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1780340910.173383:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x34e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.173389:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090f5c09a/0xa246514327755c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173396:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.173397:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.173400:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090f5c09a/0xa246514327755c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173408:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090f5c09a/0xa246514327755c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173414:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090f5c09a/0xa246514327755c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173421:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090f5c09a/0xa246514327755c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173428:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1780340910.173471:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x34d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.173476:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eee84fc/0xa246514327755c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173484:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.173485:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.173488:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eee84fc/0xa246514327755c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173498:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eee84fc/0xa246514327755c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173506:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eee84fc/0xa246514327755c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173513:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eee84fc/0xa246514327755c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173520:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1780340910.173556:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x34c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.173561:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddaf1033/0xa246514327755cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173568:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.173570:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.173572:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddaf1033/0xa246514327755cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173580:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddaf1033/0xa246514327755cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173594:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddaf1033/0xa246514327755cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173601:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddaf1033/0xa246514327755cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173610:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1780340910.173651:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x34b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.173656:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000166e78b6/0xa246514327755d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173663:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.173665:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.173668:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000166e78b6/0xa246514327755d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173676:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000166e78b6/0xa246514327755d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173684:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000166e78b6/0xa246514327755d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173691:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000166e78b6/0xa246514327755d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173700:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1780340910.173746:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x34a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.173750:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cac4165/0xa246514327755dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173779:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.173781:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.173784:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cac4165/0xa246514327755dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173794:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cac4165/0xa246514327755dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173802:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cac4165/0xa246514327755dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173809:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cac4165/0xa246514327755dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173818:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1780340910.173851:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x349:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.173856:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cc7f28b/0xa246514327755e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173862:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.173864:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.173867:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009cc7f28b/0xa246514327755e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173875:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009cc7f28b/0xa246514327755e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173889:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009cc7f28b/0xa246514327755e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173895:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009cc7f28b/0xa246514327755e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173903:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1780340910.173939:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x348:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.173944:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afc29f33/0xa246514327755eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173951:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.173952:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.173955:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afc29f33/0xa246514327755eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173963:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afc29f33/0xa246514327755eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173970:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afc29f33/0xa246514327755eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173976:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afc29f33/0xa246514327755eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.173983:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1780340910.174021:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x347:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.174025:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d643b8f7/0xa246514327755f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.174031:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.174032:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.174035:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d643b8f7/0xa246514327755f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.174042:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d643b8f7/0xa246514327755f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.174048:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d643b8f7/0xa246514327755f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.174054:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d643b8f7/0xa246514327755f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.174060:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:2.0:1780340910.174087:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x346:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.174092:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb61f803/0xa246514327755f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.174099:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.174100:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.174102:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb61f803/0xa246514327755f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.174110:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb61f803/0xa246514327755f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.174123:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb61f803/0xa246514327755f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.174130:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb61f803/0xa246514327755f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.174138:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:2.0:1780340910.174169:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x345:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.174173:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3782aa0/0xa24651432775600 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.174180:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.174181:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.174184:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3782aa0/0xa24651432775600 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.174192:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3782aa0/0xa24651432775600 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.174200:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3782aa0/0xa24651432775600 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.174207:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3782aa0/0xa24651432775600 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.174214:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:2.0:1780340910.174260:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x344:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.174265:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c97dfa3/0xa24651432775607 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.174272:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.174273:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.174276:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c97dfa3/0xa24651432775607 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.174286:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c97dfa3/0xa24651432775607 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.174293:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c97dfa3/0xa24651432775607 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174359:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:1.0:1780340910.174366:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa2465143277559e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174376:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340910.174380:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa2465143277559e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174389:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa2465143277559e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174403:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa2465143277559e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174409:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c27b694/0xa2465143277559e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174427:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:1.0:1780340910.174430:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000547a855/0xa246514327755b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174437:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486367000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340910.174440:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000547a855/0xa246514327755b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174447:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000547a855/0xa246514327755b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174465:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000547a855/0xa246514327755b3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174471:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000547a855/0xa246514327755b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174486:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:1.0:1780340910.174489:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000824213ca/0xa246514327755ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174495:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486367e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340910.174498:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000824213ca/0xa246514327755ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174505:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000824213ca/0xa246514327755ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174514:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000824213ca/0xa246514327755ba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174520:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000824213ca/0xa246514327755ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174530:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:1.0:1780340910.174533:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090f5c09a/0xa246514327755c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174547:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486366200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340910.174550:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090f5c09a/0xa246514327755c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174557:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090f5c09a/0xa246514327755c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174566:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090f5c09a/0xa246514327755c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174574:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090f5c09a/0xa246514327755c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174587:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:1.0:1780340910.174590:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eee84fc/0xa246514327755c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174595:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486367400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340910.174597:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eee84fc/0xa246514327755c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174604:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eee84fc/0xa246514327755c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174612:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eee84fc/0xa246514327755c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174626:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eee84fc/0xa246514327755c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174638:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:1.0:1780340910.174641:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddaf1033/0xa246514327755cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174647:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486366a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340910.174650:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddaf1033/0xa246514327755cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174656:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddaf1033/0xa246514327755cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174665:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddaf1033/0xa246514327755cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174672:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddaf1033/0xa246514327755cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174684:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1780340910.174687:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000166e78b6/0xa246514327755d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174693:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486367600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340910.174701:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000166e78b6/0xa246514327755d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174709:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000166e78b6/0xa246514327755d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174719:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000166e78b6/0xa246514327755d6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174725:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000166e78b6/0xa246514327755d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174737:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1780340910.174740:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cac4165/0xa246514327755dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174746:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486366c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340910.174749:0:23160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cac4165/0xa246514327755dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174755:0:23160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cac4165/0xa246514327755dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174786:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cac4165/0xa246514327755dd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.174793:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cac4165/0xa246514327755dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175293:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1780340910.175306:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009cc7f28b/0xa246514327755e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175313:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486366400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.175316:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009cc7f28b/0xa246514327755e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175324:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009cc7f28b/0xa246514327755e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175334:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009cc7f28b/0xa246514327755e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175340:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009cc7f28b/0xa246514327755e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175352:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1780340910.175355:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afc29f33/0xa246514327755eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175361:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486366600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.175363:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afc29f33/0xa246514327755eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175382:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afc29f33/0xa246514327755eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175391:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afc29f33/0xa246514327755eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175397:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afc29f33/0xa246514327755eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175409:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780340910.175412:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d643b8f7/0xa246514327755f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175419:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2d200 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.175421:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d643b8f7/0xa246514327755f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175428:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d643b8f7/0xa246514327755f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175437:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d643b8f7/0xa246514327755f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175444:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d643b8f7/0xa246514327755f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175466:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340910.175470:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb61f803/0xa246514327755f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175476:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2dc00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.175478:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb61f803/0xa246514327755f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175485:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb61f803/0xa246514327755f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175493:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb61f803/0xa246514327755f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175499:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb61f803/0xa246514327755f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175509:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.175512:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3782aa0/0xa24651432775600 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175518:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2c000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.175521:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3782aa0/0xa24651432775600 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175539:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3782aa0/0xa24651432775600 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175550:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3782aa0/0xa24651432775600 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175557:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3782aa0/0xa24651432775600 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175569:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.175571:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.175573:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.175580:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340910.175648:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x34c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.175654:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277560e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175663:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.175665:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.175669:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277560e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175679:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277560e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175688:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277560e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175702:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277560e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175717:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340910.175724:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.175727:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277560e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175733:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.175736:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277560e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175743:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277560e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175754:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277560e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175777:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277560e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.175791:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.175792:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.175794:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340910.176268:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340910.176271:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340910.176273:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340910.176281:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340910.176957:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c97dfa3/0xa24651432775607 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.176984:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1780340910.177064:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x343:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.177071:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab3b73d1/0xa24651432775615 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.177080:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.177083:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.177087:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab3b73d1/0xa24651432775615 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.177099:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab3b73d1/0xa24651432775615 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.177114:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab3b73d1/0xa24651432775615 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.177121:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab3b73d1/0xa24651432775615 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.177134:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1780340910.177172:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x342:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1780340910.177177:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac62e5b4/0xa2465143277561c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.177183:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.177185:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340910.177188:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac62e5b4/0xa2465143277561c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.177196:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac62e5b4/0xa2465143277561c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.177204:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac62e5b4/0xa2465143277561c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.177211:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac62e5b4/0xa2465143277561c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340910.177226:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1780340910.178055:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780340910.178063:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c97dfa3/0xa24651432775607 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.178082:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2d600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.178086:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c97dfa3/0xa24651432775607 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.178095:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c97dfa3/0xa24651432775607 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.178113:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c97dfa3/0xa24651432775607 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.178121:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c97dfa3/0xa24651432775607 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.178142:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340910.178145:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab3b73d1/0xa24651432775615 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.178152:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2d800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.178157:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab3b73d1/0xa24651432775615 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.178166:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab3b73d1/0xa24651432775615 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.178289:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab3b73d1/0xa24651432775615 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.178313:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab3b73d1/0xa24651432775615 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1780340910.178322:0:25496:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:771 00010000:00010000:3.0:1780340910.178329:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.178333:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac62e5b4/0xa2465143277561c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.178340:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2d400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.178343:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac62e5b4/0xa2465143277561c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.178350:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac62e5b4/0xa2465143277561c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.178361:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac62e5b4/0xa2465143277561c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.178368:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac62e5b4/0xa2465143277561c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.178380:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.178382:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.178385:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.178392:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340910.178412:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:90583:x1866818961234048:12345-0@lo:5:osp-pre-1-0.0 Request processed in 52555us (57012us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340910.178422:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5930 00000100:00100000:3.0:1780340910.178433:0:90583:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ca300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90583:1866818961234048:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1780340910.178457:0:90583:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x361:0x0] from OST, last_created [0x2c0000401:0x361:0x0]last_used is [0x2c0000401:0x303:0x0] 00000100:00100000:3.0:1780340910.178526:0:90583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90583:1866818961234304:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1780340910.178561:0:90583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340910.178582:0:90583:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047215bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1780340910.178596:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961234176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340910.178621:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340910.178658:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961234304 00000100:00100000:3.0:1780340910.178664:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961234304 00000100:00100000:3.0:1780340910.178691:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5931 00000100:00100000:3.0:1780340910.178698:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:90583:x1866818961234304:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1780340910.178732:0:8401:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 866 00000100:00100000:0.0:1780340910.181280:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961234176 00000100:00100000:0.0:1780340910.181289:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961234176 00000100:00100000:0.0:1780340910.181346:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2138 00000100:00100000:0.0:1780340910.181356:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b48c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961234176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780340910.181378:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340910.181447:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b48c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1866818961234176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (2824us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340910.181454:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2138 00000100:00100000:0.0:1780340910.183521:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961234176:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1780340910.184498:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340910.184610:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340910.185628:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:90583:x1866818961234304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6924us (7061us total) trans 4294969457 rc 0/0 00000100:00100000:3.0:1780340910.185641:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5931 00000100:00100000:3.0:1780340910.185703:0:90583:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ca680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90583:1866818961234304:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1780340910.185717:0:90583:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x361:0x0]-[0x2c0000401:0x381:0x0] 00002000:00010000:3.0:1780340910.188264:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x34b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.188279:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775623 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188296:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.188308:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.188313:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775623 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188328:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775623 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188345:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775623 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188353:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775623 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188374:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780340910.188450:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x34a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.188455:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277562a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188463:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.188464:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.188467:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277562a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188475:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277562a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188482:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277562a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188490:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277562a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188502:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1780340910.188517:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340910.188522:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775623 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188530:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.188534:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775623 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188543:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775623 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188559:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775623 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188566:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000039009ef/0xa24651432775623 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188582:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.188585:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277562a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188592:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9000 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.188595:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277562a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188602:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277562a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188623:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277562a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188630:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000172af6a9/0xa2465143277562a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188641:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.188643:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.188645:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340910.188681:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x349:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.188686:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432775631 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188694:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.188696:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.188699:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432775631 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188707:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432775631 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188715:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432775631 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188723:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432775631 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188747:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1780340910.188755:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.188781:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432775631 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188789:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8e00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.188792:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432775631 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.188801:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432775631 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.188895:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.189923:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432775631 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.189936:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aeca5bf1/0xa24651432775631 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190033:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.190035:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.190036:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340910.190111:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x348:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.190117:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775638 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190127:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.190135:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.190140:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775638 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190151:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775638 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190160:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775638 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190168:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775638 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190312:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780340910.190355:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x347:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.190360:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277563f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190368:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.190369:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.190372:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277563f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190381:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277563f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190388:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277563f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190408:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277563f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190422:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1780340910.190459:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x346:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.190464:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432775646 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190472:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.190473:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.190475:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432775646 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190484:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432775646 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190490:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432775646 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190497:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432775646 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190511:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1780340910.190518:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780340910.190523:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775638 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190543:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.190547:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775638 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190554:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775638 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190564:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775638 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190570:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1172e0f/0xa24651432775638 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190586:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340910.190589:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277563f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190595:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.190598:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277563f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190605:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277563f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190613:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277563f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190626:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4c5182b/0xa2465143277563f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190639:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340910.190642:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432775646 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190648:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9c00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340910.190651:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432775646 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190658:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432775646 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190669:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432775646 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190675:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030cb18f5/0xa24651432775646 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190690:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.190692:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.190694:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340910.190737:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x345:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.190743:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277564d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190756:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.190782:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.190786:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277564d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.190796:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277564d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.191061:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340910.191067:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.191901:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277564d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.191916:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277564d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.191930:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780340910.192114:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x344:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.192120:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa24651432775654 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.192129:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.192131:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.192134:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa24651432775654 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.192144:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa24651432775654 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.192163:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa24651432775654 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.192170:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa24651432775654 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.192325:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1780340910.196026:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780340910.196039:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277564d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.196053:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340910.196056:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277564d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.196067:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277564d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.196087:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277564d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.196094:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088340e03/0xa2465143277564d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.196118:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340910.196129:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa24651432775654 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.196137:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340910.196140:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa24651432775654 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.196148:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa24651432775654 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.196158:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa24651432775654 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.196165:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3f7ed44/0xa24651432775654 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340910.196285:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340910.196289:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340910.196291:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.197144:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1780340910.197326:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x343:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.197333:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277565b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.197348:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.197350:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.197356:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277565b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.197367:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277565b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.197376:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277565b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.197385:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277565b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.197459:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1780340910.197498:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x342:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1780340910.197503:0:8830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa24651432775662 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.197511:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.197512:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340910.197515:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa24651432775662 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.197523:0:8830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa24651432775662 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.197531:0:8830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa24651432775662 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340910.197538:0:8830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa24651432775662 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340910.201554:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780340910.201565:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277565b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340910.201579:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340910.201583:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277565b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340910.201595:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277565b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340910.201616:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277565b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340910.201623:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a78c14df/0xa2465143277565b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340910.201649:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340910.201652:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa24651432775662 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340910.201658:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8400 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340910.201661:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa24651432775662 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340910.201668:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa24651432775662 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340910.201686:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa24651432775662 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340910.201695:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340910.201697:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340910.201699:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340910.201788:0:8830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1780340910.201795:0:8830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044129825/0xa24651432775662 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340910.201882:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1780340910.202623:0:8830:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:770 00000100:00100000:3.0:1780340910.202800:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:90581:x1866818961233920:12345-0@lo:5:osp-pre-0-0.0 Request processed in 81239us (81447us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340910.202831:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5929 00000100:00100000:0.0:1780340910.207008:0:90581:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498cb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90581:1866818961233920:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1780340910.207029:0:90581:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x361:0x0] from OST, last_created [0x280000401:0x361:0x0]last_used is [0x280000401:0x302:0x0] 00000100:00100000:0.0:1780340910.207109:0:90581:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b883b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90581:1866818961234560:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1780340910.207165:0:90581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340910.207917:0:90581:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0447d0c180 going to sleep for 11 seconds 00000100:00100000:0.0:1780340910.207939:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961234432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340910.208043:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340910.208087:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961234432 00000100:00100000:0.0:1780340910.208095:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961234432 00000100:00100000:0.0:1780340910.208140:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139 00000100:00100000:0.0:1780340910.208149:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961234432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340910.208170:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340910.209012:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961234432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 795us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340910.209022:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139 00000100:00100000:0.0:1780340910.209079:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b880700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961234432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340910.209680:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961234560 00000100:00100000:2.0:1780340910.209687:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961234560 00000100:00100000:2.0:1780340910.209743:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5932 00000100:00100000:2.0:1780340910.209752:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:90581:x1866818961234560:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1780340910.209816:0:23153:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 866 00000100:00100000:2.0:1780340910.213579:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:90581:x1866818961234560:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3821us (6406us total) trans 4294969457 rc 0/0 00000100:00100000:2.0:1780340910.213591:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5932 00000100:00100000:3.0:1780340910.214034:0:90581:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b883b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90581:1866818961234560:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1780340910.214050:0:90581:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x361:0x0]-[0x280000401:0x381:0x0] 00000020:00000004:3.0:1780340910.895169:0:90885:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1780340910.895412:0:90885:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1780340910.989154:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340911.656745:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340911.657533:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340911.657558:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340911.657588:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940479744 00000100:00100000:1.0:1780340911.657599:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940479744 00000100:00100000:1.0:1780340911.657665:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940479616 00000100:00100000:1.0:1780340911.657669:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940479616 00000100:00100000:1.0:1780340911.657692:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1431 00000100:00100000:1.0:1780340911.657703:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2408:x1866818940479744:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340911.657809:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b993480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2408:x1866818940479744:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 109us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340911.657817:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1431 00000100:00100000:1.0:1780340911.657834:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1432 00000100:00100000:1.0:1780340911.657841:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2408:x1866818940479616:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340911.657864:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b991500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2408:x1866818940479616:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340911.657869:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1432 00000100:00080000:3.0:1780340911.659420:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340911.660000:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940479488 00000100:00100000:0.0:1780340911.660027:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940479488 00000100:00100000:0.0:1780340911.660083:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 73 00000100:00100000:0.0:1780340911.660093:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940479488:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340911.660308:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940479488:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 216us (3570us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340911.660317:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 73 00010000:00010000:1.0:1780340912.010024:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1780340912.102561:0:90935:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1780340912.103073:0:90935:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1780340913.038017:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340914.059936:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340914.276088:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340914.276293:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940479872 00000100:00100000:3.0:1780340914.276303:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940479872 00000100:00080000:0.0:1780340914.276598:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780340914.276662:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1443 00000100:00100000:3.0:1780340914.276744:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:71701:x1866818940479872:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1780340914.276805:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340914.276827:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432775669 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2615 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340914.276892:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432775670 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340914.276906:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432775670 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340914.276919:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432775670 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340914.276966:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1780340914.276970:0:63710:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780340914.277001:0:63710:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432775670 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340914.277044:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432775669 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2615 expref: 8 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340914.277061:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432775670 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2615 expref: 7 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340914.277070:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:3.0:1780340914.277073:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1780340914.277076:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9c00, rc 0) 00000100:00100000:3.0:1780340914.277142:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:71701:x1866818940479872:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 404us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340914.277149:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1443 00000100:00100000:3.0:1780340914.282202:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340914.282413:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940480000 00000100:00100000:0.0:1780340914.282423:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940480000 00000100:00100000:0.0:1780340914.282698:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1444 00000100:00100000:0.0:1780340914.282709:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:71701:x1866818940480000:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:0.0:1780340914.282750:0:70100:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445179392 avail 1298939904 00000100:00100000:0.0:1780340914.282891:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:71701:x1866818940480000:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 184us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340914.282897:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1444 00000100:00100000:1.0:1780340914.288338:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340914.288433:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940480128 00000100:00100000:2.0:1780340914.288444:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940480128 00000100:00100000:2.0:1780340914.288529:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1445 00000100:00100000:2.0:1780340914.288539:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:71701:x1866818940480128:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:2.0:1780340914.288575:0:63712:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:2.0:1780340914.288646:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:71701:x1866818940480128:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 109us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340914.288653:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1445 00000100:00080000:0.0:1780340914.289238:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340914.292970:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340914.293113:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940480256 00000100:00100000:3.0:1780340914.293124:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940480256 00000100:00100000:0.0:1780340914.293296:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5933 00000100:00100000:0.0:1780340914.293305:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:2406:x1866818940480256:12345-192.168.203.16@tcp:8:lfs.0 00010000:00080000:0.0:1780340914.293913:0:23157:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0000: connection from 7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp t0 exp 0000000000000000 cur 3694 last 0 00000020:00000080:0.0:1780340914.293947:0:23157:0:(genops.c:1406:class_connect()) connect: client 7d14eb83-fa7c-40d9-843e-6367bec0a7b4, cookie 0xa24651432775677 00002000:00100000:0.0:1780340914.293959:0:23157:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7d14eb83-fa7c-40d9-843e-6367bec0a7b4/ffff8c047b433800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211351c ocd_grant: 8409088 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1780340914.293976:0:23157:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1780340914.294031:0:23157:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1780340914.294058:0:23157:0:(import.c:65:import_set_state_nolock()) ffff8c047b433000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1780340914.294134:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2406:x1866818940480256:12345-192.168.203.16@tcp:8:lfs.0 Request processed in 829us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340914.294142:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5933 00000100:00100000:3.0:1780340914.296199:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340914.296334:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940480384 00000100:00100000:0.0:1780340914.296549:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940480384 00000100:00080000:3.0:1780340914.296671:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340914.296713:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2140 00000100:00100000:0.0:1780340914.296724:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:71701:x1866818940480384:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:0.0:1780340914.296747:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340914.296845:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:71701:x1866818940480384:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 123us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340914.296852:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2140 00000100:00100000:1.0:1780340914.300798:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340914.302024:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940480512 00000100:00100000:2.0:1780340914.302037:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940480512 00000100:00100000:2.0:1780340914.302087:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5934 00000100:00100000:2.0:1780340914.302095:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03474c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2406:x1866818940480512:12345-192.168.203.16@tcp:8:lfs.0 00010000:00080000:2.0:1780340914.302162:0:25488:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0001: connection from 7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp t0 exp 0000000000000000 cur 3694 last 0 00000020:00000080:2.0:1780340914.302194:0:25488:0:(genops.c:1406:class_connect()) connect: client 7d14eb83-fa7c-40d9-843e-6367bec0a7b4, cookie 0xa2465143277567e 00002000:00100000:2.0:1780340914.302218:0:25488:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7d14eb83-fa7c-40d9-843e-6367bec0a7b4/ffff8c047570b000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211351c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1780340914.302257:0:25488:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1780340914.302352:0:25488:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1780340914.302388:0:25488:0:(import.c:65:import_set_state_nolock()) ffff8c047570e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1780340914.302527:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03474c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2406:x1866818940480512:12345-192.168.203.16@tcp:8:lfs.0 Request processed in 431us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340914.302535:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5934 00000100:00100000:1.0:1780340914.308519:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340914.308572:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940480640 00000100:00100000:0.0:1780340914.308582:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940480640 00000100:00100000:0.0:1780340914.308655:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2141 00000100:00100000:0.0:1780340914.308667:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:71701:x1866818940480640:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:0.0:1780340914.308695:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1780340914.308705:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340914.308788:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:71701:x1866818940480640:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 123us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340914.308796:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2141 00000100:00100000:0.0:1780340914.570017:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a07e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961234688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340914.570086:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340914.570203:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961234688 00000100:00100000:3.0:1780340914.570212:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961234688 00000100:00100000:3.0:1780340914.570285:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2142 00000100:00100000:3.0:1780340914.570295:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961234688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340914.570318:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340914.570364:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b880700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961234688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340914.570371:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2142 00000100:00080000:0.0:1780340914.570572:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340914.570611:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a07e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961234688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340914.571899:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340914.571918:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961234816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340914.571973:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340914.572149:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961234816 00000100:00100000:0.0:1780340914.572155:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961234816 00000100:00080000:3.0:1780340914.572252:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340914.572460:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2143 00000100:00100000:0.0:1780340914.572476:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961234816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340914.572497:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340914.572553:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961234816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340914.572560:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2143 00000100:00100000:2.0:1780340914.572634:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961234816:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1780340915.082127:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340915.082363:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780340915.082384:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961234944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340915.082456:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340915.082659:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961234944 00000100:00100000:0.0:1780340915.082667:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961234944 00000100:00100000:0.0:1780340915.082720:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3968 00000100:00100000:0.0:1780340915.082738:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961234944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780340915.082793:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:0.0:1780340915.082840:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961234944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340915.082846:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3968 00000100:00100000:2.0:1780340915.083636:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961235328:0@lo:400:kworker.0 00000100:00100000:2.0:1780340915.083678:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340915.083707:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961235840:0@lo:400:kworker.0 00000100:00100000:2.0:1780340915.083742:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340915.083780:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961236352:0@lo:400:kworker.0 00000100:00100000:2.0:1780340915.083805:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340915.083827:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1780340915.083832:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818961235200:0@lo:400:kworker.0 00000100:00100000:2.0:1780340915.083851:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340915.083878:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961235712:0@lo:400:kworker.0 00000100:00100000:2.0:1780340915.083900:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340915.083915:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961236224:0@lo:400:kworker.0 00000100:00100000:2.0:1780340915.083936:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340915.083977:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961235840 00000100:00100000:2.0:1780340915.083983:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961235840 00000100:00100000:2.0:1780340915.084014:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961236352 00000100:00100000:2.0:1780340915.084017:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961236352 00000100:00100000:2.0:1780340915.084044:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961236224 00000100:00100000:2.0:1780340915.084047:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961236224 00000100:00100000:2.0:1780340915.084070:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2630 00000100:00100000:2.0:1780340915.084077:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961235840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340915.084121:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961235840:12345-0@lo:400:kworker.0 Request processed in 45us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340915.084128:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2630 00000100:00100000:2.0:1780340915.084143:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2631 00000100:00100000:2.0:1780340915.084149:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961236352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340915.084193:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961236352:12345-0@lo:400:kworker.0 Request processed in 44us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340915.084199:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2631 00000100:00100000:2.0:1780340915.084210:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632 00000100:00100000:2.0:1780340915.084217:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961236224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340915.084547:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961235456:0@lo:400:kworker.0 00000100:00100000:1.0:1780340915.084576:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340915.084597:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961235968:0@lo:400:kworker.0 00000100:00100000:1.0:1780340915.084615:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340915.084629:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961236480:0@lo:400:kworker.0 00000100:00100000:1.0:1780340915.084651:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340915.084685:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1780340915.084691:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961235072:0@lo:400:kworker.0 00000100:00100000:1.0:1780340915.084740:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340915.084783:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961235584:0@lo:400:kworker.0 00000100:00100000:1.0:1780340915.084804:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340915.084820:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961236096:0@lo:400:kworker.0 00000100:00100000:1.0:1780340915.084838:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340915.085079:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961235072 00000100:00100000:1.0:1780340915.085084:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961235072 00000100:00100000:1.0:1780340915.085117:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1780340915.085124:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961235072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340915.085166:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961235072:12345-0@lo:400:kworker.0 Request processed in 43us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340915.085289:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1780340915.085324:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961235328 00000100:00100000:1.0:1780340915.085328:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961235328 00000100:00100000:0.0:1780340915.085465:0:25497:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961235968 00000100:00100000:0.0:1780340915.085470:0:25497:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961235968 00000100:00100000:0.0:1780340915.085495:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633 00000100:00100000:0.0:1780340915.085501:0:25497:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961235968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340915.085536:0:25497:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961235968:12345-0@lo:400:kworker.0 Request processed in 35us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340915.085542:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633 00000100:00100000:0.0:1780340915.085561:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961235712 00000100:00100000:0.0:1780340915.085565:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961235712 00000100:00100000:0.0:1780340915.085590:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3969 00000100:00100000:0.0:1780340915.085596:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1866818961235712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340915.085626:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1866818961235712:12345-0@lo:400:kworker.0 Request processed in 31us (1725us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340915.085643:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3969 00000100:00100000:0.0:1780340915.085697:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961235072:0@lo:400:kworker.0 00000100:00100000:0.0:1780340915.085709:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961235968:0@lo:400:kworker.0 00000100:00100000:0.0:1780340915.085731:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961235200 00000100:00100000:0.0:1780340915.085734:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961235200 00000100:00100000:0.0:1780340915.085750:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961235456 00000100:00100000:0.0:1780340915.085752:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961235456 00000100:00100000:0.0:1780340915.085784:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961236480 00000100:00100000:0.0:1780340915.085787:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961236480 00000100:00100000:0.0:1780340915.085796:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961235584 00000100:00100000:0.0:1780340915.085798:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961235584 00000100:00100000:0.0:1780340915.085807:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961236096 00000100:00100000:0.0:1780340915.085809:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961236096 00000100:00100000:0.0:1780340915.085819:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:0.0:1780340915.085824:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961235328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340915.085852:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961235328:12345-0@lo:400:kworker.0 Request processed in 28us (2175us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340915.085858:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:2.0:1780340915.085979:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3660:x1866818961236224:12345-0@lo:400:kworker.0 Request processed in 1763us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340915.085985:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632 00000100:00100000:2.0:1780340915.088989:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:2.0:1780340915.089015:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1866818961235200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340915.089098:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1866818961235200:12345-0@lo:400:kworker.0 Request processed in 97us (5245us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340915.089105:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:2.0:1780340915.089136:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:2.0:1780340915.089157:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961235456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340915.089337:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961235456:12345-0@lo:400:kworker.0 Request processed in 180us (4758us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340915.089347:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:1.0:1780340915.089457:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:1.0:1780340915.089469:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961236480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340915.089677:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961236480:12345-0@lo:400:kworker.0 Request processed in 211us (5024us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340915.089685:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:1.0:1780340915.089702:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:1.0:1780340915.089709:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961235584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340915.089739:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961235584:12345-0@lo:400:kworker.0 Request processed in 32us (4934us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340915.089744:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:1.0:1780340915.089756:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:1.0:1780340915.089779:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961236096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340915.089816:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961236096:12345-0@lo:400:kworker.0 Request processed in 38us (4977us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340915.089822:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00080000:2.0:1780340915.089977:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780340915.089982:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340915.089985:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340915.089988:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340915.090031:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961234944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340915.090071:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818961235200:0@lo:400:kworker.0 00000100:00100000:2.0:1780340915.090081:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961235712:0@lo:400:kworker.0 00000100:00100000:2.0:1780340915.090093:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961236224:0@lo:400:kworker.0 00000100:00100000:2.0:1780340915.090103:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961235328:0@lo:400:kworker.0 00000100:00100000:2.0:1780340915.090113:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961235840:0@lo:400:kworker.0 00000100:00100000:2.0:1780340915.090124:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961236352:0@lo:400:kworker.0 00000100:00100000:1.0:1780340915.090801:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961235584:0@lo:400:kworker.0 00000100:00100000:1.0:1780340915.090813:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961236096:0@lo:400:kworker.0 00000100:00100000:1.0:1780340915.090823:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961235456:0@lo:400:kworker.0 00000100:00100000:1.0:1780340915.090834:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961236480:0@lo:400:kworker.0 00000100:00100000:0.0:1780340915.594034:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961236608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340915.594099:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340915.594148:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961236736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340915.594168:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340915.594183:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340915.594187:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961236864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340915.594205:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340915.594231:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961236608 00000100:00100000:0.0:1780340915.594247:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961236608 00000100:00100000:0.0:1780340915.594300:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961236736 00000100:00100000:0.0:1780340915.594303:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961236736 00000100:00100000:0.0:1780340915.594323:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144 00000100:00100000:0.0:1780340915.594332:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961236608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340915.594355:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340915.594397:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961236608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340915.594404:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144 00000100:00100000:0.0:1780340915.594419:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2145 00000100:00100000:0.0:1780340915.594425:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961236736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780340915.594435:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340915.594464:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ff3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1866818961236736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340915.594470:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2145 00000100:00100000:0.0:1780340915.594490:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961236864 00000100:00100000:0.0:1780340915.594493:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961236864 00000100:00100000:0.0:1780340915.594516:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3970 00000100:00100000:0.0:1780340915.594522:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961236864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780340915.594544:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445179392 avail 1298939904 00000100:00100000:0.0:1780340915.594570:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961236864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340915.594575:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3970 00000100:00100000:0.0:1780340915.594614:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961236864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340915.594625:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961236736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340915.594650:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961236608:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1780340916.106242:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1780340916.108554:0:72681:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411389 batchid updated 00000020:00080000:2.0:1780340916.108564:0:72681:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411388 batchid updated 00000020:00080000:0.0:1780340916.108748:0:72701:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411389 00000004:00080000:0.0:1780340916.108986:0:72701:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c0345c7c000 with version 15 00000020:00080000:0.0:1780340916.111322:0:72701:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411388 cancel update log [0x2000088d1:0x2:0x0].4: rc = 0 00000020:00080000:0.0:1780340916.111431:0:72701:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411388 cancel update log [0x2400090a0:0x2:0x0].4: rc = 0 00000004:00080000:0.0:1780340916.111473:0:72701:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff8c0345c7c0c0 with version 16 00000001:00100000:3.0:1780340916.114925:0:9462:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000001:00080000:3.0:1780340916.114941:0:9462:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969457 is committed 00000001:00100000:3.0:1780340916.115249:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000001:00080000:3.0:1780340916.115268:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969457 is committed 00000004:00080000:1.0:1780340916.115384:0:72687:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c034acb9780 version 15 rpc_version 15 00000020:00100000:1.0:1780340916.115419:0:72687:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1780340916.115429:0:72687:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c0446f22a00 x1866818961237120/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340916.115453:0:72687:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446f22a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72687:1866818961237120:0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1780340916.115513:0:72687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340916.115589:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471c426c0 going to sleep for 11 seconds 00000020:00080000:0.0:1780340916.119382:0:72701:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411389 cancel update log [0x2000088d1:0x2:0x0].5: rc = 0 00000020:00080000:0.0:1780340916.119483:0:72701:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411389 cancel update log [0x2400090a0:0x2:0x0].5: rc = 0 00000020:00080000:0.0:1780340916.119493:0:72701:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411389 00000100:00100000:2.0:1780340916.121078:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961237120 00000100:00100000:2.0:1780340916.121091:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961237120 00000100:00100000:2.0:1780340916.121241:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3971 00000100:00100000:2.0:1780340916.121252:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:72687:x1866818961237120:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1780340916.121499:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:72687:x1866818961237120:12345-0@lo:1000:osp_up0-1.0 Request processed in 249us (5985us total) trans 120259084289 rc 0/0 00000100:00100000:2.0:1780340916.121522:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3971 00000100:00100000:3.0:1780340916.121601:0:72687:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446f22a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72687:1866818961237120:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1780340916.121616:0:72687:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff8c034acb9780 version 16 rpc_version 16 00000020:00100000:3.0:1780340916.121637:0:72687:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1780340916.121644:0:72687:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff8c04440a6680 x1866818961237376/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340916.121666:0:72687:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72687:1866818961237376:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1780340916.121703:0:72687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1780340916.125364:0:90562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084289 is committed 00000100:00100000:3.0:1780340916.125652:0:72687:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0447c3da80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340916.125732:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961237376 00000100:00100000:0.0:1780340916.125741:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961237376 00000100:00100000:0.0:1780340916.125940:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3972 00000100:00100000:0.0:1780340916.125951:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:72687:x1866818961237376:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1780340916.126128:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:72687:x1866818961237376:12345-0@lo:1000:osp_up0-1.0 Request processed in 179us (4423us total) trans 120259084290 rc 0/0 00000100:00100000:0.0:1780340916.126149:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3972 00000100:00100000:3.0:1780340916.126291:0:72687:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084289 gen 3 00000004:00080000:3.0:1780340916.126297:0:72687:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 120259084289 committed transno 120259084289 00000100:00100000:3.0:1780340916.126317:0:72687:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff8c04440a6680 x1866818961237376/t120259084290(120259084290) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1780340932 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340916.126333:0:72687:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72687:1866818961237376:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1780340916.816705:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340916.816752:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340916.816854:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340916.816873:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340916.816894:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340916.816924:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940481280 00000100:00100000:3.0:1780340916.816934:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940481280 00000100:00100000:2.0:1780340916.817059:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940480768 00000100:00100000:2.0:1780340916.817064:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940480768 00000100:00100000:2.0:1780340916.817112:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 75 00000100:00100000:2.0:1780340916.817123:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940480768:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340916.817211:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940480768:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 90us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340916.817215:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940481152 00000100:00100000:2.0:1780340916.817220:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 75 00000100:00100000:0.0:1780340916.817222:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940481152 00000100:00080000:2.0:1780340916.817262:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340916.817279:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2634 00000100:00100000:0.0:1780340916.817289:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2408:x1866818940481152:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340916.817323:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2408:x1866818940481152:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 37us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340916.817342:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2634 00000100:00100000:0.0:1780340916.817368:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940480896 00000100:00100000:0.0:1780340916.817372:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940480896 00000100:00100000:3.0:1780340916.817404:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2635 00000100:00100000:1.0:1780340916.817412:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940481024 00000100:00100000:3.0:1780340916.817414:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940481280:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340916.817419:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940481024 00000100:00100000:3.0:1780340916.817466:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940481280:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 55us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340916.817472:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2635 00000100:00080000:2.0:1780340916.818051:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340916.818056:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780340916.818058:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340916.824262:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1439 00000100:00100000:0.0:1780340916.824294:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940480896:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340916.824392:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940480896:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 104us (7638us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340916.824411:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1439 00000100:00100000:3.0:1780340916.831785:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1440 00000100:00100000:3.0:1780340916.831812:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2407:x1866818940481024:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340916.831891:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2407:x1866818940481024:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 94us (15037us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340916.831899:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1440 00010000:00010000:1.0:1780340917.130596:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340918.160034:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1780340918.381161:0:91032:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:0.0:1780340919.179248:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340919.690926:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340919.690946:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961237504:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340919.691008:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340919.691051:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961237504 00000100:00100000:0.0:1780340919.691057:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961237504 00000100:00100000:0.0:1780340919.691105:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146 00000100:00100000:0.0:1780340919.691123:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961237504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340919.691151:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340919.691187:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961237504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340919.691194:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146 00000100:00100000:0.0:1780340919.691248:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961237504:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1780340919.692083:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340919.692471:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780340919.692487:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961237632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340919.692539:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340919.692613:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961237632 00000100:00100000:0.0:1780340919.692619:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961237632 00000100:00100000:0.0:1780340919.692670:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147 00000100:00100000:0.0:1780340919.692681:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961237632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340919.692706:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340919.692850:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961237632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 173us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340919.692857:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147 00000100:00080000:2.0:1780340919.693199:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340919.694643:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961237632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340920.202137:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0346ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961237760:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.202232:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340920.202271:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961238272:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.202307:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340920.202325:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961238784:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.202346:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340920.202362:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961239296:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.202399:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340920.202431:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1780340920.202438:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961237888:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.202459:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340920.202475:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961238400:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.202495:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340920.202509:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961238912:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.202527:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340920.202555:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961238144:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.202580:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340920.202596:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961238656:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.202616:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340920.202631:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961239168:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.202649:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340920.202666:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1780340920.202671:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961238016:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.202690:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340920.202698:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961238528:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.202726:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340920.202744:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0445597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961239040:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.202790:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340920.202815:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961237760 00000100:00100000:0.0:1780340920.202821:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961237760 00000100:00100000:0.0:1780340920.202863:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1780340920.202871:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961237760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.202916:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961237760:12345-0@lo:400:kworker.0 Request processed in 46us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340920.202923:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1780340920.202951:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961238272 00000100:00100000:0.0:1780340920.202955:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961238272 00000100:00100000:0.0:1780340920.202983:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961238784 00000100:00100000:0.0:1780340920.202986:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961238784 00000100:00100000:0.0:1780340920.202997:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961239296 00000100:00100000:0.0:1780340920.202999:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961239296 00000100:00100000:0.0:1780340920.203008:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961237888 00000100:00100000:0.0:1780340920.203010:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961237888 00000100:00100000:0.0:1780340920.203022:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961238144 00000100:00100000:0.0:1780340920.203024:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961238144 00000100:00100000:0.0:1780340920.203033:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961238016 00000100:00100000:0.0:1780340920.203036:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961238016 00000100:00100000:0.0:1780340920.203049:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1780340920.203055:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961238272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.203085:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961238272:12345-0@lo:400:kworker.0 Request processed in 31us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340920.203091:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1780340920.203101:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:0.0:1780340920.203107:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961238784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.203141:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961238784:12345-0@lo:400:kworker.0 Request processed in 35us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340920.203147:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:0.0:1780340920.203159:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:0.0:1780340920.203164:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961239296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.203187:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961239296:12345-0@lo:400:kworker.0 Request processed in 23us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340920.203192:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:0.0:1780340920.203201:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:0.0:1780340920.203207:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961237888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.203242:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961237888:12345-0@lo:400:kworker.0 Request processed in 36us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340920.203247:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:0.0:1780340920.203257:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:0.0:1780340920.203263:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961238144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.203291:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961238144:12345-0@lo:400:kworker.0 Request processed in 28us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340920.203296:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:0.0:1780340920.203306:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:0.0:1780340920.203311:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961238016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.203333:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1866818961238016:12345-0@lo:400:kworker.0 Request processed in 22us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340920.203338:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:0.0:1780340920.203366:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961238400 00000100:00100000:0.0:1780340920.203369:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961238400 00000100:00100000:0.0:1780340920.203398:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961238912 00000100:00100000:0.0:1780340920.203401:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961238912 00000100:00100000:0.0:1780340920.203418:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973 00000100:00100000:0.0:1780340920.203424:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3659:x1866818961238400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.203457:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3659:x1866818961238400:12345-0@lo:400:kworker.0 Request processed in 34us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340920.203463:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973 00000100:00100000:0.0:1780340920.203472:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3974 00000100:00100000:0.0:1780340920.203478:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0345eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961238912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.203502:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0345eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961238912:12345-0@lo:400:kworker.0 Request processed in 25us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340920.203508:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3974 00000100:00100000:0.0:1780340920.203531:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961238656 00000100:00100000:0.0:1780340920.203535:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961238656 00000100:00100000:0.0:1780340920.203556:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961239168 00000100:00100000:0.0:1780340920.203559:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961239168 00000100:00100000:0.0:1780340920.203577:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961238528 00000100:00100000:0.0:1780340920.203580:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961238528 00000100:00100000:0.0:1780340920.203593:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961239040 00000100:00100000:0.0:1780340920.203595:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961239040 00000100:00100000:0.0:1780340920.203614:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2636 00000100:00100000:0.0:1780340920.203620:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961238656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.203648:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961238656:12345-0@lo:400:kworker.0 Request processed in 28us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340920.203653:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2636 00000100:00100000:0.0:1780340920.203664:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2637 00000100:00100000:0.0:1780340920.203670:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961239168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.203693:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961239168:12345-0@lo:400:kworker.0 Request processed in 24us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340920.203706:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2637 00000100:00100000:0.0:1780340920.203716:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638 00000100:00100000:0.0:1780340920.203722:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961238528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.203748:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961238528:12345-0@lo:400:kworker.0 Request processed in 27us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340920.203753:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638 00000100:00100000:0.0:1780340920.203783:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00000100:00100000:0.0:1780340920.203789:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961239040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.203811:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961239040:12345-0@lo:400:kworker.0 Request processed in 23us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340920.203816:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00000100:00080000:0.0:1780340920.203874:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340920.203878:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340920.203880:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780340920.203882:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1780340920.203907:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340920.203936:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1866818961238016:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.203948:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961238528:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.203956:0:3662:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969457 gen 2 00000100:00100000:0.0:1780340920.203971:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961239040:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.203980:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961238144:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.203989:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961238656:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.203996:0:3662:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969457 gen 2 00000100:00100000:0.0:1780340920.204002:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961239168:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.204043:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961237888:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.204054:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961238400:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.204062:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0445594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961238912:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.204070:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0346ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961237760:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.204080:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961238272:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.204088:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961238784:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.204097:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961239296:0@lo:400:kworker.0 00000100:00100000:0.0:1780340920.209013:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961239424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340920.209080:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340920.209148:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961239424 00000100:00100000:0.0:1780340920.209155:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961239424 00000100:00100000:0.0:1780340920.209195:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3975 00000100:00100000:0.0:1780340920.209203:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961239424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780340920.209246:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:0.0:1780340920.209287:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961239424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340920.211216:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3975 00000100:00100000:0.0:1780340920.211918:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961239424:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1780340920.289757:0:91080:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1780340920.714047:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340920.714069:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961239552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340920.714157:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340920.714214:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961239552 00000100:00100000:0.0:1780340920.714244:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961239552 00000100:00100000:0.0:1780340920.714290:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2148 00000100:00100000:0.0:1780340920.714298:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961239552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340920.714321:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340920.714362:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961239552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340920.714369:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2148 00000100:00100000:0.0:1780340920.714426:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961239552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340920.714780:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780340920.714791:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961239680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340920.714825:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340920.714893:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961239680 00000100:00100000:1.0:1780340920.714898:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961239680 00000100:00100000:1.0:1780340920.714936:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3976 00000100:00100000:1.0:1780340920.714943:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3661:x1866818961239680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780340920.714979:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445179392 avail 1298939904 00000100:00100000:1.0:1780340920.715020:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349862a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3661:x1866818961239680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340920.715025:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3976 00000100:00100000:1.0:1780340920.715057:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961239680:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340920.716678:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340920.716697:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961239808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340920.716754:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340920.716931:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961239808 00000100:00100000:3.0:1780340920.716938:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961239808 00000100:00100000:3.0:1780340920.716986:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2149 00000100:00100000:3.0:1780340920.716996:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349860380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961239808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340920.717016:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340920.717059:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349860380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961239808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340920.717066:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2149 00000100:00100000:3.0:1780340920.717105:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961239808:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1780340921.226895:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1780340921.742938:0:90562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084290 is committed 00000100:00100000:1.0:1780340921.896697:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340921.896749:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340921.896816:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340921.896845:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340921.896873:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940481920 00000100:00100000:1.0:1780340921.896873:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340921.896885:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940481920 00000100:00100000:3.0:1780340921.896952:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940481792 00000100:00100000:3.0:1780340921.896954:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940481792 00000100:00100000:3.0:1780340921.896975:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2640 00000100:00100000:3.0:1780340921.896984:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2410:x1866818940481920:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340921.897063:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2410:x1866818940481920:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340921.897070:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2640 00000100:00100000:3.0:1780340921.897085:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2641 00000100:00100000:3.0:1780340921.897090:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2410:x1866818940481792:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340921.897109:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2410:x1866818940481792:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 19us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340921.897114:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2641 00000100:00100000:2.0:1780340921.897229:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940481664 00000100:00100000:2.0:1780340921.897236:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940481664 00000100:00100000:2.0:1780340921.897279:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940481536 00000100:00100000:2.0:1780340921.897290:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940481536 00000100:00100000:2.0:1780340921.897317:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1447 00000100:00100000:2.0:1780340921.897326:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2410:x1866818940481664:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340921.897356:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1448 00000100:00100000:3.0:1780340921.897369:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2410:x1866818940481536:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340921.897369:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2410:x1866818940481664:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 41us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340921.897383:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1447 00000100:00100000:3.0:1780340921.897503:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2410:x1866818940481536:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 139us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340921.897509:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1448 00000100:00100000:0.0:1780340921.899496:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940481408 00000100:00100000:0.0:1780340921.899508:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940481408 00000100:00100000:0.0:1780340921.899581:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00100000:0.0:1780340921.899594:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2410:x1866818940481408:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340921.899902:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2410:x1866818940481408:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 308us (3215us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340921.899916:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 77 00000100:00080000:1.0:1780340921.904388:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780340921.904399:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780340921.904403:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780340921.904405:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1780340922.251955:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340922.603176:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340922.603276:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940482048 00000100:00100000:0.0:1780340922.603286:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940482048 00000100:00100000:0.0:1780340922.603350:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1446 00000100:00100000:0.0:1780340922.603361:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:72147:x1866818940482048:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:0.0:1780340922.603401:0:63710:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445179392 avail 1298939904 00000100:00100000:0.0:1780340922.603472:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:72147:x1866818940482048:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 113us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340922.603479:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1446 00000100:00100000:2.0:1780340922.606585:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340922.606706:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940482176 00000100:00100000:3.0:1780340922.606716:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940482176 00000100:00100000:3.0:1780340922.606846:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1447 00000100:00100000:3.0:1780340922.606857:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:72147:x1866818940482176:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:3.0:1780340922.607790:0:64454:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:3.0:1780340922.607880:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349862300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:72147:x1866818940482176:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 1023us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340922.607889:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1447 00000100:00100000:0.0:1780340922.617512:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340922.617595:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940482304 00000100:00100000:2.0:1780340922.617605:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940482304 00000100:00100000:2.0:1780340922.617667:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2150 00000100:00100000:2.0:1780340922.617678:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:72147:x1866818940482304:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:2.0:1780340922.617709:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780340922.617794:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:72147:x1866818940482304:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 118us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340922.617802:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2150 00000100:00100000:1.0:1780340922.622059:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340922.622148:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940482432 00000100:00100000:0.0:1780340922.622158:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940482432 00000100:00100000:0.0:1780340922.622231:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2151 00000100:00100000:0.0:1780340922.622242:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:72147:x1866818940482432:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:0.0:1780340922.622278:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340922.622349:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:72147:x1866818940482432:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 108us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340922.622356:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2151 00000100:00100000:3.0:1780340922.663865:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340922.663987:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940482560 00000100:00100000:2.0:1780340922.663996:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940482560 00000100:00100000:2.0:1780340922.664057:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1448 00000100:00100000:2.0:1780340922.664067:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:71064:x1866818940482560:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:2.0:1780340922.664088:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340922.664107:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d600/0xa24651432775685 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced261c expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664175:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c000/0xa2465143277568c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664190:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c000/0xa2465143277568c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664230:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c000/0xa2465143277568c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664246:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2dc00/0xa24651432775693 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664253:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2dc00/0xa24651432775693 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664259:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2dc00/0xa24651432775693 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664406:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d200/0xa2465143277569a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664415:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d200/0xa2465143277569a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664422:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d200/0xa2465143277569a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340922.664453:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1780340922.664457:0:63712:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780340922.664492:0:63712:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d200/0xa2465143277569a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664506:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c000/0xa2465143277568c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664514:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c000/0xa2465143277568c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664530:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c000/0xa2465143277568c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664537:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c000/0xa2465143277568c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664543:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2c000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340922.664547:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c000/0xa2465143277568c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664554:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c000/0xa2465143277568c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664567:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:2.0:1780340922.664570:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340922.664575:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c000/0xa2465143277568c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664581:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c000/0xa2465143277568c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664594:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2dc00/0xa24651432775693 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664600:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2dc00/0xa24651432775693 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664606:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2dc00/0xa24651432775693 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664611:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2dc00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340922.664619:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2dc00/0xa24651432775693 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664625:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2dc00/0xa24651432775693 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664634:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff8c04428a8b00) 00010000:00010000:2.0:1780340922.664636:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340922.664639:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2dc00/0xa24651432775693 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664645:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2dc00/0xa24651432775693 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664675:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d600/0xa24651432775685 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced261c expref: 9 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664688:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d200/0xa2465143277569a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced261c expref: 8 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.664695:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff8c04428a8400) 00010000:00010000:2.0:1780340922.664698:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1780340922.664701:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0470f2d200, rc 0) 00000100:00100000:2.0:1780340922.666658:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:71064:x1866818940482560:12345-192.168.203.16@tcp:101:bash.0 Request processed in 2583us (2791us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340922.666670:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1448 00000100:00100000:1.0:1780340922.670801:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340922.671319:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940482688 00000100:00100000:0.0:1780340922.671329:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940482688 00000100:00100000:0.0:1780340922.671385:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1449 00000100:00100000:0.0:1780340922.671396:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:71064:x1866818940482688:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:0.0:1780340922.671416:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340922.671440:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eac00/0xa246514327756a1 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2623 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.671506:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756a8 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.671521:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756a8 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.671532:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756a8 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.671547:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb400/0xa246514327756af lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.671554:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb400/0xa246514327756af lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.671561:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb400/0xa246514327756af lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340922.671706:0:70100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:70100:1866818961239936:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340922.671786:0:70100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340922.672947:0:70100:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471c426c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340922.682812:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961239936 00000100:00100000:3.0:1780340922.682836:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961239936 00000100:00100000:3.0:1780340922.682945:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3977 00000100:00100000:3.0:1780340922.682959:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:70100:x1866818961239936:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1780340922.683524:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:70100:x1866818961239936:12345-0@lo:1000:mdt00_004.0 Request processed in 566us (11734us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340922.683533:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3977 00000100:00100000:0.0:1780340922.684274:0:70100:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:70100:1866818961239936:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1780340922.684375:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb000/0xa246514327756b6 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684397:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb000/0xa246514327756b6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684413:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb000/0xa246514327756b6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340922.684459:0:70100:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb000/0xa246514327756b6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684479:0:70100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756a8 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684487:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756a8 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684494:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756a8 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684501:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756a8 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684508:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eaa00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340922.684513:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756a8 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684538:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756a8 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684555:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff8c04428a8400) 00010000:00010000:0.0:1780340922.684558:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340922.684564:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756a8 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684571:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756a8 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684599:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb400/0xa246514327756af lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684606:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb400/0xa246514327756af lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684612:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb400/0xa246514327756af lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684618:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340922.684620:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb400/0xa246514327756af lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684626:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb400/0xa246514327756af lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684634:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff8c0455c3bd00) 00010000:00010000:0.0:1780340922.684636:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340922.684639:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb400/0xa246514327756af lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684655:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb400/0xa246514327756af lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684708:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eac00/0xa246514327756a1 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2623 expref: 10 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684723:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb000/0xa246514327756b6 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2623 expref: 9 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.684730:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff8c0455c3b100) 00010000:00010000:0.0:1780340922.684733:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1780340922.684735:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c034d9eb000, rc 0) 00000100:00100000:0.0:1780340922.684871:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477585f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:71064:x1866818940482688:12345-192.168.203.16@tcp:101:bash.0 Request processed in 13476us (14112us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340922.684880:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1449 00000100:00100000:1.0:1780340922.691688:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340922.692021:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940482816 00000100:00100000:3.0:1780340922.692035:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940482816 00000100:00100000:3.0:1780340922.692112:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1450 00000100:00100000:3.0:1780340922.692125:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:71064:x1866818940482816:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:3.0:1780340922.692153:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340922.692181:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa246514327756bd lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced262a expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340922.692287:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8400/0xa246514327756c4 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340922.692305:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8400/0xa246514327756c4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340922.692319:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8400/0xa246514327756c4 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340922.692384:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1780340922.692388:0:64454:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1780340922.692470:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa246514327756bd lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced262a expref: 11 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340922.692491:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8400/0xa246514327756c4 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced262a expref: 10 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340922.692524:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff8c044120fc00) 00010000:00010000:3.0:1780340922.692527:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1780340922.692532:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8400, rc 0) 00000100:00100000:3.0:1780340922.693328:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477585500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:71064:x1866818940482816:12345-192.168.203.16@tcp:101:bash.0 Request processed in 1200us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340922.693339:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1450 00000100:00100000:3.0:1780340922.699805:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340922.700155:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940482944 00000100:00100000:2.0:1780340922.700170:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940482944 00000100:00100000:2.0:1780340922.700269:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1451 00000100:00100000:2.0:1780340922.700283:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:71064:x1866818940482944:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:2.0:1780340922.700329:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340922.700357:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2d600/0xa246514327756cb lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2631 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700445:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa246514327756d2 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700464:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa246514327756d2 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700477:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa246514327756d2 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700495:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa246514327756d9 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700503:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa246514327756d9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700511:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa246514327756d9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700611:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2d800/0xa246514327756e0 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700619:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2d800/0xa246514327756e0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700625:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2d800/0xa246514327756e0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340922.700675:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x4:0x0]: returning size 0 00000004:00200000:2.0:1780340922.700687:0:63712:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780340922.700732:0:63712:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2d800/0xa246514327756e0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700747:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2d800/0xa246514327756e0 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700789:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa246514327756d2 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700809:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa246514327756d2 lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700817:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa246514327756d2 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700824:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa246514327756d2 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700831:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2dc00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340922.700836:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa246514327756d2 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700845:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa246514327756d2 lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700858:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff8c044120fc00) 00010000:00010000:2.0:1780340922.700861:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340922.700867:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa246514327756d2 lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700874:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa246514327756d2 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700900:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa246514327756d9 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700907:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa246514327756d9 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700913:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa246514327756d9 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700918:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2c000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340922.700920:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa246514327756d9 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700927:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa246514327756d9 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700935:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff8c04428a8b00) 00010000:00010000:2.0:1780340922.700937:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340922.700940:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa246514327756d9 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700946:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa246514327756d9 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700981:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2d600/0xa246514327756cb lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2631 expref: 12 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.700995:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2d800/0xa246514327756e0 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2631 expref: 11 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.701013:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff8c04506cf400) 00010000:00010000:2.0:1780340922.701016:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340922.701019:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0470f2d800, rc 0) 00000100:00100000:2.0:1780340922.701102:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:71064:x1866818940482944:12345-192.168.203.16@tcp:101:bash.0 Request processed in 823us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340922.701109:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1451 00000100:00100000:3.0:1780340922.710907:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340922.711585:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940483072 00000100:00100000:0.0:1780340922.711600:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940483072 00000100:00100000:0.0:1780340922.711690:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 726 00000100:00100000:0.0:1780340922.711703:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2410:x1866818940483072:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780340922.711724:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340922.711792:0:25498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8400/0xa246514327756c4 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced262a expref: 11 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.711819:0:25498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff8c044120fc00) 00010000:00010000:0.0:1780340922.711825:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340922.711891:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2410:x1866818940483072:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 191us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340922.711916:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 726 00000100:00100000:3.0:1780340922.725940:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340922.726169:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940483200 00000100:00100000:0.0:1780340922.726182:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940483200 00000100:00100000:0.0:1780340922.726269:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5935 00000100:00100000:0.0:1780340922.726282:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2408:x1866818940483200:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:0.0:1780340922.726307:0:25487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340922.726338:0:25487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a9db288e/0xa246514327756e7 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2638 expref: -99 pid: 25487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340922.726370:0:25487:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x622:0x0] initial LVB size: 0, mtime: 0x6a1dd889, atime: 0x6a1dd889, ctime: 0x6a1dd889, blocks: 0x0 00010000:00010000:0.0:1780340922.726394:0:25487:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340922.726397:0:25487:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340922.726406:0:25487:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a9db288e/0xa246514327756e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2638 expref: 6 pid: 25487 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.726438:0:25487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a9db288e/0xa246514327756e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2638 expref: 6 pid: 25487 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.726454:0:25487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c034d9eac00, rc 0) 00000100:00100000:0.0:1780340922.726531:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2408:x1866818940483200:12345-192.168.203.16@tcp:101:bash.0 Request processed in 252us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340922.726538:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5935 00000100:00100000:3.0:1780340922.745433:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340922.745523:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940483328 00000100:00100000:0.0:1780340922.745538:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940483328 00000100:00100000:0.0:1780340922.745636:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1452 00000100:00100000:0.0:1780340922.745648:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:71064:x1866818940483328:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:0.0:1780340922.745692:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340922.745720:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb400/0xa246514327756ee lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced263f expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.746097:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756f5 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.746116:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756f5 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.746132:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756f5 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.746151:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eba00/0xa246514327756fc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.746159:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eba00/0xa246514327756fc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.746166:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eba00/0xa246514327756fc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340922.746331:0:70100:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:70100:1866818961240064:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1780340922.746408:0:70100:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340922.746438:0:70100:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345c7c480 going to sleep for 11 seconds 00000100:00100000:1.0:1780340922.751722:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961240064 00000100:00100000:1.0:1780340922.751743:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961240064 00000100:00100000:1.0:1780340922.751890:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3978 00000100:00100000:1.0:1780340922.751903:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:70100:x1866818961240064:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1780340922.752063:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:70100:x1866818961240064:12345-0@lo:1000:mdt00_004.0 Request processed in 162us (5654us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340922.752071:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3978 00000100:00100000:0.0:1780340922.753741:0:70100:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04467fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:70100:1866818961240064:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1780340922.753916:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb800/0xa24651432775703 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.753939:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb800/0xa24651432775703 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.753970:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb800/0xa24651432775703 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340922.754006:0:70100:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb800/0xa24651432775703 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.754025:0:70100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756f5 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.754033:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756f5 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.754040:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756f5 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.754047:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756f5 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.754054:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eaa00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340922.754059:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756f5 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.754066:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756f5 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.754079:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff8c04428a8400) 00010000:00010000:0.0:1780340922.754082:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340922.754088:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756f5 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.754095:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eaa00/0xa246514327756f5 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.754119:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eba00/0xa246514327756fc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.754125:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eba00/0xa246514327756fc lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.754130:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eba00/0xa246514327756fc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.754136:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eba00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340922.754139:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eba00/0xa246514327756fc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.754145:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eba00/0xa246514327756fc lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.754153:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff8c0455c3b600) 00010000:00010000:0.0:1780340922.754155:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340922.754158:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eba00/0xa246514327756fc lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.754164:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eba00/0xa246514327756fc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.754227:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb400/0xa246514327756ee lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced263f expref: 11 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.754244:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb800/0xa24651432775703 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced263f expref: 10 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340922.754545:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff8c0455c3b900) 00010000:00010000:0.0:1780340922.754548:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1780340922.754551:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c034d9eb800, rc 0) 00000100:00100000:0.0:1780340922.754652:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:71064:x1866818940483328:12345-192.168.203.16@tcp:101:bash.0 Request processed in 9005us (9232us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340922.754661:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1452 00000100:00100000:1.0:1780340922.766562:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340922.766823:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940483456 00000100:00100000:3.0:1780340922.766838:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940483456 00000100:00100000:3.0:1780340922.766917:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1453 00000100:00100000:3.0:1780340922.766930:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:71064:x1866818940483456:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:3.0:1780340922.766958:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340922.766985:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8c00/0xa2465143277570a lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2646 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340922.767065:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa24651432775711 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340922.767082:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa24651432775711 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340922.767094:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa24651432775711 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340922.767167:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1780340922.767172:0:64454:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1780340922.767227:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8c00/0xa2465143277570a lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2646 expref: 12 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340922.767249:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa24651432775711 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2646 expref: 11 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340922.767268:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff8c044120fa00) 00010000:00010000:3.0:1780340922.767271:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1780340922.767276:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8600, rc 0) 00000100:00100000:3.0:1780340922.767352:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:71064:x1866818940483456:12345-192.168.203.16@tcp:101:bash.0 Request processed in 424us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340922.767359:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1453 00000100:00100000:1.0:1780340922.778355:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340922.778415:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340922.778948:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940483584 00000100:00100000:2.0:1780340922.778962:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940483584 00000100:00100000:2.0:1780340922.779043:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1454 00000100:00100000:2.0:1780340922.779055:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:71064:x1866818940483584:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:2.0:1780340922.779081:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340922.779118:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2d600/0xa24651432775718 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced264d expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779217:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa2465143277571f lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779235:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa2465143277571f lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779248:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa2465143277571f lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779265:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa24651432775726 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779272:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa24651432775726 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779303:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa24651432775726 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779404:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2d400/0xa2465143277572d lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779413:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2d400/0xa2465143277572d lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779420:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2d400/0xa2465143277572d lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340922.779467:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x5:0x0]: returning size 0 00000004:00200000:2.0:1780340922.779472:0:63711:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1780340922.779495:0:63711:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2d400/0xa2465143277572d lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779509:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2d400/0xa2465143277572d lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779520:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa2465143277571f lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779527:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa2465143277571f lrc: 4/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779533:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa2465143277571f lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779540:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa2465143277571f lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779556:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2c000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340922.779560:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa2465143277571f lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779569:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa2465143277571f lrc: 5/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779867:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff8c044120fa00) 00010000:00010000:2.0:1780340922.779871:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340922.779878:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa2465143277571f lrc: 3/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779885:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2c000/0xa2465143277571f lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779903:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa24651432775726 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779909:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa24651432775726 lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779915:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa24651432775726 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779920:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2dc00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340922.779923:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa24651432775726 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779929:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa24651432775726 lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779948:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff8c04428a8b00) 00010000:00010000:2.0:1780340922.779951:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340922.779954:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa24651432775726 lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.779960:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2dc00/0xa24651432775726 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.780001:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2d600/0xa24651432775718 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced264d expref: 13 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.780014:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff8c0470f2d400/0xa2465143277572d lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced264d expref: 12 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.780021:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff8c04506cf100) 00010000:00010000:2.0:1780340922.780024:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340922.780027:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0470f2d400, rc 0) 00000100:00100000:2.0:1780340922.780108:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:71064:x1866818940483584:12345-192.168.203.16@tcp:101:bash.0 Request processed in 1055us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340922.780116:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1454 00000100:00100000:3.0:1780340922.780482:0:6502:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940483712 00000100:00100000:3.0:1780340922.780491:0:6502:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940483712 00000100:00100000:3.0:1780340922.780546:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 727 00000100:00100000:3.0:1780340922.780556:0:6502:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2410:x1866818940483712:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780340922.780569:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340922.780598:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff8c03476f8600/0xa24651432775711 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2646 expref: 12 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340922.780611:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff8c044120fa00) 00010000:00010000:3.0:1780340922.780615:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340922.780641:0:6502:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2410:x1866818940483712:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 88us (2226us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340922.780659:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 727 00000100:00100000:0.0:1780340922.795976:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340922.796099:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940483840 00000100:00100000:2.0:1780340922.796113:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940483840 00000100:00100000:2.0:1780340922.796174:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5936 00000100:00100000:2.0:1780340922.796186:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2407:x1866818940483840:12345-192.168.203.16@tcp:101:bash.0 00010000:00010000:2.0:1780340922.796217:0:8401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340922.796244:0:8401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c97dfa3/0xa24651432775734 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2654 expref: -99 pid: 8401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340922.796304:0:8401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x623:0x0] initial LVB size: 0, mtime: 0x6a1dd889, atime: 0x6a1dd889, ctime: 0x6a1dd889, blocks: 0x0 00010000:00010000:2.0:1780340922.796329:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340922.796332:0:8401:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340922.796341:0:8401:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c97dfa3/0xa24651432775734 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2654 expref: 7 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.796362:0:8401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c97dfa3/0xa24651432775734 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2654 expref: 7 pid: 8401 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340922.796378:0:8401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0470f2d600, rc 0) 00000100:00100000:2.0:1780340922.796516:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940483840:12345-192.168.203.16@tcp:101:bash.0 Request processed in 332us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340922.796523:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5936 00010000:00010000:1.0:1780340923.274961:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340924.300388:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340924.813208:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340924.813250:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961240192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340924.813464:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340924.815342:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961240192 00000100:00100000:0.0:1780340924.815359:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961240192 00000100:00100000:0.0:1780340924.815455:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152 00000100:00100000:0.0:1780340924.815466:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04467fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961240192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340924.815509:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340924.815585:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04467fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961240192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (2122us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340924.815593:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152 00000100:00100000:0.0:1780340924.815658:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961240192:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1780340924.815822:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340924.816058:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961240320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340924.816109:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340924.816356:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961240320 00000100:00100000:1.0:1780340924.816362:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961240320 00000100:00100000:1.0:1780340924.816422:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2153 00000100:00100000:1.0:1780340924.816430:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961240320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780340924.816457:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780340924.816520:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961240320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340924.816527:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2153 00000100:00080000:0.0:1780340924.816591:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340924.816720:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961240320:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1780340925.327364:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340925.331938:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961240448:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.332011:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340925.332051:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961240960:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.332082:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340925.332102:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961241472:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.332124:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340925.332141:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961241984:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.332160:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340925.332184:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1780340925.332201:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961240832:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.332223:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340925.332252:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961241344:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.332275:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340925.332291:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961241856:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.332310:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340925.332351:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961240576:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.332375:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340925.332392:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961241088:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.332414:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340925.332431:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961241600:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.332476:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340925.332494:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1780340925.332500:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961240704:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.332519:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340925.332528:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961241216:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.332546:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340925.332561:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961241728:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.332580:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340925.332612:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961240448 00000100:00100000:3.0:1780340925.332620:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961240448 00000100:00100000:3.0:1780340925.332667:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1780340925.332678:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961240448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.332730:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961240448:12345-0@lo:400:kworker.0 Request processed in 53us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340925.332738:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1780340925.332806:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961240960 00000100:00100000:3.0:1780340925.332810:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961240960 00000100:00100000:3.0:1780340925.332841:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961241472 00000100:00100000:3.0:1780340925.332844:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961241472 00000100:00100000:3.0:1780340925.332855:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961241984 00000100:00100000:3.0:1780340925.332856:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961241984 00000100:00100000:3.0:1780340925.332866:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961240832 00000100:00100000:3.0:1780340925.332868:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961240832 00000100:00100000:3.0:1780340925.332878:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:3.0:1780340925.332884:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961240960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.332914:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961240960:12345-0@lo:400:kworker.0 Request processed in 30us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340925.332931:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:3.0:1780340925.332943:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961240576 00000100:00100000:3.0:1780340925.332946:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961240576 00000100:00100000:3.0:1780340925.332961:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961240704 00000100:00100000:3.0:1780340925.332963:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961240704 00000100:00100000:3.0:1780340925.332975:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:3.0:1780340925.332981:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818961241472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333009:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818961241472:12345-0@lo:400:kworker.0 Request processed in 28us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340925.333014:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00100000:3.0:1780340925.333025:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:3.0:1780340925.333030:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961241984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333059:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961241984:12345-0@lo:400:kworker.0 Request processed in 29us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340925.333064:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00100000:3.0:1780340925.333075:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:3.0:1780340925.333081:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961240832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333107:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961240832:12345-0@lo:400:kworker.0 Request processed in 27us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340925.333113:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:3.0:1780340925.333123:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1780340925.333128:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961240576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333155:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961240576:12345-0@lo:400:kworker.0 Request processed in 28us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340925.333161:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1780340925.333180:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:3.0:1780340925.333200:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961240704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333230:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961240704:12345-0@lo:400:kworker.0 Request processed in 44us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340925.333235:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:3.0:1780340925.333267:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961241344 00000100:00100000:3.0:1780340925.333271:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961241344 00000100:00100000:3.0:1780340925.333294:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961241856 00000100:00100000:3.0:1780340925.333297:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961241856 00000100:00100000:3.0:1780340925.333318:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961241216 00000100:00100000:3.0:1780340925.333321:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961241216 00000100:00100000:3.0:1780340925.333336:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961241728 00000100:00100000:3.0:1780340925.333339:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961241728 00000100:00100000:3.0:1780340925.333357:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642 00000100:00100000:3.0:1780340925.333363:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961241344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333394:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961241344:12345-0@lo:400:kworker.0 Request processed in 32us (1119us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340925.333400:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642 00000100:00100000:3.0:1780340925.333411:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2643 00000100:00100000:3.0:1780340925.333416:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961241856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333454:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349084700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961241856:12345-0@lo:400:kworker.0 Request processed in 24us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340925.333460:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2643 00000100:00100000:3.0:1780340925.333470:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2644 00000100:00100000:3.0:1780340925.333475:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961241216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333500:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961241216:12345-0@lo:400:kworker.0 Request processed in 25us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340925.333515:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2644 00000100:00100000:3.0:1780340925.333527:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2645 00000100:00100000:3.0:1780340925.333532:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961241728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333562:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961241728:12345-0@lo:400:kworker.0 Request processed in 30us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340925.333567:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2645 00000100:00100000:3.0:1780340925.333593:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961241088 00000100:00100000:3.0:1780340925.333596:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961241088 00000100:00100000:3.0:1780340925.333627:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961241600 00000100:00100000:3.0:1780340925.333630:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961241600 00000100:00100000:3.0:1780340925.333645:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979 00000100:00100000:3.0:1780340925.333650:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961241088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333680:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961241088:12345-0@lo:400:kworker.0 Request processed in 29us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340925.333685:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979 00000100:00100000:3.0:1780340925.333696:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3980 00000100:00100000:3.0:1780340925.333701:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961241600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333726:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349086d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961241600:12345-0@lo:400:kworker.0 Request processed in 26us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340925.333731:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3980 00000100:00080000:3.0:1780340925.333793:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340925.333797:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340925.333800:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780340925.333802:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340925.333847:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961240704:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333858:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961241216:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333877:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961241728:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333887:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961240576:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333896:0:3659:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084290 gen 3 00000004:00080000:3.0:1780340925.333901:0:3659:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 120259084290 committed transno 120259084290 00000100:00100000:3.0:1780340925.333918:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961241088:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333929:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961241600:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333968:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961240832:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333980:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961241344:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333990:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961241856:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.333999:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961240448:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.334009:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961240960:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.334018:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961241472:0@lo:400:kworker.0 00000100:00100000:3.0:1780340925.334028:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961241984:0@lo:400:kworker.0 00000100:00100000:2.0:1780340925.338377:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961242112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340925.338448:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340925.338857:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961242112 00000100:00100000:1.0:1780340925.338865:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961242112 00000100:00100000:1.0:1780340925.338921:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3981 00000100:00100000:1.0:1780340925.338931:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961242112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780340925.338965:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:1.0:1780340925.339018:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349861880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961242112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340925.339026:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3981 00000100:00100000:2.0:1780340925.339832:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961242112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340925.834111:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780340925.834135:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961242240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340925.834211:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340925.834581:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961242240 00000100:00100000:3.0:1780340925.834590:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961242240 00000100:00100000:3.0:1780340925.834640:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2154 00000100:00100000:3.0:1780340925.834650:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961242240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340925.834671:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340925.834724:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349863100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961242240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340925.834731:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2154 00000100:00100000:2.0:1780340925.834852:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961242240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340925.835209:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961242368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340925.835268:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340925.835548:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961242368 00000100:00100000:2.0:1780340925.835553:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961242368 00000100:00100000:2.0:1780340925.835583:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155 00000100:00100000:2.0:1780340925.835598:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0445597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961242368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780340925.835612:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780340925.835842:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961242496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340925.838726:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0445597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961242368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3120us (3449us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340925.838739:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155 00000100:00100000:0.0:1780340925.841520:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349862d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961242368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340925.841791:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340925.842452:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961242496 00000100:00100000:2.0:1780340925.842460:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961242496 00000100:00100000:2.0:1780340925.842516:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982 00000100:00100000:2.0:1780340925.842525:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961242496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780340925.842561:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445179392 avail 1298939904 00000100:00100000:2.0:1780340925.843407:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961242496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 880us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340925.843431:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982 00000100:00100000:3.0:1780340925.847076:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961242496:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1780340926.349142:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340927.039567:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340927.039615:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340927.039634:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340927.039666:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340927.039686:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340927.039715:0:25497:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940484480 00000100:00100000:0.0:1780340927.039723:0:25497:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940484480 00000100:00100000:0.0:1780340927.039799:0:25497:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940484352 00000100:00100000:0.0:1780340927.039802:0:25497:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940484352 00000100:00100000:0.0:1780340927.039822:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2646 00000100:00100000:0.0:1780340927.039830:0:25497:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2409:x1866818940484480:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340927.040502:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940483968 00000100:00100000:3.0:1780340927.040508:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940483968 00000100:00100000:3.0:1780340927.040555:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 79 00000100:00100000:3.0:1780340927.040565:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2409:x1866818940483968:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340927.040571:0:25497:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2409:x1866818940484480:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 738us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340927.040582:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2646 00000100:00100000:3.0:1780340927.040606:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2409:x1866818940483968:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 41us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340927.040606:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2647 00000100:00100000:3.0:1780340927.040618:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 79 00000100:00100000:0.0:1780340927.040620:0:25497:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2409:x1866818940484352:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340927.040654:0:25497:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2409:x1866818940484352:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 39us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340927.040658:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940484224 00000100:00100000:0.0:1780340927.040663:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2647 00000100:00100000:3.0:1780340927.040664:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940484224 00000100:00100000:3.0:1780340927.040699:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940484096 00000100:00100000:3.0:1780340927.040702:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940484096 00000100:00100000:3.0:1780340927.040730:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1455 00000100:00100000:3.0:1780340927.040739:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2409:x1866818940484224:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340927.040798:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2409:x1866818940484224:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 61us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340927.040804:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1455 00000100:00100000:3.0:1780340927.040817:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1456 00000100:00100000:3.0:1780340927.040823:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2409:x1866818940484096:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340927.040850:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2409:x1866818940484096:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 29us (1184us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340927.040856:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1456 00000100:00080000:3.0:1780340927.040875:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780340927.040888:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780340927.040890:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340927.040892:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1780340927.370687:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340928.407555:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340929.418397:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340929.930928:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340929.930949:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961242624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340929.931011:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340929.931234:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961242624 00000100:00100000:3.0:1780340929.931242:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961242624 00000100:00100000:3.0:1780340929.931302:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2156 00000100:00100000:3.0:1780340929.931312:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961242624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340929.931342:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340929.931389:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b880380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961242624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340929.931396:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2156 00000100:00100000:3.0:1780340929.931447:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961242624:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1780340929.931672:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340929.931704:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340929.931713:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961242752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340929.931740:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340929.931871:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961242752 00000100:00100000:1.0:1780340929.931877:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961242752 00000100:00100000:1.0:1780340929.931918:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2157 00000100:00100000:1.0:1780340929.931925:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961242752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780340929.931944:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780340929.931982:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961242752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340929.931996:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2157 00000100:00080000:0.0:1780340929.932046:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340929.932107:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961242752:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1780340930.442042:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961242880:0@lo:400:kworker.0 00000100:00100000:2.0:1780340930.442121:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340930.445261:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961243008:0@lo:400:kworker.0 00000100:00100000:1.0:1780340930.445332:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1780340930.446035:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340930.446163:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780340930.446175:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961243136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340930.446217:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340930.446252:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961243136 00000100:00100000:1.0:1780340930.446259:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961243136 00000100:00100000:1.0:1780340930.446306:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3983 00000100:00100000:1.0:1780340930.446315:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961243136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780340930.446349:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:1.0:1780340930.446392:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961243136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340930.446399:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3983 00000100:00100000:1.0:1780340930.446458:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961243136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340930.446958:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961243008 00000100:00100000:2.0:1780340930.446964:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961243008 00000100:00100000:2.0:1780340930.447029:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:2.0:1780340930.447038:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818961243008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340930.447086:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818961243008:12345-0@lo:400:kworker.0 Request processed in 50us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340930.447092:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:2.0:1780340930.447126:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961242880 00000100:00100000:2.0:1780340930.447131:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961242880 00000100:00100000:2.0:1780340930.447178:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1780340930.447185:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961242880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340930.447218:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961242880:12345-0@lo:400:kworker.0 Request processed in 34us (5098us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340930.447224:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1780340930.447262:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446f22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961242880:0@lo:400:kworker.0 00000100:00080000:1.0:1780340930.447913:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340930.447943:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961243008:0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.449842:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340930.449859:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961243264:0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.449921:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340930.449962:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961243264 00000100:00100000:3.0:1780340930.449969:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961243264 00000100:00100000:3.0:1780340930.450032:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00100000:3.0:1780340930.450041:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961243264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.450091:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961243264:12345-0@lo:400:kworker.0 Request processed in 51us (171us total) trans 0 rc 0/0 00000100:00080000:1.0:1780340930.450306:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340930.450339:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00100000:3.0:1780340930.450381:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961243264:0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.450461:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961243648:0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.450489:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340930.450648:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961243520:0@lo:400:kworker.0 00000100:00100000:1.0:1780340930.450678:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340930.450698:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340930.450704:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961243392:0@lo:400:kworker.0 00000100:00100000:1.0:1780340930.450726:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340930.450750:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961243520 00000100:00100000:1.0:1780340930.450754:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961243520 00000100:00100000:1.0:1780340930.450813:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961243392 00000100:00100000:1.0:1780340930.450817:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961243392 00000100:00100000:1.0:1780340930.450835:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:1.0:1780340930.450841:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961243520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340930.450876:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961243520:12345-0@lo:400:kworker.0 Request processed in 35us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340930.450883:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00100000:1.0:1780340930.450894:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:1.0:1780340930.450899:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961243392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340930.450923:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961243392:12345-0@lo:400:kworker.0 Request processed in 24us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340930.450929:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00080000:1.0:1780340930.450959:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780340930.450962:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340930.450981:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961243392:0@lo:400:kworker.0 00000100:00100000:1.0:1780340930.450990:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961243520:0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.451195:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961243648 00000100:00100000:3.0:1780340930.451200:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961243648 00000100:00100000:3.0:1780340930.451228:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3984 00000100:00100000:3.0:1780340930.451234:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961243648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.451269:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961243648:12345-0@lo:400:kworker.0 Request processed in 35us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340930.451275:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3984 00000100:00100000:3.0:1780340930.451299:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961243648:0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.451327:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340930.451332:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961243776:0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.451354:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340930.451377:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961243776 00000100:00100000:3.0:1780340930.451379:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961243776 00000100:00100000:3.0:1780340930.451402:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2648 00000100:00100000:3.0:1780340930.451409:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961243776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.451709:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961243776:12345-0@lo:400:kworker.0 Request processed in 300us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340930.451716:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2648 00000100:00100000:1.0:1780340930.451783:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961243904:0@lo:400:kworker.0 00000100:00100000:1.0:1780340930.451808:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340930.451881:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961243776:0@lo:400:kworker.0 00000100:00100000:2.0:1780340930.451986:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961244032:0@lo:400:kworker.0 00000100:00100000:2.0:1780340930.452025:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340930.452056:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961244032 00000100:00100000:2.0:1780340930.452060:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961244032 00000100:00100000:2.0:1780340930.452086:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:2.0:1780340930.452092:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818961244032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340930.452139:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349860a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818961244032:12345-0@lo:400:kworker.0 Request processed in 47us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340930.452144:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:2.0:1780340930.452185:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961244032:0@lo:400:kworker.0 00000100:00100000:2.0:1780340930.455825:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961243904 00000100:00100000:2.0:1780340930.455837:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961243904 00000100:00100000:2.0:1780340930.455894:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2649 00000100:00100000:2.0:1780340930.455903:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961243904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.458037:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961244160:0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.458097:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340930.458162:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961244160 00000100:00100000:3.0:1780340930.458169:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961244160 00000100:00100000:3.0:1780340930.458217:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650 00000100:00100000:3.0:1780340930.458225:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961244160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.458283:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961244160:12345-0@lo:400:kworker.0 Request processed in 59us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340930.458291:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650 00000100:00100000:3.0:1780340930.458334:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961244160:0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.458366:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340930.458371:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961244288:0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.458395:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340930.458418:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961244288 00000100:00100000:3.0:1780340930.458422:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961244288 00000100:00100000:3.0:1780340930.458632:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651 00000100:00100000:3.0:1780340930.458639:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961244288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.458674:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961244288:12345-0@lo:400:kworker.0 Request processed in 36us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340930.458680:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651 00000100:00100000:3.0:1780340930.458708:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961244288:0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.458739:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340930.458746:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961244416:0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.458801:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340930.458973:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961244416 00000100:00100000:1.0:1780340930.458978:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961244416 00000100:00100000:1.0:1780340930.459018:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:1.0:1780340930.459026:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961244416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340930.459068:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961244416:12345-0@lo:400:kworker.0 Request processed in 44us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340930.459075:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00080000:1.0:1780340930.459095:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340930.459107:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340930.459128:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961244416:0@lo:400:kworker.0 00000100:00100000:2.0:1780340930.462018:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961243904:12345-0@lo:400:kworker.0 Request processed in 6096us (10187us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340930.462032:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2649 00000100:00100000:1.0:1780340930.467307:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961243904:0@lo:400:kworker.0 00000100:00100000:3.0:1780340930.956503:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961244544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340930.956568:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340930.956618:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961244672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340930.956645:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340930.956692:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961244544 00000100:00100000:3.0:1780340930.956699:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961244544 00000100:00100000:3.0:1780340930.956751:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2158 00000100:00100000:3.0:1780340930.956786:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961244544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340930.956807:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340930.956849:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961244544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340930.956856:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2158 00000100:00100000:3.0:1780340930.956879:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961244672 00000100:00100000:3.0:1780340930.956882:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961244672 00000100:00100000:3.0:1780340930.956911:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3985 00000100:00100000:3.0:1780340930.956916:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961244672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340930.956940:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445179392 avail 1298939904 00000100:00100000:3.0:1780340930.956975:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961244672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340930.956981:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3985 00000100:00100000:3.0:1780340930.957046:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961244672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340930.957073:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961244544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340930.957952:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961244800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1780340930.957992:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340930.958077:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961244800 00000100:00100000:1.0:1780340930.958082:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961244800 00000100:00100000:1.0:1780340930.958120:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159 00000100:00100000:1.0:1780340930.958129:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961244800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780340930.958153:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780340930.958199:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961244800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340930.958206:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159 00000100:00100000:2.0:1780340930.958267:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961244800:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1780340931.469434:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340932.138182:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340932.138221:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340932.138251:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340932.138269:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340932.138290:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340932.138315:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940484992 00000100:00100000:3.0:1780340932.138323:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940484992 00000100:00100000:3.0:1780340932.138375:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940485120 00000100:00100000:3.0:1780340932.138391:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940485120 00000100:00100000:3.0:1780340932.138416:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2652 00000100:00100000:3.0:1780340932.138426:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940484992:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340932.138490:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940484992:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 65us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340932.138498:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2652 00000100:00100000:3.0:1780340932.138513:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2653 00000100:00100000:3.0:1780340932.138519:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940485120:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340932.138538:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940485120:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 20us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340932.138544:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2653 00000100:00100000:3.0:1780340932.138559:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940484608 00000100:00100000:3.0:1780340932.138562:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940484608 00000100:00100000:3.0:1780340932.138585:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 81 00000100:00100000:3.0:1780340932.138591:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940484608:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340932.138612:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940484608:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 22us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340932.138618:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 81 00000100:00100000:3.0:1780340932.138653:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940484736 00000100:00100000:3.0:1780340932.138656:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940484736 00000100:00100000:3.0:1780340932.138686:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940484864 00000100:00100000:3.0:1780340932.138688:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940484864 00000100:00100000:3.0:1780340932.138706:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1463 00000100:00100000:3.0:1780340932.138712:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2407:x1866818940484736:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340932.138734:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2407:x1866818940484736:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 22us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340932.138745:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1463 00000100:00100000:3.0:1780340932.138755:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1464 00000100:00100000:3.0:1780340932.138793:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2407:x1866818940484864:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340932.138817:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2407:x1866818940484864:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 25us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340932.138823:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1464 00000100:00080000:3.0:1780340932.138841:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780340932.138845:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780340932.138847:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340932.138849:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1780340932.351633:0:91372:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffcd19e5190 20000000:00000080:0.0:1780340932.351649:0:91372:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8c0448375800 uarg=0000000000000000 00000040:00100000:0.0:1780340932.353506:0:91372:0:(llog.c:1067:llog_reverse_process()) index 57 : idx 49 20000000:01000000:0.0:1780340932.353516:0:91372:0:(mgs_llog.c:959:mgs_search_pool_cb()) Matched pool rec 56 cmd:0xce021 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:0.0:1780340932.353533:0:91372:0:(mgs_llog.c:1105:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1780340932.358584:0:91373:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 55 marker 46 1->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:0.0:1780340932.358661:0:91373:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 57 marker 46 2->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1780340932.358675:0:91373:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000040:00080000:3.0:1780340932.359035:0:91372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].58, 224 off18320 20000000:01000000:3.0:1780340932.359048:0:91372:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-clilov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1780340932.359065:0:91372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].59, 136 off18456 00000040:00080000:3.0:1780340932.359081:0:91372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].60, 224 off18680 20000000:01000000:3.0:1780340932.359095:0:91372:0:(mgs_llog.c:1105:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1780340932.359548:0:91374:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 50 marker 47 1->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:0.0:1780340932.359590:0:91374:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 52 marker 47 2->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1780340932.359603:0:91374:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000040:00080000:3.0:1780340932.359839:0:91372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].53, 224 off17424 20000000:01000000:3.0:1780340932.359848:0:91372:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1780340932.359863:0:91372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].54, 144 off17568 00000040:00080000:3.0:1780340932.359878:0:91372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].55, 224 off17792 20000000:01000000:3.0:1780340932.359890:0:91372:0:(mgs_llog.c:1105:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1780340932.361373:0:91375:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 50 marker 48 1->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:1.0:1780340932.361434:0:91375:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 52 marker 48 2->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1780340932.361446:0:91375:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000040:00080000:3.0:1780340932.361847:0:91372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].53, 224 off17424 20000000:01000000:3.0:1780340932.361859:0:91372:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1780340932.361873:0:91372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].54, 144 off17568 00000040:00080000:3.0:1780340932.361889:0:91372:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].55, 224 off17792 10000000:01000000:3.0:1780340932.361900:0:91372:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1780340932.361917:0:91372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c03476f8600/0xa2465143277573b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.361952:0:91372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0475fa4c00/0xa24651432775280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775279 expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.361959:0:91372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0475fa5400/0xa24651432775360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775359 expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.361965:0:91372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c04754c6800/0xa24651432775391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277538a expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.361970:0:91372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0475fa5800/0xa246514327753ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327753a6 expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.361976:0:91372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c04754c6a00/0xa246514327753d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327753d0 expref: 22 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.361984:0:91372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0475fa5a00/0xa246514327753e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327753de expref: 22 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.361990:0:91372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c047a8b2400/0xa24651432775401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327753fa expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.361995:0:91372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0453122200/0xa2465143277540f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775408 expref: 22 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.362002:0:91372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c04754c7600/0xa24651432775439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775432 expref: 22 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.362010:0:91372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c04754c6000/0xa2465143277544e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2600 expref: 8 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.362027:0:91372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0453123600/0xa2465143277545c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced260e expref: 8 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.362035:0:91372:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c03476f8600/0xa2465143277573b lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.362073:0:91372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0453123600/0xa2465143277545c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced260e expref: 8 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.362088:0:91372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0453123600/0xa2465143277545c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced260e expref: 8 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340932.362102:0:91372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961244928:192.168.203.16@tcp:104: 00010000:00010000:2.0:1780340932.370162:0:91372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c04754c6000/0xa2465143277544e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2600 expref: 8 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.370616:0:91372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c04754c6000/0xa2465143277544e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2600 expref: 8 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.370637:0:91372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349863b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961245056:192.168.203.16@tcp:104: 00010000:00010000:2.0:1780340932.370940:0:91372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c04754c7600/0xa24651432775439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432775432 expref: 22 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.370950:0:91372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c04754c7600/0xa24651432775439 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432775432 expref: 22 pid: 90568 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.370960:0:91372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961245184:0@lo:104: 00000100:00100000:2.0:1780340932.370995:0:91372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1780340932.371030:0:91372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0453122200/0xa2465143277540f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432775408 expref: 22 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.371038:0:91372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0453122200/0xa2465143277540f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432775408 expref: 22 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.371046:0:91372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349860000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961245312:0@lo:104: 00000100:00100000:2.0:1780340932.371062:0:91372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1780340932.371143:0:91372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c047a8b2400/0xa24651432775401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa246514327753fa expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.371151:0:91372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c047a8b2400/0xa24651432775401 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa246514327753fa expref: 22 pid: 90573 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.371159:0:91372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349861500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961245440:0@lo:104: 00000100:00100000:2.0:1780340932.371189:0:91372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340932.373924:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340932.373957:0:7443:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940485248 00000100:00100000:3.0:1780340932.373964:0:7443:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940485248 00010000:00010000:3.0:1780340932.373996:0:7443:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0453123600/0xa2465143277545c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced260e expref: 9 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340932.374034:0:7443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2581 00000100:00100000:3.0:1780340932.374044:0:7443:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04757c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940485248:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780340932.374057:0:7443:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340932.374062:0:7443:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0453123600/0xa2465143277545c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced260e expref: 9 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.374073:0:7443:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0453123600/0xa2465143277545c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced260e expref: 9 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.374106:0:7443:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340932.374159:0:7443:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04757c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940485248:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 116us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340932.374166:0:7443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2581 00010000:00010000:2.0:1780340932.376159:0:91372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0475fa5a00/0xa246514327753e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa246514327753de expref: 22 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.376175:0:91372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0475fa5a00/0xa246514327753e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa246514327753de expref: 22 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.376203:0:91372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349860700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961245568:0@lo:104: 00000100:00100000:2.0:1780340932.376248:0:91372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340932.376471:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961245184 00000100:00100000:0.0:1780340932.376479:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961245184 00000100:00100000:0.0:1780340932.376514:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961245312 00000100:00100000:0.0:1780340932.376517:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961245312 00000100:00100000:0.0:1780340932.376525:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961245440 00000100:00100000:0.0:1780340932.376527:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961245440 00000100:00100000:0.0:1780340932.376539:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1780340932.376546:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349863800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+5:91372:x1866818961245184:12345-0@lo:104: 00010000:00010000:0.0:1780340932.376700:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa24651432775432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775439 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.376753:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1780340932.376778:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349863800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+5:91372:x1866818961245184:12345-0@lo:104: Request processed in 214us (5764us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340932.376808:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1780340932.376819:0:6499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349860e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+5:91372:x1866818961245312:12345-0@lo:104: 00010000:00010000:1.0:1780340932.376825:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3e00/0xa24651432775408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2465143277540f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340932.376861:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1780340932.376865:0:6499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349860e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+5:91372:x1866818961245312:12345-0@lo:104: Request processed in 51us (5803us total) trans 0 rc 0/0 00010000:00010000:2.0:1780340932.376925:0:91372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c04754c6a00/0xa246514327753d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa246514327753d0 expref: 22 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.376933:0:91372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c04754c6a00/0xa246514327753d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa246514327753d0 expref: 22 pid: 90568 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.376943:0:91372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349862d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961245696:0@lo:104: 00000100:00100000:2.0:1780340932.376964:0:91372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1780340932.376981:0:91372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0475fa5800/0xa246514327753ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa246514327753a6 expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.376988:0:91372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0475fa5800/0xa246514327753ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa246514327753a6 expref: 22 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.376996:0:91372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047aa69c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961245824:0@lo:104: 00000100:00100000:2.0:1780340932.377029:0:91372:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1780340932.377047:0:91372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c04754c6800/0xa24651432775391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2465143277538a expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.377055:0:91372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c04754c6800/0xa24651432775391 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2465143277538a expref: 22 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.377082:0:91372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047aa69180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961245952:0@lo:104: 00010000:00010000:2.0:1780340932.377106:0:91372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0475fa5400/0xa24651432775360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432775359 expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.377114:0:91372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0475fa5400/0xa24651432775360 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432775359 expref: 22 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.377122:0:91372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047aa69f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961246080:0@lo:104: 00010000:00010000:2.0:1780340932.377163:0:91372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0475fa4c00/0xa24651432775280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432775279 expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.377171:0:91372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0475fa4c00/0xa24651432775280 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432775279 expref: 22 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.377193:0:91372:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047aa68380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961246208:0@lo:104: 00000100:00100000:2.0:1780340932.377212:0:91372:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034abfe780 going to sleep for 11 seconds 00010000:00010000:2.0:1780340932.377234:0:91372:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453123600/0xa2465143277545c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced260e expref: 8 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.377247:0:91372:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961244928:192.168.203.16@tcp:104: 00000100:00100000:2.0:1780340932.377259:0:91372:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961245184:0@lo:104: 00000100:00100000:2.0:1780340932.377266:0:91372:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349860000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961245312:0@lo:104: 00000100:00100000:3.0:1780340932.377580:0:9471:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961245568 00000100:00100000:3.0:1780340932.377585:0:9471:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961245568 00000100:00100000:0.0:1780340932.377742:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1780340932.377794:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1780340932.377819:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340932.377833:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340932.377843:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340932.377849:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961245696 00000100:00100000:0.0:1780340932.377852:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961245696 00000100:00100000:0.0:1780340932.377867:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961245824 00000100:00100000:0.0:1780340932.377869:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961245824 00000100:00100000:0.0:1780340932.377879:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961245952 00000100:00100000:0.0:1780340932.377882:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961245952 00000100:00100000:0.0:1780340932.377891:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961246080 00000100:00100000:0.0:1780340932.377894:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961246080 00000100:00100000:0.0:1780340932.377902:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961246208 00000100:00100000:0.0:1780340932.377905:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961246208 00000100:00100000:0.0:1780340932.377916:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1780340932.377922:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349862680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:91372:x1866818961245440:12345-0@lo:104: 00010000:00010000:0.0:1780340932.377931:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0453122600/0xa246514327753fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775401 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.377979:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1780340932.377984:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349862680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+10:91372:x1866818961245440:12345-0@lo:104: Request processed in 63us (6795us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340932.377990:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1780340932.378003:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1780340932.378009:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+9:91372:x1866818961245696:12345-0@lo:104: 00000100:00100000:1.0:1780340932.378114:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1780340932.378129:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1780340932.378146:0:6499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0470f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:91372:x1866818961245824:12345-0@lo:104: 00010000:00010000:1.0:1780340932.378154:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5200/0xa246514327753a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa246514327753ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.378353:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa246514327753d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa246514327753d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.378389:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1780340932.378395:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+8:91372:x1866818961245696:12345-0@lo:104: Request processed in 387us (1429us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340932.378409:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1780340932.378423:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1780340932.378429:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:91372:x1866818961245952:12345-0@lo:104: 00010000:00010000:0.0:1780340932.378436:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5c00/0xa2465143277538a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775391 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.378468:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1780340932.378472:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+7:91372:x1866818961245952:12345-0@lo:104: Request processed in 45us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340932.378478:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1780340932.378490:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1780340932.378496:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:91372:x1866818961246080:12345-0@lo:104: 00010000:00010000:0.0:1780340932.378502:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0453123c00/0xa24651432775359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775360 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.378525:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1780340932.378530:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+6:91372:x1866818961246080:12345-0@lo:104: Request processed in 36us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340932.378535:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1780340932.378546:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1780340932.378550:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+5:91372:x1866818961246208:12345-0@lo:104: 00010000:00010000:0.0:1780340932.378570:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa24651432775279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775280 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.378594:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1780340932.378598:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+5:91372:x1866818961246208:12345-0@lo:104: Request processed in 48us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340932.378609:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00010000:00010000:0.0:1780340932.378755:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1780340932.378780:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa24651432775432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775439 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.378788:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b2c00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:0.0:1780340932.378792:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa24651432775432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432775439 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.378800:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa24651432775432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432775439 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340932.378807:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa24651432775432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432775439 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340932.378813:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340932.378842:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa24651432775432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775439 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.378849:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780340932.378868:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa24651432775432 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775439 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.378874:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2c00/0xa24651432775432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775439 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.378886:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1780340932.378889:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3e00/0xa24651432775408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2465143277540f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.378904:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b3e00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:0.0:1780340932.378907:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3e00/0xa24651432775408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2465143277540f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.378913:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3e00/0xa24651432775408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2465143277540f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340932.378919:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3e00/0xa24651432775408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2465143277540f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340932.378924:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340932.378936:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3e00/0xa24651432775408 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2465143277540f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.378941:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780340932.378947:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3e00/0xa24651432775408 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2465143277540f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.378953:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3e00/0xa24651432775408 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2465143277540f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.378962:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1780340932.378965:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0453122600/0xa246514327753fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775401 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.378970:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122600 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:0.0:1780340932.378973:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0453122600/0xa246514327753fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432775401 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.378990:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0453122600/0xa246514327753fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432775401 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340932.378995:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0453122600/0xa246514327753fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432775401 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340932.379000:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340932.379080:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0453122600/0xa246514327753fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775401 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379086:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780340932.379103:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0453122600/0xa246514327753fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775401 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379109:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0453122600/0xa246514327753fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775401 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379118:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1780340932.379121:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa246514327753d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa246514327753d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379126:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5000 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:0.0:1780340932.379129:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa246514327753d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa246514327753d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379146:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa246514327753d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa246514327753d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340932.379151:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa246514327753d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa246514327753d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340932.379163:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340932.379176:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa246514327753d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327753d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379323:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780340932.379330:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa246514327753d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327753d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379336:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa246514327753d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327753d7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379347:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1780340932.379350:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5c00/0xa2465143277538a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775391 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379355:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5c00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:0.0:1780340932.379358:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5c00/0xa2465143277538a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432775391 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379363:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5c00/0xa2465143277538a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432775391 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340932.379369:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5c00/0xa2465143277538a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432775391 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340932.379374:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340932.379388:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5c00/0xa2465143277538a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775391 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379393:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780340932.379404:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5c00/0xa2465143277538a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775391 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379410:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5c00/0xa2465143277538a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775391 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379419:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1780340932.379422:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0453123c00/0xa24651432775359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775360 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379428:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123c00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:0.0:1780340932.379431:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0453123c00/0xa24651432775359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432775360 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379437:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0453123c00/0xa24651432775359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432775360 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340932.379444:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0453123c00/0xa24651432775359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432775360 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340932.379449:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340932.379461:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0453123c00/0xa24651432775359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775360 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379466:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780340932.379471:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0453123c00/0xa24651432775359 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775360 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379477:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0453123c00/0xa24651432775359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775360 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379485:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1780340932.379492:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa24651432775279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775280 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379498:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6400 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:0.0:1780340932.379501:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa24651432775279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432775280 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379507:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa24651432775279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432775280 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1780340932.379512:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa24651432775279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432775280 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340932.379517:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1780340932.379529:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa24651432775279 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775280 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379534:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1780340932.379539:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa24651432775279 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775280 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.379545:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04754c6400/0xa24651432775279 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775280 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.379707:0:91372:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349861500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961245440:0@lo:104: 00000100:00100000:2.0:1780340932.379717:0:91372:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349862d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961245696:0@lo:104: 00000100:00100000:2.0:1780340932.379724:0:91372:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047aa69180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961245952:0@lo:104: 00000100:00100000:2.0:1780340932.379740:0:91372:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047aa69f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961246080:0@lo:104: 00000100:00100000:2.0:1780340932.379747:0:91372:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047aa68380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961246208:0@lo:104: 00000100:00100000:2.0:1780340932.379809:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961246336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340932.379852:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340932.379884:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961246848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340932.379902:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340932.379921:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1780340932.379926:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961246464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340932.379942:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340932.379958:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961246976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340932.379977:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1780340932.380002:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340932.380007:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340932.380011:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340932.380164:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340932.380166:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340932.380168:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340932.380342:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961246336 00000100:00100000:2.0:1780340932.380349:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961246336 00010000:00010000:2.0:1780340932.380372:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c04754c7600/0xa24651432775439 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432775432 expref: 23 pid: 90568 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.380396:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961246848 00000100:00100000:2.0:1780340932.380398:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961246848 00010000:00010000:2.0:1780340932.380409:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c04754c6800/0xa24651432775391 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2465143277538a expref: 24 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.380423:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961246464 00000100:00100000:2.0:1780340932.380426:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961246464 00010000:00010000:2.0:1780340932.380434:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0453122200/0xa2465143277540f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432775408 expref: 25 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.380455:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961246976 00000100:00100000:2.0:1780340932.380457:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961246976 00010000:00010000:2.0:1780340932.380467:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0475fa5400/0xa24651432775360 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432775359 expref: 26 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.380479:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:2.0:1780340932.380486:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+26:3661:x1866818961246336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340932.380500:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340932.380504:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c04754c7600/0xa24651432775439 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432775432 expref: 26 pid: 90568 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.380511:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c04754c7600/0xa24651432775439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432775432 expref: 26 pid: 90568 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.380523:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04754c7600/0xa24651432775439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432775432 expref: 26 pid: 90568 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.380535:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340932.380578:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+25:3661:x1866818961246336:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340932.380585:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:2.0:1780340932.380600:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:2.0:1780340932.380606:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+24:3661:x1866818961246848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340932.380612:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340932.380616:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c04754c6800/0xa24651432775391 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2465143277538a expref: 24 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.380623:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c04754c6800/0xa24651432775391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2465143277538a expref: 24 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.380637:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04754c6800/0xa24651432775391 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2465143277538a expref: 24 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340932.380751:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961246592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780340932.380797:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340932.380814:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961247104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780340932.380842:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340932.380854:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1780340932.380859:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961246720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780340932.380878:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340932.380915:0:19125:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961246592 00000100:00100000:0.0:1780340932.380919:0:19125:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961246592 00010000:00010000:0.0:1780340932.380934:0:19125:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c047a8b2400/0xa24651432775401 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa246514327753fa expref: 25 pid: 90573 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.381444:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340932.381472:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+24:3661:x1866818961246848:12345-0@lo:103:ldlm_bl.0 Request processed in 867us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340932.381479:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:2.0:1780340932.381492:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961247104 00000100:00100000:2.0:1780340932.381496:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961247104 00010000:00010000:2.0:1780340932.381506:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0475fa4c00/0xa24651432775280 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432775279 expref: 24 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.381517:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961246720 00000100:00100000:2.0:1780340932.381519:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961246720 00010000:00010000:2.0:1780340932.381528:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c04754c6a00/0xa246514327753d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa246514327753d0 expref: 25 pid: 90568 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.381537:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:2.0:1780340932.381542:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+25:3661:x1866818961246464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340932.381549:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340932.381565:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0453122200/0xa2465143277540f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432775408 expref: 25 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.381572:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0453122200/0xa2465143277540f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432775408 expref: 25 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.381583:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453122200/0xa2465143277540f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432775408 expref: 25 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.381603:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340932.381625:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+24:3661:x1866818961246464:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340932.381631:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00000100:00100000:2.0:1780340932.381775:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2585 00000100:00100000:2.0:1780340932.381783:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961246976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340932.381789:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340932.381794:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0475fa5400/0xa24651432775360 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432775359 expref: 23 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.381802:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0475fa5400/0xa24651432775360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432775359 expref: 23 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.381811:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5400/0xa24651432775360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432775359 expref: 23 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.381821:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340932.381843:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3661:x1866818961246976:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340932.381849:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2585 00000100:00100000:2.0:1780340932.381860:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2586 00000100:00100000:2.0:1780340932.381864:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349955180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:3659:x1866818961247104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340932.381871:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340932.381874:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0475fa4c00/0xa24651432775280 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432775279 expref: 21 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.381880:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0475fa4c00/0xa24651432775280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432775279 expref: 21 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.381894:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa4c00/0xa24651432775280 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432775279 expref: 21 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.381902:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340932.381930:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349955180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3659:x1866818961247104:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340932.381936:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2586 00000100:00100000:2.0:1780340932.381947:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:2.0:1780340932.381952:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04757c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:3659:x1866818961246720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340932.381960:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340932.381963:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c04754c6a00/0xa246514327753d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa246514327753d0 expref: 19 pid: 90568 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.381970:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c04754c6a00/0xa246514327753d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa246514327753d0 expref: 19 pid: 90568 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.381979:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04754c6a00/0xa246514327753d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa246514327753d0 expref: 19 pid: 90568 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.381987:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340932.382006:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04757c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:3659:x1866818961246720:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340932.382012:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00010000:00010000:1.0:1780340932.382793:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1780340932.382800:0:6499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0470f4c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:91372:x1866818961245824:12345-0@lo:104: Request processed in 4665us (5770us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340932.382808:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00010000:00010000:1.0:1780340932.382838:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340932.382844:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5200/0xa246514327753a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa246514327753ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340932.382851:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5200 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340932.382855:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5200/0xa246514327753a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa246514327753ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340932.382863:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5200/0xa246514327753a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa246514327753ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340932.382869:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5200/0xa246514327753a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa246514327753ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340932.382875:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340932.382906:0:6504:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5200/0xa246514327753a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327753ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340932.382913:0:6504:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340932.382927:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5200/0xa246514327753a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327753ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340932.382934:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5200/0xa246514327753a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327753ad expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340932.382959:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340932.382961:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340932.382962:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340932.382972:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340932.382984:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961247232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340932.383016:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340932.383069:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961247232 00000100:00100000:1.0:1780340932.383074:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961247232 00010000:00010000:1.0:1780340932.383091:0:25498:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0475fa5800/0xa246514327753ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa246514327753a6 expref: 19 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340932.383193:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961246464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340932.383204:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961246976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340932.383211:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961246336:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340932.383226:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961246848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340932.383366:0:91372:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047aa69c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961245824:0@lo:104: 00000100:00100000:2.0:1780340932.384341:0:91372:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349863b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961245056:192.168.203.16@tcp:104: 00000100:00100000:3.0:1780340932.384426:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1780340932.384439:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349863480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:91372:x1866818961245568:12345-0@lo:104: 00010000:00010000:3.0:1780340932.384450:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa246514327753de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa246514327753e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.384509:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1780340932.384514:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349863480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:91372:x1866818961245568:12345-0@lo:104: Request processed in 80us (8266us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340932.384520:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1780340932.384897:0:91372:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349860700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91372:1866818961245568:0@lo:104: 00010000:00010000:2.0:1780340932.384941:0:91372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c03476f8600/0xa2465143277573b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.385120:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340932.385125:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa246514327753de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa246514327753e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.385141:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7400 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340932.385145:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa246514327753de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa246514327753e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.385152:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa246514327753de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa246514327753e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340932.385158:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa246514327753de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa246514327753e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340932.385176:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1780340932.385346:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340932.385370:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940485376 00000100:00100000:2.0:1780340932.385376:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940485376 00010000:00010000:2.0:1780340932.385396:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c04754c6000/0xa2465143277544e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2600 expref: 8 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.385449:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa246514327753de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327753e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.385456:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340932.385476:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa246514327753de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327753e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.385482:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c04754c7400/0xa246514327753de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327753e5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340932.385496:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340932.385498:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340932.385499:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340932.385511:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961247360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340932.385544:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340932.385591:0:25499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961247360 00000100:00100000:3.0:1780340932.385595:0:25499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961247360 00010000:00010000:3.0:1780340932.385607:0:25499:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0475fa5a00/0xa246514327753e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa246514327753de expref: 19 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340932.386366:0:19125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00000100:00100000:0.0:1780340932.386379:0:19125:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349956d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:3659:x1866818961246592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780340932.386391:0:19125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340932.386397:0:19125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c047a8b2400/0xa24651432775401 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa246514327753fa expref: 19 pid: 90573 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.386407:0:19125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c047a8b2400/0xa24651432775401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa246514327753fa expref: 19 pid: 90573 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.386421:0:19125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c047a8b2400/0xa24651432775401 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa246514327753fa expref: 19 pid: 90573 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.386432:0:19125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340932.386469:0:19125:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349956d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:3659:x1866818961246592:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (5671us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340932.386476:0:19125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00000100:00100000:0.0:1780340932.386536:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961246720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780340932.386546:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961246592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1780340932.386565:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961247104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340932.386946:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:1.0:1780340932.386958:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:3660:x1866818961247232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340932.386967:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340932.386971:0:25498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0475fa5800/0xa246514327753ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa246514327753a6 expref: 17 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340932.386980:0:25498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0475fa5800/0xa246514327753ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa246514327753a6 expref: 17 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340932.386989:0:25498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5800/0xa246514327753ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa246514327753a6 expref: 17 pid: 90570 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340932.386998:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340932.387041:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:3660:x1866818961247232:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (4025us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340932.387047:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000100:00100000:1.0:1780340932.387075:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961247232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340932.387409:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2590 00000100:00100000:2.0:1780340932.387419:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:540506f4-4e8e-4fb6-b537-f45d44291964+8:2408:x1866818940485376:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1780340932.387427:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340932.387432:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c04754c6000/0xa2465143277544e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2600 expref: 8 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.387442:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c04754c6000/0xa2465143277544e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2600 expref: 8 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.387452:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04754c6000/0xa2465143277544e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2600 expref: 8 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340932.387460:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340932.387509:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:540506f4-4e8e-4fb6-b537-f45d44291964+7:2408:x1866818940485376:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 93us (2165us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340932.387522:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2590 00000100:00100000:0.0:1780340932.388744:0:19125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00100000:0.0:1780340932.388847:0:19125:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:3661:x1866818961247360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1780340932.388862:0:19125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340932.388869:0:19125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0475fa5a00/0xa246514327753e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa246514327753de expref: 15 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.388881:0:19125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0475fa5a00/0xa246514327753e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa246514327753de expref: 15 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.388896:0:19125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5a00/0xa246514327753e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa246514327753de expref: 15 pid: 90567 timeout: 3812 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.388912:0:19125:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c03476f8600/0xa2465143277573b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.388920:0:19125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f8600/0xa2465143277573b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.388937:0:19125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c03476f8600/0xa2465143277573b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.388942:0:19125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c03476f8600/0xa2465143277573b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.388949:0:19125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c03476f8600/0xa2465143277573b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.388954:0:19125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c03476f8600/0xa2465143277573b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.388960:0:19125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8600 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:0.0:1780340932.388972:0:19125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c03476f8600/0xa2465143277573b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.388981:0:19125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c03476f8600/0xa2465143277573b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340932.389265:0:91372:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c03476f8600/0xa2465143277573b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340932.389273:0:91372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c03476f8600/0xa2465143277573b lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.390857:0:19125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c03476f8600/0xa2465143277573b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.390870:0:19125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f8600/0xa2465143277573b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340932.390887:0:19125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340932.390957:0:19125:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:3661:x1866818961247360:12345-0@lo:103:ldlm_bl.0 Request processed in 2202us (5409us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340932.390965:0:19125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00100000:3.0:1780340932.391150:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961247360:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340932.490057:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1780340933.513883:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1780340933.513891:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c0470f7c000 from 58 10000000:01000000:1.0:1780340933.513896:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780340933.513940:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432775742 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340933.513951:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432775742 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340933.513962:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432775742 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340933.513997:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961247488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340933.514084:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340933.514134:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047215b240 going to sleep for 11 seconds 00000100:00100000:2.0:1780340933.514781:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961247488 00000100:00100000:2.0:1780340933.514789:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961247488 00010000:00010000:0.0:1780340933.515082:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340933.515322:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1780340933.515334:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:6514:x1866818961247488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340933.515348:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340933.515364:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0470f2dc00/0xa24651432775749 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432775742 expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340933.515389:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0470f2dc00/0xa24651432775749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775742 expref: 15 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340933.515400:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0470f2dc00/0xa24651432775749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775742 expref: 15 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340933.515408:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0470f2dc00, rc 0) 00000100:00100000:2.0:1780340933.515468:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961247488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340933.515474:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1780340933.516123:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961247488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340933.516151:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432775742 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775749 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340933.516161:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432775742 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775749 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340933.516245:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961247616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340933.516296:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340933.519786:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047215b240 going to sleep for 11 seconds 00000100:00100000:3.0:1780340933.520345:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961247616 00000100:00100000:3.0:1780340933.520355:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961247616 00000100:00100000:3.0:1780340933.520499:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1780340933.520509:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961247616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.520996:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961247616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 487us (4698us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.521028:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1780340933.521608:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961247616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340933.521658:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961247744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340933.522116:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340933.522191:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047215b240 going to sleep for 11 seconds 00000100:00100000:3.0:1780340933.522335:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961247744 00000100:00100000:3.0:1780340933.522341:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961247744 00000100:00100000:3.0:1780340933.522477:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1780340933.522486:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961247744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.522603:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961247744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.522610:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1780340933.522682:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961247744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340933.523293:0:91376:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91376:1866818961247872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340933.523333:0:91376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340933.524151:0:91376:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047215ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1780340933.524327:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961247872 00000100:00100000:2.0:1780340933.524334:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961247872 00000100:00100000:2.0:1780340933.524477:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1780340933.524486:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:91376:x1866818961247872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340933.524625:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:91376:x1866818961247872:12345-0@lo:502:llog_process_th.0 Request processed in 140us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340933.524632:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1780340933.525160:0:91376:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91376:1866818961247872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340933.525324:0:91376:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91376:1866818961248000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340933.525365:0:91376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340933.525398:0:91376:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047215ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340933.525502:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961248000 00000100:00100000:3.0:1780340933.525508:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961248000 00000100:00100000:3.0:1780340933.525552:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1780340933.525561:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:91376:x1866818961248000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340933.525640:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:91376:x1866818961248000:12345-0@lo:502:llog_process_th.0 Request processed in 80us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.525647:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1780340933.525858:0:91376:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91376:1866818961248000:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1780340933.525877:0:91376:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1780340933.526179:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1780340933.526210:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780340933.526219:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432775742 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775749 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.526230:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432775742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775749 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340933.526240:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1780340933.526243:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 53 10000000:01000000:3.0:1780340933.526245:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1780340933.526268:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f8c00/0xa24651432775750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.526281:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c03476f8c00/0xa24651432775750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.526290:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c03476f8c00/0xa24651432775750 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340933.526306:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961248128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.526338:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340933.526362:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471c426c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340933.526385:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961248128 00000100:00100000:3.0:1780340933.526390:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961248128 00000100:00100000:3.0:1780340933.526414:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1780340933.526420:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961248128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340933.526429:0:90568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340933.526441:0:90568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f8e00/0xa24651432775757 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432775750 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.526462:0:90568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f8e00/0xa24651432775757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775750 expref: 16 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.526472:0:90568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f8e00/0xa24651432775757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775750 expref: 16 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.526480:0:90568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8e00, rc 0) 00000100:00100000:3.0:1780340933.526508:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961248128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.526514:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1780340933.526865:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961248128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340933.526876:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c03476f8c00/0xa24651432775750 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775757 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.526884:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c03476f8c00/0xa24651432775750 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775757 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340933.526932:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961248256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.526957:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340933.526971:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471c426c0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340933.526992:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961248256 00000100:00100000:3.0:1780340933.526995:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961248256 00000100:00100000:3.0:1780340933.527340:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1780340933.527348:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961248256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.527458:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961248256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.527465:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1780340933.527497:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961248256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.527523:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961248384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.527746:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340933.527781:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0447b68000 going to sleep for 11 seconds 00000100:00100000:3.0:1780340933.527794:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961248384 00000100:00100000:3.0:1780340933.527797:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961248384 00000100:00100000:3.0:1780340933.527818:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1780340933.527823:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961248384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.527902:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961248384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.527913:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1780340933.527951:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961248384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340933.529633:0:91377:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349954000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91377:1866818961248512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340933.530001:0:91377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340933.530041:0:91377:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a877180 going to sleep for 11 seconds 00000100:00100000:3.0:1780340933.530142:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961248512 00000100:00100000:3.0:1780340933.530148:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961248512 00000100:00100000:3.0:1780340933.530189:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1780340933.530196:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:91377:x1866818961248512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340933.530441:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:91377:x1866818961248512:12345-0@lo:502:llog_process_th.0 Request processed in 244us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.530448:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1780340933.530600:0:91377:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349954000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91377:1866818961248512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780340933.530628:0:91377:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340933.530639:0:91377:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340933.530642:0:91377:0:(obd_config.c:1561:class_process_config()) marker 48 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1780340933.530648:0:91377:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1780340933.530662:0:91377:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:3.0:1780340933.531591:0:91377:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91377:1866818961248640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340933.531642:0:91377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340933.531676:0:91377:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0447b68e40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340933.531794:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961248640 00000100:00100000:0.0:1780340933.531800:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961248640 00000100:00100000:0.0:1780340933.531959:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1780340933.531968:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:91377:x1866818961248640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340933.532074:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:91377:x1866818961248640:12345-0@lo:502:llog_process_th.0 Request processed in 107us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340933.532081:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1780340933.535993:0:91377:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91377:1866818961248640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780340933.536094:0:91377:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780340933.536105:0:91377:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340933.536107:0:91377:0:(obd_config.c:1561:class_process_config()) marker 48 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1780340933.536111:0:91377:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000020:01000004:2.0:1780340933.537519:0:91378:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0470f7c000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1780340933.537525:0:91378:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c0470f7c000 4 00000020:01000000:0.0:1780340933.537993:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 53-55 (rc=0) 10000000:01000000:0.0:1780340933.538078:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1780340933.538100:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f8c00/0xa24651432775750 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775757 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.538112:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c03476f8c00/0xa24651432775750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775757 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340933.538135:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780340933.538137:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c045f0c4800 from 58 10000000:01000000:0.0:1780340933.538140:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780340933.538172:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c034d9ebe00/0xa2465143277575e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.538179:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c034d9ebe00/0xa2465143277575e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.538189:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c034d9ebe00/0xa2465143277575e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340933.538450:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961248768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340933.538511:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340933.538553:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a877cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1780340933.538606:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961248768 00000100:00100000:3.0:1780340933.538613:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961248768 00000100:00100000:3.0:1780340933.538656:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1780340933.538665:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961248768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340933.538677:0:90568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340933.538688:0:90568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f9000/0xa24651432775765 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277575e expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.538730:0:90568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f9000/0xa24651432775765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277575e expref: 17 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.538741:0:90568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f9000/0xa24651432775765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277575e expref: 17 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.538749:0:90568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9000, rc 0) 00000100:00100000:2.0:1780340933.539023:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961248768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340933.539036:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c034d9ebe00/0xa2465143277575e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775765 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340933.539043:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c034d9ebe00/0xa2465143277575e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775765 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340933.539095:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961248896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340933.539120:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340933.539143:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443afb900 going to sleep for 11 seconds 00000100:00100000:3.0:1780340933.539316:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961248768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.539324:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1780340933.539349:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961248896 00000100:00100000:3.0:1780340933.539353:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961248896 00000100:00100000:3.0:1780340933.539388:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1780340933.539395:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961248896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.539491:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961248896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.539498:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1780340933.539803:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961248896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340933.539948:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961249024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340933.539989:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340933.540111:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443afb900 going to sleep for 11 seconds 00000100:00100000:2.0:1780340933.540134:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961249024 00000100:00100000:2.0:1780340933.540138:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961249024 00000100:00100000:2.0:1780340933.540168:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1780340933.540174:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961249024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340933.540473:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961249024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 299us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340933.540486:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1780340933.540804:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961249024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340933.544588:0:91379:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91379:1866818961249152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340933.544674:0:91379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340933.545035:0:91379:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443afbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340933.545139:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961249152 00000100:00100000:0.0:1780340933.545147:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961249152 00000100:00100000:0.0:1780340933.545341:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1780340933.545351:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:91379:x1866818961249152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340933.545482:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:91379:x1866818961249152:12345-0@lo:502:llog_process_th.0 Request processed in 132us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340933.545490:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1780340933.545568:0:91379:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91379:1866818961249152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340933.545614:0:91379:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91379:1866818961249280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340933.545645:0:91379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340933.548056:0:91379:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443afbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340933.548157:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961249280 00000100:00100000:3.0:1780340933.548167:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961249280 00000100:00100000:3.0:1780340933.548365:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1780340933.548381:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:91379:x1866818961249280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340933.548514:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:91379:x1866818961249280:12345-0@lo:502:llog_process_th.0 Request processed in 142us (2868us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.548522:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1780340933.548668:0:91379:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91379:1866818961249280:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1780340933.548710:0:91379:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1780340933.549115:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1780340933.549146:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780340933.549163:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c034d9ebe00/0xa2465143277575e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775765 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.549174:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c034d9ebe00/0xa2465143277575e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775765 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340933.549182:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1780340933.549185:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:3.0:1780340933.549188:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1780340933.549327:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa2465143277576c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.549336:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa2465143277576c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.549345:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa2465143277576c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340933.549364:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961249408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.549412:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340933.549431:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445377540 going to sleep for 11 seconds 00000100:00100000:3.0:1780340933.549456:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961249408 00000100:00100000:3.0:1780340933.549460:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961249408 00000100:00100000:3.0:1780340933.549491:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1780340933.549498:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961249408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340933.549508:0:90570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340933.549520:0:90570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f8000/0xa24651432775773 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277576c expref: -99 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.549541:0:90570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f8000/0xa24651432775773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277576c expref: 18 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.549558:0:90570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f8000/0xa24651432775773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277576c expref: 18 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.549567:0:90570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8000, rc 0) 00000100:00100000:3.0:1780340933.549597:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961249408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.549603:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1780340933.549636:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961249408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340933.549647:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa2465143277576c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775773 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.549657:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa2465143277576c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775773 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340933.549712:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961249536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.549735:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340933.549748:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445377540 going to sleep for 11 seconds 00000100:00100000:3.0:1780340933.549775:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961249536 00000100:00100000:3.0:1780340933.549779:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961249536 00000100:00100000:3.0:1780340933.549798:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1780340933.549803:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961249536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.550162:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961249536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 357us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.550168:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1780340933.550308:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961249536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.550347:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961249664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.550381:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340933.550394:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445377540 going to sleep for 11 seconds 00000100:00100000:3.0:1780340933.550406:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961249664 00000100:00100000:3.0:1780340933.550409:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961249664 00000100:00100000:3.0:1780340933.550430:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1780340933.550435:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961249664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.550504:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961249664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.550510:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1780340933.550549:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961249664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.551122:0:91380:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91380:1866818961249792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340933.551185:0:91380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340933.551367:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961249792 00000100:00100000:3.0:1780340933.551495:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961249792 00000100:00100000:3.0:1780340933.551525:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1780340933.551532:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:91380:x1866818961249792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340933.551617:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:91380:x1866818961249792:12345-0@lo:502:llog_process_th.0 Request processed in 85us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.551624:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1780340933.551657:0:91380:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0477220e40 going to sleep for 11 seconds 00000100:00100000:3.0:1780340933.551670:0:91380:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91380:1866818961249792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780340933.551691:0:91380:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780340933.552080:0:91380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340933.552089:0:91380:0:(obd_config.c:1561:class_process_config()) marker 49 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1780340933.552096:0:91380:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1780340933.552114:0:91380:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:3.0:1780340933.552148:0:91380:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91380:1866818961249920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340933.552187:0:91380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340933.552428:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961249920 00000100:00100000:0.0:1780340933.552433:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961249920 00000100:00100000:0.0:1780340933.552469:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1780340933.552476:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:91380:x1866818961249920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340933.552552:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:91380:x1866818961249920:12345-0@lo:502:llog_process_th.0 Request processed in 76us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340933.552558:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1780340933.552667:0:91380:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445377540 going to sleep for 11 seconds 00000100:00100000:3.0:1780340933.552681:0:91380:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91380:1866818961249920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780340933.553331:0:91380:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780340933.553340:0:91380:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340933.553342:0:91380:0:(obd_config.c:1561:class_process_config()) marker 49 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1780340933.553347:0:91380:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000020:01000000:0.0:1780340933.553707:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-55 (rc=0) 10000000:01000000:0.0:1780340933.553730:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1780340933.553740:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa2465143277576c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775773 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.553750:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa2465143277576c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775773 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340933.553788:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780340933.553791:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c04773ad000 from 58 10000000:01000000:0.0:1780340933.553794:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780340933.554074:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea200/0xa2465143277577a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.554083:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea200/0xa2465143277577a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.554093:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea200/0xa2465143277577a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340933.554111:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961250048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340933.554166:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340933.554329:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961250048 00000100:00100000:1.0:1780340933.554335:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961250048 00000100:00100000:1.0:1780340933.554384:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1780340933.554392:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961250048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340933.554403:0:90567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340933.554417:0:90567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453122400/0xa24651432775781 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277577a expref: -99 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340933.554448:0:90567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453122400/0xa24651432775781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277577a expref: 19 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340933.554458:0:90567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453122400/0xa24651432775781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277577a expref: 19 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340933.554467:0:90567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122400, rc 0) 00000100:00100000:1.0:1780340933.554499:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961250048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340933.554505:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1780340933.554600:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a877180 going to sleep for 11 seconds 00000100:00100000:0.0:1780340933.554615:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961250048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340933.554626:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea200/0xa2465143277577a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775781 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.554634:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea200/0xa2465143277577a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775781 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340933.554684:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961250176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340933.554802:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340933.555089:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961250176 00000100:00100000:1.0:1780340933.555094:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961250176 00000100:00100000:1.0:1780340933.555119:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1780340933.555135:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961250176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340933.555313:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a877180 going to sleep for 11 seconds 00000100:00100000:0.0:1780340933.556492:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961250176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1363us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340933.556501:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1780340933.556573:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961250176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.556618:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961250304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.556666:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340933.556698:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0477220e40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340933.556978:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961250304 00000100:00100000:0.0:1780340933.556983:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961250304 00000100:00100000:0.0:1780340933.557083:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1780340933.557093:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961250304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.557364:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961250304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340933.558838:0:91381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91381:1866818961250432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340933.558902:0:91381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340933.558946:0:91381:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443afb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340933.559486:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961250304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340933.559509:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1780340933.559555:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961250432 00000100:00100000:0.0:1780340933.559561:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961250432 00000100:00100000:0.0:1780340933.559601:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1780340933.559609:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:91381:x1866818961250432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340933.559718:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:91381:x1866818961250432:12345-0@lo:502:llog_process_th.0 Request processed in 110us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340933.559735:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1780340933.560352:0:91381:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91381:1866818961250432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340933.560409:0:91381:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91381:1866818961250560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340933.560449:0:91381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340933.560476:0:91381:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443afb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340933.560798:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961250560 00000100:00100000:0.0:1780340933.560803:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961250560 00000100:00100000:0.0:1780340933.561314:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1780340933.561324:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:91381:x1866818961250560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340933.561464:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:91381:x1866818961250560:12345-0@lo:502:llog_process_th.0 Request processed in 142us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340933.561472:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1780340933.562109:0:91381:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91381:1866818961250560:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1780340933.562338:0:91381:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1780340933.562579:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1780340933.562602:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780340933.562612:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea200/0xa2465143277577a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775781 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.562623:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea200/0xa2465143277577a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775781 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340933.562632:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1780340933.562635:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1780340933.562638:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1780340933.562676:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa24651432775788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.562683:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa24651432775788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.562691:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa24651432775788 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340933.563097:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961250688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.563156:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340933.563331:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445377540 going to sleep for 11 seconds 00000100:00100000:0.0:1780340933.563366:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961250688 00000100:00100000:0.0:1780340933.563426:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961250688 00000100:00100000:0.0:1780340933.563497:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1780340933.563506:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961250688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340933.563517:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340933.563529:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c034d9ea800/0xa2465143277578f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432775788 expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.563550:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c034d9ea800/0xa2465143277578f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775788 expref: 20 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.563559:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c034d9ea800/0xa2465143277578f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775788 expref: 20 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.563568:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c034d9ea800, rc 0) 00000100:00100000:0.0:1780340933.563611:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961250688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340933.563618:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1780340933.563687:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961250688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340933.563709:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa24651432775788 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277578f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.563718:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa24651432775788 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277578f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340933.563793:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961250816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.563833:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340933.564627:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445377540 going to sleep for 11 seconds 00000100:00100000:2.0:1780340933.565594:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961250816 00000100:00100000:2.0:1780340933.565603:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961250816 00000100:00100000:2.0:1780340933.565657:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1780340933.565665:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961250816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340933.565991:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961250816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (2163us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340933.565999:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1780340933.566161:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961250816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.566693:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961250944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.566754:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340933.566822:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445377540 going to sleep for 11 seconds 00000100:00100000:3.0:1780340933.566951:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961250944 00000100:00100000:3.0:1780340933.566962:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961250944 00000100:00100000:3.0:1780340933.566991:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1780340933.566997:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961250944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.567161:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961250944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.567167:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1780340933.567429:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961250944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780340933.568573:0:91382:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1780340933.568950:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1780340933.568973:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1780340933.568982:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa24651432775788 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277578f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.568992:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa24651432775788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277578f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340933.569001:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780340933.569003:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c047b065000 from 58 10000000:01000000:0.0:1780340933.569017:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780340933.569049:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea400/0xa24651432775796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.569057:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea400/0xa24651432775796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.569065:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea400/0xa24651432775796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340933.569085:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961251072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340933.569142:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340933.569170:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034aa82180 going to sleep for 11 seconds 00000100:00100000:2.0:1780340933.569455:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961251072 00000100:00100000:2.0:1780340933.569462:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961251072 00000100:00100000:2.0:1780340933.569507:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1780340933.569515:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a99e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961251072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340933.569527:0:90567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340933.569540:0:90567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0470f2c000/0xa2465143277579d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432775796 expref: -99 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340933.569561:0:90567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0470f2c000/0xa2465143277579d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775796 expref: 21 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340933.569569:0:90567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0470f2c000/0xa2465143277579d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775796 expref: 21 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340933.569577:0:90567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0470f2c000, rc 0) 00000100:00100000:2.0:1780340933.569613:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a99e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961251072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340933.569618:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1780340933.570079:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961251072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340933.570094:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea400/0xa24651432775796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277579d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.570103:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea400/0xa24651432775796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277579d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340933.570186:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961251200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340933.571531:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340933.571604:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034aa82180 going to sleep for 11 seconds 00000100:00100000:1.0:1780340933.573730:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961251200 00000100:00100000:1.0:1780340933.573741:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961251200 00000100:00100000:2.0:1780340933.574175:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1780340933.574503:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a99dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961251200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.574669:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a99dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961251200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 485us (3142us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.574677:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1780340933.575051:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961251200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340933.575105:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961251328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340933.575166:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340933.575506:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961251328 00000100:00100000:3.0:1780340933.575511:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961251328 00000100:00100000:3.0:1780340933.575547:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1780340933.575555:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046f953050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961251328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.575631:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046f953050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961251328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.575638:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1780340933.575977:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443afb540 going to sleep for 11 seconds 00000100:00100000:2.0:1780340933.575992:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961251328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340933.576575:0:91383:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91383:1866818961251456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340933.576618:0:91383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340933.577218:0:91383:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443afb840 going to sleep for 11 seconds 00000100:00100000:1.0:1780340933.577501:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961251456 00000100:00100000:1.0:1780340933.577508:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961251456 00000100:00100000:1.0:1780340933.577552:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1780340933.577560:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046f953450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:91383:x1866818961251456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340933.577688:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046f953450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:91383:x1866818961251456:12345-0@lo:502:llog_process_th.0 Request processed in 127us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340933.577696:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1780340933.577858:0:91383:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91383:1866818961251456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340933.577907:0:91383:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91383:1866818961251584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340933.577942:0:91383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340933.577961:0:91383:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443afb840 going to sleep for 11 seconds 00000100:00100000:0.0:1780340933.578184:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961251584 00000100:00100000:0.0:1780340933.578189:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961251584 00000100:00100000:0.0:1780340933.578542:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1780340933.578551:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:91383:x1866818961251584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340933.578635:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:91383:x1866818961251584:12345-0@lo:502:llog_process_th.0 Request processed in 86us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340933.578642:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1780340933.579471:0:91383:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91383:1866818961251584:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1780340933.579503:0:91383:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:0.0:1780340933.579661:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:0.0:1780340933.579685:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780340933.579695:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea400/0xa24651432775796 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277579d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.579716:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea400/0xa24651432775796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277579d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340933.579725:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1780340933.579728:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1780340933.579730:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1780340933.579755:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c034d9eb600/0xa246514327757a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.579786:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c034d9eb600/0xa246514327757a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.579807:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c034d9eb600/0xa246514327757a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340933.580065:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961251712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340933.580110:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340933.580195:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034aa82d80 going to sleep for 11 seconds 00000100:00100000:1.0:1780340933.580477:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961251712 00000100:00100000:1.0:1780340933.580484:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961251712 00000100:00100000:1.0:1780340933.580531:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1780340933.580539:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961251712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340933.580558:0:90570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340933.580571:0:90570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453122200/0xa246514327757ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327757a4 expref: -99 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340933.580593:0:90570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453122200/0xa246514327757ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327757a4 expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340933.580603:0:90570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453122200/0xa246514327757ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327757a4 expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340933.580611:0:90570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122200, rc 0) 00000100:00100000:1.0:1780340933.580657:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961251712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340933.580663:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1780340933.580806:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961251712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340933.580835:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c034d9eb600/0xa246514327757a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327757ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340933.580844:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c034d9eb600/0xa246514327757a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327757ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340933.580898:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961251840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340933.580927:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340933.580945:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443afb840 going to sleep for 11 seconds 00000100:00100000:0.0:1780340933.581167:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961251840 00000100:00100000:0.0:1780340933.581172:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961251840 00000100:00100000:0.0:1780340933.581214:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1780340933.581285:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961251840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340933.581455:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961251840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340933.581462:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1780340933.581681:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961251840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340933.581723:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961251968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340933.581804:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340933.582068:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961251968 00000100:00100000:1.0:1780340933.582073:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961251968 00000100:00100000:1.0:1780340933.582108:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1780340933.582115:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961251968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340933.582686:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961251968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 570us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340933.582693:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1780340933.583181:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443afb840 going to sleep for 11 seconds 00000100:00100000:2.0:1780340933.583410:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961251968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780340933.585459:0:91384:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1780340933.585654:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1780340933.585676:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1780340933.585686:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c034d9eb600/0xa246514327757a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327757ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340933.585698:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c034d9eb600/0xa246514327757a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327757ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340933.586079:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1780340933.586082:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8c0471e119c0 from 1 10000000:01000000:2.0:1780340933.586084:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1780340933.586120:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0470f2da00/0xa246514327757b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340933.586137:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0470f2da00/0xa246514327757b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340933.586147:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0470f2da00/0xa246514327757b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340933.586170:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961252096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340933.586538:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340933.586618:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443afb840 going to sleep for 11 seconds 00000100:00100000:0.0:1780340933.587460:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961252096 00000100:00100000:0.0:1780340933.587469:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961252096 00000100:00100000:0.0:1780340933.587549:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1780340933.587559:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961252096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340933.587575:0:90568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340933.587590:0:90568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c034d9ebc00/0xa246514327757b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327757b2 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.587613:0:90568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c034d9ebc00/0xa246514327757b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327757b2 expref: 23 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.587623:0:90568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c034d9ebc00/0xa246514327757b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327757b2 expref: 23 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340933.587649:0:90568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c034d9ebc00, rc 0) 00000100:00100000:0.0:1780340933.587740:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961252096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340933.587746:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1780340933.588107:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961252096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340933.588122:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0470f2da00/0xa246514327757b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327757b9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340933.588140:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0470f2da00/0xa246514327757b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327757b9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340933.588234:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961252224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340933.588264:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340933.588396:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0443afb840 going to sleep for 11 seconds 00000100:00100000:0.0:1780340933.588605:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961252224 00000100:00100000:0.0:1780340933.588611:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961252224 00000100:00100000:0.0:1780340933.588649:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1780340933.588656:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961252224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340933.588743:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961252224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (478us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780340933.588750:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1780340933.589075:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961252224:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1780340933.589103:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1780340933.589109:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0470f2da00/0xa246514327757b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327757b9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.589117:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0470f2da00/0xa246514327757b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327757b9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340933.672445:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340933.672591:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940485504 00000100:00100000:3.0:1780340933.672601:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940485504 00000100:00100000:3.0:1780340933.672657:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 120 00000100:00100000:3.0:1780340933.672667:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+7:70274:x1866818940485504:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340933.672683:0:90567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340933.672699:0:90567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f9e00/0xa246514327757c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced265b expref: -99 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.672726:0:90567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f9e00/0xa246514327757c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced265b expref: 8 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.672736:0:90567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f9e00/0xa246514327757c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced265b expref: 8 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340933.672744:0:90567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9e00, rc 0) 00000100:00100000:3.0:1780340933.672851:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940485504:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 186us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.672858:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 120 00000100:00100000:1.0:1780340933.682065:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340933.682104:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940485632 00000100:00100000:2.0:1780340933.682114:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940485632 00000100:00100000:2.0:1780340933.682178:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 121 00000100:00100000:2.0:1780340933.682192:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940485632:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340933.682334:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940485632:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 146us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340933.682342:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 121 00000100:00100000:2.0:1780340933.697160:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340933.697625:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940485760 00000100:00100000:3.0:1780340933.697636:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940485760 00000100:00100000:3.0:1780340933.698458:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 122 00000100:00100000:3.0:1780340933.698481:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940485760:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340933.698628:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940485760:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 159us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340933.698637:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 122 00000100:00100000:2.0:1780340933.702166:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340933.702399:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940485888 00000100:00100000:1.0:1780340933.702416:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940485888 00000100:00100000:1.0:1780340933.702462:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 123 00000100:00100000:1.0:1780340933.702471:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+8:72630:x1866818940485888:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:1.0:1780340933.702597:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+8:72630:x1866818940485888:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 126us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340933.702611:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 123 00000100:00100000:1.0:1780340933.706557:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340933.706721:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940486016 00000100:00100000:0.0:1780340933.706732:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940486016 00000100:00100000:0.0:1780340933.706854:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 124 00000100:00100000:0.0:1780340933.706865:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04505ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:72630:x1866818940486016:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:0.0:1780340933.707010:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04505ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:72630:x1866818940486016:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 146us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340933.707017:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 124 00000100:00100000:2.0:1780340933.711599:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340933.711699:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940486144 00000100:00100000:1.0:1780340933.711708:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940486144 00000100:00100000:1.0:1780340933.711791:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 125 00000100:00100000:1.0:1780340933.711802:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04505ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940486144:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340933.711818:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340933.711835:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453122600/0xa246514327757c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2662 expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340933.711862:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453122600/0xa246514327757c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2662 expref: 9 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340933.711873:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453122600/0xa246514327757c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2662 expref: 9 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340933.711881:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122600, rc 0) 00000100:00100000:1.0:1780340933.711939:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04505ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940486144:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 139us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340933.711946:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 125 00000100:00100000:2.0:1780340933.719591:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340933.722305:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940486272 00000100:00100000:0.0:1780340933.722318:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940486272 00000100:00100000:0.0:1780340933.722389:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 126 00000100:00100000:0.0:1780340933.722409:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940486272:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340933.722528:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940486272:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 120us (2945us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780340933.722554:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 126 00010000:00010000:2.0:1780340934.538647:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340935.050898:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340935.050920:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961252352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340935.050982:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340935.051025:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961252352 00000100:00100000:3.0:1780340935.051032:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961252352 00000100:00100000:3.0:1780340935.051081:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2160 00000100:00100000:3.0:1780340935.051090:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961252352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340935.051126:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340935.051166:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961252352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340935.051172:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2160 00000100:00080000:3.0:1780340935.051193:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340935.051225:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961252352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340935.051335:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780340935.051344:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961252480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340935.051372:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340935.051396:0:8404:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961252480 00000100:00100000:1.0:1780340935.051400:0:8404:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961252480 00000100:00100000:1.0:1780340935.051427:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2161 00000100:00100000:1.0:1780340935.051435:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961252480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1780340935.051465:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1780340935.051496:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961252480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340935.051502:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2161 00000100:00100000:1.0:1780340935.051540:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961252480:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1780340935.051847:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1780340935.561873:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340935.562272:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961252608:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.562338:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340935.562373:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961253120:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.562398:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340935.562422:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961253632:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.562459:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340935.562484:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1780340935.562489:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961252992:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.562511:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340935.562527:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961253504:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.562548:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340935.562576:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961252736:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.562597:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340935.562612:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961253248:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.562643:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340935.562658:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961253760:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.562676:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340935.562692:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1780340935.562698:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961252864:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.562716:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340935.562730:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961253376:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.562792:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340935.562806:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961253888:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.562826:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340935.562846:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961252608 00000100:00100000:0.0:1780340935.562853:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961252608 00000100:00100000:0.0:1780340935.562890:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1780340935.562898:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961252608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.562946:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961252608:12345-0@lo:400:kworker.0 Request processed in 49us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340935.562954:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1780340935.562984:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961253632 00000100:00100000:0.0:1780340935.562987:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961253632 00000100:00100000:0.0:1780340935.563036:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961253760 00000100:00100000:0.0:1780340935.563038:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961253760 00000100:00100000:0.0:1780340935.563058:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654 00000100:00100000:0.0:1780340935.563064:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961253632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563092:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961253632:12345-0@lo:400:kworker.0 Request processed in 29us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340935.563097:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654 00000100:00100000:0.0:1780340935.563107:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655 00000100:00100000:0.0:1780340935.563125:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961253760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563152:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961253760:12345-0@lo:400:kworker.0 Request processed in 29us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340935.563158:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655 00000100:00100000:0.0:1780340935.563175:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961253120 00000100:00100000:0.0:1780340935.563178:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961253120 00000100:00100000:0.0:1780340935.563196:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961252992 00000100:00100000:0.0:1780340935.563205:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961252992 00000100:00100000:0.0:1780340935.563220:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961252736 00000100:00100000:0.0:1780340935.563222:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961252736 00000100:00100000:0.0:1780340935.563233:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961252864 00000100:00100000:0.0:1780340935.563235:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961252864 00000100:00100000:0.0:1780340935.563246:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961253376 00000100:00100000:0.0:1780340935.563248:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961253376 00000100:00100000:0.0:1780340935.563258:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961253888 00000100:00100000:0.0:1780340935.563260:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961253888 00000100:00100000:0.0:1780340935.563272:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:0.0:1780340935.563277:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961253120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563306:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349955880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961253120:12345-0@lo:400:kworker.0 Request processed in 29us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340935.563312:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:0.0:1780340935.563323:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:0.0:1780340935.563328:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961252992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563352:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961252992:12345-0@lo:400:kworker.0 Request processed in 23us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340935.563357:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00100000:0.0:1780340935.563367:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:0.0:1780340935.563373:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961252736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563396:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1866818961252736:12345-0@lo:400:kworker.0 Request processed in 24us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340935.563403:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:0.0:1780340935.563414:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1468 00000100:00100000:0.0:1780340935.563419:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961252864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563443:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961252864:12345-0@lo:400:kworker.0 Request processed in 24us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340935.563453:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1468 00000100:00100000:0.0:1780340935.563465:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:0.0:1780340935.563470:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961253376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563495:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961253376:12345-0@lo:400:kworker.0 Request processed in 25us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340935.563500:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:0.0:1780340935.563510:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:0.0:1780340935.563516:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961253888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563538:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961253888:12345-0@lo:400:kworker.0 Request processed in 23us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340935.563543:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00100000:0.0:1780340935.563562:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961253504 00000100:00100000:0.0:1780340935.563565:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961253504 00000100:00100000:0.0:1780340935.563587:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961253248 00000100:00100000:0.0:1780340935.563590:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961253248 00000100:00100000:0.0:1780340935.563606:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3986 00000100:00100000:0.0:1780340935.563611:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961253504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563638:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961253504:12345-0@lo:400:kworker.0 Request processed in 27us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340935.563644:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3986 00000100:00100000:0.0:1780340935.563654:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3987 00000100:00100000:0.0:1780340935.563660:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961253248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563682:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961253248:12345-0@lo:400:kworker.0 Request processed in 22us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340935.563686:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3987 00000100:00080000:0.0:1780340935.563723:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780340935.563727:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340935.563729:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340935.563731:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340935.563794:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961252864:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563807:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961253376:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563815:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961253888:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563824:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349954700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1866818961252736:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563831:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349956a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961253248:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563839:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349954000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961253760:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563877:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349957800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961252992:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563885:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961253504:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563893:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961252608:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563901:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349957100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961253120:0@lo:400:kworker.0 00000100:00100000:0.0:1780340935.563910:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349955c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961253632:0@lo:400:kworker.0 00000100:00100000:2.0:1780340935.568845:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961254016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340935.568913:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340935.568964:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961254016 00000100:00100000:2.0:1780340935.568970:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961254016 00000100:00100000:2.0:1780340935.569020:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3988 00000100:00100000:2.0:1780340935.569029:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961254016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340935.569062:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:2.0:1780340935.569104:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961254016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340935.569135:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3988 00000100:00100000:2.0:1780340935.569180:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961254016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340936.073980:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1780340936.074001:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961254272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340936.074073:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340936.074119:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961254144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340936.074145:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340936.074351:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961254400:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1780340936.074382:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340936.074592:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961254272 00000100:00100000:3.0:1780340936.074601:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961254272 00000100:00100000:3.0:1780340936.074645:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961254144 00000100:00100000:3.0:1780340936.074648:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961254144 00000100:00100000:3.0:1780340936.074669:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2162 00000100:00100000:3.0:1780340936.074677:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961254272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340936.074700:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340936.074786:0:8404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2163 00000100:00100000:1.0:1780340936.074795:0:8404:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961254144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780340936.074805:0:8404:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780340936.077228:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961254400 00000100:00100000:2.0:1780340936.077241:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961254400 00000100:00100000:2.0:1780340936.077307:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3989 00000100:00100000:2.0:1780340936.077317:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961254400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780340936.077352:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445179392 avail 1298939904 00000100:00100000:2.0:1780340936.077604:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961254400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 289us (3220us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340936.077613:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3989 00000100:00100000:0.0:1780340936.077714:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961254400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340936.081897:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961254272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7213us (7816us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340936.081911:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2162 00000100:00100000:1.0:1780340936.084591:0:8404:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961254144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9789us (10435us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340936.084603:0:8404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2163 00000100:00100000:2.0:1780340936.090787:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961254272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340936.090818:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961254144:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1780340936.587606:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1780340936.626610:0:91483:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffed07a0550 20000000:00000080:2.0:1780340936.626626:0:91483:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff8c034de96800 uarg=0000000000000000 00000040:00100000:2.0:1780340936.627581:0:91483:0:(llog.c:1067:llog_reverse_process()) index 60 : idx 49 20000000:01000000:2.0:1780340936.627589:0:91483:0:(mgs_llog.c:959:mgs_search_pool_cb()) Matched pool rec 59 cmd:0xce022 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:2.0:1780340936.627605:0:91483:0:(mgs_llog.c:1105:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1780340936.628059:0:91484:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 52 marker 43 1->4: lustre-clilov new lustre.pool_134 20000000:01000000:0.0:1780340936.628100:0:91484:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 54 marker 43 2->4: lustre-clilov new lustre.pool_134 00000040:00080000:0.0:1780340936.628128:0:91484:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000040:00080000:2.0:1780340936.628574:0:91483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].61, 224 off18904 20000000:01000000:2.0:1780340936.628588:0:91483:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-clilov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:2.0:1780340936.628611:0:91483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].62, 112 off19016 00000040:00080000:2.0:1780340936.628626:0:91483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].63, 224 off19240 20000000:01000000:2.0:1780340936.628638:0:91483:0:(mgs_llog.c:1105:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1780340936.629098:0:91485:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 46 marker 44 1->4: lustre-MDT0000-mdtlov new lustre.pool_134 20000000:01000000:0.0:1780340936.629136:0:91485:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 49 marker 44 2->4: lustre-MDT0000-mdtlov new lustre.pool_134 00000040:00080000:0.0:1780340936.629150:0:91485:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000040:00080000:2.0:1780340936.629348:0:91483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].56, 224 off18016 20000000:01000000:2.0:1780340936.629356:0:91483:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:2.0:1780340936.629369:0:91483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].57, 120 off18136 00000040:00080000:2.0:1780340936.629382:0:91483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].58, 224 off18360 20000000:01000000:2.0:1780340936.629393:0:91483:0:(mgs_llog.c:1105:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:0.0:1780340936.630172:0:91486:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 46 marker 45 1->4: lustre-MDT0001-mdtlov new lustre.pool_134 20000000:01000000:0.0:1780340936.630265:0:91486:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 49 marker 45 2->4: lustre-MDT0001-mdtlov new lustre.pool_134 00000040:00080000:0.0:1780340936.630285:0:91486:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000040:00080000:2.0:1780340936.630439:0:91483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].56, 224 off18016 20000000:01000000:2.0:1780340936.630517:0:91483:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:2.0:1780340936.630535:0:91483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].57, 120 off18136 00000040:00080000:2.0:1780340936.630551:0:91483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].58, 224 off18360 10000000:01000000:2.0:1780340936.630561:0:91483:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1780340936.630578:0:91483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0470f2cc00/0xa246514327757ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.630595:0:91483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0470f2dc00/0xa24651432775749 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775742 expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.630602:0:91483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c03476f8e00/0xa24651432775757 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775750 expref: 22 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.630609:0:91483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c03476f9000/0xa24651432775765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277575e expref: 22 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.630616:0:91483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c03476f8000/0xa24651432775773 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277576c expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.630622:0:91483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0453122400/0xa24651432775781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277577a expref: 22 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.630630:0:91483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c034d9ea800/0xa2465143277578f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775788 expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.630643:0:91483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0470f2c000/0xa2465143277579d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775796 expref: 22 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.630650:0:91483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0453122200/0xa246514327757ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327757a4 expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.630657:0:91483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c034d9ebc00/0xa246514327757b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327757b2 expref: 22 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.630666:0:91483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c03476f9e00/0xa246514327757c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced265b expref: 8 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.630673:0:91483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0453122600/0xa246514327757c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2662 expref: 8 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.630681:0:91483:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c0470f2cc00/0xa246514327757ce lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.630717:0:91483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0453122600/0xa246514327757c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2662 expref: 8 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.630732:0:91483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0453122600/0xa246514327757c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2662 expref: 8 pid: 90573 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340936.630745:0:91483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961254528:192.168.203.16@tcp:104: 00010000:00010000:2.0:1780340936.630960:0:91483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c03476f9e00/0xa246514327757c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced265b expref: 8 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.630968:0:91483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c03476f9e00/0xa246514327757c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced265b expref: 8 pid: 90567 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340936.631324:0:91483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497adc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961254656:192.168.203.16@tcp:104: 00010000:00010000:2.0:1780340936.631360:0:91483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c034d9ebc00/0xa246514327757b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa246514327757b2 expref: 22 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.631368:0:91483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c034d9ebc00/0xa246514327757b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa246514327757b2 expref: 22 pid: 90568 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340936.631377:0:91483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497ac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961254784:0@lo:104: 00000100:00100000:2.0:1780340936.631412:0:91483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1780340936.631551:0:91483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0453122200/0xa246514327757ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa246514327757a4 expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.631559:0:91483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0453122200/0xa246514327757ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa246514327757a4 expref: 22 pid: 90570 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340936.631567:0:91483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961254912:0@lo:104: 00000100:00100000:2.0:1780340936.631589:0:91483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1780340936.632004:0:91483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0470f2c000/0xa2465143277579d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432775796 expref: 22 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.632012:0:91483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0470f2c000/0xa2465143277579d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432775796 expref: 22 pid: 90567 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340936.632020:0:91483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047aa68380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961255040:0@lo:104: 00000100:00100000:2.0:1780340936.632042:0:91483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340936.632153:0:6499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961254784 00000100:00100000:1.0:1780340936.632160:0:6499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961254784 00000100:00100000:1.0:1780340936.632294:0:6499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961254912 00000100:00100000:1.0:1780340936.632298:0:6499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961254912 00010000:00010000:2.0:1780340936.632637:0:91483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c034d9ea800/0xa2465143277578f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432775788 expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.632659:0:91483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c034d9ea800/0xa2465143277578f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432775788 expref: 22 pid: 90573 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340936.632669:0:91483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047aa69180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961255168:0@lo:104: 00000100:00100000:2.0:1780340936.632694:0:91483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340936.632719:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961255040 00000100:00100000:3.0:1780340936.632723:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961255040 00000100:00100000:3.0:1780340936.632744:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1780340936.632752:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+5:91483:x1866818961254784:12345-0@lo:104: 00010000:00010000:3.0:1780340936.632792:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0470f2da00/0xa246514327757b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa246514327757b9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.632835:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1780340936.632841:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+5:91483:x1866818961254784:12345-0@lo:104: Request processed in 90us (1429us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340936.632848:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1780340936.632864:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1780340936.632870:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:91483:x1866818961254912:12345-0@lo:104: 00010000:00010000:3.0:1780340936.632877:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c034d9eb600/0xa246514327757a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa246514327757ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.632908:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1780340936.632912:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:91483:x1866818961254912:12345-0@lo:104: Request processed in 43us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340936.632918:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1780340936.632929:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1780340936.632934:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:91483:x1866818961255040:12345-0@lo:104: 00010000:00010000:3.0:1780340936.632940:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea400/0xa24651432775796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2465143277579d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.632967:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1780340936.632972:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:91483:x1866818961255040:12345-0@lo:104: Request processed in 38us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340936.632977:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00010000:00010000:3.0:1780340936.633005:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1780340936.633011:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0470f2da00/0xa246514327757b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xa246514327757b9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633024:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2da00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340936.633028:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0470f2da00/0xa246514327757b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xa246514327757b9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633036:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0470f2da00/0xa246514327757b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xa246514327757b9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340936.633042:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0470f2da00/0xa246514327757b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xa246514327757b9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340936.633048:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780340936.633074:0:6505:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0470f2da00/0xa246514327757b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327757b9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633080:0:6505:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340936.633098:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0470f2da00/0xa246514327757b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327757b9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633114:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0470f2da00/0xa246514327757b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327757b9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633126:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340936.633129:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c034d9eb600/0xa246514327757a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa246514327757ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633133:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb600 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340936.633136:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c034d9eb600/0xa246514327757a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xa246514327757ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633151:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c034d9eb600/0xa246514327757a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xa246514327757ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340936.633158:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c034d9eb600/0xa246514327757a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xa246514327757ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340936.633162:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780340936.633174:0:6505:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c034d9eb600/0xa246514327757a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327757ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633180:0:6505:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340936.633193:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c034d9eb600/0xa246514327757a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327757ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633308:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c034d9eb600/0xa246514327757a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa246514327757ab expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633318:0:6505:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340936.633320:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea400/0xa24651432775796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2465143277579d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633327:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea400 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340936.633329:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea400/0xa24651432775796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2465143277579d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633335:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea400/0xa24651432775796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2465143277579d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340936.633340:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea400/0xa24651432775796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2465143277579d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340936.633349:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780340936.633362:0:6505:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea400/0xa24651432775796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2465143277579d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633367:0:6505:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340936.633372:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea400/0xa24651432775796 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2465143277579d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633377:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea400/0xa24651432775796 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2465143277579d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633385:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340936.633386:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340936.633388:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340936.633393:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340936.633398:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340936.633414:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961255296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340936.633440:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340936.633486:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961255424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340936.633506:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340936.633523:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340936.633529:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961255552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340936.633547:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340936.633572:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961255296 00000100:00100000:3.0:1780340936.633576:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961255296 00010000:00010000:3.0:1780340936.633592:0:25498:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c034d9ebc00/0xa246514327757b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa246514327757b2 expref: 23 pid: 90568 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340936.633619:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961255424 00000100:00100000:3.0:1780340936.633622:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961255424 00010000:00010000:3.0:1780340936.633631:0:25498:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0453122200/0xa246514327757ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa246514327757a4 expref: 24 pid: 90570 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340936.633644:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961255552 00000100:00100000:3.0:1780340936.633646:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961255552 00010000:00010000:3.0:1780340936.633655:0:25498:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0470f2c000/0xa2465143277579d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432775796 expref: 25 pid: 90567 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340936.633668:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:3.0:1780340936.633674:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+25:3662:x1866818961255296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340936.633683:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340936.633686:0:25498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c034d9ebc00/0xa246514327757b9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa246514327757b2 expref: 25 pid: 90568 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633694:0:25498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c034d9ebc00/0xa246514327757b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa246514327757b2 expref: 25 pid: 90568 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633707:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340936.633731:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+25:3662:x1866818961255296:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340936.633737:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00100000:3.0:1780340936.633747:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:3.0:1780340936.633752:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+24:3659:x1866818961255424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340936.633787:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340936.633791:0:25498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0453122200/0xa246514327757ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa246514327757a4 expref: 24 pid: 90570 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633823:0:25498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0453122200/0xa246514327757ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa246514327757a4 expref: 24 pid: 90570 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633832:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340936.633856:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+24:3659:x1866818961255424:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340936.633861:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00100000:3.0:1780340936.633874:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:3.0:1780340936.633880:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961255552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340936.633887:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340936.633891:0:25498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0470f2c000/0xa2465143277579d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432775796 expref: 23 pid: 90567 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633899:0:25498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0470f2c000/0xa2465143277579d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432775796 expref: 23 pid: 90567 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.633907:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1780340936.633927:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961255552:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340936.633932:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:3.0:1780340936.633968:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961255296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340936.634121:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961255552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340936.634129:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961255424:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340936.634798:0:91483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0453122400/0xa24651432775781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2465143277577a expref: 22 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.634809:0:91483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0453122400/0xa24651432775781 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2465143277577a expref: 22 pid: 90567 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340936.634818:0:91483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498da300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961255680:0@lo:104: 00010000:00010000:2.0:1780340936.634855:0:91483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c03476f8000/0xa24651432775773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2465143277576c expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.634862:0:91483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c03476f8000/0xa24651432775773 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2465143277576c expref: 22 pid: 90570 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340936.634870:0:91483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498db100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961255808:0@lo:104: 00010000:00010000:2.0:1780340936.634893:0:91483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c03476f9000/0xa24651432775765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2465143277575e expref: 22 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.634900:0:91483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c03476f9000/0xa24651432775765 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2465143277575e expref: 22 pid: 90568 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340936.634909:0:91483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961255936:0@lo:104: 00010000:00010000:2.0:1780340936.634931:0:91483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c03476f8e00/0xa24651432775757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432775750 expref: 22 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.634950:0:91483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c03476f8e00/0xa24651432775757 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432775750 expref: 22 pid: 90568 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340936.634958:0:91483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961256064:0@lo:104: 00010000:00010000:2.0:1780340936.635109:0:91483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0470f2dc00/0xa24651432775749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432775742 expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.635120:0:91483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0470f2dc00/0xa24651432775749 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432775742 expref: 22 pid: 90573 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340936.635128:0:91483:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961256192:0@lo:104: 00000100:00100000:2.0:1780340936.635148:0:91483:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034abfe900 going to sleep for 11 seconds 00010000:00010000:2.0:1780340936.635166:0:91483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c034d9ebc00/0xa246514327757b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa246514327757b2 expref: 22 pid: 90568 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340936.635178:0:91483:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497ac700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961254784:0@lo:104: 00010000:00010000:2.0:1780340936.635188:0:91483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453122200/0xa246514327757ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa246514327757a4 expref: 21 pid: 90570 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340936.635196:0:91483:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961254912:0@lo:104: 00010000:00010000:2.0:1780340936.635268:0:91483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0470f2c000/0xa2465143277579d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432775796 expref: 20 pid: 90567 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340936.635276:0:91483:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047aa68380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961255040:0@lo:104: 00000100:00100000:3.0:1780340936.635401:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1780340936.635422:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340936.635546:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340936.640873:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340936.640986:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340936.641034:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340936.641079:0:91483:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961254528:192.168.203.16@tcp:104: 00000100:00100000:2.0:1780340936.641100:0:91483:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497adc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961254656:192.168.203.16@tcp:104: 00000100:00100000:0.0:1780340936.641348:0:19125:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940486400 00000100:00100000:0.0:1780340936.641355:0:19125:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940486400 00010000:00010000:0.0:1780340936.641384:0:19125:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0453122600/0xa246514327757c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2662 expref: 9 pid: 90573 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340936.641415:0:19125:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940486528 00000100:00100000:0.0:1780340936.641418:0:19125:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940486528 00010000:00010000:0.0:1780340936.641428:0:19125:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c03476f9e00/0xa246514327757c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced265b expref: 10 pid: 90567 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340936.641455:0:19125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2595 00000100:00100000:0.0:1780340936.641462:0:19125:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04757c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:540506f4-4e8e-4fb6-b537-f45d44291964+10:2407:x1866818940486400:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780340936.641475:0:19125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340936.641479:0:19125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0453122600/0xa246514327757c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2662 expref: 10 pid: 90573 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340936.641490:0:19125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0453122600/0xa246514327757c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2662 expref: 10 pid: 90573 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340936.641505:0:19125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453122600/0xa246514327757c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2662 expref: 10 pid: 90573 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340936.641517:0:19125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340936.641563:0:19125:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04757c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940486400:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 101us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340936.641570:0:19125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2595 00000100:00100000:0.0:1780340936.641606:0:19125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2596 00000100:00100000:0.0:1780340936.641612:0:19125:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:540506f4-4e8e-4fb6-b537-f45d44291964+8:2407:x1866818940486528:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1780340936.641618:0:19125:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340936.641621:0:19125:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c03476f9e00/0xa246514327757c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced265b expref: 8 pid: 90567 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340936.641630:0:19125:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c03476f9e00/0xa246514327757c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced265b expref: 8 pid: 90567 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340936.641640:0:19125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f9e00/0xa246514327757c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced265b expref: 8 pid: 90567 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340936.641647:0:19125:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1780340936.641660:0:19125:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:540506f4-4e8e-4fb6-b537-f45d44291964+7:2407:x1866818940486528:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 49us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340936.641665:0:19125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2596 00000100:00100000:1.0:1780340936.642617:0:6499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961255168 00000100:00100000:1.0:1780340936.642625:0:6499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961255168 00000100:00100000:1.0:1780340936.642655:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1780340936.642662:0:6499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0448375050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:91483:x1866818961255168:12345-0@lo:104: 00010000:00010000:1.0:1780340936.642673:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa24651432775788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2465143277578f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.642736:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1780340936.642741:0:6499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0448375050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:91483:x1866818961255168:12345-0@lo:104: Request processed in 80us (10046us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340936.642747:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1780340936.642796:0:6499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961255680 00000100:00100000:1.0:1780340936.642809:0:6499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961255680 00000100:00100000:1.0:1780340936.642823:0:6499:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961255808 00000100:00100000:1.0:1780340936.642826:0:6499:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961255808 00000100:00100000:1.0:1780340936.642838:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1780340936.642844:0:6499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:91483:x1866818961255680:12345-0@lo:104: 00010000:00010000:1.0:1780340936.642851:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea200/0xa2465143277577a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775781 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.642894:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1780340936.642899:0:6499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:91483:x1866818961255680:12345-0@lo:104: Request processed in 56us (7478us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340936.642904:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1780340936.642914:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1780340936.642919:0:6499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:91483:x1866818961255808:12345-0@lo:104: 00010000:00010000:1.0:1780340936.642925:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa2465143277576c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775773 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.642950:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1780340936.642964:0:6499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:91483:x1866818961255808:12345-0@lo:104: Request processed in 45us (7418us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340936.642969:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1780340936.643183:0:91483:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047aa69180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961255168:0@lo:104: 00000100:00100000:2.0:1780340936.643192:0:91483:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498da300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961255680:0@lo:104: 00000100:00100000:2.0:1780340936.643211:0:91483:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498db100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961255808:0@lo:104: 00010000:00010000:1.0:1780340936.643285:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1780340936.643291:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa24651432775788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2465143277578f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.643299:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8200 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340936.643303:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa24651432775788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2465143277578f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.643321:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa24651432775788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2465143277578f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340936.643328:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa24651432775788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2465143277578f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340936.643333:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340936.643366:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa24651432775788 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2465143277578f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.643372:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340936.643387:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa24651432775788 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2465143277578f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.643394:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c03476f8200/0xa24651432775788 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2465143277578f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.643405:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780340936.643407:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea200/0xa2465143277577a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775781 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.643413:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea200 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340936.643416:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea200/0xa2465143277577a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432775781 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.643422:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea200/0xa2465143277577a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432775781 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340936.643428:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea200/0xa2465143277577a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432775781 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340936.643439:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340936.643508:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea200/0xa2465143277577a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775781 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.643514:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340936.643520:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea200/0xa2465143277577a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775781 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.643526:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea200/0xa2465143277577a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775781 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.643535:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340936.643538:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa2465143277576c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775773 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.643543:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9400 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340936.643546:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa2465143277576c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432775773 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.643552:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa2465143277576c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432775773 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340936.643558:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa2465143277576c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432775773 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340936.643563:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340936.643571:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa2465143277576c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775773 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.643576:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340936.643597:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa2465143277576c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775773 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.643603:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c03476f9400/0xa2465143277576c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775773 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.643612:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340936.643613:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340936.643615:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340936.643816:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961256320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340936.643866:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340936.643902:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780340936.643908:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961256448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340936.643927:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1780340936.643963:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340936.643973:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961256320 00000100:00100000:2.0:1780340936.643977:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961256320 00010000:00010000:2.0:1780340936.644166:0:25498:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c034d9ea800/0xa2465143277578f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432775788 expref: 20 pid: 90573 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340936.644188:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961256448 00000100:00100000:2.0:1780340936.644191:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961256448 00010000:00010000:2.0:1780340936.644212:0:25498:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0453122400/0xa24651432775781 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2465143277577a expref: 21 pid: 90567 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340936.644231:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:2.0:1780340936.644238:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:3661:x1866818961256320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340936.644249:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340936.644253:0:25498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c034d9ea800/0xa2465143277578f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432775788 expref: 21 pid: 90573 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.644263:0:25498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c034d9ea800/0xa2465143277578f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432775788 expref: 21 pid: 90573 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.644283:0:25498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c034d9ea800/0xa2465143277578f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432775788 expref: 21 pid: 90573 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.644294:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340936.644321:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3661:x1866818961256320:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340936.644327:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:2.0:1780340936.644340:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:2.0:1780340936.644345:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:3661:x1866818961256448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340936.644351:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340936.644354:0:25498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0453122400/0xa24651432775781 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2465143277577a expref: 19 pid: 90567 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.644362:0:25498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0453122400/0xa24651432775781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2465143277577a expref: 19 pid: 90567 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.644371:0:25498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453122400/0xa24651432775781 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2465143277577a expref: 19 pid: 90567 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.644378:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340936.644393:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:3661:x1866818961256448:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340936.644398:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00100000:2.0:1780340936.644424:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961256448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340936.644432:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961256320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340936.644818:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340936.644829:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340936.644835:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961255936 00000100:00100000:3.0:1780340936.644838:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961255936 00000100:00100000:3.0:1780340936.644850:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961256576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340936.644882:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340936.644925:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961256064 00000100:00100000:3.0:1780340936.644928:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961256064 00000100:00100000:3.0:1780340936.644936:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961256192 00000100:00100000:3.0:1780340936.644938:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961256192 00000100:00100000:3.0:1780340936.644946:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1780340936.645135:0:6503:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961256576 00000100:00100000:3.0:1780340936.645139:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+5:91483:x1866818961255936:12345-0@lo:104: 00000100:00100000:2.0:1780340936.645145:0:6503:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961256576 00010000:00010000:3.0:1780340936.645149:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c034d9ebe00/0xa2465143277575e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775765 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.645158:0:6503:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c03476f8000/0xa24651432775773 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2465143277576c expref: 18 pid: 90570 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340936.645179:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:2.0:1780340936.645184:0:6503:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:3659:x1866818961256576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340936.645193:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340936.645207:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c03476f8000/0xa24651432775773 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2465143277576c expref: 18 pid: 90570 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.645217:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c03476f8000/0xa24651432775773 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2465143277576c expref: 18 pid: 90570 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.645228:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f8000/0xa24651432775773 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2465143277576c expref: 18 pid: 90570 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.645237:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340936.645261:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1780340936.645263:0:6503:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:3659:x1866818961256576:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340936.645265:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+5:91483:x1866818961255936:12345-0@lo:104: Request processed in 314us (4399us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340936.645269:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00100000:3.0:1780340936.645271:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1780340936.645293:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961256576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340936.645300:0:91483:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961255936:0@lo:104: 00010000:00010000:3.0:1780340936.645306:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340936.645311:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c034d9ebe00/0xa2465143277575e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775765 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.645317:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ebe00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340936.645321:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c034d9ebe00/0xa2465143277575e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432775765 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.645337:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c034d9ebe00/0xa2465143277575e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432775765 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340936.645343:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c034d9ebe00/0xa2465143277575e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432775765 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340936.645349:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780340936.645379:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c034d9ebe00/0xa2465143277575e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775765 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.645386:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340936.645471:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c034d9ebe00/0xa2465143277575e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775765 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.645477:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c034d9ebe00/0xa2465143277575e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775765 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.645487:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340936.645489:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340936.645491:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340936.645499:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961256704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340936.645522:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340936.645554:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961256704 00000100:00100000:3.0:1780340936.645558:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961256704 00010000:00010000:3.0:1780340936.645569:0:25498:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c03476f9000/0xa24651432775765 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2465143277575e expref: 17 pid: 90568 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340936.645653:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1780340936.645662:0:6499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:91483:x1866818961256064:12345-0@lo:104: 00010000:00010000:1.0:1780340936.645670:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c03476f8c00/0xa24651432775750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775757 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.645706:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1780340936.645711:0:6499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:91483:x1866818961256064:12345-0@lo:104: Request processed in 51us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340936.645716:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1780340936.645730:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1780340936.645735:0:6499:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:91483:x1866818961256192:12345-0@lo:104: 00010000:00010000:1.0:1780340936.645741:0:6499:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432775742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775749 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.645796:0:6499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1780340936.645801:0:6499:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:91483:x1866818961256192:12345-0@lo:104: Request processed in 67us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340936.645805:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00010000:00010000:1.0:1780340936.645818:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1780340936.645822:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c03476f8c00/0xa24651432775750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775757 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.645833:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8c00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340936.645835:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c03476f8c00/0xa24651432775750 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432775757 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.645841:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c03476f8c00/0xa24651432775750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432775757 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340936.645846:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c03476f8c00/0xa24651432775750 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432775757 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340936.645851:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1780340936.645877:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c03476f8c00/0xa24651432775750 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775757 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.645883:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340936.645897:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c03476f8c00/0xa24651432775750 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775757 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.645903:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c03476f8c00/0xa24651432775750 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775757 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.645912:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340936.645915:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432775742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775749 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340936.645917:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00010000:00010000:1.0:1780340936.645920:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122000 already unused, calling callback (ffffffffc129ac20) 00000100:00100000:3.0:1780340936.645923:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349863b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:3660:x1866818961256704:12345-0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1780340936.645923:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432775742 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432775749 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.645936:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340936.645937:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432775742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432775749 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.645940:0:25498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c03476f9000/0xa24651432775765 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2465143277575e expref: 17 pid: 90568 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340936.645943:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432775742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432775749 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340936.645948:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1780340936.645949:0:25498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c03476f9000/0xa24651432775765 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2465143277575e expref: 17 pid: 90568 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.645960:0:25498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f9000/0xa24651432775765 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2465143277575e expref: 17 pid: 90568 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.645969:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780340936.645970:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432775742 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775749 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.645975:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340936.645981:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432775742 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775749 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340936.645992:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349863b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:3660:x1866818961256704:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340936.645998:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00100000:3.0:1780340936.646024:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349860700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961256704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340936.646165:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0453122000/0xa24651432775742 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775749 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.646176:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340936.646178:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340936.646180:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340936.646253:0:91483:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961256064:0@lo:104: 00000100:00100000:2.0:1780340936.646262:0:91483:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91483:1866818961256192:0@lo:104: 00010000:00010000:2.0:1780340936.646303:0:91483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c0470f2cc00/0xa246514327757ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340936.648222:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340936.650300:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340936.650508:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961256832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340936.650573:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340936.650634:0:6503:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961256832 00000100:00100000:1.0:1780340936.650641:0:6503:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961256832 00010000:00010000:1.0:1780340936.650672:0:6503:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c03476f8e00/0xa24651432775757 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432775750 expref: 16 pid: 90568 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340936.650700:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:1.0:1780340936.650708:0:6503:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:3661:x1866818961256832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340936.650735:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340936.650740:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c03476f8e00/0xa24651432775757 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432775750 expref: 16 pid: 90568 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.650752:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c03476f8e00/0xa24651432775757 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432775750 expref: 16 pid: 90568 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.650791:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c03476f8e00/0xa24651432775757 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432775750 expref: 16 pid: 90568 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.650804:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340936.650837:0:6503:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:3661:x1866818961256832:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340936.650843:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:1.0:1780340936.651208:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961256832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340936.652798:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961256960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340936.652860:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340936.652962:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961256960 00000100:00100000:1.0:1780340936.652970:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961256960 00010000:00010000:1.0:1780340936.653005:0:25498:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0470f2dc00/0xa24651432775749 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432775742 expref: 15 pid: 90573 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340936.653036:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:1.0:1780340936.653044:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04757c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:3662:x1866818961256960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1780340936.653056:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340936.653060:0:25498:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0470f2dc00/0xa24651432775749 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432775742 expref: 15 pid: 90573 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.653071:0:25498:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0470f2dc00/0xa24651432775749 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432775742 expref: 15 pid: 90573 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.653114:0:25498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0470f2dc00/0xa24651432775749 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432775742 expref: 15 pid: 90573 timeout: 3816 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.653127:0:25498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c0470f2cc00/0xa246514327757ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.653136:0:25498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0470f2cc00/0xa246514327757ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.653150:0:25498:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0470f2cc00/0xa246514327757ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.653158:0:25498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0470f2cc00/0xa246514327757ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.653164:0:25498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0470f2cc00/0xa246514327757ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.653170:0:25498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0470f2cc00/0xa246514327757ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.653175:0:25498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2cc00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340936.653179:0:25498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0470f2cc00/0xa246514327757ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.653186:0:25498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0470f2cc00/0xa246514327757ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.653204:0:25498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0470f2cc00/0xa246514327757ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340936.653225:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340936.653263:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04757c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:3662:x1866818961256960:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340936.653269:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:3.0:1780340936.653690:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961256960:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340936.653703:0:91483:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c0470f2cc00/0xa246514327757ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.653711:0:91483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0470f2cc00/0xa246514327757ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340936.653724:0:91483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0470f2cc00/0xa246514327757ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340937.256196:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340937.256237:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340937.256277:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340937.256398:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340937.256421:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340937.256470:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940486656 00000100:00100000:0.0:1780340937.256481:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940486656 00000100:00100000:0.0:1780340937.256532:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 128 00000100:00100000:0.0:1780340937.256540:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+7:2407:x1866818940486656:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340937.256621:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+7:2407:x1866818940486656:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 82us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340937.256628:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 128 00000100:00100000:0.0:1780340937.256673:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940486912 00000100:00100000:0.0:1780340937.256677:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940486912 00000100:00100000:0.0:1780340937.256710:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940486784 00000100:00100000:0.0:1780340937.256713:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940486784 00000100:00100000:0.0:1780340937.256736:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1471 00000100:00100000:0.0:1780340937.256742:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2407:x1866818940486912:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340937.256812:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349860700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2407:x1866818940486912:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 70us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340937.256819:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1471 00000100:00100000:0.0:1780340937.256831:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1472 00000100:00100000:0.0:1780340937.256838:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2407:x1866818940486784:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340937.256860:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349861500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2407:x1866818940486784:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 23us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340937.256866:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1472 00000100:00080000:0.0:1780340937.256979:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780340937.256983:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340937.267812:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940487168 00000100:00100000:2.0:1780340937.267827:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940487168 00000100:00100000:2.0:1780340937.267921:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940487040 00000100:00100000:2.0:1780340937.267924:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940487040 00000100:00080000:1.0:1780340937.268091:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780340937.268105:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340937.270862:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2656 00000100:00100000:2.0:1780340937.270887:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940487168:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340937.270997:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349862d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940487168:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 122us (14719us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340937.277844:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2657 00000100:00100000:3.0:1780340937.277876:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940487040:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340937.278443:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940487040:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 581us (22017us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340937.278452:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2657 00000100:00100000:2.0:1780340937.284162:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2656 00010000:00010000:2.0:1780340937.610428:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340938.475116:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340938.476797:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940487296 00000100:00100000:1.0:1780340938.476810:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940487296 00000100:00100000:1.0:1780340938.476877:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 129 00000100:00100000:1.0:1780340938.476887:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:540506f4-4e8e-4fb6-b537-f45d44291964+7:70274:x1866818940487296:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340938.476902:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340938.476922:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453122400/0xa246514327757d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2669 expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.476949:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453122400/0xa246514327757d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2669 expref: 8 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.476960:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453122400/0xa246514327757d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2669 expref: 8 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.476978:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122400, rc 0) 00000100:00100000:1.0:1780340938.477037:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940487296:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 152us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340938.477044:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 129 00000100:00100000:1.0:1780340938.491037:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340938.491141:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940487424 00000100:00100000:0.0:1780340938.491151:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940487424 00000100:00100000:0.0:1780340938.493488:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 130 00000100:00100000:0.0:1780340938.493509:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940487424:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340938.493684:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940487424:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 184us (2657us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340938.493691:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 130 10000000:01000000:2.0:1780340938.513888:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1780340938.513895:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c0470f7c000 from 61 10000000:01000000:2.0:1780340938.513900:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1780340938.513955:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0470f2c000/0xa246514327757dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.513976:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0470f2c000/0xa246514327757dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.513986:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0470f2c000/0xa246514327757dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340938.514011:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961257088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340938.514076:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340938.514134:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034abfe900 going to sleep for 11 seconds 00000100:00100000:0.0:1780340938.514454:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961257088 00000100:00100000:0.0:1780340938.514462:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961257088 00000100:00100000:0.0:1780340938.514521:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1780340938.514529:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+14:6514:x1866818961257088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340938.514541:0:90570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340938.514553:0:90570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c034d9eb400/0xa246514327757e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327757dc expref: -99 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340938.514576:0:90570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c034d9eb400/0xa246514327757e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327757dc expref: 15 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340938.514586:0:90570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c034d9eb400/0xa246514327757e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327757dc expref: 15 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340938.515560:0:90570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c034d9eb400, rc 0) 00000100:00100000:0.0:1780340938.515649:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961257088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1119us (1570us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340938.515818:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961257088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340938.515835:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0470f2c000/0xa246514327757dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327757e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.515847:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0470f2c000/0xa246514327757dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327757e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340938.515920:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961257216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340938.515953:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340938.515987:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034abfe900 going to sleep for 11 seconds 00000100:00100000:0.0:1780340938.516075:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1780340938.516115:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961257216 00000100:00100000:0.0:1780340938.516119:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961257216 00000100:00100000:0.0:1780340938.516155:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1780340938.516163:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961257216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340938.516259:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961257216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340938.516266:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1780340938.516527:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961257216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340938.516554:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961257344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340938.516608:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340938.516627:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034abfe900 going to sleep for 11 seconds 00000100:00100000:2.0:1780340938.516641:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961257344 00000100:00100000:2.0:1780340938.516644:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961257344 00000100:00100000:2.0:1780340938.516954:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1780340938.516963:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961257344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340938.517041:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961257344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340938.517048:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1780340938.517084:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961257344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340938.519612:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340938.519794:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940487552 00000100:00100000:0.0:1780340938.519804:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940487552 00000100:00100000:0.0:1780340938.519858:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 134 00000100:00100000:0.0:1780340938.519868:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940487552:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340938.519993:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940487552:12345-192.168.203.16@tcp:503:ll_cfg_requeue.0 Request processed in 126us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340938.520007:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 134 00000100:00100000:0.0:1780340938.520961:0:91487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91487:1866818961257472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340938.521011:0:91487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340938.521098:0:91487:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a877d80 going to sleep for 11 seconds 00000100:00100000:1.0:1780340938.523187:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961257472 00000100:00100000:1.0:1780340938.523201:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961257472 00000100:00100000:1.0:1780340938.523265:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1780340938.523274:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:91487:x1866818961257472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340938.530964:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:91487:x1866818961257472:12345-0@lo:502:llog_process_th.0 Request processed in 7684us (9945us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340938.530977:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1780340938.535153:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340938.535479:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940487680 00000100:00100000:3.0:1780340938.535489:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940487680 00000100:00100000:3.0:1780340938.535566:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 136 00000100:00100000:3.0:1780340938.535576:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:72650:x1866818940487680:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1780340938.535717:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:72650:x1866818940487680:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 142us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340938.535724:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 136 00000100:00100000:0.0:1780340938.544341:0:91487:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91487:1866818961257472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340938.544443:0:91487:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91487:1866818961257600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340938.544516:0:91487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340938.544550:0:91487:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a877d80 going to sleep for 11 seconds 00000100:00100000:1.0:1780340938.545214:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961257600 00000100:00100000:1.0:1780340938.545222:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961257600 00000100:00100000:1.0:1780340938.545280:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1780340938.545290:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:91487:x1866818961257600:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340938.545438:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:91487:x1866818961257600:12345-0@lo:502:llog_process_th.0 Request processed in 149us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340938.545446:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1780340938.545849:0:91487:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91487:1866818961257600:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1780340938.545875:0:91487:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:3.0:1780340938.547217:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:3.0:1780340938.547247:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1780340938.547258:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0470f2c000/0xa246514327757dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327757e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340938.547271:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0470f2c000/0xa246514327757dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327757e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340938.547282:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1780340938.547284:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 56 10000000:01000000:3.0:1780340938.547288:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1780340938.547319:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f9000/0xa246514327757ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340938.547340:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c03476f9000/0xa246514327757ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340938.547350:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c03476f9000/0xa246514327757ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340938.547380:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961257728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1780340938.547929:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340938.547961:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471e66780 going to sleep for 11 seconds 00000100:00100000:0.0:1780340938.548018:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961257728 00000100:00100000:0.0:1780340938.548025:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961257728 00000100:00100000:0.0:1780340938.548071:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1780340938.548083:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+15:6514:x1866818961257728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340938.548106:0:90568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340938.548119:0:90568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c034d9eba00/0xa246514327757f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327757ea expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340938.548140:0:90568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c034d9eba00/0xa246514327757f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327757ea expref: 16 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340938.548151:0:90568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c034d9eba00/0xa246514327757f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327757ea expref: 16 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340938.548159:0:90568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c034d9eba00, rc 0) 00000100:00100000:0.0:1780340938.548210:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961257728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340938.548218:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1780340938.552239:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961257728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340938.552264:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c03476f9000/0xa246514327757ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327757f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340938.552277:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c03476f9000/0xa246514327757ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327757f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340938.552369:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961257856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340938.552426:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340938.552483:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471e66780 going to sleep for 11 seconds 00000100:00100000:2.0:1780340938.552545:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961257856 00000100:00100000:2.0:1780340938.552563:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961257856 00000100:00100000:2.0:1780340938.552616:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1780340938.552625:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961257856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340938.552740:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961257856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340938.552747:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1780340938.554163:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961257856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340938.554211:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961257984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340938.554264:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340938.554304:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471e66780 going to sleep for 11 seconds 00000100:00100000:1.0:1780340938.554614:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961257984 00000100:00100000:1.0:1780340938.554621:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961257984 00000100:00100000:1.0:1780340938.554679:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1780340938.554687:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961257984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340938.554825:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961257984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340938.554832:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1780340938.555287:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961257984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340938.557860:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340938.558248:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940487808 00000100:00100000:3.0:1780340938.558258:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940487808 00000100:00100000:3.0:1780340938.558302:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 141 00000100:00100000:3.0:1780340938.558313:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+8:72650:x1866818940487808:12345-192.168.203.16@tcp:502:llog_process_th.0 00000100:00100000:3.0:1780340938.558485:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+8:72650:x1866818940487808:12345-192.168.203.16@tcp:502:llog_process_th.0 Request processed in 174us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340938.558499:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 141 00000100:00100000:0.0:1780340938.574578:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340938.575319:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940487936 00000100:00100000:1.0:1780340938.575338:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940487936 00000100:00100000:1.0:1780340938.575403:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 142 00000100:00100000:1.0:1780340938.575413:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940487936:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340938.575437:0:90568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340938.575456:0:90568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453122200/0xa246514327757f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2670 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.575498:0:90568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453122200/0xa246514327757f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2670 expref: 9 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.575507:0:90568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453122200/0xa246514327757f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2670 expref: 9 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.575515:0:90568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122200, rc 0) 00000100:00100000:1.0:1780340938.575575:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940487936:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 163us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340938.575581:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 142 00000100:00100000:0.0:1780340938.583974:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340938.584293:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940488064 00000100:00100000:3.0:1780340938.584303:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940488064 00000100:00100000:3.0:1780340938.584369:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 143 00000100:00100000:3.0:1780340938.584380:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940488064:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340938.584506:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940488064:12345-192.168.203.16@tcp:501:ll_cfg_requeue.0 Request processed in 128us (539us total) trans 0 rc -2/-2 00000100:00100000:3.0:1780340938.584514:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 143 00000100:00100000:2.0:1780340938.595771:0:91488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91488:1866818961258112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340938.595855:0:91488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340938.595898:0:91488:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034abfec00 going to sleep for 11 seconds 00000100:00100000:1.0:1780340938.596583:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961258112 00000100:00100000:1.0:1780340938.596591:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961258112 00000100:00100000:1.0:1780340938.596640:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1780340938.596648:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:91488:x1866818961258112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340938.596796:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:91488:x1866818961258112:12345-0@lo:502:llog_process_th.0 Request processed in 148us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340938.596803:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1780340938.598839:0:91488:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91488:1866818961258112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780340938.598883:0:91488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340938.598896:0:91488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340938.598899:0:91488:0:(obd_config.c:1561:class_process_config()) marker 51 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:2.0:1780340938.598904:0:91488:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1780340938.599575:0:91488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91488:1866818961258240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340938.599638:0:91488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340938.601129:0:91488:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034abfe840 going to sleep for 11 seconds 00000100:00100000:3.0:1780340938.612950:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961258240 00000100:00100000:3.0:1780340938.612964:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961258240 00000100:00100000:1.0:1780340938.613107:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1780340938.613118:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:91488:x1866818961258240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340938.613289:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:91488:x1866818961258240:12345-0@lo:502:llog_process_th.0 Request processed in 172us (13650us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340938.613296:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1780340938.613393:0:91488:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91488:1866818961258240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1780340938.613427:0:91488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340938.613445:0:91488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340938.613447:0:91488:0:(obd_config.c:1561:class_process_config()) marker 51 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:2.0:1780340938.613452:0:91488:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:1.0:1780340938.613783:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 56-58 (rc=0) 10000000:01000000:1.0:1780340938.613807:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1780340938.613816:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f9000/0xa246514327757ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327757f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.613834:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c03476f9000/0xa246514327757ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327757f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340938.613843:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1780340938.613846:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c045f0c4800 from 61 10000000:01000000:1.0:1780340938.613849:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780340938.613874:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa246514327757ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.613882:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa246514327757ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.613889:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa246514327757ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340938.613909:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961258368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340938.613943:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340938.613974:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a865d80 going to sleep for 11 seconds 00000100:00100000:2.0:1780340938.614031:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961258368 00000100:00100000:2.0:1780340938.614036:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961258368 00000100:00100000:2.0:1780340938.614068:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1780340938.614075:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+16:6514:x1866818961258368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340938.614099:0:90568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340938.614111:0:90568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0470f2dc00/0xa24651432775806 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327757ff expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.614131:0:90568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0470f2dc00/0xa24651432775806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327757ff expref: 17 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.614141:0:90568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0470f2dc00/0xa24651432775806 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327757ff expref: 17 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.614150:0:90568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0470f2dc00, rc 0) 00000100:00100000:2.0:1780340938.614194:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961258368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340938.614200:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1780340938.614352:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961258368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340938.614363:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa246514327757ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775806 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.614372:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa246514327757ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775806 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340938.614417:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961258496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340938.614455:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340938.614489:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a865d80 going to sleep for 11 seconds 00000100:00100000:2.0:1780340938.614580:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961258496 00000100:00100000:2.0:1780340938.614584:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961258496 00000100:00100000:2.0:1780340938.614619:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1780340938.614626:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961258496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340938.614726:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961258496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340938.614733:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1780340938.614857:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961258496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340938.614886:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961258624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1780340938.614923:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340938.614944:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a8779c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340938.615113:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961258624 00000100:00100000:1.0:1780340938.615117:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961258624 00000100:00100000:1.0:1780340938.615151:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1780340938.615158:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961258624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340938.615235:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961258624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340938.615241:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1780340938.615278:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961258624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340938.616914:0:91489:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91489:1866818961258752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340938.616977:0:91489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340938.617009:0:91489:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047215b840 going to sleep for 11 seconds 00000100:00100000:2.0:1780340938.617298:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961258752 00000100:00100000:2.0:1780340938.617305:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961258752 00000100:00100000:2.0:1780340938.617352:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1780340938.617361:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:91489:x1866818961258752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340938.617473:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:91489:x1866818961258752:12345-0@lo:502:llog_process_th.0 Request processed in 114us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340938.617489:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1780340938.619705:0:91489:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91489:1866818961258752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340938.619830:0:91489:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91489:1866818961258880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340938.619908:0:91489:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340938.619942:0:91489:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445f68e40 going to sleep for 11 seconds 00000100:00100000:2.0:1780340938.621060:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961258880 00000100:00100000:2.0:1780340938.621069:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961258880 00000100:00100000:2.0:1780340938.621123:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1780340938.621132:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:91489:x1866818961258880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340938.621265:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:91489:x1866818961258880:12345-0@lo:502:llog_process_th.0 Request processed in 133us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340938.621272:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1780340938.622130:0:91489:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91489:1866818961258880:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1780340938.622165:0:91489:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:1.0:1780340938.622384:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:1.0:1780340938.622409:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1780340938.622419:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa246514327757ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775806 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.622440:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa246514327757ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775806 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340938.622449:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1780340938.622451:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 56 10000000:01000000:1.0:1780340938.622453:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1780340938.622493:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa2465143277580d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.622501:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa2465143277580d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.622510:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa2465143277580d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340938.622528:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961259008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340938.622569:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340938.622801:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961259008 00000100:00100000:2.0:1780340938.622807:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961259008 00000100:00100000:2.0:1780340938.622838:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1780340938.622847:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+17:6514:x1866818961259008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340938.622860:0:90568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340938.622872:0:90568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0470f2da00/0xa24651432775814 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277580d expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.622896:0:90568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0470f2da00/0xa24651432775814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277580d expref: 18 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.622905:0:90568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0470f2da00/0xa24651432775814 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277580d expref: 18 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.622915:0:90568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0470f2da00, rc 0) 00000100:00100000:2.0:1780340938.622943:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961259008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340938.622949:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1780340938.624543:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445f68e40 going to sleep for 11 seconds 00000100:00100000:1.0:1780340938.624575:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961259008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340938.624969:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa2465143277580d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775814 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.624982:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa2465143277580d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775814 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340938.625063:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961259136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340938.625123:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340938.625190:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445f68e40 going to sleep for 11 seconds 00000100:00100000:2.0:1780340938.626110:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961259136 00000100:00100000:2.0:1780340938.626131:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961259136 00000100:00100000:0.0:1780340938.626370:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1780340938.626381:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961259136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340938.626527:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961259136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340938.626534:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1780340938.626611:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961259136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340938.626649:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961259264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340938.626698:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340938.627124:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445f68e40 going to sleep for 11 seconds 00000100:00100000:3.0:1780340938.627240:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961259264 00000100:00100000:3.0:1780340938.627246:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961259264 00000100:00100000:3.0:1780340938.627287:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1780340938.627296:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961259264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340938.627380:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961259264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340938.627387:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1780340938.627533:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961259264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340938.628512:0:91490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91490:1866818961259392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340938.628562:0:91490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340938.628603:0:91490:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471e669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340938.628892:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961259392 00000100:00100000:0.0:1780340938.628898:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961259392 00000100:00100000:0.0:1780340938.628937:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1780340938.628957:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:91490:x1866818961259392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340938.629100:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:91490:x1866818961259392:12345-0@lo:502:llog_process_th.0 Request processed in 130us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340938.629107:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1780340938.629315:0:91490:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91490:1866818961259392:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780340938.629346:0:91490:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1780340938.629357:0:91490:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340938.629359:0:91490:0:(obd_config.c:1561:class_process_config()) marker 52 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:3.0:1780340938.629364:0:91490:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1780340938.629522:0:91490:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91490:1866818961259520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340938.629572:0:91490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340938.629741:0:91490:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471e663c0 going to sleep for 11 seconds 00000100:00100000:0.0:1780340938.631999:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961259520 00000100:00100000:0.0:1780340938.632013:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961259520 00000100:00100000:1.0:1780340938.632379:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1780340938.632389:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:91490:x1866818961259520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340938.632552:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:91490:x1866818961259520:12345-0@lo:502:llog_process_th.0 Request processed in 164us (2979us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340938.632559:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1780340938.632923:0:91490:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91490:1866818961259520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1780340938.632956:0:91490:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1780340938.632964:0:91490:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340938.632977:0:91490:0:(obd_config.c:1561:class_process_config()) marker 52 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:3.0:1780340938.632982:0:91490:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 59 count 58 00000020:01000000:1.0:1780340938.633337:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 56-58 (rc=0) 10000000:01000000:1.0:1780340938.633360:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1780340938.633370:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa2465143277580d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775814 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.633381:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa2465143277580d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775814 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340938.633390:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1780340938.633393:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c04773ad000 from 61 10000000:01000000:1.0:1780340938.633396:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1780340938.633423:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa2465143277581b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.633440:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa2465143277581b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.633449:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa2465143277581b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340938.633471:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961259648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340938.633510:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340938.633545:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445f68900 going to sleep for 11 seconds 00000100:00100000:2.0:1780340938.634203:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961259648 00000100:00100000:2.0:1780340938.634210:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961259648 00000100:00100000:2.0:1780340938.634241:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1780340938.634249:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+18:6514:x1866818961259648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340938.634261:0:90567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340938.634273:0:90567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0470f2c400/0xa24651432775822 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa2465143277581b expref: -99 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.634293:0:90567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0470f2c400/0xa24651432775822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa2465143277581b expref: 19 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.634302:0:90567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0470f2c400/0xa24651432775822 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277581b expref: 19 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.634310:0:90567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0470f2c400, rc 0) 00000100:00100000:2.0:1780340938.634367:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961259648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340938.634374:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1780340938.634485:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961259648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340938.634497:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa2465143277581b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775822 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340938.634506:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa2465143277581b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775822 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340938.634557:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961259776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340938.634581:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340938.634617:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471c42540 going to sleep for 11 seconds 00000100:00100000:2.0:1780340938.635404:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961259776 00000100:00100000:2.0:1780340938.635410:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961259776 00000100:00100000:2.0:1780340938.635457:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1780340938.635466:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961259776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340938.635571:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961259776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340938.635578:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1780340938.635732:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961259776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340938.635800:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961259904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340938.635842:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340938.635865:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471c42540 going to sleep for 11 seconds 00000100:00100000:3.0:1780340938.635878:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961259904 00000100:00100000:3.0:1780340938.635882:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961259904 00000100:00100000:3.0:1780340938.635905:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1780340938.635911:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961259904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340938.635995:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961259904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340938.636002:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1780340938.636059:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961259904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340938.638884:0:91491:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91491:1866818961260032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340938.638957:0:91491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340938.639096:0:91491:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471c42780 going to sleep for 11 seconds 00010000:00010000:3.0:1780340938.641273:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340938.643811:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961260032 00000100:00100000:2.0:1780340938.643825:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961260032 00000100:00100000:3.0:1780340938.643922:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1780340938.643933:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:91491:x1866818961260032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1780340938.644113:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346e22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:91491:x1866818961260032:12345-0@lo:502:llog_process_th.0 Request processed in 182us (5156us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340938.644120:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1780340938.644319:0:91491:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91491:1866818961260032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340938.644388:0:91491:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91491:1866818961260160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340938.644430:0:91491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340938.644463:0:91491:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0445f68900 going to sleep for 11 seconds 00000100:00100000:0.0:1780340938.644505:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961260160 00000100:00100000:0.0:1780340938.644509:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961260160 00000100:00100000:0.0:1780340938.644540:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1780340938.644547:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:91491:x1866818961260160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1780340938.644623:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:91491:x1866818961260160:12345-0@lo:502:llog_process_th.0 Request processed in 76us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340938.644628:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1780340938.645483:0:91491:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91491:1866818961260160:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1780340938.645509:0:91491:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:1.0:1780340938.645707:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:1.0:1780340938.645726:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1780340938.645735:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa2465143277581b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775822 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.645746:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa2465143277581b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775822 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340938.645756:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1780340938.645781:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1780340938.645784:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1780340938.645808:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432775829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.645816:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432775829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.645825:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432775829 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340938.645839:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961260288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1780340938.645875:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340938.645894:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471c42780 going to sleep for 11 seconds 00000100:00100000:3.0:1780340938.646438:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961260288 00000100:00100000:3.0:1780340938.646445:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961260288 00000100:00100000:3.0:1780340938.646488:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1780340938.646496:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+19:6514:x1866818961260288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340938.646508:0:90570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340938.646520:0:90570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f9600/0xa24651432775830 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432775829 expref: -99 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340938.646542:0:90570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f9600/0xa24651432775830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775829 expref: 20 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340938.646566:0:90570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f9600/0xa24651432775830 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775829 expref: 20 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340938.646575:0:90570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9600, rc 0) 00000100:00100000:3.0:1780340938.646624:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961260288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340938.646631:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1780340938.646666:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961260288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340938.646677:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432775829 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775830 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340938.646684:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432775829 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775830 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340938.646731:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349863800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961260416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340938.646754:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340938.646788:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0447d1de40 going to sleep for 11 seconds 00000100:00100000:2.0:1780340938.647297:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961260416 00000100:00100000:2.0:1780340938.647309:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961260416 00000100:00100000:2.0:1780340938.647343:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1780340938.647350:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961260416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340938.647471:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961260416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340938.647479:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1780340938.647735:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349863800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961260416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340938.647806:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349863800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961260544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1780340938.647845:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340938.647870:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0447d1de40 going to sleep for 11 seconds 00000100:00100000:2.0:1780340938.648059:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961260544 00000100:00100000:2.0:1780340938.648064:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961260544 00000100:00100000:2.0:1780340938.648086:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1780340938.648110:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961260544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340938.648355:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961260544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340938.648361:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1780340938.648458:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349863800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961260544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1780340938.649468:0:91492:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1780340938.654265:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1780340938.654305:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1780340938.654315:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432775829 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775830 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340938.654327:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432775829 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa24651432775830 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340938.654339:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1780340938.654341:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c047b065000 from 61 10000000:01000000:0.0:1780340938.654345:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1780340938.654385:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c034d9eaa00/0xa24651432775837 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340938.654392:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c034d9eaa00/0xa24651432775837 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340938.654403:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c034d9eaa00/0xa24651432775837 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340938.654438:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961260672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340938.654498:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340938.654545:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a877a80 going to sleep for 11 seconds 00000100:00100000:1.0:1780340938.655118:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961260672 00000100:00100000:1.0:1780340938.655126:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961260672 00000100:00100000:1.0:1780340938.655192:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1780340938.655199:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:6514:x1866818961260672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340938.655211:0:90567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340938.655222:0:90567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0453123400/0xa2465143277583e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432775837 expref: -99 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.655241:0:90567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0453123400/0xa2465143277583e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775837 expref: 21 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.655250:0:90567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0453123400/0xa2465143277583e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775837 expref: 21 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.655257:0:90567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123400, rc 0) 00000100:00100000:1.0:1780340938.655303:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961260672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340938.655310:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1780340938.655382:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961260672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340938.655403:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c034d9eaa00/0xa24651432775837 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277583e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340938.655412:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c034d9eaa00/0xa24651432775837 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277583e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340938.655478:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349863800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961260800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1780340938.655503:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340938.655529:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0447d1d900 going to sleep for 11 seconds 00000100:00100000:1.0:1780340938.655718:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961260800 00000100:00100000:1.0:1780340938.655722:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961260800 00000100:00100000:1.0:1780340938.655749:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1780340938.655756:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961260800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340938.655893:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961260800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340938.655900:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1780340938.656424:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349863800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961260800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340938.656468:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961260928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340938.656510:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340938.656539:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034abfe600 going to sleep for 11 seconds 00000100:00100000:1.0:1780340938.656585:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961260928 00000100:00100000:1.0:1780340938.656589:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961260928 00000100:00100000:1.0:1780340938.656628:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1780340938.656636:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961260928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340938.656717:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961260928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340938.656728:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1780340938.656911:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961260928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1780340938.659920:0:91493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91493:1866818961261056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340938.660005:0:91493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340938.660050:0:91493:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034abfe6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340938.660157:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961261056 00000100:00100000:1.0:1780340938.660165:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961261056 00000100:00100000:1.0:1780340938.660220:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1780340938.660229:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:91493:x1866818961261056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340938.660342:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:91493:x1866818961261056:12345-0@lo:502:llog_process_th.0 Request processed in 114us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340938.660350:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1780340938.662198:0:91493:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91493:1866818961261056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340938.662269:0:91493:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91493:1866818961261184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1780340938.662326:0:91493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340938.662360:0:91493:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034abfe6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340938.662546:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961261184 00000100:00100000:1.0:1780340938.662553:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961261184 00000100:00100000:1.0:1780340938.662605:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1780340938.662613:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:91493:x1866818961261184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1780340938.662720:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:91493:x1866818961261184:12345-0@lo:502:llog_process_th.0 Request processed in 107us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340938.662727:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1780340938.662964:0:91493:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:91493:1866818961261184:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1780340938.663166:0:91493:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:0.0:1780340938.663809:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:0.0:1780340938.663835:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1780340938.663845:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c034d9eaa00/0xa24651432775837 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277583e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340938.663857:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c034d9eaa00/0xa24651432775837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277583e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340938.663867:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1780340938.663869:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1780340938.663872:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1780340938.663898:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea000/0xa24651432775845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340938.663906:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea000/0xa24651432775845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340938.663915:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea000/0xa24651432775845 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340938.663946:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961261312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1780340938.665419:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340938.665476:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a877000 going to sleep for 11 seconds 00000100:00100000:2.0:1780340938.666424:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961261312 00000100:00100000:2.0:1780340938.666445:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961261312 00000100:00100000:2.0:1780340938.666492:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1780340938.666501:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961261312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340938.666515:0:90570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340938.666534:0:90570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0470f2de00/0xa2465143277584c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432775845 expref: -99 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.666558:0:90570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0470f2de00/0xa2465143277584c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775845 expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.666569:0:90570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0470f2de00/0xa2465143277584c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775845 expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.666577:0:90570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0470f2de00, rc 0) 00000100:00100000:2.0:1780340938.666841:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961261312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 340us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340938.666849:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1780340938.668300:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961261312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1780340938.668323:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea000/0xa24651432775845 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277584c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340938.668334:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea000/0xa24651432775845 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277584c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340938.668414:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961261440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340938.668471:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340938.668505:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04453779c0 going to sleep for 11 seconds 00000100:00100000:2.0:1780340938.668575:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961261440 00000100:00100000:2.0:1780340938.668581:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961261440 00000100:00100000:2.0:1780340938.668628:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1780340938.668635:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961261440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340938.668900:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961261440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340938.668907:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1780340938.669519:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961261440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1780340938.669553:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961261568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340938.670350:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340938.670381:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04453779c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340938.670396:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961261568 00000100:00100000:1.0:1780340938.670401:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961261568 00000100:00100000:1.0:1780340938.671903:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1780340938.671917:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961261568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1780340938.672291:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961261568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 378us (2694us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340938.672299:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1780340938.672848:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961261568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1780340938.680418:0:91494:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1780340938.680667:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1780340938.680688:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1780340938.680699:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea000/0xa24651432775845 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277584c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.680711:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea000/0xa24651432775845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277584c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340938.680721:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1780340938.680723:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8c0471e119c0 from 1 10000000:01000000:2.0:1780340938.680726:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1780340938.680781:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0470f2ca00/0xa24651432775853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.680790:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0470f2ca00/0xa24651432775853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.680801:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0470f2ca00/0xa24651432775853 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340938.680825:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961261696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1780340938.680895:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340938.680932:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034abfe600 going to sleep for 11 seconds 00000100:00100000:0.0:1780340938.684979:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961261696 00000100:00100000:0.0:1780340938.684994:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961261696 00000100:00100000:0.0:1780340938.685063:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1780340938.685074:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961261696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1780340938.685119:0:90567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340938.685136:0:90567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c034d9ea600/0xa2465143277585a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432775853 expref: -99 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340938.685165:0:90567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c034d9ea600/0xa2465143277585a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432775853 expref: 23 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340938.685176:0:90567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c034d9ea600/0xa2465143277585a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775853 expref: 23 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340938.685185:0:90567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c034d9ea600, rc 0) 00000100:00100000:0.0:1780340938.685255:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961261696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (4359us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340938.685261:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1780340938.685404:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961261696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340938.685421:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0470f2ca00/0xa24651432775853 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277585a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.685431:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0470f2ca00/0xa24651432775853 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277585a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1780340938.685513:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961261824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1780340938.685545:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340938.685573:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034abfe600 going to sleep for 11 seconds 00000100:00100000:0.0:1780340938.686784:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961261824 00000100:00100000:0.0:1780340938.686794:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961261824 00000100:00100000:0.0:1780340938.686842:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1780340938.686852:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961261824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1780340938.686947:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961261824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (1401us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780340938.686954:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1780340938.687072:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961261824:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1780340938.687117:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1780340938.687125:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0470f2ca00/0xa24651432775853 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277585a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340938.687134:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0470f2ca00/0xa24651432775853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277585a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340939.661871:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340940.172602:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961261952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340940.172672:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340940.172787:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961261952 00000100:00100000:2.0:1780340940.172795:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961261952 00000100:00100000:2.0:1780340940.172865:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2164 00000100:00100000:2.0:1780340940.172875:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961261952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340940.172901:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340940.172944:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961261952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340940.172951:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2164 00000100:00100000:2.0:1780340940.173004:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349862680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961261952:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1780340940.173252:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340940.173615:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04497aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961262080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340940.173651:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340940.173730:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961262080 00000100:00100000:3.0:1780340940.173735:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961262080 00000100:00100000:3.0:1780340940.173805:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2165 00000100:00100000:3.0:1780340940.173812:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961262080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1780340940.173831:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780340940.173878:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961262080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340940.173885:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2165 00000100:00080000:0.0:1780340940.173981:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340940.174107:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04497aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961262080:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340940.682095:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961262208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340940.682164:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340940.682379:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961262208 00000100:00100000:2.0:1780340940.682387:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961262208 00000100:00100000:2.0:1780340940.682443:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3990 00000100:00100000:2.0:1780340940.682452:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961262208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340940.682502:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:2.0:1780340940.682556:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961262208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340940.682563:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3990 00000100:00100000:1.0:1780340940.683281:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961262208:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1780340940.683456:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340940.684877:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961262592:0@lo:400:kworker.0 00000100:00100000:1.0:1780340940.684935:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340940.684973:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961263104:0@lo:400:kworker.0 00000100:00100000:1.0:1780340940.684991:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340940.685007:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1780340940.685012:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818961262464:0@lo:400:kworker.0 00000100:00100000:1.0:1780340940.685028:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340940.685056:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961262976:0@lo:400:kworker.0 00000100:00100000:1.0:1780340940.685086:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340940.685100:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047aa68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1866818961263488:0@lo:400:kworker.0 00000100:00100000:1.0:1780340940.685119:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340940.685145:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961262592 00000100:00100000:1.0:1780340940.685151:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961262592 00000100:00100000:1.0:1780340940.685195:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961263104 00000100:00100000:1.0:1780340940.685197:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961263104 00000100:00100000:1.0:1780340940.685207:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961262464 00000100:00100000:1.0:1780340940.685209:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961262464 00000100:00100000:1.0:1780340940.685219:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961263488 00000100:00100000:1.0:1780340940.685221:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961263488 00000100:00100000:1.0:1780340940.685232:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:1.0:1780340940.685239:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961262592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.685356:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961262336:0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.685388:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340940.685409:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961262848:0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.685426:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340940.685434:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047aa69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961263360:0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.685449:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340940.685464:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1780340940.685469:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961262720:0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.685503:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340940.685512:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961263232:0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.685527:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340940.685548:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961263360 00000100:00100000:3.0:1780340940.685551:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961263360 00000100:00100000:3.0:1780340940.685575:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961263232 00000100:00100000:3.0:1780340940.685577:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961263232 00000100:00100000:3.0:1780340940.685593:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2658 00000100:00100000:3.0:1780340940.685598:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349863480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961263360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.685631:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349863480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961263360:12345-0@lo:400:kworker.0 Request processed in 33us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340940.685638:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2658 00000100:00100000:3.0:1780340940.685651:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659 00000100:00100000:3.0:1780340940.685656:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961263232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.685677:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349863800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961263232:12345-0@lo:400:kworker.0 Request processed in 21us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340940.685682:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659 00000100:00100000:3.0:1780340940.685718:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961263232:0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.685727:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047aa69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961263360:0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.685785:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961262848 00000100:00100000:3.0:1780340940.685788:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961262848 00000100:00100000:3.0:1780340940.685803:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961262720 00000100:00100000:3.0:1780340940.685805:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961262720 00000100:00100000:3.0:1780340940.685815:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:3.0:1780340940.685820:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961263104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.685848:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961263104:12345-0@lo:400:kworker.0 Request processed in 28us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340940.685859:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00100000:3.0:1780340940.685870:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:3.0:1780340940.685875:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1866818961262464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.685897:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a204380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1866818961262464:12345-0@lo:400:kworker.0 Request processed in 22us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340940.685902:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00100000:3.0:1780340940.685910:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:3.0:1780340940.685915:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1866818961263488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.685933:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1866818961263488:12345-0@lo:400:kworker.0 Request processed in 18us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340940.685938:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00100000:3.0:1780340940.685946:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:3.0:1780340940.685950:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961262848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.685970:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349860e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961262848:12345-0@lo:400:kworker.0 Request processed in 20us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340940.685975:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:3.0:1780340940.685983:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:3.0:1780340940.685988:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961262720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.686021:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349862680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961262720:12345-0@lo:400:kworker.0 Request processed in 33us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340940.686027:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00100000:3.0:1780340940.686040:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961262976 00000100:00100000:3.0:1780340940.686043:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961262976 00000100:00100000:3.0:1780340940.686061:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3991 00000100:00100000:3.0:1780340940.686065:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034a204e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1866818961262976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.686108:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034a204e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1866818961262976:12345-0@lo:400:kworker.0 Request processed in 42us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340940.686114:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3991 00000100:00100000:3.0:1780340940.686137:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b883b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961262720:0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.686145:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961262848:0@lo:400:kworker.0 00000100:00080000:3.0:1780340940.686172:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340940.686175:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1780340940.686177:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780340940.686179:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340940.686195:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818961262464:0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.686203:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961262976:0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.686211:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047aa68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1866818961263488:0@lo:400:kworker.0 00000100:00100000:3.0:1780340940.686218:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961263104:0@lo:400:kworker.0 00000100:00100000:0.0:1780340940.686632:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961262336 00000100:00100000:0.0:1780340940.686636:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961262336 00000100:00100000:0.0:1780340940.686673:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1780340940.686687:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a99e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961262336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340940.686728:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a99e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961262336:12345-0@lo:400:kworker.0 Request processed in 43us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340940.686734:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1780340940.686783:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b84d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961262336:0@lo:400:kworker.0 00000100:00100000:1.0:1780340940.686939:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961262592:12345-0@lo:400:kworker.0 Request processed in 1699us (2003us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340940.686946:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00100000:0.0:1780340940.689822:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961262592:0@lo:400:kworker.0 00000100:00100000:0.0:1780340941.194850:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340941.194871:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961263744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340941.194947:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340941.194996:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961263744 00000100:00100000:0.0:1780340941.195003:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961263744 00000100:00100000:0.0:1780340941.195045:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2166 00000100:00100000:0.0:1780340941.195054:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961263744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780340941.195087:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340941.195130:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961263744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340941.195137:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2166 00000100:00100000:0.0:1780340941.195178:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349861180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961263744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340941.195201:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047155e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961263616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340941.195226:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340941.195443:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961263616 00000100:00100000:3.0:1780340941.195447:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961263616 00000100:00100000:3.0:1780340941.195471:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2167 00000100:00100000:3.0:1780340941.195478:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961263616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1780340941.195489:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1780340941.195523:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961263616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340941.195528:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2167 00000100:00100000:3.0:1780340941.195558:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047155e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961263616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340941.195613:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780340941.195623:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961263872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340941.195663:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340941.195801:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961263872 00000100:00100000:3.0:1780340941.195816:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961263872 00000100:00100000:3.0:1780340941.195850:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3992 00000100:00100000:3.0:1780340941.195857:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961263872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340941.195880:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445203968 avail 1298964480 00000100:00100000:3.0:1780340941.195916:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961263872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340941.195922:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3992 00000100:00100000:3.0:1780340941.195949:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349863b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961263872:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1780340941.708081:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1780340942.004902:0:91591:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 135: Server failure in lock replay phase ========================================================== 15:09:00 (1780340940) 00000100:00100000:0.0:1780340942.196028:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.196166:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940488320 00000100:00100000:3.0:1780340942.196176:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940488320 00000100:00100000:3.0:1780340942.196244:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1455 00000100:00100000:3.0:1780340942.196254:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:72821:x1866818940488320:12345-192.168.203.16@tcp:36:mkdir.0 00010000:00010000:3.0:1780340942.196308:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340942.196334:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432775670 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2615 expref: 10 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.196353:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:3.0:1780340942.196359:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340942.196423:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775861 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.196436:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775861 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.196445:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775861 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.196459:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432775868 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.196480:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432775868 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.196487:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432775868 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.197175:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277586f lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.197186:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277586f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.197194:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277586f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340942.197209:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ed7870d7 reply state 0000000074c21b17 transno 120259084291 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277586f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.197218:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277586f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.197224:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:3.0:1780340942.197226:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340942.197229:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1780340942.197233:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1780340942.197240:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775861 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.197245:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775861 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.197250:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775861 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.197263:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775861 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.197269:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340942.197273:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775861 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.197280:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775861 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.197289:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:3.0:1780340942.197292:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340942.197295:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775861 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.197300:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775861 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340942.197310:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ed7870d7 reply state 0000000074c21b17 transno 120259084291 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432775868 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.197318:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432775868 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.197324:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff8c04506cff00) 00010000:00010000:3.0:1780340942.197327:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340942.197329:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1780340942.197431:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:72821:x1866818940488320:12345-192.168.203.16@tcp:36:mkdir.0 Request processed in 1177us (1412us total) trans 120259084291 rc 0/0 00000100:00100000:3.0:1780340942.197439:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1455 00000100:00080000:0.0:1780340942.197521:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340942.226985:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.227035:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940488448 00000100:00100000:0.0:1780340942.227045:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940488448 00000100:00100000:0.0:1780340942.227112:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1456 00000100:00100000:0.0:1780340942.227129:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:72824:x1866818940488448:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1780340942.227151:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340942.227171:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432775876 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2677 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.227236:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa2465143277587d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.227251:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa2465143277587d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.227262:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa2465143277587d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340942.227303:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780340942.227307:0:63712:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780340942.227327:0:63712:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa2465143277587d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.227351:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432775876 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2677 expref: 13 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.227370:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa2465143277587d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2677 expref: 12 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.227379:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:0.0:1780340942.227382:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780340942.227386:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c034d9eb200, rc 0) 00000100:00100000:0.0:1780340942.227460:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:72824:x1866818940488448:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 332us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340942.227478:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1456 00000100:00100000:1.0:1780340942.238402:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.238520:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940488704 00000100:00100000:3.0:1780340942.238530:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940488704 00000100:00100000:3.0:1780340942.238590:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1457 00000100:00100000:3.0:1780340942.238601:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:72824:x1866818940488704:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1780340942.238633:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340942.238637:0:63710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1780340942.238665:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa2465143277587d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2677 expref: 12 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.238684:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:3.0:1780340942.238694:0:63710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340942.238707:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775884 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced267e expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.240583:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa2465143277588b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.240605:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa2465143277588b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.240616:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa2465143277588b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.240638:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432775892 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.240646:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432775892 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.240652:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432775892 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.240733:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432775899 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.240741:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432775899 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.240747:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432775899 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340942.240756:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1780340942.242166:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432775899 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242175:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432775899 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242182:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432775899 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242187:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340942.242192:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432775899 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242200:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432775899 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242214:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:3.0:1780340942.242217:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340942.242222:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432775899 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242243:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432775899 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242261:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa2465143277588b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242268:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa2465143277588b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242273:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa2465143277588b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242280:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa2465143277588b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242284:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340942.242287:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa2465143277588b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242293:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa2465143277588b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242300:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:3.0:1780340942.242302:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340942.242305:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa2465143277588b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242311:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa2465143277588b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242319:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432775892 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242331:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432775892 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242336:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432775892 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242341:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340942.242344:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432775892 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242350:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432775892 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242358:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff8c04506cff00) 00010000:00010000:3.0:1780340942.242361:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340942.242364:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432775892 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242370:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432775892 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242419:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775884 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced267e expref: 12 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242430:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:3.0:1780340942.242432:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340942.242435:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775884 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced267e expref: 12 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.242444:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9200, rc 0) 00000100:00100000:3.0:1780340942.242517:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:72824:x1866818940488704:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 3917us (4132us total) trans 0 rc 301/301 00000100:00100000:3.0:1780340942.242526:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1457 00000100:00100000:0.0:1780340942.261586:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.263840:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940488832 00000100:00100000:3.0:1780340942.263855:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940488832 00000100:00100000:3.0:1780340942.263921:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1458 00000100:00100000:3.0:1780340942.263933:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:72824:x1866818940488832:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:3.0:1780340942.263952:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340942.263972:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327758a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2685 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.264037:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327758a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.264051:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327758a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.264073:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327758a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340942.264113:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1780340942.264117:0:63711:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780340942.264136:0:63711:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327758a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.264159:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327758a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2685 expref: 13 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.264175:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327758a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2685 expref: 12 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.264202:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:3.0:1780340942.264205:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1780340942.264208:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8c00, rc 0) 00000100:00100000:3.0:1780340942.264276:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:72824:x1866818940488832:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 345us (2699us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340942.264283:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1458 00000100:00100000:3.0:1780340942.271276:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.271350:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940489088 00000100:00100000:0.0:1780340942.271360:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940489088 00000100:00100000:0.0:1780340942.271416:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1459 00000100:00100000:0.0:1780340942.271426:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:72824:x1866818940489088:12345-192.168.203.16@tcp:101:lfs.0 00010000:00010000:0.0:1780340942.271456:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340942.271478:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa246514327758ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced268c expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.271550:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa246514327758b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.271566:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa246514327758b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.271578:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa246514327758b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.271589:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa246514327758bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.271596:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa246514327758bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.271602:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa246514327758bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340942.272128:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:0.0:1780340942.272212:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa246514327758b5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.272232:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa246514327758b5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.272238:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa246514327758b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.272244:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa246514327758b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.272249:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340942.272253:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa246514327758b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.272260:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa246514327758b5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.272272:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:0.0:1780340942.272275:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340942.272280:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa246514327758b5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.272286:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa246514327758b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.272300:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa246514327758bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.272306:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa246514327758bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.272312:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa246514327758bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.272324:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ebc00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340942.272327:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa246514327758bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.272333:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa246514327758bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.272341:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff8c04506cff00) 00010000:00010000:0.0:1780340942.272343:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340942.272346:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa246514327758bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.272352:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa246514327758bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.272390:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa246514327758ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced268c expref: 14 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.272400:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:0.0:1780340942.272403:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1780340942.272406:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa246514327758ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced268c expref: 14 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.272416:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c034d9eae00, rc 0) 00000100:00100000:0.0:1780340942.274879:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349863b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:72824:x1866818940489088:12345-192.168.203.16@tcp:101:lfs.0 Request processed in 3444us (3600us total) trans 120259084292 rc 301/301 00000100:00100000:0.0:1780340942.274891:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1459 00000100:00100000:2.0:1780340942.284238:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.284404:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940489344 00000100:00100000:0.0:1780340942.284428:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940489344 00000100:00100000:0.0:1780340942.284484:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1460 00000100:00100000:0.0:1780340942.284494:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:72824:x1866818940489344:12345-192.168.203.16@tcp:36:lfs.0 00010000:00010000:0.0:1780340942.284574:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa246514327758ca lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.284592:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa246514327758ca lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.284603:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa246514327758ca lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340942.284741:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d5d7d657 reply state 00000000b88be557 transno 120259084293 ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa246514327758ca lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.284755:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa246514327758ca lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.285046:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:0.0:1780340942.285050:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1780340942.285053:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1780340942.285070:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00000100:00100000:0.0:1780340942.285200:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+15:72824:x1866818940489344:12345-192.168.203.16@tcp:36:lfs.0 Request processed in 707us (971us total) trans 120259084293 rc 0/0 00000100:00100000:0.0:1780340942.285207:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1460 00000100:00100000:3.0:1780340942.296784:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.296917:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940489600 00000100:00100000:0.0:1780340942.296927:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940489600 00000100:00100000:0.0:1780340942.296993:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 246 00000100:00100000:0.0:1780340942.297004:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+15:72824:x1866818940489600:12345-192.168.203.16@tcp:35:lfs.0 00000100:00100000:0.0:1780340942.297210:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+16:72824:x1866818940489600:12345-192.168.203.16@tcp:35:lfs.0 Request processed in 208us (461us total) trans 120259084294 rc 0/0 00000100:00100000:0.0:1780340942.297230:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 246 00000100:00100000:2.0:1780340942.335335:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.335431:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940489728 00000100:00100000:3.0:1780340942.335441:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940489728 00000100:00100000:3.0:1780340942.335503:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1461 00000100:00100000:3.0:1780340942.335513:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+16:72831:x1866818940489728:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:3.0:1780340942.335538:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340942.335559:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327758d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2693 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.336756:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327758d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.337360:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327758d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.337372:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327758d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.337386:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.337411:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.337419:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.337488:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8200/0xa246514327758e6 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.337496:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8200/0xa246514327758e6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.337503:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8200/0xa246514327758e6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340942.337534:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00000004:00200000:3.0:1780340942.337537:0:63712:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780340942.338655:0:63712:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8200/0xa246514327758e6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.338677:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327758d8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.338685:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327758d8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.338691:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327758d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.339335:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327758d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.339357:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340942.339361:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327758d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.339369:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327758d8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.339384:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:3.0:1780340942.339386:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340942.339391:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327758d8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.339397:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa246514327758d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.339412:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.339419:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.339425:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.339430:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340942.339432:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.339438:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.339453:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff8c04506cff00) 00010000:00010000:3.0:1780340942.339456:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340942.339459:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.339464:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.339500:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327758d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2693 expref: 18 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.339512:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8200/0xa246514327758e6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2693 expref: 17 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.339519:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:3.0:1780340942.339521:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1780340942.339523:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8200, rc 0) 00000100:00100000:3.0:1780340942.340876:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+17:72831:x1866818940489728:12345-192.168.203.16@tcp:101:touch.0 Request processed in 5356us (5928us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340942.340887:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1461 00000100:00100000:0.0:1780340942.368346:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.368425:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940489984 00000100:00100000:3.0:1780340942.368435:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940489984 00000100:00100000:3.0:1780340942.368517:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1462 00000100:00100000:3.0:1780340942.368528:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04497adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+17:72831:x1866818940489984:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:3.0:1780340942.368546:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340942.368577:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8000/0xa246514327758ed lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced269a expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.368694:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327758f4 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.368709:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327758f4 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.368719:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327758f4 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.368732:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758fb lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.368739:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758fb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.368745:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758fb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1780340942.369315:0:70100:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x303:0x0], count =95 00000004:00080000:3.0:1780340942.369325:0:70100:0:(osp_object.c:1640:osp_create()) Writing gap [0x280000401:0x303:0x0]+95 in llog 00000004:00080000:3.0:1780340942.369348:0:70100:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x362:0x0], index 0: 0 00010000:00010000:3.0:1780340942.369637:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432775902 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.369649:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432775902 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.369657:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432775902 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.369689:0:70100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327758f4 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.369707:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327758f4 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.369713:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327758f4 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.369720:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327758f4 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.369726:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340942.369730:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327758f4 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.369737:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327758f4 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.369749:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:3.0:1780340942.369752:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340942.369756:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327758f4 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.369792:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa246514327758f4 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340942.369806:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002febc163 reply state 0000000022f165e1 transno 120259084295 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758fb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.369817:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758fb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.369822:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff8c04506cfa00) 00010000:00010000:3.0:1780340942.369829:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340942.369832:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1780340942.369864:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8000/0xa246514327758ed lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced269a expref: 20 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.369879:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432775902 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced269a expref: 19 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.369885:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff8c04506cf300) 00010000:00010000:3.0:1780340942.369887:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780340942.369889:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9c00, rc 0) 00000100:00100000:3.0:1780340942.369976:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04497adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+20:72831:x1866818940489984:12345-192.168.203.16@tcp:101:touch.0 Request processed in 1450us (1638us total) trans 120259084295 rc 0/0 00000100:00100000:3.0:1780340942.369984:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1462 00000100:00100000:3.0:1780340942.381881:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.381924:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.381966:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.381999:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340942.382139:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940490240 00000100:00100000:2.0:1780340942.382149:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940490240 00000100:00100000:2.0:1780340942.382211:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1479 00000100:00100000:2.0:1780340942.382222:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2410:x1866818940490240:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340942.382296:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2410:x1866818940490240:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 76us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340942.382304:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1479 00000100:00080000:2.0:1780340942.382327:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340942.382735:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940490112 00000100:00100000:1.0:1780340942.382740:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940490112 00000100:00100000:1.0:1780340942.382792:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 175 00000100:00100000:1.0:1780340942.382800:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a99dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2410:x1866818940490112:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340942.382833:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a99dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2410:x1866818940490112:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 34us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340942.382839:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 175 00000100:00100000:0.0:1780340942.383736:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940490496 00000100:00100000:0.0:1780340942.383746:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940490496 00000100:00100000:3.0:1780340942.385245:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940490368 00000100:00100000:3.0:1780340942.385259:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940490368 00000100:00100000:2.0:1780340942.387963:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5937 00000100:00100000:2.0:1780340942.387976:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2406:x1866818940490368:12345-192.168.203.16@tcp:9:kworker.0 00000020:00000080:2.0:1780340942.388005:0:25487:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432775677 00000100:00080000:0.0:1780340942.388147:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340942.388185:0:25487:0:(import.c:65:import_set_state_nolock()) ffff8c047b433000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1780340942.388239:0:25487:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969457 00010000:00010000:0.0:1780340942.388418:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340942.390086:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2660 00000100:00100000:1.0:1780340942.390102:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2410:x1866818940490496:12345-192.168.203.16@tcp:400:kworker.0 00000100:00080000:0.0:1780340942.390197:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1780340942.401556:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+2:2406:x1866818940490368:12345-192.168.203.16@tcp:9:kworker.0 Request processed in 13571us (19543us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340942.401579:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5937 00000100:00100000:2.0:1780340942.401688:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340942.402753:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940490752 00000100:00100000:2.0:1780340942.402785:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940490752 00000100:00100000:2.0:1780340942.402842:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1463 00000100:00100000:2.0:1780340942.402852:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+20:72831:x1866818940490752:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:2.0:1780340942.402905:0:63712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340942.402930:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432775902 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced269a expref: 20 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.403085:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff8c04506cf300) 00010000:00010000:2.0:1780340942.403097:0:63712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340942.403152:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa24651432775910 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.403167:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa24651432775910 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.403177:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa24651432775910 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340942.403276:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f2724a6f reply state 000000005200bd66 transno 120259084296 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa24651432775910 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.403288:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa24651432775910 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.403294:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff8c045312ea00) 00010000:00010000:2.0:1780340942.403296:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340942.403299:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340942.403386:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+21:72831:x1866818940490752:12345-192.168.203.16@tcp:36:touch.0 Request processed in 534us (1698us total) trans 120259084296 rc 0/0 00000100:00100000:1.0:1780340942.403517:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2410:x1866818940490496:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 13418us (21590us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340942.403526:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2660 00000100:00100000:2.0:1780340942.403725:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1463 00000100:00100000:2.0:1780340942.408122:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.408209:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940490880 00000100:00100000:3.0:1780340942.408219:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940490880 00000100:00100000:3.0:1780340942.408300:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1464 00000100:00100000:3.0:1780340942.408311:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+21:72831:x1866818940490880:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:3.0:1780340942.408333:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340942.408351:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8000/0xa24651432775917 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced26a1 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.408525:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8000/0xa24651432775917 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26a1 expref: 22 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.408539:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8000/0xa24651432775917 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26a1 expref: 22 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.408557:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff8c045312ea00) 00010000:00010000:3.0:1780340942.408560:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780340942.408565:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8000, rc 0) 00000100:00100000:3.0:1780340942.408637:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+22:72831:x1866818940490880:12345-192.168.203.16@tcp:101:touch.0 Request processed in 328us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340942.408643:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1464 00000100:00100000:2.0:1780340942.414463:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.414652:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940491008 00000100:00100000:3.0:1780340942.414661:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940491008 00000100:00100000:3.0:1780340942.414707:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5938 00000100:00100000:3.0:1780340942.414715:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2406:x1866818940491008:12345-192.168.203.16@tcp:8:touch.0 00010000:00080000:3.0:1780340942.414749:0:25492:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0000: connection from 7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp t0 exp 0000000000000000 cur 3722 last 0 00000020:00000080:3.0:1780340942.414802:0:25492:0:(genops.c:1406:class_connect()) connect: client 7d14eb83-fa7c-40d9-843e-6367bec0a7b4, cookie 0xa2465143277591e 00002000:00100000:3.0:1780340942.414814:0:25492:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7d14eb83-fa7c-40d9-843e-6367bec0a7b4/ffff8c0475709800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211351c ocd_grant: 8409088 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1780340942.414832:0:25492:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1780340942.414902:0:25492:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1780340942.414930:0:25492:0:(import.c:65:import_set_state_nolock()) ffff8c047570f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340942.415001:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2406:x1866818940491008:12345-192.168.203.16@tcp:8:touch.0 Request processed in 285us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340942.415034:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5938 00000100:00100000:3.0:1780340942.417629:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.418172:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940491136 00000100:00100000:1.0:1780340942.418184:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940491136 00000100:00100000:1.0:1780340942.418284:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5939 00000100:00100000:1.0:1780340942.418295:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:0:x1866818940491136:12345-192.168.203.16@tcp:2:touch.0 00000001:00080000:2.0:1780340942.420243:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969458 is committed 00000001:00100000:2.0:1780340942.420255:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000001:00100000:2.0:1780340942.420260:0:8395:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000020:00000080:2.0:1780340942.420263:0:8395:0:(genops.c:906:class_export_put()) final put ffff8c047b433800/7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00000020:00000080:3.0:1780340942.420341:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047b433800/7d14eb83-fa7c-40d9-843e-6367bec0a7b4 for lustre-OST0000 00000020:00000080:3.0:1780340942.420403:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047b433000 for lustre-OST0000 00000100:00100000:1.0:1780340942.420643:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:0:x1866818940491136:12345-192.168.203.16@tcp:2:touch.0 Request processed in 2344us (3015us total) trans 4294969458 rc 0/0 00000100:00100000:1.0:1780340942.420653:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5939 00000100:00100000:2.0:1780340942.423035:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.423198:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940491392 00000100:00100000:3.0:1780340942.423208:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940491392 00000100:00100000:3.0:1780340942.423261:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 247 00000100:00100000:3.0:1780340942.423271:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034af38050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+22:72831:x1866818940491392:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:3.0:1780340942.423539:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034af38050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+23:72831:x1866818940491392:12345-192.168.203.16@tcp:35:touch.0 Request processed in 269us (511us total) trans 120259084297 rc 0/0 00000100:00100000:3.0:1780340942.423547:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 247 00000100:00080000:0.0:1780340942.424969:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340942.429832:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.429915:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940491648 00000100:00100000:0.0:1780340942.429925:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940491648 00000100:00100000:0.0:1780340942.429992:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1465 00000100:00100000:0.0:1780340942.430002:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+23:72831:x1866818940491648:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:0.0:1780340942.430191:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340942.430212:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa24651432775925 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced26a8 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.430313:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa2465143277592c lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.430328:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa2465143277592c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.430339:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa2465143277592c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.430353:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa24651432775933 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.430360:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa24651432775933 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.430384:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa24651432775933 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780340942.431691:0:64454:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x363:0x0], index 0: 0 00010000:00010000:1.0:1780340942.431856:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa2465143277593a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.431870:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa2465143277593a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.431878:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa2465143277593a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.431911:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa2465143277592c lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.431918:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa2465143277592c lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.431924:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa2465143277592c lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.432349:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa2465143277592c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.432360:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340942.432365:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa2465143277592c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.432374:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa2465143277592c lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.432386:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:1.0:1780340942.432475:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340942.432481:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa2465143277592c lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.432488:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa2465143277592c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340942.432503:0:64454:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f06696a8 reply state 00000000e94bb8c3 transno 120259084298 ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa24651432775933 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.432513:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa24651432775933 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.432520:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff8c045a897b00) 00010000:00010000:1.0:1780340942.432522:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340942.432525:0:64454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780340942.432626:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa24651432775925 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26a8 expref: 26 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.432644:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa2465143277593a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26a8 expref: 25 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.432659:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff8c0477219d00) 00010000:00010000:1.0:1780340942.432661:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780340942.432663:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122600, rc 0) 00000100:00100000:1.0:1780340942.432833:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+26:72831:x1866818940491648:12345-192.168.203.16@tcp:101:touch.0 Request processed in 2832us (3008us total) trans 120259084298 rc 0/0 00000100:00100000:1.0:1780340942.432842:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1465 00000100:00100000:1.0:1780340942.435992:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340942.436162:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940491904 00000100:00100000:2.0:1780340942.436172:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940491904 00000100:00100000:2.0:1780340942.436269:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1466 00000100:00100000:2.0:1780340942.436281:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+26:72831:x1866818940491904:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:2.0:1780340942.436337:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340942.436361:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa2465143277593a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26a8 expref: 26 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.436379:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff8c0477219d00) 00010000:00010000:2.0:1780340942.436399:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340942.436453:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa24651432775948 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.436466:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa24651432775948 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.436476:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa24651432775948 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340942.436599:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000094db3ad5 reply state 0000000095baab88 transno 120259084299 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa24651432775948 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.436611:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa24651432775948 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.436617:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff8c045312e900) 00010000:00010000:2.0:1780340942.436619:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340942.436622:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340942.436708:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:72831:x1866818940491904:12345-192.168.203.16@tcp:36:touch.0 Request processed in 429us (776us total) trans 120259084299 rc 0/0 00000100:00100000:2.0:1780340942.436715:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1466 00000100:00100000:3.0:1780340942.439587:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.439665:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940492032 00000100:00100000:1.0:1780340942.439674:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940492032 00000100:00100000:1.0:1780340942.439730:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1467 00000100:00100000:1.0:1780340942.439749:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:72831:x1866818940492032:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:1.0:1780340942.439807:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340942.439827:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa2465143277594f lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced26af expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.439878:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa2465143277594f lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26af expref: 28 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.439892:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122e00/0xa2465143277594f lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26af expref: 28 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.439909:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff8c045312e900) 00010000:00010000:1.0:1780340942.439913:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1780340942.439917:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122e00, rc 0) 00000100:00100000:1.0:1780340942.439983:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+28:72831:x1866818940492032:12345-192.168.203.16@tcp:101:touch.0 Request processed in 236us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340942.440004:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1467 00000100:00100000:3.0:1780340942.443752:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.443922:0:25497:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940492160 00000100:00100000:0.0:1780340942.443932:0:25497:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940492160 00000100:00100000:0.0:1780340942.443997:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5940 00000100:00100000:0.0:1780340942.444007:0:25497:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2408:x1866818940492160:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:0.0:1780340942.444218:0:25497:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2408:x1866818940492160:12345-192.168.203.16@tcp:2:touch.0 Request processed in 211us (473us total) trans 4294969459 rc 0/0 00000100:00100000:0.0:1780340942.444225:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5940 00000100:00100000:3.0:1780340942.447315:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.447422:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940492416 00000100:00100000:0.0:1780340942.447431:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940492416 00000100:00100000:0.0:1780340942.447523:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 248 00000100:00100000:0.0:1780340942.447535:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+28:72831:x1866818940492416:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:1.0:1780340942.448050:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+29:72831:x1866818940492416:12345-192.168.203.16@tcp:35:touch.0 Request processed in 515us (743us total) trans 120259084300 rc 0/0 00000100:00100000:1.0:1780340942.448067:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 248 00000100:00100000:3.0:1780340942.451436:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.451673:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940492672 00000100:00100000:1.0:1780340942.451683:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940492672 00000100:00100000:1.0:1780340942.451744:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1468 00000100:00100000:1.0:1780340942.451754:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+29:72831:x1866818940492672:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:1.0:1780340942.451812:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340942.451833:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432775956 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced26b6 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.451954:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa2465143277595d lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.451971:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa2465143277595d lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.451982:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa2465143277595d lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.451998:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432775964 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.452005:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432775964 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.452021:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432775964 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780340942.452341:0:64454:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x364:0x0], index 0: 0 00010000:00010000:1.0:1780340942.452486:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122000/0xa2465143277596b lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.452495:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122000/0xa2465143277596b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.452502:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122000/0xa2465143277596b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.452535:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa2465143277595d lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.452542:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa2465143277595d lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.452548:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa2465143277595d lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.452554:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa2465143277595d lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.452560:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340942.452564:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa2465143277595d lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.452570:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa2465143277595d lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.452582:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:1.0:1780340942.452585:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340942.452597:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa2465143277595d lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.452603:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa2465143277595d lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340942.452616:0:64454:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f61f3344 reply state 000000001cbc91d0 transno 120259084301 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432775964 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.452628:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432775964 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.452634:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff8c0477219b00) 00010000:00010000:1.0:1780340942.452636:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340942.452639:0:64454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780340942.452669:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432775956 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26b6 expref: 32 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.452683:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122000/0xa2465143277596b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26b6 expref: 31 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.452690:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff8c0477219400) 00010000:00010000:1.0:1780340942.452692:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780340942.452695:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122000, rc 0) 00000100:00100000:1.0:1780340942.452811:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349861180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+32:72831:x1866818940492672:12345-192.168.203.16@tcp:101:touch.0 Request processed in 1057us (1384us total) trans 120259084301 rc 0/0 00000100:00100000:1.0:1780340942.452820:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1468 00000100:00100000:2.0:1780340942.457330:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.462965:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940492928 00000100:00100000:0.0:1780340942.462980:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940492928 00000100:00100000:0.0:1780340942.463184:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1469 00000100:00100000:0.0:1780340942.463196:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+32:72831:x1866818940492928:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:0.0:1780340942.463257:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340942.463282:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122000/0xa2465143277596b lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26b6 expref: 32 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.463302:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff8c0477219400) 00010000:00010000:0.0:1780340942.463314:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780340942.463365:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa24651432775979 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.463405:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa24651432775979 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.463416:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa24651432775979 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340942.463523:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f48efc12 reply state 00000000ffbaddc8 transno 120259084302 ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa24651432775979 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.463534:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa24651432775979 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.463540:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff8c045a897d00) 00010000:00010000:0.0:1780340942.463542:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340942.463545:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780340942.463972:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+33:72831:x1866818940492928:12345-192.168.203.16@tcp:36:touch.0 Request processed in 777us (6651us total) trans 120259084302 rc 0/0 00000100:00100000:0.0:1780340942.463980:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1469 00000100:00100000:1.0:1780340942.468255:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340942.468327:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940493056 00000100:00100000:2.0:1780340942.468338:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940493056 00000100:00100000:2.0:1780340942.468396:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1470 00000100:00100000:2.0:1780340942.468407:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047ace6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+33:72831:x1866818940493056:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:2.0:1780340942.468431:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340942.468451:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2cc00/0xa24651432775980 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced26bd expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.468507:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2cc00/0xa24651432775980 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26bd expref: 34 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.468522:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2cc00/0xa24651432775980 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26bd expref: 34 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.468561:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff8c045a897d00) 00010000:00010000:2.0:1780340942.468564:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1780340942.468637:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0470f2cc00, rc 0) 00000100:00100000:2.0:1780340942.468698:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047ace6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+34:72831:x1866818940493056:12345-192.168.203.16@tcp:101:touch.0 Request processed in 292us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340942.468705:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1470 00000100:00100000:1.0:1780340942.471838:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.471973:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940493184 00000100:00100000:3.0:1780340942.471983:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940493184 00000100:00100000:3.0:1780340942.472163:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5941 00000100:00100000:3.0:1780340942.472175:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04776c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2408:x1866818940493184:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:3.0:1780340942.472391:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04776c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940493184:12345-192.168.203.16@tcp:2:touch.0 Request processed in 219us (560us total) trans 4294969460 rc 0/0 00000100:00100000:3.0:1780340942.472399:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5941 00000100:00100000:3.0:1780340942.475703:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340942.475811:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940493440 00000100:00100000:2.0:1780340942.475821:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940493440 00000100:00100000:2.0:1780340942.475871:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 249 00000100:00100000:2.0:1780340942.475880:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+34:72831:x1866818940493440:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:2.0:1780340942.476321:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+35:72831:x1866818940493440:12345-192.168.203.16@tcp:35:touch.0 Request processed in 441us (627us total) trans 120259084303 rc 0/0 00000100:00100000:2.0:1780340942.476330:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 249 00000100:00100000:1.0:1780340942.479996:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.480168:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940493696 00000100:00100000:0.0:1780340942.480178:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940493696 00000100:00100000:0.0:1780340942.480232:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1471 00000100:00100000:0.0:1780340942.480243:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+35:72831:x1866818940493696:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:0.0:1780340942.480265:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340942.480284:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775987 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced26c4 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.480386:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa2465143277598e lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.480411:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa2465143277598e lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.480421:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa2465143277598e lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.480436:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432775995 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.480442:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432775995 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.480448:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432775995 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780340942.480741:0:63710:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x365:0x0], index 0: 0 00010000:00010000:0.0:1780340942.480911:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa2465143277599c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.480921:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa2465143277599c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.480928:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa2465143277599c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.480958:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa2465143277598e lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.480965:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa2465143277598e lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.480970:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa2465143277598e lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.480983:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa2465143277598e lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.480990:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ebc00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340942.480994:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa2465143277598e lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.481002:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa2465143277598e lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.481026:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:0.0:1780340942.481029:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340942.481034:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa2465143277598e lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.481040:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa2465143277598e lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340942.481055:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005d2f4cda reply state 000000000f5c11a3 transno 120259084304 ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432775995 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.481074:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432775995 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.481081:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff8c045a897400) 00010000:00010000:0.0:1780340942.481083:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340942.481085:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1780340942.481114:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775987 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26c4 expref: 38 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.481128:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa2465143277599c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26c4 expref: 37 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.481142:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff8c045a897900) 00010000:00010000:0.0:1780340942.481144:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780340942.481147:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c034d9eb200, rc 0) 00000100:00100000:0.0:1780340942.481213:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a845500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+38:72831:x1866818940493696:12345-192.168.203.16@tcp:101:touch.0 Request processed in 972us (1226us total) trans 120259084304 rc 0/0 00000100:00100000:0.0:1780340942.481221:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1471 00000100:00100000:1.0:1780340942.485559:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.485652:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940493952 00000100:00100000:0.0:1780340942.485662:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940493952 00000100:00100000:0.0:1780340942.485718:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1472 00000100:00100000:0.0:1780340942.485728:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+38:72831:x1866818940493952:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:0.0:1780340942.485819:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340942.485846:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa2465143277599c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26c4 expref: 38 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.485866:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff8c045a897900) 00010000:00010000:0.0:1780340942.485877:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780340942.485928:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327759aa lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.486233:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327759aa lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.486245:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327759aa lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340942.486410:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d08bc085 reply state 000000006bcf213d transno 120259084305 ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327759aa lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.486423:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327759aa lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.486429:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff8c0455c3b300) 00010000:00010000:1.0:1780340942.486432:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340942.486434:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780340942.486559:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a845180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+39:72831:x1866818940493952:12345-192.168.203.16@tcp:36:touch.0 Request processed in 831us (1007us total) trans 120259084305 rc 0/0 00000100:00100000:1.0:1780340942.486567:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1472 00000100:00100000:3.0:1780340942.489561:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.489633:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940494080 00000100:00100000:1.0:1780340942.489644:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940494080 00000100:00100000:1.0:1780340942.489700:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1473 00000100:00100000:1.0:1780340942.489711:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+39:72831:x1866818940494080:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:1.0:1780340942.489734:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340942.489755:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122000/0xa246514327759b1 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced26cb expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.489835:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122000/0xa246514327759b1 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26cb expref: 40 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.489850:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122000/0xa246514327759b1 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26cb expref: 40 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.489870:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff8c0455c3b300) 00010000:00010000:1.0:1780340942.489874:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1780340942.489890:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122000, rc 0) 00000100:00100000:1.0:1780340942.490362:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349862d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+40:72831:x1866818940494080:12345-192.168.203.16@tcp:101:touch.0 Request processed in 651us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340942.490369:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1473 00000100:00100000:3.0:1780340942.493519:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340942.493735:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940494208 00000100:00100000:2.0:1780340942.493746:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940494208 00000100:00100000:2.0:1780340942.493827:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5942 00000100:00100000:2.0:1780340942.493837:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349863480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940494208:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:2.0:1780340942.494075:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349863480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2407:x1866818940494208:12345-192.168.203.16@tcp:2:touch.0 Request processed in 239us (565us total) trans 4294969461 rc 0/0 00000100:00100000:2.0:1780340942.494083:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5942 00000100:00100000:0.0:1780340942.499460:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.499529:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940494464 00000100:00100000:1.0:1780340942.499541:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940494464 00000100:00100000:1.0:1780340942.499604:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 250 00000100:00100000:1.0:1780340942.499615:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+40:72831:x1866818940494464:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:1.0:1780340942.499908:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+41:72831:x1866818940494464:12345-192.168.203.16@tcp:35:touch.0 Request processed in 294us (456us total) trans 120259084306 rc 0/0 00000100:00100000:1.0:1780340942.499918:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 250 00000100:00100000:3.0:1780340942.503159:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.503315:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940494720 00000100:00100000:1.0:1780340942.503326:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940494720 00000100:00100000:1.0:1780340942.503393:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1474 00000100:00100000:1.0:1780340942.503404:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+41:72831:x1866818940494720:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:1.0:1780340942.503428:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340942.503446:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa246514327759b8 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced26d2 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.503546:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa246514327759bf lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.503561:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa246514327759bf lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.503585:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa246514327759bf lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.503603:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa246514327759c6 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.503623:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa246514327759c6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.503631:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa246514327759c6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780340942.507412:0:70100:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x366:0x0], index 0: 0 00010000:00010000:1.0:1780340942.507724:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa246514327759cd lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.507742:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa246514327759cd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.507753:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa246514327759cd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.507808:0:70100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa246514327759bf lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.507815:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa246514327759bf lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.507821:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa246514327759bf lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.507826:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa246514327759bf lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.507831:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340942.507835:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa246514327759bf lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.507857:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa246514327759bf lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.507871:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:1.0:1780340942.507874:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340942.507879:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa246514327759bf lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.507885:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa246514327759bf lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340942.507898:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ccdd86ce reply state 000000003544ae81 transno 120259084307 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa246514327759c6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.507908:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa246514327759c6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.507914:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff8c0477219200) 00010000:00010000:1.0:1780340942.507917:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340942.507920:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780340942.507973:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa246514327759b8 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26d2 expref: 44 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.507987:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa246514327759cd lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26d2 expref: 43 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.507994:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff8c0477219e00) 00010000:00010000:1.0:1780340942.507996:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780340942.507999:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0486366400, rc 0) 00000100:00100000:1.0:1780340942.508791:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349863800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+44:72831:x1866818940494720:12345-192.168.203.16@tcp:101:touch.0 Request processed in 5165us (5417us total) trans 120259084307 rc 0/0 00000100:00100000:1.0:1780340942.508800:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1474 00000100:00100000:3.0:1780340942.512177:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.512313:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940494976 00000100:00100000:1.0:1780340942.512322:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940494976 00000100:00100000:1.0:1780340942.512375:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1475 00000100:00100000:1.0:1780340942.512386:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046fd69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+44:72831:x1866818940494976:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:1.0:1780340942.512454:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340942.512482:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa246514327759cd lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26d2 expref: 44 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.512501:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff8c0477219e00) 00010000:00010000:1.0:1780340942.512511:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780340942.512558:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366c00/0xa246514327759db lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.512581:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366c00/0xa246514327759db lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.512591:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366c00/0xa246514327759db lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340942.512688:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007c77fd71 reply state 0000000023dd8fff transno 120259084308 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366c00/0xa246514327759db lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.512700:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366c00/0xa246514327759db lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.512705:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff8c0477219300) 00010000:00010000:1.0:1780340942.512708:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340942.512723:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780340942.512836:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046fd69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+45:72831:x1866818940494976:12345-192.168.203.16@tcp:36:touch.0 Request processed in 450us (666us total) trans 120259084308 rc 0/0 00000100:00100000:1.0:1780340942.512843:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1475 00000100:00100000:0.0:1780340942.517482:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.517788:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940495104 00000100:00100000:1.0:1780340942.517798:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940495104 00000100:00100000:1.0:1780340942.517857:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1476 00000100:00100000:1.0:1780340942.517867:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+45:72831:x1866818940495104:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:1.0:1780340942.517892:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340942.517910:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367600/0xa246514327759e2 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced26d9 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.517977:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367600/0xa246514327759e2 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26d9 expref: 46 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.517993:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367600/0xa246514327759e2 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26d9 expref: 46 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.518021:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff8c0477219300) 00010000:00010000:1.0:1780340942.518024:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1780340942.518028:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0486367600, rc 0) 00000100:00100000:1.0:1780340942.518103:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+46:72831:x1866818940495104:12345-192.168.203.16@tcp:101:touch.0 Request processed in 238us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340942.518111:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1476 00000100:00100000:3.0:1780340942.522330:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.522444:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940495232 00000100:00100000:0.0:1780340942.522456:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940495232 00000100:00100000:0.0:1780340942.522508:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5943 00000100:00100000:0.0:1780340942.522518:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2408:x1866818940495232:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:0.0:1780340942.522852:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2408:x1866818940495232:12345-192.168.203.16@tcp:2:touch.0 Request processed in 335us (532us total) trans 4294969462 rc 0/0 00000100:00100000:0.0:1780340942.522860:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5943 00000100:00100000:0.0:1780340942.526003:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.526147:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940495488 00000100:00100000:3.0:1780340942.526158:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940495488 00000100:00100000:3.0:1780340942.526205:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 251 00000100:00100000:3.0:1780340942.526213:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+46:72831:x1866818940495488:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:3.0:1780340942.526474:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+47:72831:x1866818940495488:12345-192.168.203.16@tcp:35:touch.0 Request processed in 261us (478us total) trans 120259084309 rc 0/0 00000100:00100000:3.0:1780340942.526482:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 251 00000100:00100000:3.0:1780340942.530809:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.531052:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940495744 00000100:00100000:1.0:1780340942.531071:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940495744 00000100:00100000:1.0:1780340942.531134:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1477 00000100:00100000:1.0:1780340942.531144:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03476f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+47:72831:x1866818940495744:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:1.0:1780340942.531184:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340942.531203:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa246514327759e9 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced26e0 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.531301:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa246514327759f0 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.531317:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa246514327759f0 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.531327:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa246514327759f0 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.531341:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa246514327759f7 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.531348:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa246514327759f7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.531355:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa246514327759f7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780340942.531903:0:70100:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x367:0x0], index 0: 0 00010000:00010000:1.0:1780340942.532177:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa246514327759fe lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.532189:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa246514327759fe lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.532197:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa246514327759fe lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.532245:0:70100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa246514327759f0 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.532252:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa246514327759f0 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.532258:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa246514327759f0 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.532263:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa246514327759f0 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.532269:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486366a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340942.532273:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa246514327759f0 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.532279:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa246514327759f0 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.532291:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:1.0:1780340942.532294:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340942.532298:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa246514327759f0 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.532304:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa246514327759f0 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340942.532318:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009712acec reply state 000000006b6106b8 transno 120259084310 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa246514327759f7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.532328:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa246514327759f7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.532341:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff8c0477219e00) 00010000:00010000:1.0:1780340942.532343:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340942.532345:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780340942.532378:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa246514327759e9 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26e0 expref: 50 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.532711:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa246514327759fe lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26e0 expref: 49 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.532719:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff8c0477219f00) 00010000:00010000:1.0:1780340942.532722:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780340942.532724:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0486366200, rc 0) 00000100:00100000:1.0:1780340942.532837:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03476f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+50:72831:x1866818940495744:12345-192.168.203.16@tcp:101:touch.0 Request processed in 1694us (2899us total) trans 120259084310 rc 0/0 00000100:00100000:1.0:1780340942.532845:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1477 00000100:00100000:0.0:1780340942.541828:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.542224:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940496000 00000100:00100000:3.0:1780340942.542234:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940496000 00000100:00100000:3.0:1780340942.542293:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1478 00000100:00100000:3.0:1780340942.542303:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+50:72831:x1866818940496000:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:3.0:1780340942.542357:0:63710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340942.542382:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa246514327759fe lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26e0 expref: 50 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.542401:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff8c0477219f00) 00010000:00010000:3.0:1780340942.542411:0:63710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340942.542468:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775a0c lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.542481:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775a0c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.542490:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775a0c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340942.542670:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dc6f63eb reply state 00000000d73f6e26 transno 120259084311 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775a0c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.542683:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775a0c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.542690:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff8c04506cfd00) 00010000:00010000:3.0:1780340942.542692:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340942.542695:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780340942.542829:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349957b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+51:72831:x1866818940496000:12345-192.168.203.16@tcp:36:touch.0 Request processed in 527us (1008us total) trans 120259084311 rc 0/0 00000100:00100000:3.0:1780340942.542837:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1478 00000100:00100000:0.0:1780340942.552340:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.552413:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940496128 00000100:00100000:3.0:1780340942.552423:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940496128 00000100:00100000:3.0:1780340942.552484:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1479 00000100:00100000:3.0:1780340942.552494:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+51:72831:x1866818940496128:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:3.0:1780340942.552519:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340942.552539:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8600/0xa24651432775a13 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced26e7 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.552608:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8600/0xa24651432775a13 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26e7 expref: 52 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.552625:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8600/0xa24651432775a13 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26e7 expref: 52 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.552644:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff8c04506cfd00) 00010000:00010000:3.0:1780340942.552661:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780340942.552665:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8600, rc 0) 00000100:00100000:3.0:1780340942.552727:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349954a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+52:72831:x1866818940496128:12345-192.168.203.16@tcp:101:touch.0 Request processed in 234us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340942.552734:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1479 00000100:00100000:0.0:1780340942.557314:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.557448:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940496256 00000100:00100000:3.0:1780340942.557458:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940496256 00000100:00100000:3.0:1780340942.557519:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5944 00000100:00100000:3.0:1780340942.557529:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2407:x1866818940496256:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:3.0:1780340942.557957:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349955c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2407:x1866818940496256:12345-192.168.203.16@tcp:2:touch.0 Request processed in 428us (652us total) trans 4294969463 rc 0/0 00000100:00100000:3.0:1780340942.557966:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5944 00000100:00100000:0.0:1780340942.561107:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340942.561216:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940496512 00000100:00100000:2.0:1780340942.561226:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940496512 00000100:00100000:2.0:1780340942.561318:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 252 00000100:00100000:2.0:1780340942.561329:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+52:72831:x1866818940496512:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:2.0:1780340942.561732:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349957100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+53:72831:x1866818940496512:12345-192.168.203.16@tcp:35:touch.0 Request processed in 404us (633us total) trans 120259084312 rc 0/0 00000100:00100000:2.0:1780340942.561740:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 252 00000100:00100000:0.0:1780340942.565233:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.565312:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940496768 00000100:00100000:1.0:1780340942.565321:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940496768 00000100:00100000:1.0:1780340942.565378:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1480 00000100:00100000:1.0:1780340942.565388:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+53:72831:x1866818940496768:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:1.0:1780340942.565421:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340942.565441:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775a1a lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced26ee expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.565540:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775a21 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.565554:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775a21 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.565589:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775a21 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.565605:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa24651432775a28 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.565613:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa24651432775a28 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.565620:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa24651432775a28 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780340942.565960:0:70100:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x368:0x0], index 0: 0 00010000:00010000:1.0:1780340942.566537:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775a2f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.566549:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775a2f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.566557:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775a2f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.566790:0:70100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775a21 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.566799:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775a21 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.566805:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775a21 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.566812:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775a21 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.566828:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486366a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340942.566832:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775a21 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.566840:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775a21 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.566852:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:1.0:1780340942.566855:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340942.566860:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775a21 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.566867:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775a21 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340942.566880:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002730f160 reply state 000000002f604438 transno 120259084313 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa24651432775a28 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.566891:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa24651432775a28 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.566897:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff8c0477219100) 00010000:00010000:1.0:1780340942.566900:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340942.566902:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780340942.566934:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775a1a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26ee expref: 56 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.566950:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775a2f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26ee expref: 55 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.566969:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff8c0477219000) 00010000:00010000:1.0:1780340942.566971:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780340942.566974:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0486367000, rc 0) 00000100:00100000:1.0:1780340942.567215:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349955500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+56:72831:x1866818940496768:12345-192.168.203.16@tcp:101:touch.0 Request processed in 1827us (1990us total) trans 120259084313 rc 0/0 00000100:00100000:1.0:1780340942.567224:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1480 00000100:00100000:0.0:1780340942.572885:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.573108:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940497024 00000100:00100000:1.0:1780340942.573119:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940497024 00000100:00100000:1.0:1780340942.573209:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1481 00000100:00100000:1.0:1780340942.573220:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+56:72831:x1866818940497024:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:1.0:1780340942.573290:0:64454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340942.573321:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775a2f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26ee expref: 56 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.573340:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff8c0477219000) 00010000:00010000:1.0:1780340942.573351:0:64454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780340942.573466:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775a3d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.573479:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775a3d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.573489:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775a3d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340942.573692:0:64454:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006dbe2889 reply state 000000008d30765b transno 120259084314 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775a3d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.573716:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775a3d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.573723:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff8c0477219700) 00010000:00010000:1.0:1780340942.573726:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340942.573728:0:64454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780340942.573890:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349955180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+57:72831:x1866818940497024:12345-192.168.203.16@tcp:36:touch.0 Request processed in 670us (1012us total) trans 120259084314 rc 0/0 00000100:00100000:1.0:1780340942.573898:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1481 00000100:00100000:0.0:1780340942.576697:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340942.577284:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940497152 00000100:00100000:2.0:1780340942.577295:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940497152 00000100:00100000:2.0:1780340942.577402:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1482 00000100:00100000:2.0:1780340942.577413:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+57:72831:x1866818940497152:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:2.0:1780340942.577438:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340942.577456:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2ce00/0xa24651432775a44 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced26f5 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.577509:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2ce00/0xa24651432775a44 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26f5 expref: 58 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.577522:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2ce00/0xa24651432775a44 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26f5 expref: 58 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.577540:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff8c0477219700) 00010000:00010000:2.0:1780340942.577543:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1780340942.577546:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0470f2ce00, rc 0) 00000100:00100000:2.0:1780340942.577715:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349957800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+58:72831:x1866818940497152:12345-192.168.203.16@tcp:101:touch.0 Request processed in 303us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340942.577723:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1482 00000100:00100000:0.0:1780340942.581815:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.581946:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940497280 00000100:00100000:3.0:1780340942.581957:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940497280 00000100:00100000:3.0:1780340942.582024:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5945 00000100:00100000:3.0:1780340942.582034:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2407:x1866818940497280:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:3.0:1780340942.582233:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349954000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2407:x1866818940497280:12345-192.168.203.16@tcp:2:touch.0 Request processed in 200us (427us total) trans 4294969464 rc 0/0 00000100:00100000:3.0:1780340942.582241:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5945 00000100:00100000:0.0:1780340942.585519:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.585631:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940497536 00000100:00100000:1.0:1780340942.585642:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940497536 00000100:00100000:1.0:1780340942.585695:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 253 00000100:00100000:1.0:1780340942.585706:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034af3b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+58:72831:x1866818940497536:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:1.0:1780340942.586004:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034af3b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+59:72831:x1866818940497536:12345-192.168.203.16@tcp:35:touch.0 Request processed in 300us (495us total) trans 120259084315 rc 0/0 00000100:00100000:1.0:1780340942.586492:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 253 00000100:00100000:0.0:1780340942.590751:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.591048:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940497792 00000100:00100000:3.0:1780340942.591065:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940497792 00000100:00100000:3.0:1780340942.591124:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1483 00000100:00100000:3.0:1780340942.591135:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+59:72831:x1866818940497792:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:3.0:1780340942.591160:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340942.591180:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432775a4b lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced26fc expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.591294:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775a52 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.591310:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775a52 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.591320:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775a52 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.591334:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432775a59 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.591341:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432775a59 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.591348:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432775a59 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1780340942.591625:0:63710:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x369:0x0], index 0: 0 00010000:00010000:3.0:1780340942.591755:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa24651432775a60 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.591824:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa24651432775a60 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.591831:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa24651432775a60 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.591865:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775a52 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.591884:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775a52 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.591890:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775a52 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.591896:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775a52 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.591902:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340942.591907:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775a52 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.591915:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775a52 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.591926:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:3.0:1780340942.591929:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340942.591933:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775a52 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.591939:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775a52 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340942.591951:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bcb9ea36 reply state 00000000f47d58a6 transno 120259084316 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432775a59 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.591962:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432775a59 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.591968:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff8c04506cf800) 00010000:00010000:3.0:1780340942.591978:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340942.591982:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1780340942.592013:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432775a4b lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26fc expref: 62 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.592027:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa24651432775a60 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26fc expref: 61 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.592034:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff8c04506cfb00) 00010000:00010000:3.0:1780340942.592036:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780340942.592038:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9800, rc 0) 00000100:00100000:3.0:1780340942.592110:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349956a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+62:72831:x1866818940497792:12345-192.168.203.16@tcp:101:touch.0 Request processed in 977us (1369us total) trans 120259084316 rc 0/0 00000100:00100000:3.0:1780340942.592118:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1483 00000100:00100000:0.0:1780340942.604319:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.605193:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940498048 00000100:00100000:1.0:1780340942.605204:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940498048 00000100:00100000:1.0:1780340942.605296:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1484 00000100:00100000:1.0:1780340942.605307:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+62:72831:x1866818940498048:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:1.0:1780340942.605366:0:64454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340942.605393:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa24651432775a60 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced26fc expref: 62 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.605414:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff8c04506cfb00) 00010000:00010000:1.0:1780340942.605425:0:64454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780340942.605491:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775a6e lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.605506:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775a6e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.605517:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775a6e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340942.605627:0:64454:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005130856b reply state 0000000014a5daeb transno 120259084317 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775a6e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.605640:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775a6e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.605646:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff8c0477219000) 00010000:00010000:1.0:1780340942.605649:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340942.605652:0:64454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780340942.605805:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349954700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+63:72831:x1866818940498048:12345-192.168.203.16@tcp:36:touch.0 Request processed in 500us (1494us total) trans 120259084317 rc 0/0 00000100:00100000:1.0:1780340942.605813:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1484 00000100:00100000:1.0:1780340942.608563:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340942.608712:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940498176 00000100:00100000:2.0:1780340942.608723:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940498176 00000100:00100000:2.0:1780340942.608852:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1485 00000100:00100000:2.0:1780340942.608862:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+63:72831:x1866818940498176:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:2.0:1780340942.608896:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340942.608914:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c600/0xa24651432775a75 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2703 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.608976:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c600/0xa24651432775a75 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2703 expref: 64 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.608990:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c600/0xa24651432775a75 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2703 expref: 64 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.609220:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff8c0477219000) 00010000:00010000:2.0:1780340942.609224:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1780340942.609229:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0470f2c600, rc 0) 00000100:00100000:2.0:1780340942.609286:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a846300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+64:72831:x1866818940498176:12345-192.168.203.16@tcp:101:touch.0 Request processed in 424us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340942.609293:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1485 00000100:00100000:0.0:1780340942.617520:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.617602:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940498304 00000100:00100000:1.0:1780340942.617612:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940498304 00000100:00100000:1.0:1780340942.617674:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5946 00000100:00100000:1.0:1780340942.617685:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2409:x1866818940498304:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:1.0:1780340942.617913:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349956300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2409:x1866818940498304:12345-192.168.203.16@tcp:2:touch.0 Request processed in 229us (402us total) trans 4294969465 rc 0/0 00000100:00100000:1.0:1780340942.617922:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5946 00000100:00100000:1.0:1780340942.621447:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.621873:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940498560 00000100:00100000:0.0:1780340942.621883:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940498560 00000100:00100000:0.0:1780340942.621990:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 254 00000100:00100000:0.0:1780340942.622001:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+64:72831:x1866818940498560:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:0.0:1780340942.622744:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349860000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+65:72831:x1866818940498560:12345-192.168.203.16@tcp:35:touch.0 Request processed in 744us (1305us total) trans 120259084318 rc 0/0 00000100:00100000:0.0:1780340942.622753:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 254 00000100:00100000:1.0:1780340942.627752:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340942.627906:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940498816 00000100:00100000:2.0:1780340942.627917:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940498816 00000100:00100000:0.0:1780340942.628253:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1486 00000100:00100000:0.0:1780340942.628265:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+65:72831:x1866818940498816:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:0.0:1780340942.628290:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340942.628311:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa24651432775a7c lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced270a expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.628425:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775a83 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.628441:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775a83 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.628452:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775a83 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.628466:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa24651432775a8a lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.628473:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa24651432775a8a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.628479:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa24651432775a8a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780340942.628804:0:63712:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x36a:0x0], index 0: 0 00010000:00010000:0.0:1780340942.628933:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432775a91 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.629111:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432775a91 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.629119:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432775a91 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.629167:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775a83 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.629174:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775a83 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.629180:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775a83 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.629186:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775a83 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.629192:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340942.629196:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775a83 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.629203:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775a83 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.629215:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:0.0:1780340942.629218:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340942.629222:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775a83 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.629227:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775a83 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340942.629242:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000538ed3cc reply state 00000000475b649a transno 120259084319 ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa24651432775a8a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.629252:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa24651432775a8a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.629266:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff8c0455c3b000) 00010000:00010000:0.0:1780340942.629268:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340942.629271:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1780340942.629301:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa24651432775a7c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced270a expref: 68 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.629316:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432775a91 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced270a expref: 67 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.629323:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff8c0455c3b400) 00010000:00010000:0.0:1780340942.629325:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780340942.629328:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5a00, rc 0) 00000100:00100000:0.0:1780340942.629382:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b84f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+68:72831:x1866818940498816:12345-192.168.203.16@tcp:101:touch.0 Request processed in 1120us (1638us total) trans 120259084319 rc 0/0 00000100:00100000:0.0:1780340942.629390:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1486 00000100:00100000:1.0:1780340942.633367:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.633574:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940499072 00000100:00100000:0.0:1780340942.633585:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940499072 00000100:00100000:0.0:1780340942.633642:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1487 00000100:00100000:0.0:1780340942.633652:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+68:72831:x1866818940499072:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:0.0:1780340942.633734:0:63712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340942.633777:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432775a91 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced270a expref: 68 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.633797:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff8c0455c3b400) 00010000:00010000:0.0:1780340942.633808:0:63712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780340942.633854:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432775a9f lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.633874:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432775a9f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.633884:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432775a9f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340942.634170:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000010fbe189 reply state 00000000db9de0bc transno 120259084320 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432775a9f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.634182:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432775a9f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.634188:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff8c0455c3b700) 00010000:00010000:0.0:1780340942.634191:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340942.634194:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780340942.634280:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446f22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+69:72831:x1866818940499072:12345-192.168.203.16@tcp:36:touch.0 Request processed in 629us (922us total) trans 120259084320 rc 0/0 00000100:00100000:0.0:1780340942.634287:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1487 00000100:00100000:1.0:1780340942.637227:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.638160:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940499200 00000100:00100000:0.0:1780340942.638170:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940499200 00000100:00100000:0.0:1780340942.638231:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1488 00000100:00100000:0.0:1780340942.638241:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+69:72831:x1866818940499200:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:0.0:1780340942.638263:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340942.638283:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa24651432775aa6 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2711 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.638336:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa24651432775aa6 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2711 expref: 70 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.638370:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5200/0xa24651432775aa6 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2711 expref: 70 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.638400:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff8c0455c3b700) 00010000:00010000:0.0:1780340942.638404:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1780340942.638408:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5200, rc 0) 00000100:00100000:0.0:1780340942.638459:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+70:72831:x1866818940499200:12345-192.168.203.16@tcp:101:touch.0 Request processed in 220us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340942.638466:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1488 00000100:00100000:1.0:1780340942.642181:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340942.642297:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940499328 00000100:00100000:2.0:1780340942.642308:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940499328 00000100:00100000:2.0:1780340942.642360:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5947 00000100:00100000:2.0:1780340942.642370:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2407:x1866818940499328:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:2.0:1780340942.642610:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:2407:x1866818940499328:12345-192.168.203.16@tcp:2:touch.0 Request processed in 241us (438us total) trans 4294969466 rc 0/0 00000100:00100000:2.0:1780340942.642618:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5947 00000100:00100000:1.0:1780340942.651592:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.651666:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940499584 00000100:00100000:3.0:1780340942.651676:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940499584 00000100:00100000:3.0:1780340942.651731:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 255 00000100:00100000:3.0:1780340942.651741:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+70:72831:x1866818940499584:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:3.0:1780340942.652209:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+71:72831:x1866818940499584:12345-192.168.203.16@tcp:35:touch.0 Request processed in 467us (626us total) trans 120259084321 rc 0/0 00000100:00100000:3.0:1780340942.652217:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 255 00000100:00100000:0.0:1780340942.659270:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.659368:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940499840 00000100:00100000:3.0:1780340942.659378:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940499840 00000100:00100000:3.0:1780340942.659446:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1489 00000100:00100000:3.0:1780340942.659457:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+71:72831:x1866818940499840:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:3.0:1780340942.659481:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340942.659503:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432775aad lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2718 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.659644:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775ab4 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.659659:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775ab4 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.659669:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775ab4 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.659683:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432775abb lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.659689:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432775abb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.659696:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432775abb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780340942.661682:0:63712:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x36b:0x0], index 0: 0 00010000:00010000:0.0:1780340942.661851:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775ac2 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.661865:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775ac2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.661874:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775ac2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.661908:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775ab4 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.662037:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775ab4 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.662113:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775ab4 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.662131:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775ab4 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.662138:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340942.662142:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775ab4 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.662149:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775ab4 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.662161:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:0.0:1780340942.662165:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340942.662170:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775ab4 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.662176:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775ab4 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340942.662190:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003b11c3df reply state 0000000005c39452 transno 120259084322 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432775abb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.662200:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432775abb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.662206:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff8c04506cfb00) 00010000:00010000:0.0:1780340942.662209:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340942.662211:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1780340942.662246:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432775aad lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2718 expref: 74 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.662260:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775ac2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2718 expref: 73 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.662274:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff8c0455c3b400) 00010000:00010000:0.0:1780340942.662276:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780340942.662279:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5400, rc 0) 00000100:00100000:0.0:1780340942.662424:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349956d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+74:72831:x1866818940499840:12345-192.168.203.16@tcp:101:touch.0 Request processed in 2968us (3164us total) trans 120259084322 rc 0/0 00000100:00100000:0.0:1780340942.662432:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1489 00000100:00100000:0.0:1780340942.675321:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340942.675404:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940500096 00000100:00100000:2.0:1780340942.675415:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940500096 00000100:00100000:2.0:1780340942.675490:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1490 00000100:00100000:2.0:1780340942.675500:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+74:72831:x1866818940500096:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:2.0:1780340942.675557:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340942.675583:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775ac2 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2718 expref: 74 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.675600:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff8c0455c3b400) 00010000:00010000:2.0:1780340942.675612:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340942.675665:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa24651432775ad0 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.675679:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa24651432775ad0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.675687:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa24651432775ad0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340942.675829:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007bb337d2 reply state 0000000025feafd0 transno 120259084323 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa24651432775ad0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.675841:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa24651432775ad0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.675847:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff8c045312ed00) 00010000:00010000:2.0:1780340942.675849:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340942.675852:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340942.675927:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349956680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+75:72831:x1866818940500096:12345-192.168.203.16@tcp:36:touch.0 Request processed in 428us (615us total) trans 120259084323 rc 0/0 00000100:00100000:2.0:1780340942.675935:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1490 00000100:00100000:1.0:1780340942.679388:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.679658:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940500224 00000100:00100000:3.0:1780340942.679668:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940500224 00000100:00100000:3.0:1780340942.679726:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1491 00000100:00100000:3.0:1780340942.679749:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+75:72831:x1866818940500224:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:3.0:1780340942.679800:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340942.679820:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa24651432775ad7 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced271f expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.679874:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa24651432775ad7 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced271f expref: 76 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.679910:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9800/0xa24651432775ad7 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced271f expref: 76 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.680134:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff8c045312ed00) 00010000:00010000:3.0:1780340942.680138:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780340942.680142:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9800, rc 0) 00000100:00100000:3.0:1780340942.680202:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+76:72831:x1866818940500224:12345-192.168.203.16@tcp:101:touch.0 Request processed in 467us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340942.680210:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1491 00000100:00100000:0.0:1780340942.697225:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.697374:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940500352 00000100:00100000:3.0:1780340942.697385:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940500352 00000100:00100000:3.0:1780340942.697456:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5948 00000100:00100000:3.0:1780340942.697468:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:2410:x1866818940500352:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:3.0:1780340942.697695:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349957100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+14:2410:x1866818940500352:12345-192.168.203.16@tcp:2:touch.0 Request processed in 230us (479us total) trans 4294969467 rc 0/0 00000100:00100000:3.0:1780340942.697704:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5948 00000100:00100000:0.0:1780340942.700629:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340942.705251:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940500608 00000100:00100000:2.0:1780340942.705282:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940500608 00000100:00100000:2.0:1780340942.705351:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 256 00000100:00100000:2.0:1780340942.705362:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+76:72831:x1866818940500608:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:2.0:1780340942.705648:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+77:72831:x1866818940500608:12345-192.168.203.16@tcp:35:touch.0 Request processed in 287us (5027us total) trans 120259084324 rc 0/0 00000100:00100000:2.0:1780340942.705656:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 256 00000100:00100000:2.0:1780340942.712720:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.712804:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940500864 00000100:00100000:0.0:1780340942.712814:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940500864 00000100:00100000:0.0:1780340942.712874:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1492 00000100:00100000:0.0:1780340942.712884:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047155d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+77:72831:x1866818940500864:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:0.0:1780340942.712909:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340942.712942:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775ade lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2726 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713039:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775ae5 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713054:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775ae5 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713076:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775ae5 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713089:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432775aec lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713109:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432775aec lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713115:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432775aec lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780340942.713392:0:63712:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x36c:0x0], index 0: 0 00010000:00010000:0.0:1780340942.713520:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775af3 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713529:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775af3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713537:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775af3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713580:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775ae5 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713588:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775ae5 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713594:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775ae5 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713600:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775ae5 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713606:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340942.713610:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775ae5 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713627:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775ae5 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713639:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:0.0:1780340942.713642:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340942.713646:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775ae5 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713651:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775ae5 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340942.713666:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a4de0a87 reply state 000000008df3d6c9 transno 120259084325 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432775aec lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713675:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432775aec lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713681:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff8c0455c3b800) 00010000:00010000:0.0:1780340942.713684:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340942.713686:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1780340942.713714:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775ade lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2726 expref: 80 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713728:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775af3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2726 expref: 79 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.713735:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff8c0455c3bf00) 00010000:00010000:0.0:1780340942.713737:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780340942.713740:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4c00, rc 0) 00000100:00100000:0.0:1780340942.717069:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047155d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+80:72831:x1866818940500864:12345-192.168.203.16@tcp:101:touch.0 Request processed in 4166us (4337us total) trans 120259084325 rc 0/0 00000100:00100000:0.0:1780340942.717082:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1492 00000100:00100000:0.0:1780340942.726353:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.726596:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940501120 00000100:00100000:1.0:1780340942.726607:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940501120 00000100:00100000:1.0:1780340942.726667:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1493 00000100:00100000:1.0:1780340942.726677:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+80:72831:x1866818940501120:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:1.0:1780340942.726733:0:70100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340942.727102:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775af3 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2726 expref: 80 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.727122:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff8c0455c3bf00) 00010000:00010000:1.0:1780340942.727133:0:70100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780340942.727190:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775b01 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.727204:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775b01 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.727214:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775b01 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340942.727316:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e496a658 reply state 0000000045db11b4 transno 120259084326 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775b01 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.727327:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775b01 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.727346:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff8c0477219600) 00010000:00010000:1.0:1780340942.727349:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340942.727352:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780340942.727509:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+81:72831:x1866818940501120:12345-192.168.203.16@tcp:36:touch.0 Request processed in 833us (1164us total) trans 120259084326 rc 0/0 00000100:00100000:1.0:1780340942.727517:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1493 00010000:00010000:3.0:1780340942.732973:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340942.739158:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.739295:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940501248 00000100:00100000:3.0:1780340942.739305:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940501248 00000100:00100000:3.0:1780340942.739401:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1494 00000100:00100000:3.0:1780340942.739412:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+81:72831:x1866818940501248:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:3.0:1780340942.739436:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340942.739456:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432775b08 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced272d expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.739533:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432775b08 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced272d expref: 82 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.739549:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9c00/0xa24651432775b08 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced272d expref: 82 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.739580:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff8c0477219600) 00010000:00010000:3.0:1780340942.739583:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780340942.739587:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9c00, rc 0) 00000100:00100000:3.0:1780340942.739646:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+82:72831:x1866818940501248:12345-192.168.203.16@tcp:101:touch.0 Request processed in 235us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340942.739653:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1494 00000100:00100000:2.0:1780340942.743673:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.744024:0:25497:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940501376 00000100:00100000:0.0:1780340942.744034:0:25497:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940501376 00000100:00100000:1.0:1780340942.744199:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5949 00000100:00100000:1.0:1780340942.744210:0:25497:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+14:2407:x1866818940501376:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:1.0:1780340942.744416:0:25497:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+15:2407:x1866818940501376:12345-192.168.203.16@tcp:2:touch.0 Request processed in 207us (750us total) trans 4294969468 rc 0/0 00000100:00100000:1.0:1780340942.744424:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5949 00000100:00100000:1.0:1780340942.763317:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.763452:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940501632 00000100:00100000:3.0:1780340942.763463:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940501632 00000100:00100000:3.0:1780340942.763518:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 257 00000100:00100000:3.0:1780340942.763527:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+82:72831:x1866818940501632:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:3.0:1780340942.763867:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+83:72831:x1866818940501632:12345-192.168.203.16@tcp:35:touch.0 Request processed in 339us (559us total) trans 120259084327 rc 0/0 00000100:00100000:3.0:1780340942.763876:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 257 00000100:00100000:0.0:1780340942.778846:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340942.778948:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940501888 00000100:00100000:2.0:1780340942.778959:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940501888 00000100:00100000:2.0:1780340942.779019:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1495 00000100:00100000:2.0:1780340942.779029:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+83:72831:x1866818940501888:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:2.0:1780340942.779052:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340942.779081:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775b0f lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2734 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.779183:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775b16 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.779198:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775b16 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.779210:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775b16 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.779224:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432775b1d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.779247:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432775b1d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.779253:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432775b1d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1780340942.779748:0:63712:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x36d:0x0], index 0: 0 00010000:00010000:2.0:1780340942.779917:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775b24 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.779927:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775b24 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.780330:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775b24 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.787756:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775b16 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.787996:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775b16 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.788004:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775b16 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.788011:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775b16 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.788017:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340942.788021:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775b16 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.788028:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775b16 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.788045:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:0.0:1780340942.788048:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340942.788053:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775b16 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.788070:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775b16 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340942.788104:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009dc8bbb2 reply state 00000000292857b8 transno 120259084328 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432775b1d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.788117:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432775b1d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.788124:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff8c045312e100) 00010000:00010000:0.0:1780340942.788127:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340942.788130:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1780340942.788180:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775b0f lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2734 expref: 86 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.788194:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775b24 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2734 expref: 85 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.788201:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff8c045312e700) 00010000:00010000:0.0:1780340942.788203:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780340942.788205:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7800, rc 0) 00000100:00100000:0.0:1780340942.788271:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+86:72831:x1866818940501888:12345-192.168.203.16@tcp:101:touch.0 Request processed in 9244us (9433us total) trans 120259084328 rc 0/0 00000100:00100000:0.0:1780340942.788279:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1495 00000100:00100000:0.0:1780340942.802258:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.802494:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940502144 00000100:00100000:1.0:1780340942.802505:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940502144 00000100:00100000:1.0:1780340942.802574:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1496 00000100:00100000:1.0:1780340942.802585:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+86:72831:x1866818940502144:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:1.0:1780340942.802638:0:70100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340942.802664:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775b24 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2734 expref: 86 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.802683:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff8c045312e700) 00010000:00010000:1.0:1780340942.802694:0:70100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780340942.802744:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775b32 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.802813:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775b32 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.802836:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775b32 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340942.803038:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dbb28021 reply state 000000000a6fb734 transno 120259084329 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775b32 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.803051:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775b32 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.803067:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff8c0477219500) 00010000:00010000:1.0:1780340942.803070:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340942.803073:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780340942.803266:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+87:72831:x1866818940502144:12345-192.168.203.16@tcp:36:touch.0 Request processed in 682us (1017us total) trans 120259084329 rc 0/0 00000100:00100000:1.0:1780340942.803275:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1496 00000100:00100000:1.0:1780340942.818923:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.820968:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940502272 00000100:00100000:3.0:1780340942.820985:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940502272 00000100:00100000:3.0:1780340942.821070:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1497 00000100:00100000:3.0:1780340942.821082:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+87:72831:x1866818940502272:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:3.0:1780340942.821105:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340942.821124:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432775b39 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced273b expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.821207:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432775b39 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced273b expref: 88 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.821222:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8400/0xa24651432775b39 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced273b expref: 88 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.821240:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff8c0477219500) 00010000:00010000:3.0:1780340942.821243:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780340942.821247:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8400, rc 0) 00000100:00100000:3.0:1780340942.821305:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+88:72831:x1866818940502272:12345-192.168.203.16@tcp:101:touch.0 Request processed in 226us (2401us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340942.821312:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1497 00000100:00100000:0.0:1780340942.826318:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.826406:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940502400 00000100:00100000:3.0:1780340942.826416:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940502400 00000100:00100000:3.0:1780340942.826472:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5950 00000100:00100000:3.0:1780340942.826482:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+15:2408:x1866818940502400:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:3.0:1780340942.826682:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+16:2408:x1866818940502400:12345-192.168.203.16@tcp:2:touch.0 Request processed in 200us (373us total) trans 4294969469 rc 0/0 00000100:00100000:3.0:1780340942.826690:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5950 00000100:00100000:0.0:1780340942.835467:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.835624:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940502656 00000100:00100000:3.0:1780340942.835634:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940502656 00000100:00100000:3.0:1780340942.835694:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 258 00000100:00100000:3.0:1780340942.835705:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+88:72831:x1866818940502656:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:0.0:1780340942.836354:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+89:72831:x1866818940502656:12345-192.168.203.16@tcp:35:touch.0 Request processed in 649us (895us total) trans 120259084330 rc 0/0 00000100:00100000:0.0:1780340942.836364:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 258 00000100:00100000:1.0:1780340942.851923:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.852108:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940502912 00000100:00100000:0.0:1780340942.852118:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940502912 00000100:00100000:0.0:1780340942.852172:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1498 00000100:00100000:0.0:1780340942.852181:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+89:72831:x1866818940502912:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:0.0:1780340942.852203:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340942.852224:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432775b40 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2742 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.852314:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775b47 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.852329:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775b47 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.852340:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775b47 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.852354:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775b4e lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.852360:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775b4e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.852366:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775b4e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780340942.852619:0:63712:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x36e:0x0], index 0: 0 00010000:00010000:0.0:1780340942.852728:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775b55 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.852737:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775b55 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.852756:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775b55 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.852899:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775b47 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.852907:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775b47 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.852913:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775b47 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.852982:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775b47 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.852988:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340942.852992:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775b47 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.852999:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775b47 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.853078:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:0.0:1780340942.853082:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340942.853087:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775b47 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.853094:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775b47 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340942.853108:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007ec97ce9 reply state 00000000eca96b5b transno 120259084331 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775b4e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.853124:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775b4e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.853131:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff8c0455c3b600) 00010000:00010000:0.0:1780340942.853133:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340942.853135:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1780340942.853162:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432775b40 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2742 expref: 92 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.853175:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775b55 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2742 expref: 91 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.853183:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff8c0455c3bc00) 00010000:00010000:0.0:1780340942.853185:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780340942.853187:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5c00, rc 0) 00000100:00100000:0.0:1780340942.853240:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+92:72831:x1866818940502912:12345-192.168.203.16@tcp:101:touch.0 Request processed in 1060us (1333us total) trans 120259084331 rc 0/0 00000100:00100000:0.0:1780340942.853247:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1498 00000100:00100000:3.0:1780340942.862291:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.862379:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940503168 00000100:00100000:0.0:1780340942.862400:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940503168 00000100:00100000:0.0:1780340942.862463:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1499 00000100:00100000:0.0:1780340942.862473:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+92:72831:x1866818940503168:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:0.0:1780340942.862532:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340942.862562:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775b55 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2742 expref: 92 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.862586:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff8c0455c3bc00) 00010000:00010000:0.0:1780340942.862611:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780340942.862663:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa24651432775b63 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.862676:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa24651432775b63 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.862686:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa24651432775b63 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340942.863164:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001fb05fad reply state 000000003642336c transno 120259084332 ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa24651432775b63 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.863178:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa24651432775b63 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.863184:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff8c0455c3ba00) 00010000:00010000:0.0:1780340942.863187:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340942.863190:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780340942.863323:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+93:72831:x1866818940503168:12345-192.168.203.16@tcp:36:touch.0 Request processed in 850us (1040us total) trans 120259084332 rc 0/0 00000100:00100000:0.0:1780340942.863330:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1499 00000100:00100000:2.0:1780340942.869143:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.869361:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940503296 00000100:00100000:3.0:1780340942.869383:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940503296 00000100:00100000:3.0:1780340942.869444:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1500 00000100:00100000:3.0:1780340942.869455:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+93:72831:x1866818940503296:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:3.0:1780340942.869476:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340942.869496:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775b6a lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2749 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.869551:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775b6a lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2749 expref: 94 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.869565:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9a00/0xa24651432775b6a lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2749 expref: 94 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.869584:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff8c0455c3ba00) 00010000:00010000:3.0:1780340942.869588:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780340942.869591:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9a00, rc 0) 00000100:00100000:3.0:1780340942.869650:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+94:72831:x1866818940503296:12345-192.168.203.16@tcp:101:touch.0 Request processed in 197us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340942.869657:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1500 00000100:00100000:1.0:1780340942.883921:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340942.884077:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940503424 00000100:00100000:2.0:1780340942.884087:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940503424 00000100:00100000:2.0:1780340942.884145:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5951 00000100:00100000:2.0:1780340942.884155:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+16:2407:x1866818940503424:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:2.0:1780340942.884363:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+17:2407:x1866818940503424:12345-192.168.203.16@tcp:2:touch.0 Request processed in 209us (451us total) trans 4294969470 rc 0/0 00000100:00100000:2.0:1780340942.884371:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5951 00000100:00100000:1.0:1780340942.892002:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340942.892376:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940503680 00000100:00100000:2.0:1780340942.892389:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940503680 00000100:00100000:2.0:1780340942.892456:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 259 00000100:00100000:2.0:1780340942.892468:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047723b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+94:72831:x1866818940503680:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:2.0:1780340942.892849:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047723b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+95:72831:x1866818940503680:12345-192.168.203.16@tcp:35:touch.0 Request processed in 382us (856us total) trans 120259084333 rc 0/0 00000100:00100000:2.0:1780340942.892859:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 259 00000100:00100000:0.0:1780340942.900318:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.900484:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940503936 00000100:00100000:1.0:1780340942.900495:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940503936 00000100:00100000:1.0:1780340942.900571:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1501 00000100:00100000:1.0:1780340942.900581:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+95:72831:x1866818940503936:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:1.0:1780340942.900605:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340942.900630:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432775b71 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2750 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.900742:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432775b78 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.900804:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432775b78 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.900816:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432775b78 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.900834:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432775b7f lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.900841:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432775b7f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.900847:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432775b7f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780340942.901178:0:70100:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x36f:0x0], index 0: 0 00010000:00010000:1.0:1780340942.901451:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775b86 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.901462:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775b86 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.901469:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775b86 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.901559:0:70100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432775b78 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.901568:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432775b78 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.901575:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432775b78 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.901587:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432775b78 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.901593:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340942.901597:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432775b78 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.901604:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432775b78 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.901616:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:1.0:1780340942.901619:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340942.901623:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432775b78 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.901630:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432775b78 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340942.901643:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001840e898 reply state 000000003443433d transno 120259084334 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432775b7f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.901652:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432775b7f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.901658:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff8c0477219c00) 00010000:00010000:1.0:1780340942.901660:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340942.901663:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780340942.901692:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123600/0xa24651432775b71 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2750 expref: 98 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.901705:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775b86 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2750 expref: 97 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.901718:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff8c0477219a00) 00010000:00010000:1.0:1780340942.901720:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780340942.901722:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722af200, rc 0) 00000100:00100000:1.0:1780340942.901833:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+98:72831:x1866818940503936:12345-192.168.203.16@tcp:101:touch.0 Request processed in 1252us (1523us total) trans 120259084334 rc 0/0 00000100:00100000:1.0:1780340942.901840:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1501 00000100:00100000:1.0:1780340942.905570:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.905717:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940504192 00000100:00100000:0.0:1780340942.905730:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940504192 00000100:00100000:0.0:1780340942.905820:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1502 00000100:00100000:0.0:1780340942.905831:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+98:72831:x1866818940504192:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:0.0:1780340942.905889:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340942.905915:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775b86 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2750 expref: 98 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.905951:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff8c0477219a00) 00010000:00010000:0.0:1780340942.905963:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780340942.906016:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775b94 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.906029:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775b94 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.906038:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775b94 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340942.906148:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000059c6b6da reply state 00000000ec1d6407 transno 120259084335 ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775b94 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.906160:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775b94 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340942.906167:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff8c0455c3bc00) 00010000:00010000:0.0:1780340942.906169:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340942.906172:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340942.914075:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+99:72831:x1866818940504192:12345-192.168.203.16@tcp:36:touch.0 Request processed in 8228us (8496us total) trans 120259084335 rc 0/0 00000100:00100000:2.0:1780340942.914088:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1502 00000100:00100000:3.0:1780340942.918729:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.918913:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940504320 00000100:00100000:1.0:1780340942.918925:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940504320 00000100:00100000:1.0:1780340942.918986:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1503 00000100:00100000:1.0:1780340942.918996:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04441b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+99:72831:x1866818940504320:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:1.0:1780340942.919032:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340942.919053:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432775b9b lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2757 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.919118:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432775b9b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2757 expref: 100 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.919132:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae600/0xa24651432775b9b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2757 expref: 100 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340942.919151:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff8c0455c3bc00) 00010000:00010000:1.0:1780340942.919154:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1780340942.919157:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722ae600, rc 0) 00000100:00100000:1.0:1780340942.919228:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04441b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+100:72831:x1866818940504320:12345-192.168.203.16@tcp:101:touch.0 Request processed in 234us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340942.919252:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1503 00000100:00100000:3.0:1780340942.922832:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340942.922929:0:8401:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940504448 00000100:00100000:0.0:1780340942.922949:0:8401:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940504448 00000100:00100000:0.0:1780340942.923007:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5952 00000100:00100000:0.0:1780340942.923016:0:8401:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b993b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+17:2408:x1866818940504448:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:0.0:1780340942.923273:0:8401:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b993b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+18:2408:x1866818940504448:12345-192.168.203.16@tcp:2:touch.0 Request processed in 258us (450us total) trans 4294969471 rc 0/0 00000100:00100000:0.0:1780340942.923281:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5952 00000100:00100000:2.0:1780340942.926179:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340942.926319:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940504704 00000100:00100000:1.0:1780340942.926328:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940504704 00000100:00100000:1.0:1780340942.926380:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 260 00000100:00100000:1.0:1780340942.926391:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+100:72831:x1866818940504704:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:1.0:1780340942.926658:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+101:72831:x1866818940504704:12345-192.168.203.16@tcp:35:touch.0 Request processed in 267us (485us total) trans 120259084336 rc 0/0 00000100:00100000:1.0:1780340942.926666:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 260 00000100:00100000:1.0:1780340942.945483:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.948106:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940504960 00000100:00100000:3.0:1780340942.948119:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940504960 00000100:00100000:3.0:1780340942.948205:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1504 00000100:00100000:3.0:1780340942.948216:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+101:72831:x1866818940504960:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:3.0:1780340942.948240:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340942.948261:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1400/0xa24651432775ba2 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced275e expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.948381:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775ba9 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.948396:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775ba9 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.948406:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775ba9 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.948419:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1200/0xa24651432775bb0 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.948425:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1200/0xa24651432775bb0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.948431:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1200/0xa24651432775bb0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1780340942.948719:0:63710:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x370:0x0], index 0: 0 00010000:00010000:3.0:1780340942.948900:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1600/0xa24651432775bb7 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.948909:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1600/0xa24651432775bb7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.948929:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1600/0xa24651432775bb7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.960594:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775ba9 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.960613:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775ba9 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.960620:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775ba9 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.960626:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775ba9 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.960632:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340942.960637:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775ba9 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.960645:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775ba9 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.960662:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:2.0:1780340942.960665:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340942.960670:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775ba9 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.960694:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775ba9 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340942.960711:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000018de18e7 reply state 00000000e620f226 transno 120259084337 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1200/0xa24651432775bb0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.960723:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1200/0xa24651432775bb0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.960730:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff8c04506cf300) 00010000:00010000:2.0:1780340942.960733:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340942.960736:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1780340942.960798:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1400/0xa24651432775ba2 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced275e expref: 104 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.960820:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1600/0xa24651432775bb7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced275e expref: 103 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.960828:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff8c04506cf600) 00010000:00010000:2.0:1780340942.960830:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340942.960833:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03485a1600, rc 0) 00000100:00100000:2.0:1780340942.962083:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+104:72831:x1866818940504960:12345-192.168.203.16@tcp:101:touch.0 Request processed in 13862us (16604us total) trans 120259084337 rc 0/0 00000100:00100000:2.0:1780340942.962094:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1504 00000100:00100000:3.0:1780340942.976025:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340942.976229:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940505216 00000100:00100000:2.0:1780340942.976239:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940505216 00000100:00100000:2.0:1780340942.976295:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1505 00000100:00100000:2.0:1780340942.976305:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+104:72831:x1866818940505216:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:2.0:1780340942.976370:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340942.976396:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1600/0xa24651432775bb7 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced275e expref: 104 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.976414:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff8c04506cf600) 00010000:00010000:2.0:1780340942.976423:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340942.976477:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432775bc5 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.976491:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432775bc5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.976500:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432775bc5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340942.976610:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007682ff83 reply state 0000000088ae7b83 transno 120259084338 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432775bc5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.976622:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432775bc5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340942.976629:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff8c045312ec00) 00010000:00010000:2.0:1780340942.976632:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340942.976634:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340942.976720:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+105:72831:x1866818940505216:12345-192.168.203.16@tcp:36:touch.0 Request processed in 416us (702us total) trans 120259084338 rc 0/0 00000100:00100000:2.0:1780340942.976728:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1505 00000100:00100000:1.0:1780340942.998320:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340942.998405:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940505344 00000100:00100000:3.0:1780340942.998415:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940505344 00000100:00100000:3.0:1780340942.998485:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1506 00000100:00100000:3.0:1780340942.998494:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+105:72831:x1866818940505344:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:3.0:1780340942.998518:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340942.998538:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0000/0xa24651432775bcc lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2765 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.998603:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0000/0xa24651432775bcc lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2765 expref: 106 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.998617:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0000/0xa24651432775bcc lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2765 expref: 106 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340942.998634:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff8c045312ec00) 00010000:00010000:3.0:1780340942.998637:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780340942.998640:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03485a0000, rc 0) 00000100:00100000:3.0:1780340942.998697:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+106:72831:x1866818940505344:12345-192.168.203.16@tcp:101:touch.0 Request processed in 204us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340942.998703:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1506 00000100:00100000:3.0:1780340943.002400:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340943.002587:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940505472 00000100:00100000:0.0:1780340943.002613:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940505472 00000100:00100000:0.0:1780340943.002670:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5953 00000100:00100000:0.0:1780340943.002679:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+18:2407:x1866818940505472:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:0.0:1780340943.003284:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+19:2407:x1866818940505472:12345-192.168.203.16@tcp:2:touch.0 Request processed in 603us (890us total) trans 4294969472 rc 0/0 00000100:00100000:0.0:1780340943.003294:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5953 00000100:00100000:0.0:1780340943.009210:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340943.009356:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940505728 00000100:00100000:2.0:1780340943.009369:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940505728 00000100:00100000:2.0:1780340943.009430:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 261 00000100:00100000:2.0:1780340943.009453:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+106:72831:x1866818940505728:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:2.0:1780340943.009748:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+107:72831:x1866818940505728:12345-192.168.203.16@tcp:35:touch.0 Request processed in 295us (544us total) trans 120259084339 rc 0/0 00000100:00100000:2.0:1780340943.009755:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 261 00000100:00100000:1.0:1780340943.022672:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340943.024009:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940505984 00000100:00100000:2.0:1780340943.024021:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940505984 00000100:00100000:2.0:1780340943.024106:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1507 00000100:00100000:2.0:1780340943.024117:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+107:72831:x1866818940505984:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:2.0:1780340943.024141:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340943.024162:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775bd3 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced276c expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.024270:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775bda lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.024286:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775bda lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.024299:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775bda lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.024314:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775be1 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.024321:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775be1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.024328:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775be1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1780340943.024664:0:63710:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x371:0x0], index 0: 0 00010000:00010000:2.0:1780340943.024853:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775be8 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.024862:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775be8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.024870:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775be8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.024902:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775bda lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.024910:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775bda lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.024916:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775bda lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.024922:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775bda lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.024928:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.024932:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775bda lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.024938:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775bda lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.024949:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:2.0:1780340943.024951:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.024962:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775bda lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.024968:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775bda lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340943.024982:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e7ea873f reply state 0000000072974354 transno 120259084340 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775be1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.024992:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775be1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.024997:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff8c045312eb00) 00010000:00010000:2.0:1780340943.025000:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340943.025002:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1780340943.025031:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775bd3 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced276c expref: 110 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.025044:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775be8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced276c expref: 109 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.025051:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff8c045312ee00) 00010000:00010000:2.0:1780340943.025053:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340943.025066:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6800, rc 0) 00000100:00100000:2.0:1780340943.025140:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+110:72831:x1866818940505984:12345-192.168.203.16@tcp:101:touch.0 Request processed in 1024us (2475us total) trans 120259084340 rc 0/0 00000100:00100000:2.0:1780340943.025147:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1507 00000100:00100000:3.0:1780340943.030752:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340943.031232:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940506240 00000100:00100000:1.0:1780340943.031244:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940506240 00000100:00100000:1.0:1780340943.031302:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1508 00000100:00100000:1.0:1780340943.031313:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034933b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+110:72831:x1866818940506240:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:1.0:1780340943.031370:0:63712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340943.031408:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775be8 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced276c expref: 110 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.031428:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff8c045312ee00) 00010000:00010000:1.0:1780340943.031439:0:63712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780340943.031492:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432775bf6 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.031505:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432775bf6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.031533:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432775bf6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340943.031645:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004ecbc5cd reply state 00000000d616f72e transno 120259084341 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432775bf6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.031656:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432775bf6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.031662:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff8c0477219a00) 00010000:00010000:1.0:1780340943.031665:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340943.031667:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780340943.031752:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034933b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+111:72831:x1866818940506240:12345-192.168.203.16@tcp:36:touch.0 Request processed in 441us (1012us total) trans 120259084341 rc 0/0 00000100:00100000:1.0:1780340943.031786:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1508 00000100:00100000:3.0:1780340943.039011:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340943.039111:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940506368 00000100:00100000:2.0:1780340943.039121:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940506368 00000100:00100000:2.0:1780340943.039175:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1509 00000100:00100000:2.0:1780340943.039186:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03474c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+111:72831:x1866818940506368:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:2.0:1780340943.039222:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340943.039244:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775bfd lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2773 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.039299:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775bfd lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2773 expref: 112 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.039312:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7800/0xa24651432775bfd lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2773 expref: 112 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.039330:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff8c0477219a00) 00010000:00010000:2.0:1780340943.039333:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1780340943.039337:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c7800, rc 0) 00000100:00100000:2.0:1780340943.039385:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03474c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+112:72831:x1866818940506368:12345-192.168.203.16@tcp:101:touch.0 Request processed in 201us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340943.039402:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1509 00000100:00100000:2.0:1780340943.057297:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340943.057725:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940506496 00000100:00100000:3.0:1780340943.057736:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940506496 00000100:00100000:3.0:1780340943.057838:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5954 00000100:00100000:3.0:1780340943.057848:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+19:2407:x1866818940506496:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:3.0:1780340943.058301:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+20:2407:x1866818940506496:12345-192.168.203.16@tcp:2:touch.0 Request processed in 452us (1008us total) trans 4294969473 rc 0/0 00000100:00100000:3.0:1780340943.058322:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5954 00000100:00100000:3.0:1780340943.067654:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340943.067831:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940506752 00000100:00100000:2.0:1780340943.067842:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940506752 00000100:00100000:2.0:1780340943.067899:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 262 00000100:00100000:2.0:1780340943.067909:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+112:72831:x1866818940506752:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:2.0:1780340943.068439:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+113:72831:x1866818940506752:12345-192.168.203.16@tcp:35:touch.0 Request processed in 530us (795us total) trans 120259084342 rc 0/0 00000100:00100000:2.0:1780340943.068448:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 262 00000100:00100000:1.0:1780340943.076908:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340943.077011:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940507008 00000100:00100000:0.0:1780340943.077021:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940507008 00000100:00100000:0.0:1780340943.077078:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1510 00000100:00100000:0.0:1780340943.077087:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+113:72831:x1866818940507008:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:0.0:1780340943.077108:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340943.077134:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432775c04 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced277a expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077224:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775c0b lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077239:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775c0b lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077251:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775c0b lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077264:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775c12 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077270:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775c12 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077291:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775c12 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780340943.077575:0:63711:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x372:0x0], index 0: 0 00010000:00010000:0.0:1780340943.077684:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432775c19 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077692:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432775c19 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077699:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432775c19 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077726:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775c0b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077733:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775c0b lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077739:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775c0b lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077745:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775c0b lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077750:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340943.077754:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775c0b lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077815:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775c0b lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077839:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:0.0:1780340943.077842:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340943.077847:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775c0b lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077853:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa24651432775c0b lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340943.077868:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e1005e54 reply state 000000004ceb0173 transno 120259084343 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775c12 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077878:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775c12 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077884:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff8c0455c3bf00) 00010000:00010000:0.0:1780340943.077886:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340943.077888:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1780340943.077913:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432775c04 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced277a expref: 116 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077927:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432775c19 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced277a expref: 115 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.077934:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff8c0455c3b400) 00010000:00010000:0.0:1780340943.077936:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780340943.077938:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440030200, rc 0) 00000100:00100000:0.0:1780340943.077987:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+116:72831:x1866818940507008:12345-192.168.203.16@tcp:101:touch.0 Request processed in 901us (1087us total) trans 120259084343 rc 0/0 00000100:00100000:0.0:1780340943.077994:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1510 00000100:00100000:2.0:1780340943.078677:0:90581:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90581:1866818961264000:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1780340943.078719:0:90581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340943.078781:0:90581:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c046b899540 going to sleep for 11 seconds 00000100:00100000:3.0:1780340943.078836:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961264000 00000100:00100000:3.0:1780340943.078841:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961264000 00000100:00100000:3.0:1780340943.078900:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5955 00000100:00100000:3.0:1780340943.078908:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:90581:x1866818961264000:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1780340943.078943:0:8830:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 898 00000100:00080000:2.0:1780340943.083670:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1780340943.087513:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:90581:x1866818961264000:12345-0@lo:5:osp-pre-0-0.0 Request processed in 8600us (8786us total) trans 4294969474 rc 0/0 00000100:00100000:3.0:1780340943.087526:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5955 00000100:00100000:2.0:1780340943.087940:0:90581:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498ed880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90581:1866818961264000:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1780340943.087956:0:90581:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x372:0x0]-[0x280000401:0x3a1:0x0] 00000100:00100000:1.0:1780340943.090195:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340943.090296:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940507264 00000100:00100000:3.0:1780340943.090307:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940507264 00000100:00100000:3.0:1780340943.090410:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1511 00000100:00100000:3.0:1780340943.090421:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+116:72831:x1866818940507264:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:3.0:1780340943.090484:0:70100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340943.090513:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa24651432775c19 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced277a expref: 116 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340943.090535:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff8c0455c3b400) 00010000:00010000:3.0:1780340943.090546:0:70100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340943.090620:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775c27 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340943.090636:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775c27 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340943.090646:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775c27 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340943.090885:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005b7004ab reply state 000000002a27cd4b transno 120259084344 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775c27 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340943.090897:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775c27 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340943.090903:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff8c04506cfe00) 00010000:00010000:3.0:1780340943.090906:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340943.090908:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780340943.091309:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+117:72831:x1866818940507264:12345-192.168.203.16@tcp:36:touch.0 Request processed in 889us (1121us total) trans 120259084344 rc 0/0 00000100:00100000:3.0:1780340943.091318:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1511 00000100:00100000:3.0:1780340943.095905:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340943.096135:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940507392 00000100:00100000:1.0:1780340943.096145:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940507392 00000100:00100000:1.0:1780340943.096198:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1512 00000100:00100000:1.0:1780340943.096208:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+117:72831:x1866818940507392:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:1.0:1780340943.096233:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340943.096253:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aea00/0xa24651432775c2e lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2781 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.096308:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aea00/0xa24651432775c2e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2781 expref: 118 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.096342:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aea00/0xa24651432775c2e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2781 expref: 118 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.096361:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff8c04506cfe00) 00010000:00010000:1.0:1780340943.096363:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1780340943.096368:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722aea00, rc 0) 00000100:00100000:1.0:1780340943.096678:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+118:72831:x1866818940507392:12345-192.168.203.16@tcp:101:touch.0 Request processed in 469us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340943.096686:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1512 00000100:00100000:1.0:1780340943.100848:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340943.100993:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940507520 00000100:00100000:2.0:1780340943.101010:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940507520 00000100:00100000:2.0:1780340943.101067:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5956 00000100:00100000:2.0:1780340943.101076:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+20:2408:x1866818940507520:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:2.0:1780340943.101279:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+21:2408:x1866818940507520:12345-192.168.203.16@tcp:2:touch.0 Request processed in 203us (438us total) trans 4294969475 rc 0/0 00000100:00100000:2.0:1780340943.101287:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5956 00000100:00100000:2.0:1780340943.125583:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340943.125675:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940507776 00000100:00100000:1.0:1780340943.125685:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940507776 00000100:00100000:1.0:1780340943.125740:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 263 00000100:00100000:1.0:1780340943.125749:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+118:72831:x1866818940507776:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:3.0:1780340943.126342:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+119:72831:x1866818940507776:12345-192.168.203.16@tcp:35:touch.0 Request processed in 592us (766us total) trans 120259084345 rc 0/0 00000100:00100000:3.0:1780340943.126351:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 263 00000100:00100000:3.0:1780340943.142836:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340943.143340:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940508032 00000100:00100000:1.0:1780340943.143351:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940508032 00000100:00100000:1.0:1780340943.143413:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1513 00000100:00100000:1.0:1780340943.143423:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+119:72831:x1866818940508032:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:1.0:1780340943.143446:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340943.143465:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af400/0xa24651432775c35 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2788 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.143574:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afc00/0xa24651432775c3c lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.143590:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afc00/0xa24651432775c3c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.143616:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afc00/0xa24651432775c3c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.143631:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432775c43 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.143638:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432775c43 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.143644:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432775c43 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1780340943.144255:0:63712:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x373:0x0], index 0: 0 00010000:00010000:1.0:1780340943.144387:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae400/0xa24651432775c4a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.144398:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae400/0xa24651432775c4a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.144409:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae400/0xa24651432775c4a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.144443:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afc00/0xa24651432775c3c lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.144450:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afc00/0xa24651432775c3c lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.144455:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afc00/0xa24651432775c3c lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.144461:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afc00/0xa24651432775c3c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.144474:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722afc00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340943.144478:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afc00/0xa24651432775c3c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.144486:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afc00/0xa24651432775c3c lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.144499:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:1.0:1780340943.144502:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340943.144508:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afc00/0xa24651432775c3c lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.144514:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afc00/0xa24651432775c3c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1780340943.144528:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009e39b1b8 reply state 0000000015a2932c transno 120259084346 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432775c43 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.144538:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432775c43 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.144543:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff8c0477219f00) 00010000:00010000:1.0:1780340943.144545:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340943.144548:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1780340943.144592:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af400/0xa24651432775c35 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2788 expref: 122 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.144605:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae400/0xa24651432775c4a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2788 expref: 121 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340943.144623:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff8c0477219400) 00010000:00010000:1.0:1780340943.144625:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780340943.144628:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722ae400, rc 0) 00000100:00100000:1.0:1780340943.144696:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+122:72831:x1866818940508032:12345-192.168.203.16@tcp:101:touch.0 Request processed in 1274us (1868us total) trans 120259084346 rc 0/0 00000100:00100000:1.0:1780340943.144703:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1513 00000100:00100000:1.0:1780340943.152964:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340943.153083:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940508288 00000100:00100000:3.0:1780340943.153095:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940508288 00000100:00100000:3.0:1780340943.153158:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1514 00000100:00100000:3.0:1780340943.153168:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+122:72831:x1866818940508288:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:3.0:1780340943.153226:0:70100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340943.153253:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae400/0xa24651432775c4a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2788 expref: 122 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340943.153272:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff8c0477219400) 00010000:00010000:3.0:1780340943.153285:0:70100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340943.153361:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775c58 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340943.153375:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775c58 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340943.153384:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775c58 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340943.153502:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000075ca55c4 reply state 000000002bc68c68 transno 120259084347 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775c58 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340943.153514:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775c58 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340943.153521:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff8c04506cf000) 00010000:00010000:3.0:1780340943.153523:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340943.153526:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780340943.153628:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+123:72831:x1866818940508288:12345-192.168.203.16@tcp:36:touch.0 Request processed in 462us (673us total) trans 120259084347 rc 0/0 00000100:00100000:3.0:1780340943.153635:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1514 00000100:00100000:2.0:1780340943.158086:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340943.158213:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940508416 00000100:00100000:3.0:1780340943.158224:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940508416 00000100:00100000:3.0:1780340943.158282:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1515 00000100:00100000:3.0:1780340943.158292:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+123:72831:x1866818940508416:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:3.0:1780340943.158314:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340943.158333:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0c00/0xa24651432775c5f lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced278f expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340943.158401:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0c00/0xa24651432775c5f lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced278f expref: 124 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340943.158439:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0c00/0xa24651432775c5f lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced278f expref: 124 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340943.158459:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff8c04506cf000) 00010000:00010000:3.0:1780340943.158462:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780340943.158465:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03485a0c00, rc 0) 00000100:00100000:3.0:1780340943.158526:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+124:72831:x1866818940508416:12345-192.168.203.16@tcp:101:touch.0 Request processed in 236us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340943.158534:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1515 00000100:00100000:0.0:1780340943.172014:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340943.172159:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940508544 00000100:00100000:3.0:1780340943.172171:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940508544 00000100:00100000:3.0:1780340943.172229:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5957 00000100:00100000:3.0:1780340943.172238:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+21:2408:x1866818940508544:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:3.0:1780340943.172438:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+22:2408:x1866818940508544:12345-192.168.203.16@tcp:2:touch.0 Request processed in 201us (433us total) trans 4294969476 rc 0/0 00000100:00100000:3.0:1780340943.172447:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5957 00000100:00100000:0.0:1780340943.177028:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340943.177148:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940508800 00000100:00100000:1.0:1780340943.177159:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940508800 00000100:00100000:1.0:1780340943.177219:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 264 00000100:00100000:1.0:1780340943.177230:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+124:72831:x1866818940508800:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:1.0:1780340943.177742:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+125:72831:x1866818940508800:12345-192.168.203.16@tcp:35:touch.0 Request processed in 512us (809us total) trans 120259084348 rc 0/0 00000100:00100000:1.0:1780340943.177750:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 264 00000100:00100000:0.0:1780340943.189322:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340943.192810:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940509056 00000100:00100000:1.0:1780340943.192824:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940509056 00000100:00100000:0.0:1780340943.196960:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1516 00000100:00100000:0.0:1780340943.196974:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+125:72831:x1866818940509056:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:0.0:1780340943.197001:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340943.197021:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432775c66 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2796 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197147:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775c6d lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197162:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775c6d lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197173:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775c6d lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197188:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432775c74 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197194:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432775c74 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197201:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432775c74 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1780340943.197490:0:63712:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x374:0x0], index 0: 0 00010000:00010000:0.0:1780340943.197643:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031000/0xa24651432775c7b lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197671:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031000/0xa24651432775c7b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197679:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031000/0xa24651432775c7b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197715:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775c6d lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197722:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775c6d lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197728:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775c6d lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197733:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775c6d lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197739:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340943.197743:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775c6d lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197749:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775c6d lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197804:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:0.0:1780340943.197808:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340943.197812:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775c6d lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197818:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775c6d lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340943.197852:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001e7aa9f1 reply state 000000008dc4aa63 transno 120259084349 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432775c74 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197863:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432775c74 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197870:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff8c0455c3b400) 00010000:00010000:0.0:1780340943.197872:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340943.197876:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1780340943.197907:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432775c66 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2796 expref: 128 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197921:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031000/0xa24651432775c7b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2796 expref: 127 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.197927:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff8c045a897900) 00010000:00010000:0.0:1780340943.197929:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780340943.197931:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440031000, rc 0) 00000100:00100000:0.0:1780340943.197999:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+128:72831:x1866818940509056:12345-192.168.203.16@tcp:101:touch.0 Request processed in 1028us (8686us total) trans 120259084349 rc 0/0 00000100:00100000:0.0:1780340943.198007:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1516 00000100:00100000:1.0:1780340943.212734:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340943.213326:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940509312 00000100:00100000:0.0:1780340943.213337:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940509312 00000100:00100000:0.0:1780340943.213408:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1517 00000100:00100000:0.0:1780340943.213420:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+128:72831:x1866818940509312:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:0.0:1780340943.213477:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340943.213503:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031000/0xa24651432775c7b lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2796 expref: 128 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.213538:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff8c045a897900) 00010000:00010000:0.0:1780340943.213549:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780340943.213612:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775c89 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.213627:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775c89 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.213637:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775c89 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340943.213752:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e2d90723 reply state 0000000015f32882 transno 120259084350 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775c89 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.213804:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775c89 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.213811:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff8c0345328400) 00010000:00010000:0.0:1780340943.213814:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340943.213817:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780340943.214636:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+129:72831:x1866818940509312:12345-192.168.203.16@tcp:36:touch.0 Request processed in 1214us (1906us total) trans 120259084350 rc 0/0 00000100:00100000:0.0:1780340943.214644:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1517 00000100:00100000:1.0:1780340943.222461:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340943.222555:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940509440 00000100:00100000:2.0:1780340943.222575:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940509440 00000100:00100000:2.0:1780340943.222628:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1518 00000100:00100000:2.0:1780340943.222639:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+129:72831:x1866818940509440:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:2.0:1780340943.222662:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340943.222681:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775c90 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced279d expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.222736:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775c90 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced279d expref: 130 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.222750:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6000/0xa24651432775c90 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced279d expref: 130 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.222821:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff8c0345328400) 00010000:00010000:2.0:1780340943.222824:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1780340943.222828:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04754c6000, rc 0) 00000100:00100000:2.0:1780340943.222886:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+130:72831:x1866818940509440:12345-192.168.203.16@tcp:101:touch.0 Request processed in 249us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340943.222893:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1518 00000100:00100000:1.0:1780340943.227557:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340943.227656:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940509568 00000100:00100000:2.0:1780340943.227667:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940509568 00000100:00100000:2.0:1780340943.227720:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5958 00000100:00100000:2.0:1780340943.227730:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+22:2407:x1866818940509568:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:2.0:1780340943.227987:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+23:2407:x1866818940509568:12345-192.168.203.16@tcp:2:touch.0 Request processed in 258us (441us total) trans 4294969477 rc 0/0 00000100:00100000:2.0:1780340943.227995:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5958 00000100:00100000:0.0:1780340943.244155:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340943.244457:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940509824 00000100:00100000:3.0:1780340943.244469:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940509824 00000100:00100000:3.0:1780340943.244521:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 265 00000100:00100000:3.0:1780340943.244531:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477239450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+130:72831:x1866818940509824:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:3.0:1780340943.244832:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477239450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+131:72831:x1866818940509824:12345-192.168.203.16@tcp:35:touch.0 Request processed in 302us (686us total) trans 120259084351 rc 0/0 00000100:00100000:3.0:1780340943.244840:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 265 00000100:00100000:0.0:1780340943.253455:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340943.253666:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940510080 00000100:00100000:2.0:1780340943.253676:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940510080 00000100:00100000:2.0:1780340943.253740:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1519 00000100:00100000:2.0:1780340943.253752:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+131:72831:x1866818940510080:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:2.0:1780340943.253812:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340943.253837:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775c97 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced27a4 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.253971:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775c9e lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.253988:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775c9e lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.254007:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775c9e lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.254031:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775ca5 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.254039:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775ca5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.254045:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775ca5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1780340943.255513:0:63712:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x375:0x0], index 0: 0 00010000:00010000:2.0:1780340943.255824:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432775cac lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.255840:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432775cac lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.255850:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432775cac lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.255888:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775c9e lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.255896:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775c9e lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.255902:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775c9e lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.255909:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775c9e lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.255925:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.255930:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775c9e lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.255937:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775c9e lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.255950:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:2.0:1780340943.255953:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.255957:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775c9e lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.255964:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7400/0xa24651432775c9e lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1780340943.255979:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000078b7a059 reply state 00000000e6b282c0 transno 120259084352 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775ca5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.255990:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775ca5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.255996:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff8c045312e300) 00010000:00010000:2.0:1780340943.255998:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340943.256001:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1780340943.256036:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6800/0xa24651432775c97 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27a4 expref: 134 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.256051:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432775cac lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27a4 expref: 133 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.256080:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff8c045312ef00) 00010000:00010000:2.0:1780340943.256082:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340943.256085:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04445c6e00, rc 0) 00000100:00100000:2.0:1780340943.256264:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+134:72831:x1866818940510080:12345-192.168.203.16@tcp:101:touch.0 Request processed in 2513us (2819us total) trans 120259084352 rc 0/0 00000100:00100000:2.0:1780340943.256273:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1519 00000100:00100000:3.0:1780340943.271706:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340943.275325:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940510336 00000100:00100000:0.0:1780340943.275343:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940510336 00000100:00100000:0.0:1780340943.275437:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1520 00000100:00100000:0.0:1780340943.275449:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034759ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+134:72831:x1866818940510336:12345-192.168.203.16@tcp:36:touch.0 00010000:00010000:0.0:1780340943.275546:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340943.275576:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432775cac lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27a4 expref: 134 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.275608:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff8c045312ef00) 00010000:00010000:0.0:1780340943.275620:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780340943.275678:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775cba lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.275693:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775cba lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.275702:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775cba lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1780340943.275872:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001e9ef23f reply state 000000009445d1ac transno 120259084353 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775cba lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.275886:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775cba lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340943.275893:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff8c0345328100) 00010000:00010000:0.0:1780340943.275896:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340943.275899:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780340943.275998:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034759ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+135:72831:x1866818940510336:12345-192.168.203.16@tcp:36:touch.0 Request processed in 551us (4302us total) trans 120259084353 rc 0/0 00000100:00100000:0.0:1780340943.276005:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1520 00000100:00100000:2.0:1780340943.294639:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340943.294736:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940510464 00000100:00100000:3.0:1780340943.294746:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940510464 00000100:00100000:3.0:1780340943.294856:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1521 00000100:00100000:3.0:1780340943.294866:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+135:72831:x1866818940510464:12345-192.168.203.16@tcp:101:touch.0 00010000:00010000:3.0:1780340943.294891:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340943.294911:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1e00/0xa24651432775cc1 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced27ab expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340943.294979:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1e00/0xa24651432775cc1 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27ab expref: 136 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340943.294995:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1e00/0xa24651432775cc1 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27ab expref: 136 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340943.295013:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff8c0345328100) 00010000:00010000:3.0:1780340943.295016:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1780340943.295020:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03485a1e00, rc 0) 00000100:00100000:3.0:1780340943.295081:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+136:72831:x1866818940510464:12345-192.168.203.16@tcp:101:touch.0 Request processed in 217us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340943.295089:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1521 00000100:00100000:1.0:1780340943.305191:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340943.309158:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940510592 00000100:00100000:3.0:1780340943.309174:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940510592 00000100:00100000:2.0:1780340943.313259:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5959 00000100:00100000:2.0:1780340943.313274:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+23:2407:x1866818940510592:12345-192.168.203.16@tcp:2:touch.0 00000100:00100000:2.0:1780340943.313504:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+24:2407:x1866818940510592:12345-192.168.203.16@tcp:2:touch.0 Request processed in 233us (8321us total) trans 4294969478 rc 0/0 00000100:00100000:2.0:1780340943.313512:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5959 00000100:00100000:2.0:1780340943.322892:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340943.324404:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940510848 00000100:00100000:1.0:1780340943.324418:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940510848 00000100:00100000:1.0:1780340943.324696:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 266 00000100:00100000:1.0:1780340943.324706:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+136:72831:x1866818940510848:12345-192.168.203.16@tcp:35:touch.0 00000100:00100000:1.0:1780340943.325157:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+137:72831:x1866818940510848:12345-192.168.203.16@tcp:35:touch.0 Request processed in 451us (2272us total) trans 120259084354 rc 0/0 00000100:00100000:1.0:1780340943.325177:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 266 00010000:00010000:0.0:1780340943.758506:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1780340943.762721:0:90562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084354 is committed 00010000:00010000:2.0:1780340943.769324:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432775868 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769341:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432775868 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769348:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432775868 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769354:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.769359:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432775868 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769383:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432775868 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769399:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff8c04506cff00) 00010000:00010000:2.0:1780340943.769401:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.769405:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432775868 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769412:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa24651432775868 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769434:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277586f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769440:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277586f lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769446:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277586f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769451:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.769454:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277586f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769459:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277586f lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769465:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:2.0:1780340943.769467:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.769470:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277586f lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769483:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa2465143277586f lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769497:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa246514327758ca lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769513:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa246514327758ca lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769518:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa246514327758ca lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769523:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ebe00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.769526:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa246514327758ca lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769532:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa246514327758ca lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769539:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:2.0:1780340943.769541:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780340943.769543:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa246514327758ca lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769549:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa246514327758ca lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769559:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758fb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769565:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758fb lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769576:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758fb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769581:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.769583:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758fb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769589:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758fb lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769596:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff8c04506cfa00) 00010000:00010000:2.0:1780340943.769598:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.769600:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758fb lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769606:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa246514327758fb lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769619:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa24651432775910 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769625:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa24651432775910 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769630:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa24651432775910 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769635:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2d000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.769637:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa24651432775910 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769658:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa24651432775910 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769666:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff8c045312ea00) 00010000:00010000:2.0:1780340943.769668:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.769671:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa24651432775910 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769677:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa24651432775910 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769686:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa24651432775933 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769692:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa24651432775933 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769697:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa24651432775933 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769702:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.769705:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa24651432775933 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769710:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa24651432775933 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769716:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff8c045a897b00) 00010000:00010000:2.0:1780340943.769718:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.769720:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa24651432775933 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769730:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa24651432775933 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769743:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa24651432775948 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769748:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa24651432775948 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769754:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa24651432775948 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769786:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2c200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.769789:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa24651432775948 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769795:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa24651432775948 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769803:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff8c045312e900) 00010000:00010000:2.0:1780340943.769805:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.769808:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa24651432775948 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769813:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa24651432775948 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769823:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432775964 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769829:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432775964 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769839:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432775964 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769845:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453122600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.769847:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432775964 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769853:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432775964 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769861:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff8c0477219b00) 00010000:00010000:2.0:1780340943.769863:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.769866:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432775964 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769871:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa24651432775964 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769884:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa24651432775979 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769890:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa24651432775979 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.769895:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa24651432775979 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770106:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.770111:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa24651432775979 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770127:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa24651432775979 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770136:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff8c045a897d00) 00010000:00010000:2.0:1780340943.770138:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.770142:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa24651432775979 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770147:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa24651432775979 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770159:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432775995 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770164:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432775995 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770170:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432775995 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770175:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eae00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.770178:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432775995 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770184:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432775995 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770191:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff8c045a897400) 00010000:00010000:2.0:1780340943.770193:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.770195:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432775995 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770207:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432775995 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770223:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327759aa lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770228:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327759aa lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770234:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327759aa lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770237:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.770240:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327759aa lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770245:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327759aa lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770251:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff8c0455c3b300) 00010000:00010000:2.0:1780340943.770253:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.770256:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327759aa lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770260:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327759aa lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770269:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa246514327759c6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770274:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa246514327759c6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770286:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa246514327759c6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770290:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486366600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.770292:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa246514327759c6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770297:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa246514327759c6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770305:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff8c0477219200) 00010000:00010000:2.0:1780340943.770307:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.770309:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa246514327759c6 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770314:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa246514327759c6 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770328:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366c00/0xa246514327759db lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770333:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366c00/0xa246514327759db lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770337:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366c00/0xa246514327759db lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770340:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486366c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.770343:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366c00/0xa246514327759db lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770355:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366c00/0xa246514327759db lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770361:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff8c0477219300) 00010000:00010000:2.0:1780340943.770363:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.770366:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366c00/0xa246514327759db lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770371:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366c00/0xa246514327759db lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770381:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa246514327759f7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770386:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa246514327759f7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770392:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa246514327759f7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770397:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486367400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.770399:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa246514327759f7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770404:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa246514327759f7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770411:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff8c0477219e00) 00010000:00010000:2.0:1780340943.770413:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.770415:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa246514327759f7 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770429:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa246514327759f7 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770443:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775a0c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770449:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775a0c lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770454:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775a0c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770458:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.770461:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775a0c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770467:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775a0c lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770474:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff8c04506cfd00) 00010000:00010000:2.0:1780340943.770476:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.770479:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775a0c lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770484:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa24651432775a0c lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770504:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa24651432775a28 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770510:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa24651432775a28 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770522:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa24651432775a28 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770528:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486367e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.770531:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa24651432775a28 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770537:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa24651432775a28 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770545:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff8c0477219100) 00010000:00010000:2.0:1780340943.770547:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.770549:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa24651432775a28 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770554:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa24651432775a28 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770569:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775a3d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770575:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775a3d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770579:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775a3d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770584:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486366200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.770587:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775a3d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770601:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775a3d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770609:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff8c0477219700) 00010000:00010000:2.0:1780340943.770611:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.770614:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775a3d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770620:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775a3d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770632:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432775a59 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770637:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432775a59 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770642:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432775a59 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770656:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.770659:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432775a59 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770664:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432775a59 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770672:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff8c04506cf800) 00010000:00010000:2.0:1780340943.770674:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.770677:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432775a59 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770688:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432775a59 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770702:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775a6e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770707:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775a6e lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770712:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775a6e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770717:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486367000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.770719:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775a6e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770724:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775a6e lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770732:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff8c0477219000) 00010000:00010000:2.0:1780340943.770734:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.770737:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775a6e lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770743:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775a6e lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.770753:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa24651432775a8a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771459:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa24651432775a8a lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771478:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa24651432775a8a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771483:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.771485:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa24651432775a8a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771500:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa24651432775a8a lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771512:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff8c0455c3b000) 00010000:00010000:2.0:1780340943.771514:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.771517:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa24651432775a8a lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771522:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa24651432775a8a lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771541:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432775a9f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771548:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432775a9f lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771554:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432775a9f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771558:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.771561:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432775a9f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771576:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432775a9f lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771584:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff8c0455c3b700) 00010000:00010000:2.0:1780340943.771587:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.771590:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432775a9f lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771596:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa24651432775a9f lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771608:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432775abb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771613:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432775abb lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771619:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432775abb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771624:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.771627:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432775abb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771632:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432775abb lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771639:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff8c04506cfb00) 00010000:00010000:2.0:1780340943.771641:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.771643:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432775abb lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771661:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa24651432775abb lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771681:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa24651432775ad0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771688:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa24651432775ad0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771694:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa24651432775ad0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771699:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2c800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.771701:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa24651432775ad0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771707:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa24651432775ad0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771714:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff8c045312ed00) 00010000:00010000:2.0:1780340943.771716:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.771719:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa24651432775ad0 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771724:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa24651432775ad0 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771732:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432775aec lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771739:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432775aec lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771749:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432775aec lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.771754:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.772536:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432775aec lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.772549:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432775aec lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.772560:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff8c0455c3b800) 00010000:00010000:2.0:1780340943.772562:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.772566:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432775aec lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.772571:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432775aec lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.772590:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775b01 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.772596:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775b01 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.772603:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775b01 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.772608:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486366400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.772610:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775b01 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.772627:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775b01 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.772634:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff8c0477219600) 00010000:00010000:2.0:1780340943.772636:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.772640:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775b01 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.773661:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775b01 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.773693:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432775b1d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.773700:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432775b1d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.773706:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432775b1d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.773711:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.773714:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432775b1d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.773720:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432775b1d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.773728:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff8c045312e100) 00010000:00010000:2.0:1780340943.773731:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.773734:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432775b1d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.773748:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6400/0xa24651432775b1d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.774844:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775b32 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.774855:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775b32 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.774863:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775b32 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.774868:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486366a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.774870:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775b32 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.774876:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775b32 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.774887:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff8c0477219500) 00010000:00010000:2.0:1780340943.774890:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.774894:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775b32 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.774898:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775b32 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775152:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775b4e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775158:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775b4e lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775176:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775b4e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775180:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.775183:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775b4e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775189:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775b4e lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775197:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff8c0455c3b600) 00010000:00010000:2.0:1780340943.775200:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.775202:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775b4e lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775208:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5400/0xa24651432775b4e lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775228:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa24651432775b63 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775234:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa24651432775b63 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775239:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa24651432775b63 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775347:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ebc00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.775350:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa24651432775b63 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775366:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa24651432775b63 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775374:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff8c0455c3ba00) 00010000:00010000:2.0:1780340943.775376:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.775379:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa24651432775b63 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775384:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa24651432775b63 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775397:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432775b7f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775402:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432775b7f lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775407:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432775b7f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775412:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722afe00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.775414:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432775b7f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775418:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432775b7f lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775424:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff8c0477219c00) 00010000:00010000:2.0:1780340943.775426:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.775429:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432775b7f lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775440:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432775b7f lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775454:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775b94 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775459:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775b94 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775464:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775b94 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775468:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.775471:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775b94 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775476:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775b94 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775482:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff8c0455c3bc00) 00010000:00010000:2.0:1780340943.775485:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.775487:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775b94 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775492:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432775b94 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775512:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1200/0xa24651432775bb0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775517:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1200/0xa24651432775bb0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775527:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1200/0xa24651432775bb0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775531:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.775534:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1200/0xa24651432775bb0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775539:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1200/0xa24651432775bb0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775545:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff8c04506cf300) 00010000:00010000:2.0:1780340943.775548:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.775551:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1200/0xa24651432775bb0 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775556:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1200/0xa24651432775bb0 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775572:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432775bc5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775577:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432775bc5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775582:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432775bc5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775587:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c6a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.775589:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432775bc5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775604:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432775bc5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775613:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff8c045312ec00) 00010000:00010000:2.0:1780340943.775615:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.775619:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432775bc5 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775624:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c6a00/0xa24651432775bc5 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775635:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775be1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775641:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775be1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.775647:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775be1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.776891:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04754c7600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.776895:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775be1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.777061:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775be1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.777074:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff8c045312eb00) 00010000:00010000:2.0:1780340943.777077:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.777081:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775be1 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.777097:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04754c7600/0xa24651432775be1 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.777120:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432775bf6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.777126:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432775bf6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.777132:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432775bf6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.777136:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.777139:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432775bf6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.777145:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432775bf6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.777152:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff8c0477219a00) 00010000:00010000:2.0:1780340943.777154:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.777158:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432775bf6 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.777164:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432775bf6 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.777174:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775c12 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.777179:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775c12 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.777192:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775c12 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.777197:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.777200:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775c12 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.777206:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775c12 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.777214:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff8c0455c3bf00) 00010000:00010000:2.0:1780340943.777217:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.777220:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775c12 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.777225:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5c00/0xa24651432775c12 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.777668:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775c27 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780162:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775c27 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780173:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775c27 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780178:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.780182:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775c27 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780209:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775c27 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780225:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff8c04506cfe00) 00010000:00010000:2.0:1780340943.780227:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.780232:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775c27 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780237:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775c27 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780362:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432775c43 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780368:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432775c43 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780374:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432775c43 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780378:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.780381:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432775c43 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780386:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432775c43 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780393:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff8c0477219f00) 00010000:00010000:2.0:1780340943.780395:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.780397:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432775c43 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780409:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432775c43 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780427:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775c58 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780432:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775c58 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780437:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775c58 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780441:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.780443:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775c58 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780447:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775c58 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780454:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff8c04506cf000) 00010000:00010000:2.0:1780340943.780456:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.780459:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775c58 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780464:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775c58 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780471:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432775c74 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780476:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432775c74 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780486:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432775c74 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.780490:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.780493:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432775c74 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781183:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432775c74 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781194:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff8c0455c3b400) 00010000:00010000:2.0:1780340943.781197:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.781201:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432775c74 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781207:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432775c74 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781229:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775c89 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781236:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775c89 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781856:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775c89 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781863:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440030800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.781866:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775c89 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781886:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775c89 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781894:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff8c0345328400) 00010000:00010000:2.0:1780340943.781897:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.781912:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775c89 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781918:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775c89 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781933:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775ca5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781938:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775ca5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781944:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775ca5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781948:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04445c7000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.781950:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775ca5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781955:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775ca5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781961:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff8c045312e300) 00010000:00010000:2.0:1780340943.781963:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.781966:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775ca5 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781977:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775ca5 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781992:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775cba lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.781998:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775cba lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.782003:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775cba lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.782007:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340943.782009:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775cba lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.782014:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775cba lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.782021:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff8c0345328100) 00010000:00010000:2.0:1780340943.782023:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340943.782026:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775cba lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340943.782031:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775cba lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340944.778220:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340945.292062:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961264128:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340945.292178:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340945.296926:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961264256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340945.297057:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340945.297313:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961264128 00000100:00100000:0.0:1780340945.297333:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961264128 00000100:00100000:0.0:1780340945.297428:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961264256 00000100:00100000:0.0:1780340945.297432:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961264256 00000100:00100000:0.0:1780340945.297453:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2168 00000100:00100000:0.0:1780340945.297463:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961264128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340945.297492:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340945.297553:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961264128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (5375us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340945.297561:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2168 00000100:00100000:0.0:1780340945.297578:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2169 00000100:00100000:0.0:1780340945.297584:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961264256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340945.297600:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340945.297652:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961264256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340945.297658:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2169 00000100:00100000:1.0:1780340945.298623:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961264128:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1780340945.301119:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340945.301145:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340945.301207:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961264256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340945.711918:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340945.712088:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940510976 00000100:00100000:2.0:1780340945.712111:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940510976 00000100:00100000:2.0:1780340945.712204:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1522 00000100:00100000:2.0:1780340945.712215:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+31:72860:x1866818940510976:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:2.0:1780340945.712269:0:63712:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445199872 avail 1298960384 00000100:00100000:2.0:1780340945.712351:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+31:72860:x1866818940510976:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 139us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340945.712359:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1522 00000100:00080000:1.0:1780340945.712592:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1780340945.717622:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340945.717714:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940511104 00000100:00100000:3.0:1780340945.717725:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940511104 00000100:00100000:3.0:1780340945.717872:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1523 00000100:00100000:3.0:1780340945.717883:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:72860:x1866818940511104:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:3.0:1780340945.717930:0:64454:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:3.0:1780340945.718022:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:72860:x1866818940511104:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 140us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340945.718052:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1523 00000100:00080000:1.0:1780340945.719887:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340945.743674:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340945.743817:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940511232 00000100:00100000:0.0:1780340945.743826:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940511232 00000100:00100000:0.0:1780340945.743894:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2170 00000100:00100000:0.0:1780340945.743904:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+24:72860:x1866818940511232:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:0.0:1780340945.743940:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340945.744076:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+24:72860:x1866818940511232:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 172us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340945.744084:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2170 00000100:00080000:1.0:1780340945.745075:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340945.760863:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340945.761389:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940511360 00000100:00100000:3.0:1780340945.761410:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940511360 00000100:00100000:3.0:1780340945.761489:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2171 00000100:00100000:3.0:1780340945.761500:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:72860:x1866818940511360:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:3.0:1780340945.761525:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1780340945.761610:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:72860:x1866818940511360:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 104us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340945.761618:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2171 00000100:00080000:1.0:1780340945.762359:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340945.802106:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340945.802131:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961264384:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340945.802250:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340945.802458:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961264384 00000100:00100000:2.0:1780340945.802467:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961264384 00000100:00100000:2.0:1780340945.802521:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3993 00000100:00100000:2.0:1780340945.802531:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961264384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340945.802562:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:2.0:1780340945.802617:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961264384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340945.802625:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3993 00000100:00100000:3.0:1780340945.803010:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961264896:0@lo:400:kworker.0 00000100:00100000:3.0:1780340945.803054:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340945.803077:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340945.803094:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961264512:0@lo:400:kworker.0 00000100:00100000:3.0:1780340945.803124:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340945.803160:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961264512 00000100:00100000:3.0:1780340945.803164:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961264512 00000100:00100000:3.0:1780340945.803306:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1780340945.803314:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046f953050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961264512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340945.803354:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046f953050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961264512:12345-0@lo:400:kworker.0 Request processed in 42us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340945.803360:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1780340945.803407:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961264512:0@lo:400:kworker.0 00000100:00100000:3.0:1780340945.803445:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961264896 00000100:00100000:3.0:1780340945.803463:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961264896 00000100:00100000:3.0:1780340945.803499:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1480 00000100:00100000:3.0:1780340945.803505:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961264896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340945.803540:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961264896:12345-0@lo:400:kworker.0 Request processed in 35us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340945.803546:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1480 00000100:00100000:3.0:1780340945.803572:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961264896:0@lo:400:kworker.0 00010000:00010000:2.0:1780340945.804223:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340945.804245:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961264768:0@lo:400:kworker.0 00000100:00100000:2.0:1780340945.804284:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340945.804312:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961265280:0@lo:400:kworker.0 00000100:00100000:2.0:1780340945.804335:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340945.804390:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1780340945.804397:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818961264640:0@lo:400:kworker.0 00000100:00100000:2.0:1780340945.804422:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340945.804437:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961265152:0@lo:400:kworker.0 00000100:00100000:2.0:1780340945.804460:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340945.804478:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1866818961265664:0@lo:400:kworker.0 00000100:00100000:2.0:1780340945.804518:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340945.804543:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961265152 00000100:00100000:2.0:1780340945.804547:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961265152 00000100:00100000:2.0:1780340945.804581:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3994 00000100:00100000:2.0:1780340945.804588:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1866818961265152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340945.804643:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1866818961265152:12345-0@lo:400:kworker.0 Request processed in 56us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340945.804650:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3994 00000100:00100000:2.0:1780340945.804686:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961265152:0@lo:400:kworker.0 00000100:00100000:2.0:1780340945.804705:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961264768 00000100:00100000:2.0:1780340945.804709:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961264768 00000100:00100000:2.0:1780340945.804729:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961265280 00000100:00100000:2.0:1780340945.804731:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961265280 00000100:00100000:2.0:1780340945.804741:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961264640 00000100:00100000:2.0:1780340945.804743:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961264640 00000100:00100000:2.0:1780340945.804755:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961265664 00000100:00100000:2.0:1780340945.804785:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961265664 00000100:00100000:2.0:1780340945.804802:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:2.0:1780340945.804809:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961264768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340945.804845:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961264768:12345-0@lo:400:kworker.0 Request processed in 37us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340945.804850:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00100000:2.0:1780340945.804883:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961264768:0@lo:400:kworker.0 00000100:00100000:2.0:1780340945.804900:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:2.0:1780340945.804906:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961265280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340945.804951:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961265280:12345-0@lo:400:kworker.0 Request processed in 46us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340945.804957:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00100000:2.0:1780340945.804980:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961265280:0@lo:400:kworker.0 00000100:00100000:2.0:1780340945.804996:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:2.0:1780340945.805002:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1866818961264640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340945.805044:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1866818961264640:12345-0@lo:400:kworker.0 Request processed in 32us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340945.805050:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00100000:2.0:1780340945.805074:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818961264640:0@lo:400:kworker.0 00000100:00100000:0.0:1780340945.805499:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:0.0:1780340945.805509:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1866818961265664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340945.805548:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1866818961265664:12345-0@lo:400:kworker.0 Request processed in 41us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340945.805562:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00080000:1.0:1780340945.806023:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1780340945.806028:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340945.806071:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961265024:0@lo:400:kworker.0 00000100:00100000:1.0:1780340945.806119:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340945.806149:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961265536:0@lo:400:kworker.0 00000100:00100000:1.0:1780340945.806176:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340945.806226:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961264384:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340945.806242:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340945.806247:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961265408:0@lo:400:kworker.0 00000100:00100000:1.0:1780340945.806268:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340945.806295:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961265536 00000100:00100000:1.0:1780340945.806300:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961265536 00000100:00100000:1.0:1780340945.806339:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961265408 00000100:00100000:1.0:1780340945.806342:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961265408 00000100:00100000:1.0:1780340945.806376:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2661 00000100:00100000:1.0:1780340945.806382:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961265536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340945.806421:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961265536:12345-0@lo:400:kworker.0 Request processed in 39us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340945.806428:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2661 00000100:00100000:1.0:1780340945.806442:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662 00000100:00100000:1.0:1780340945.806448:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961265408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340945.806473:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961265408:12345-0@lo:400:kworker.0 Request processed in 26us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340945.806478:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662 00000100:00080000:1.0:1780340945.806501:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1780340945.806504:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340945.806520:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961265408:0@lo:400:kworker.0 00000100:00100000:1.0:1780340945.806529:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961265536:0@lo:400:kworker.0 00000100:00100000:0.0:1780340945.806854:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961265024 00000100:00100000:0.0:1780340945.806859:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961265024 00000100:00100000:0.0:1780340945.806904:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:0.0:1780340945.806910:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961265024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340945.806968:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961265024:12345-0@lo:400:kworker.0 Request processed in 57us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340945.806974:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00080000:1.0:1780340945.807246:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340945.807269:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961265024:0@lo:400:kworker.0 00000100:00100000:2.0:1780340945.807726:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1866818961265664:0@lo:400:kworker.0 00000100:00100000:3.0:1780340946.313951:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1780340946.313972:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961265792:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340946.314048:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340946.314092:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961265792 00000100:00100000:3.0:1780340946.314099:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961265792 00000100:00100000:3.0:1780340946.314143:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3995 00000100:00100000:3.0:1780340946.314153:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961265792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340946.314187:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445199872 avail 1298960384 00000100:00100000:3.0:1780340946.314245:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346f50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961265792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340946.314253:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3995 00000100:00100000:3.0:1780340946.314298:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961265792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340946.314820:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1780340946.314832:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961265920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340946.314864:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340946.315100:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961265920 00000100:00100000:0.0:1780340946.315105:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961265920 00000100:00100000:0.0:1780340946.315138:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2172 00000100:00100000:0.0:1780340946.315145:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961265920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1780340946.315161:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1780340946.315201:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961265920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340946.315209:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2172 00000100:00100000:0.0:1780340946.315254:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961265920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340946.315950:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04529d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961266048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340946.315988:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340946.316020:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961266048 00000100:00100000:0.0:1780340946.316025:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961266048 00000100:00100000:0.0:1780340946.316061:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2173 00000100:00100000:0.0:1780340946.316068:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961266048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780340946.316083:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340946.316132:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349084000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961266048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340946.316149:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2173 00000100:00100000:0.0:1780340946.316184:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04529d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961266048:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1780340946.825914:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1780340947.373948:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969478 is committed 00000001:00080000:2.0:1780340947.373970:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969474 is committed 00000100:00100000:2.0:1780340947.493385:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340947.493684:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940511488 00000100:00100000:1.0:1780340947.493694:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940511488 00000100:00100000:1.0:1780340947.493784:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1524 00000100:00100000:1.0:1780340947.493794:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+31:72894:x1866818940511488:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:1.0:1780340947.493831:0:63712:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445199872 avail 1298960384 00000100:00100000:1.0:1780340947.493905:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+31:72894:x1866818940511488:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 113us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340947.493913:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1524 00000100:00080000:2.0:1780340947.495367:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780340947.522632:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340947.522673:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340947.522693:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340947.522720:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340947.522744:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340947.522791:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940512000 00000100:00100000:0.0:1780340947.522801:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940512000 00000100:00100000:0.0:1780340947.522849:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940511872 00000100:00100000:0.0:1780340947.522853:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940511872 00000100:00100000:0.0:1780340947.522872:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2663 00000100:00100000:0.0:1780340947.522881:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940512000:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340947.522958:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940512000:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 77us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340947.522966:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2663 00000100:00100000:0.0:1780340947.522981:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2664 00000100:00100000:0.0:1780340947.522988:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940511872:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340947.523011:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940511872:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340947.523017:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2664 00000100:00100000:0.0:1780340947.523047:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940511616 00000100:00100000:0.0:1780340947.523050:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940511616 00000100:00100000:0.0:1780340947.523074:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 177 00000100:00100000:0.0:1780340947.523089:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046f953450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940511616:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340947.523112:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046f953450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940511616:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340947.523118:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 177 00000100:00080000:0.0:1780340947.523144:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1780340947.523147:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340947.523422:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940512128 00000100:00100000:1.0:1780340947.523432:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940512128 00000100:00100000:1.0:1780340947.523470:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940511744 00000100:00100000:1.0:1780340947.523473:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940511744 00000100:00100000:1.0:1780340947.523495:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1486 00000100:00100000:1.0:1780340947.523502:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2407:x1866818940511744:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340947.523537:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2407:x1866818940511744:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 37us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340947.523543:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1486 00000100:00100000:1.0:1780340947.523556:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1525 00000100:00100000:1.0:1780340947.523562:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:72894:x1866818940512128:12345-192.168.203.16@tcp:41:lfs.0 00000004:00000024:1.0:1780340947.523588:0:70100:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:1.0:1780340947.523616:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:72894:x1866818940512128:12345-192.168.203.16@tcp:41:lfs.0 Request processed in 53us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340947.523622:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1525 00000100:00080000:0.0:1780340947.523790:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340947.534898:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340947.535392:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940512256 00000100:00100000:2.0:1780340947.535403:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940512256 00000100:00100000:2.0:1780340947.535460:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2174 00000100:00100000:2.0:1780340947.535472:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:72894:x1866818940512256:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:2.0:1780340947.535512:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1780340947.535575:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:72894:x1866818940512256:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 105us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340947.535593:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2174 00000100:00100000:1.0:1780340947.539269:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340947.539403:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940512384 00000100:00100000:0.0:1780340947.539412:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940512384 00000100:00100000:0.0:1780340947.539467:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2175 00000100:00100000:0.0:1780340947.539477:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:72894:x1866818940512384:12345-192.168.203.16@tcp:13:lfs.0 00002000:00000024:0.0:1780340947.539508:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340947.539574:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:72894:x1866818940512384:12345-192.168.203.16@tcp:13:lfs.0 Request processed in 98us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340947.539590:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2175 00000100:00100000:3.0:1780340947.649328:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340947.649366:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940512640 00000100:00100000:3.0:1780340947.649375:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940512640 00000100:00100000:3.0:1780340947.649430:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1526 00000100:00100000:3.0:1780340947.649440:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+31:72902:x1866818940512640:12345-192.168.203.16@tcp:36:mcreate.0 00010000:00010000:3.0:1780340947.649495:0:64454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340947.649522:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa246514327758a7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2685 expref: 31 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.649553:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:3.0:1780340947.649557:0:64454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340947.649624:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775cc8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.649637:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775cc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.649647:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775cc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.649662:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0600/0xa24651432775ccf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.649668:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0600/0xa24651432775ccf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.649683:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0600/0xa24651432775ccf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.650786:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775cc8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.650799:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775cc8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.650806:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775cc8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.650812:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775cc8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.650834:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340947.650838:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775cc8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.650846:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775cc8 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.650860:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:3.0:1780340947.650863:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340947.650867:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775cc8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.650873:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775cc8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340947.650887:0:64454:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000092d82a35 reply state 00000000d81cc481 transno 120259084355 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0600/0xa24651432775ccf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.650898:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0600/0xa24651432775ccf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.650904:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04506cf300) 00010000:00010000:3.0:1780340947.650907:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340947.650910:0:64454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780340947.652756:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+32:72902:x1866818940512640:12345-192.168.203.16@tcp:36:mcreate.0 Request processed in 3308us (3429us total) trans 120259084355 rc 0/0 00000100:00100000:3.0:1780340947.652783:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1526 00000100:00100000:0.0:1780340947.697121:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340947.697160:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940512768 00000100:00100000:0.0:1780340947.697171:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940512768 00000100:00100000:0.0:1780340947.697238:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1527 00000100:00100000:0.0:1780340947.697249:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+32:72905:x1866818940512768:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:0.0:1780340947.697272:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340947.697291:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432775cd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced27b2 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340947.697352:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432775cdd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340947.697373:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432775cdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340947.697385:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432775cdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340947.697428:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1780340947.697432:0:63712:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1780340947.697453:0:63712:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432775cdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340947.697476:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432775cd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27b2 expref: 34 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340947.697491:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432775cdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27b2 expref: 33 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340947.697499:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:0.0:1780340947.697502:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1780340947.697505:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440030e00, rc 0) 00000100:00100000:0.0:1780340947.697554:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+33:72905:x1866818940512768:12345-192.168.203.16@tcp:101:rm.0 Request processed in 308us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340947.697561:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1527 00000100:00100000:0.0:1780340947.705322:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340947.705802:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940512896 00000100:00100000:3.0:1780340947.705814:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940512896 00000100:00100000:3.0:1780340947.705866:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1528 00000100:00100000:3.0:1780340947.705888:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+33:72905:x1866818940512896:12345-192.168.203.16@tcp:101:rm.0 00010000:00010000:3.0:1780340947.706666:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340947.706731:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775ce4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced27b9 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.706821:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775ceb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.706836:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775ceb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.706847:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775ceb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.706858:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0800/0xa24651432775cf2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.706865:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0800/0xa24651432775cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.706871:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0800/0xa24651432775cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.708085:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775cf9 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.708102:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775cf9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.708111:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775cf9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340947.708170:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x1a:0x0]: returning size 0 00000004:00200000:3.0:1780340947.708174:0:63710:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1780340947.708195:0:63710:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775cf9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.712145:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775cf9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.712165:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775ceb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.712171:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775ceb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.712177:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775ceb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.712183:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775ceb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.712189:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340947.712193:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775ceb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.712200:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775ceb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.713131:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:3.0:1780340947.713135:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340947.713141:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775ceb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.713163:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775ceb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.713177:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0800/0xa24651432775cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.713183:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0800/0xa24651432775cf2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.713188:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0800/0xa24651432775cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.713193:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340947.713196:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0800/0xa24651432775cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.713202:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0800/0xa24651432775cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.715501:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04506cf300) 00010000:00010000:3.0:1780340947.715506:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340947.715513:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0800/0xa24651432775cf2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.715521:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0800/0xa24651432775cf2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.715691:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775ce4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27b9 expref: 35 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.715706:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775cf9 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27b9 expref: 34 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.715726:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff8c04506cf700) 00010000:00010000:3.0:1780340947.715729:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780340947.715732:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03485a0200, rc 0) 00000100:00100000:3.0:1780340947.716742:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+34:72905:x1866818940512896:12345-192.168.203.16@tcp:101:rm.0 Request processed in 10850us (11423us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340947.716752:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1528 00000100:00100000:0.0:1780340947.727675:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340947.727830:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940513152 00000100:00100000:3.0:1780340947.727841:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940513152 00000100:00100000:3.0:1780340947.727905:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1529 00000100:00100000:3.0:1780340947.727916:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+34:72905:x1866818940513152:12345-192.168.203.16@tcp:36:rm.0 00010000:00010000:3.0:1780340947.727974:0:70100:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1780340947.728000:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775cf9 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27b9 expref: 34 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.728018:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff8c04506cf700) 00010000:00010000:3.0:1780340947.728048:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432775cdd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27b2 expref: 33 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.728059:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:3.0:1780340947.728062:0:70100:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340947.728091:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0e00/0xa24651432775d00 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.728104:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0e00/0xa24651432775d00 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.728113:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0e00/0xa24651432775d00 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.728140:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1000/0xa24651432775d07 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.728147:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1000/0xa24651432775d07 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.728154:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1000/0xa24651432775d07 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.728509:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775d0e lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.728519:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775d0e lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.728526:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775d0e lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.728813:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775d15 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.728822:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775d15 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.728829:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775d15 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.728836:0:70100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775d15 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.728842:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775d15 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.728859:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775d15 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.728880:0:70100:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1780340947.729163:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340947.729171:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775d15 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340947.729178:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1a00 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:1.0:1780340947.729182:0:7442:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775d15 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340947.729190:0:7442:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775d15 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340947.729200:0:7442:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff8c04506cf800) 00010000:00010000:1.0:1780340947.729202:0:7442:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1780340947.729224:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775d15 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340947.729230:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775d15 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340947.729244:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340947.729246:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340947.729247:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340947.729654:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775d0e lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.729663:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775d0e lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.729669:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775d0e lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.729674:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340947.729678:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775d0e lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.729683:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775d0e lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.729693:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff8c04506cf800) 00010000:00010000:3.0:1780340947.729695:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1780340947.729698:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775d0e lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.729704:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775d0e lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.729727:0:70100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0e00/0xa24651432775d00 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.729733:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0e00/0xa24651432775d00 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.729746:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0e00/0xa24651432775d00 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.729751:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0e00/0xa24651432775d00 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.729756:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340947.729795:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0e00/0xa24651432775d00 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.729801:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0e00/0xa24651432775d00 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.729809:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:3.0:1780340947.729811:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340947.729814:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0e00/0xa24651432775d00 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.729819:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0e00/0xa24651432775d00 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340947.729829:0:70100:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ea088eaf reply state 000000000ee122ff transno 120259084356 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1000/0xa24651432775d07 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.729838:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1000/0xa24651432775d07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340947.729844:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04506cf300) 00010000:00010000:3.0:1780340947.729846:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340947.729849:0:70100:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780340947.730691:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+34:72905:x1866818940513152:12345-192.168.203.16@tcp:36:rm.0 Request processed in 2770us (3017us total) trans 120259084356 rc 0/0 00000100:00100000:3.0:1780340947.730710:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1529 00010000:00010000:0.0:1780340947.850341:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340948.874221:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340949.898812:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340950.411620:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961266176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340950.411682:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340950.411792:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961266176 00000100:00100000:2.0:1780340950.411798:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961266176 00000100:00080000:3.0:1780340950.414560:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340950.414586:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961266304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340950.414644:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340950.416290:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961266304 00000100:00100000:2.0:1780340950.416302:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961266304 00000100:00100000:0.0:1780340950.416303:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176 00000100:00100000:0.0:1780340950.416317:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961266176:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340950.416345:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2177 00000100:00100000:2.0:1780340950.416351:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a07e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961266304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1780340950.416354:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1780340950.416365:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00010000:00000080:2.0:1780340950.416375:0:34330:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047a07e300 x1866818961266304/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:376/0 lens 224/368 e 0 to 0 dl 1780340961 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340950.416408:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a07e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961266304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (1763us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340950.416408:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961266176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (4726us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340950.416415:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2177 00000100:00100000:0.0:1780340950.416417:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176 00000100:00080000:2.0:1780340950.416437:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340950.416456:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961266304:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1780340950.416456:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961266176:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1780340950.921949:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340950.925246:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ecbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961266560:0@lo:400:kworker.0 00000100:00100000:3.0:1780340950.925349:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340950.925390:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961267072:0@lo:400:kworker.0 00000100:00100000:3.0:1780340950.925415:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340950.925434:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961267584:0@lo:400:kworker.0 00000100:00100000:3.0:1780340950.925455:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340950.925477:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1780340950.925483:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961266432:0@lo:400:kworker.0 00000100:00100000:3.0:1780340950.925508:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340950.925533:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961266944:0@lo:400:kworker.0 00000100:00100000:3.0:1780340950.925554:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340950.925568:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961267456:0@lo:400:kworker.0 00000100:00100000:3.0:1780340950.925588:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340950.925616:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961267072 00000100:00100000:3.0:1780340950.925623:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961267072 00000100:00100000:3.0:1780340950.925663:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3996 00000100:00100000:3.0:1780340950.925671:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961267072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340950.925720:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961267072:12345-0@lo:400:kworker.0 Request processed in 49us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340950.925727:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3996 00000100:00100000:3.0:1780340950.925805:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961266432 00000100:00100000:3.0:1780340950.925809:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961266432 00000100:00100000:3.0:1780340950.925834:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1780340950.925840:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961266432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340950.926142:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477381050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961266432:12345-0@lo:400:kworker.0 Request processed in 302us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340950.926149:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1780340950.926178:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961267584 00000100:00100000:3.0:1780340950.926181:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961267584 00000100:00100000:3.0:1780340950.926256:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961267456 00000100:00100000:3.0:1780340950.926260:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961267456 00000100:00100000:3.0:1780340950.926281:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665 00000100:00100000:3.0:1780340950.926287:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961267584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340950.926318:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961267584:12345-0@lo:400:kworker.0 Request processed in 31us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340950.926325:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665 00000100:00100000:3.0:1780340950.926335:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666 00000100:00100000:3.0:1780340950.926340:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961267456:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1780340950.926352:0:8830:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0485a18700 x1866818961267456/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:376/0 lens 224/224 e 0 to 0 dl 1780340961 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340950.926376:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961267456:12345-0@lo:400:kworker.0 Request processed in 36us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340950.926382:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666 00000100:00080000:3.0:1780340950.926400:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1780340950.926403:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340950.926430:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047207e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961266432:0@lo:400:kworker.0 00000100:00100000:3.0:1780340950.926443:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961267456:0@lo:400:kworker.0 00000100:00100000:3.0:1780340950.926462:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961267072:0@lo:400:kworker.0 00000100:00100000:3.0:1780340950.926470:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961267584:0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.926571:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961266688:0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.926601:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340950.926624:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961267200:0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.926644:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340950.926660:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961267712:0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.926681:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340950.926697:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1780340950.926703:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04587b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961266816:0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.926722:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340950.926732:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961267328:0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.926789:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340950.926818:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961266560 00000100:00100000:0.0:1780340950.926822:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961266560 00000100:00100000:0.0:1780340950.926850:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961266944 00000100:00100000:0.0:1780340950.926853:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961266944 00000100:00100000:0.0:1780340950.926866:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961266688 00000100:00100000:0.0:1780340950.926868:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961266688 00000100:00100000:0.0:1780340950.926880:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961267200 00000100:00100000:0.0:1780340950.926882:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961267200 00000100:00100000:0.0:1780340950.926892:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961267712 00000100:00100000:0.0:1780340950.926894:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961267712 00000100:00100000:0.0:1780340950.926924:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961266816 00000100:00100000:0.0:1780340950.926927:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961266816 00000100:00100000:0.0:1780340950.926942:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:0.0:1780340950.926948:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818961266560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.926985:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818961266560:12345-0@lo:400:kworker.0 Request processed in 37us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340950.926991:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:0.0:1780340950.927017:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00100000:0.0:1780340950.927024:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961266944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.927050:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961266944:12345-0@lo:400:kworker.0 Request processed in 27us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340950.927056:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00100000:0.0:1780340950.927069:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:0.0:1780340950.927075:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961266688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.927105:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961266688:12345-0@lo:400:kworker.0 Request processed in 30us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340950.927110:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00100000:0.0:1780340950.927122:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1490 00000100:00100000:0.0:1780340950.927128:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961267200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.927151:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961267200:12345-0@lo:400:kworker.0 Request processed in 24us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340950.927157:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1490 00000100:00100000:0.0:1780340950.927168:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:0.0:1780340950.927174:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961267712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.927198:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961267712:12345-0@lo:400:kworker.0 Request processed in 25us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340950.927211:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00100000:0.0:1780340950.927222:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:0.0:1780340950.927228:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961266816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.927253:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961266816:12345-0@lo:400:kworker.0 Request processed in 25us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340950.927258:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:0.0:1780340950.927279:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961267328 00000100:00100000:0.0:1780340950.927283:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961267328 00000100:00100000:0.0:1780340950.927308:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3997 00000100:00100000:0.0:1780340950.927314:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961267328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.927342:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961267328:12345-0@lo:400:kworker.0 Request processed in 29us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340950.927348:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3997 00000100:00080000:0.0:1780340950.927364:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340950.927367:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780340950.927384:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961266816:0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.927394:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961267328:0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.927402:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961266688:0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.927410:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961267200:0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.927418:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961267712:0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.927448:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04587b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961266944:0@lo:400:kworker.0 00000100:00100000:0.0:1780340950.927458:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ecbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961266560:0@lo:400:kworker.0 00000100:00100000:2.0:1780340950.927849:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961267840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340950.927879:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340950.928071:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961267840 00000100:00100000:1.0:1780340950.928076:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961267840 00000100:00100000:1.0:1780340950.928111:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3998 00000100:00100000:1.0:1780340950.928118:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961267840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1780340950.928141:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:1.0:1780340950.928179:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961267840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340950.928185:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3998 00000100:00100000:1.0:1780340950.928218:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961267840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340951.433947:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c03498c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961267968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340951.434020:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340951.434083:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961267968 00000100:00100000:2.0:1780340951.434091:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961267968 00000100:00100000:2.0:1780340951.434130:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2178 00000100:00100000:2.0:1780340951.434138:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961267968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1780340951.434158:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00010000:00000080:2.0:1780340951.434172:0:8403:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c03498caa00 x1866818961267968/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:377/0 lens 224/368 e 0 to 0 dl 1780340962 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340951.434332:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04440a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961268096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340951.434357:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340951.434361:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961267968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 223us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340951.434368:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2178 00000100:00100000:2.0:1780340951.434382:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961268096 00000100:00100000:2.0:1780340951.434385:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961268096 00000100:00100000:1.0:1780340951.434412:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c03498c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961267968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1780340951.434417:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2179 00000100:00100000:2.0:1780340951.434422:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961268096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780340951.434432:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340951.434468:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961268096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340951.434474:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2179 00000100:00100000:1.0:1780340951.434496:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04440a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961268096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340951.445979:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1780340951.446011:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961268224:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340951.446083:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340951.446735:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961268224 00000100:00100000:0.0:1780340951.446744:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961268224 00000100:00100000:0.0:1780340951.446813:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3999 00000100:00100000:0.0:1780340951.446823:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1866818961268224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780340951.446859:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445199872 avail 1298960384 00000100:00100000:0.0:1780340951.446926:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1866818961268224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340951.446933:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3999 00000100:00100000:0.0:1780340951.446982:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961268224:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1780340951.947982:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340952.624246:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340952.624281:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340952.624307:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340952.624325:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340952.624349:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340952.624389:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940513408 00000100:00100000:2.0:1780340952.624404:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940513408 00000100:00100000:2.0:1780340952.624458:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940513536 00000100:00100000:2.0:1780340952.624461:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940513536 00000100:00100000:2.0:1780340952.624485:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1493 00000100:00100000:2.0:1780340952.624507:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+34:2407:x1866818940513408:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340952.624618:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+34:2407:x1866818940513408:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 125us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340952.624624:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1493 00000100:00100000:2.0:1780340952.624640:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1494 00000100:00100000:2.0:1780340952.624646:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0444224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2407:x1866818940513536:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340952.624667:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0444224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2407:x1866818940513536:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 22us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340952.624673:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1494 00000100:00100000:2.0:1780340952.624689:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940513664 00000100:00100000:2.0:1780340952.624692:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940513664 00000100:00100000:2.0:1780340952.624713:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940513792 00000100:00100000:2.0:1780340952.624715:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940513792 00000100:00100000:2.0:1780340952.624732:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2667 00000100:00100000:2.0:1780340952.624738:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940513664:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000080:2.0:1780340952.624751:0:25486:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046b883b80 x1866818940513664/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:378/0 lens 224/224 e 0 to 0 dl 1780340963 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340952.624796:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b883b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2407:x1866818940513664:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 58us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340952.624801:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2667 00000100:00100000:2.0:1780340952.624811:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2668 00000100:00100000:2.0:1780340952.624817:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940513792:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340952.624841:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940513792:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340952.624847:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2668 00000100:00100000:2.0:1780340952.624863:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940513280 00000100:00100000:2.0:1780340952.624866:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940513280 00000100:00100000:2.0:1780340952.624893:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 179 00000100:00100000:2.0:1780340952.624899:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940513280:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340952.624921:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477380450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940513280:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 22us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340952.624927:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 179 00000100:00080000:2.0:1780340952.624954:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340952.624958:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1780340952.624960:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340952.624962:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1780340952.969925:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1780340952.973656:0:90562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084356 is committed 00010000:00010000:1.0:1780340952.974708:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0600/0xa24651432775ccf lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340952.974722:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0600/0xa24651432775ccf lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340952.974736:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0600/0xa24651432775ccf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340952.974743:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340952.974748:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0600/0xa24651432775ccf lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340952.974755:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0600/0xa24651432775ccf lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340952.974787:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04506cf300) 00010000:00010000:1.0:1780340952.974790:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340952.974795:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0600/0xa24651432775ccf lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340952.974801:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0600/0xa24651432775ccf lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340952.974850:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1000/0xa24651432775d07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340952.974856:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1000/0xa24651432775d07 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340952.974862:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1000/0xa24651432775d07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340952.974867:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340952.974869:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1000/0xa24651432775d07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340952.974884:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1000/0xa24651432775d07 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340952.974892:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xfcdb443d (ffff8c04506cf300) 00010000:00010000:1.0:1780340952.974894:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340952.974897:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1000/0xa24651432775d07 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340952.974903:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1000/0xa24651432775d07 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xfcdb443d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340953.997205:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340955.018502:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1780340955.382113:0:91987:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: ost1 REPLAY BARRIER on lustre-OST0000 00000100:00100000:1.0:1780340955.532621:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961268480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340955.532722:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340955.532796:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780340955.532816:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961268480 00000100:00100000:1.0:1780340955.532819:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0348a6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961268352:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1780340955.532825:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961268480 00000100:00100000:1.0:1780340955.532848:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340955.532883:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961268352 00000100:00100000:1.0:1780340955.532887:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961268352 00000100:00100000:2.0:1780340955.532888:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2180 00000100:00100000:2.0:1780340955.532902:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961268480:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1780340955.532921:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2181 00000100:00100000:1.0:1780340955.532929:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961268352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340955.532940:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00002000:00000024:1.0:1780340955.532949:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000080:2.0:1780340955.532973:0:10290:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04440a4380 x1866818961268480/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:381/0 lens 224/368 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340955.533008:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961268352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340955.533017:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2181 00000100:00100000:2.0:1780340955.533022:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961268480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340955.533030:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2180 00000100:00080000:2.0:1780340955.533053:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1780340955.533070:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1780340955.533072:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0348a6a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961268352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340955.533107:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446b64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961268480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340955.692441:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340955.694027:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940513920 00000100:00100000:1.0:1780340955.694039:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940513920 00000100:00080000:2.0:1780340955.694115:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340955.694129:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1530 00000100:00100000:1.0:1780340955.694140:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+30:72983:x1866818940513920:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:1.0:1780340955.694159:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340955.694179:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af400/0xa24651432775d1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced27c0 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.694242:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432775d23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.694255:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432775d23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.694266:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432775d23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340955.694308:0:70100:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1780340955.694311:0:70100:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1780340955.694346:0:70100:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432775d23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.694369:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af400/0xa24651432775d1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27c0 expref: 32 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.694388:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aec00/0xa24651432775d23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27c0 expref: 31 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.694395:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c045247cb00) 00010000:00010000:1.0:1780340955.694410:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1780340955.694414:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722aec00, rc 0) 00000100:00100000:1.0:1780340955.694478:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+31:72983:x1866818940513920:12345-192.168.203.16@tcp:101:dd.0 Request processed in 341us (2059us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340955.694484:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1530 00000100:00100000:2.0:1780340955.697742:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340955.698201:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940514176 00000100:00100000:0.0:1780340955.698211:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940514176 00000100:00100000:0.0:1780340955.698266:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1531 00000100:00100000:0.0:1780340955.698276:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+31:72983:x1866818940514176:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:0.0:1780340955.698294:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340955.698312:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775d2a lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced27c7 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698465:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775d31 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698479:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775d31 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698490:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775d31 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698531:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432775d38 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698540:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432775d38 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698547:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432775d38 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698600:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432775d3f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698608:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432775d3f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698615:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432775d3f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340955.698625:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x6:0x0]: returning size 0 00010000:00010000:0.0:1780340955.698721:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775d31 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698730:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775d31 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698736:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775d31 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698741:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775d31 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698746:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440030800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340955.698756:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775d31 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698786:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775d31 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698799:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:0.0:1780340955.698803:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340955.698807:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775d31 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698814:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432775d31 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698827:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432775d38 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698833:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432775d38 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698839:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432775d38 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698854:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440031c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340955.698856:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432775d38 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698862:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432775d38 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.698868:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff8c0345328500) 00010000:00010000:0.0:1780340955.698870:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340955.699142:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432775d38 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.699149:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031c00/0xa24651432775d38 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.699194:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031600/0xa24651432775d2a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27c7 expref: 34 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.699207:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432775d3f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27c7 expref: 33 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.699215:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff8c045312ea00) 00010000:00010000:0.0:1780340955.699217:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780340955.699220:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440030e00, rc 0) 00000100:00100000:0.0:1780340955.699279:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+33:72983:x1866818940514176:12345-192.168.203.16@tcp:101:dd.0 Request processed in 1005us (1547us total) trans 120259084357 rc 0/0 00000100:00100000:0.0:1780340955.699287:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1531 00000100:00100000:2.0:1780340955.714445:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340955.714679:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940514304 00000100:00100000:3.0:1780340955.714689:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940514304 00000100:00100000:3.0:1780340955.714745:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1532 00000100:00100000:3.0:1780340955.714756:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+33:72983:x1866818940514304:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340955.714813:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340955.714833:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775d4d lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced27ce expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.714885:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0e00/0xa24651432775d54 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.714899:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0e00/0xa24651432775d54 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.715185:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0e00/0xa24651432775d54 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.715299:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775d4d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27ce expref: 35 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.715317:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0e00/0xa24651432775d54 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27ce expref: 34 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.715327:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff8c045312ea00) 00010000:00010000:3.0:1780340955.715336:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1780340955.715340:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03485a0e00, rc 0) 00000100:00100000:3.0:1780340955.715403:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+34:72983:x1866818940514304:12345-192.168.203.16@tcp:101:dd.0 Request processed in 649us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340955.715410:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1532 00000100:00100000:1.0:1780340955.730481:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340955.730521:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340955.730547:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940514560 00000100:00100000:1.0:1780340955.730556:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940514560 00000100:00100000:1.0:1780340955.730603:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940514816 00000100:00100000:1.0:1780340955.730606:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940514816 00000100:00100000:1.0:1780340955.730627:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1533 00000100:00100000:1.0:1780340955.730635:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+35:72983:x1866818940514560:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:1.0:1780340955.730687:0:63712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340955.730711:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432775d3f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27c7 expref: 35 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.730729:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff8c045312ea00) 00010000:00010000:1.0:1780340955.730734:0:63712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780340955.730929:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af400/0xa24651432775d5b lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.730954:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af400/0xa24651432775d5b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.730972:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af400/0xa24651432775d5b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1780340955.731015:0:63712:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084358 00000004:00010000:1.0:1780340955.731037:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000063df8a5c reply state 000000003cae6d45 transno 120259084359 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af400/0xa24651432775d5b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731071:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af400/0xa24651432775d5b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731078:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff8c045312ea00) 00010000:00010000:1.0:1780340955.731081:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340955.731083:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780340955.731162:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+37:72983:x1866818940514560:12345-192.168.203.16@tcp:36:dd.0 Request processed in 527us (689us total) trans 120259084359 rc 0/0 00000100:00100000:1.0:1780340955.731169:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1533 00000020:00080000:1.0:1780340955.731174:0:63712:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1780340955.731188:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1534 00000100:00100000:1.0:1780340955.731194:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04440a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+36:72984:x1866818940514816:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:1.0:1780340955.731202:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340955.731212:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aee00/0xa24651432775d62 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced27d5 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731297:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775d69 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731306:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775d69 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731313:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775d69 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731326:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432775d70 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731333:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432775d70 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731346:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432775d70 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731385:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae200/0xa24651432775d77 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731393:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae200/0xa24651432775d77 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731399:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae200/0xa24651432775d77 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340955.731407:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x7:0x0]: returning size 0 00010000:00010000:1.0:1780340955.731450:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775d69 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731456:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775d69 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731461:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775d69 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731467:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775d69 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731472:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340955.731476:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775d69 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731483:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775d69 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731500:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:1.0:1780340955.731503:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340955.731507:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775d69 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731513:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775d69 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731524:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432775d70 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731530:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432775d70 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731534:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432775d70 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731538:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340955.731541:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432775d70 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731546:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432775d70 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731553:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff8c0471ec0900) 00010000:00010000:1.0:1780340955.731555:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340955.731557:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432775d70 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731563:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432775d70 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731604:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aee00/0xa24651432775d62 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27d5 expref: 39 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731617:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae200/0xa24651432775d77 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27d5 expref: 38 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.731623:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff8c045312e900) 00010000:00010000:1.0:1780340955.731625:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780340955.731628:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722ae200, rc 0) 00000100:00100000:1.0:1780340955.731651:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04440a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+38:72984:x1866818940514816:12345-192.168.203.16@tcp:101:dd.0 Request processed in 458us (1130us total) trans 120259084360 rc 0/0 00000100:00100000:1.0:1780340955.731657:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1534 00000100:00100000:2.0:1780340955.737164:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340955.737727:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940514944 00000100:00100000:0.0:1780340955.737738:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940514944 00000100:00100000:0.0:1780340955.738043:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5960 00000100:00100000:0.0:1780340955.738063:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:72983:x1866818940514944:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:0.0:1780340955.738080:0:25494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340955.738100:0:25494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa24651432775d85 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced27dc expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340955.738125:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x362:0x0] initial LVB size: 0, mtime: 0x6a1dd8ce, atime: 0x6a1dd8ce, ctime: 0x6a1dd8ce, blocks: 0x0 00010000:00010000:0.0:1780340955.738144:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340955.738158:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340955.738166:0:25494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa24651432775d85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27dc expref: 6 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.738184:0:25494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa24651432775d85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27dc expref: 6 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.738197:0:25494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440031600, rc 0) 00010000:00000080:0.0:1780340955.738204:0:25494:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0476d9df80 x1866818940514944/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 328/400 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340955.738268:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:72983:x1866818940514944:12345-192.168.203.16@tcp:101:dd.0 Request processed in 216us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340955.738275:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5960 00000100:00080000:2.0:1780340955.738589:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340955.749225:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340955.750653:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940515200 00000100:00100000:1.0:1780340955.750681:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940515200 00000100:00100000:1.0:1780340955.750750:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1535 00000100:00100000:1.0:1780340955.750800:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+38:72984:x1866818940515200:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:1.0:1780340955.750826:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340955.750856:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aee00/0xa24651432775d8c lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced27e3 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.750897:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432775d93 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.750918:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432775d93 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.750929:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432775d93 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.751054:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aee00/0xa24651432775d8c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27e3 expref: 40 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.751075:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af000/0xa24651432775d93 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27e3 expref: 39 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.751083:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff8c045312e900) 00010000:00010000:1.0:1780340955.751086:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1780340955.751090:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722af000, rc 0) 00000100:00100000:1.0:1780340955.751150:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+39:72984:x1866818940515200:12345-192.168.203.16@tcp:101:dd.0 Request processed in 391us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340955.751157:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1535 00000100:00100000:3.0:1780340955.753829:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340955.754228:0:8406:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940515072 00000100:00100000:0.0:1780340955.754239:0:8406:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940515072 00002000:00010000:0.0:1780340955.754277:0:8406:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/866 (0->18446744073709551615) 00002000:00100000:0.0:1780340955.754282:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c04587b6300 with x1866818940515072 ext(0->18446744073709551615) 00002000:00010000:0.0:1780340955.754292:0:8406:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c04587b6300. 00000100:00100000:0.0:1780340955.754433:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1008 00000100:00100000:0.0:1780340955.754445:0:8406:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2408:x1866818940515072:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:0.0:1780340955.754600:0:8406:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x362:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1780340955.754604:0:8406:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x362:0x0] updating lvb mtime from disk: 1780340942 -> 1780340956 00002000:00010000:0.0:1780340955.754607:0:8406:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x362:0x0] updating lvb atime from disk: 1780340942 -> 1780340942 00002000:00010000:0.0:1780340955.754609:0:8406:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x362:0x0] updating lvb ctime from disk: 1780340942 -> 1780340956 00002000:00010000:0.0:1780340955.754611:0:8406:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x362:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1780340955.754620:0:8406:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04587b6300 x1866818940515072/t4294969479(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 440/432 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340955.754699:0:8406:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940515072:12345-192.168.203.16@tcp:10:dd.0 Request processed in 257us (878us total) trans 4294969479 rc 0/0 00000100:00100000:0.0:1780340955.754707:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1008 00002000:00010000:0.0:1780340955.754712:0:8406:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/866 (0->18446744073709551615) 00002000:00100000:0.0:1780340955.754715:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c04587b6300 with x1866818940515072 ext(0->18446744073709551615) 00002000:00010000:0.0:1780340955.754720:0:8406:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c04587b6300. 00000100:00100000:3.0:1780340955.758483:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340955.758575:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340955.758602:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940515456 00000100:00100000:3.0:1780340955.758612:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940515456 00000100:00100000:3.0:1780340955.758655:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940515712 00000100:00100000:3.0:1780340955.758658:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940515712 00000100:00100000:3.0:1780340955.758694:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1536 00000100:00100000:3.0:1780340955.758704:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+40:72985:x1866818940515456:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340955.758723:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340955.758740:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775d9a lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced27ea expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.758898:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775da1 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340955.759165:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1537 00000100:00100000:1.0:1780340955.759177:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+41:72984:x1866818940515712:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:1.0:1780340955.759202:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340955.759222:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae200/0xa24651432775d77 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27d5 expref: 41 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.759240:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff8c045312e900) 00010000:00010000:1.0:1780340955.759245:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780340955.759385:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775da8 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.759398:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775da8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.759407:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775da8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1780340955.759461:0:63711:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084361 00000004:00010000:1.0:1780340955.759480:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003efbd06d reply state 000000005a2272c0 transno 120259084362 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775da8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.759490:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775da8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.759496:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff8c045312e900) 00010000:00010000:1.0:1780340955.759499:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340955.759502:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780340955.759655:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+43:72984:x1866818940515712:12345-192.168.203.16@tcp:36:dd.0 Request processed in 480us (1077us total) trans 120259084362 rc 0/0 00010000:00010000:3.0:1780340955.759795:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775da1 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.759805:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775da1 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.759821:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775daf lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.759839:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775daf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.759847:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775daf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.759902:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0800/0xa24651432775db6 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340955.760078:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1537 00000020:00080000:1.0:1780340955.760083:0:63711:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1780340955.760230:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0800/0xa24651432775db6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.760240:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0800/0xa24651432775db6 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340955.760251:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x8:0x0]: returning size 0 00010000:00010000:1.0:1780340955.762047:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775da1 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.762062:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775da1 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.762068:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775da1 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.762075:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775da1 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.762081:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340955.762085:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775da1 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.762091:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775da1 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.762115:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:1.0:1780340955.762118:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340955.762122:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775da1 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.762128:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775da1 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.762143:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775daf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.762149:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775daf lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.762155:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775daf lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.762160:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340955.762162:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775daf lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.762168:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775daf lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.762176:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff8c04506cf700) 00010000:00010000:1.0:1780340955.762179:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340955.762181:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775daf lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.762187:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775daf lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.762250:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775d9a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27ea expref: 44 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.762263:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0800/0xa24651432775db6 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27ea expref: 43 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.762270:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff8c045a897d00) 00010000:00010000:1.0:1780340955.762271:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780340955.762274:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03485a0800, rc 0) 00000100:00100000:1.0:1780340955.762343:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+43:72985:x1866818940515456:12345-192.168.203.16@tcp:101:dd.0 Request processed in 3640us (3880us total) trans 120259084363 rc 0/0 00000100:00100000:1.0:1780340955.762351:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1536 00000100:00100000:3.0:1780340955.773731:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340955.773883:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340955.774817:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940516096 00000100:00100000:0.0:1780340955.774830:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940516096 00000100:00100000:0.0:1780340955.774904:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 267 00000100:00100000:0.0:1780340955.774921:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+43:72983:x1866818940516096:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:0.0:1780340955.775219:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+44:72983:x1866818940516096:12345-192.168.203.16@tcp:35:dd.0 Request processed in 300us (1345us total) trans 120259084364 rc 0/0 00000100:00100000:0.0:1780340955.775227:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 267 00000100:00100000:2.0:1780340955.781351:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340955.781436:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940516224 00000100:00100000:3.0:1780340955.781445:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940516224 00000100:00100000:3.0:1780340955.781540:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1538 00000100:00100000:3.0:1780340955.781551:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+44:72985:x1866818940516224:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340955.781575:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340955.781595:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1200/0xa24651432775dc4 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced27f8 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.781628:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1600/0xa24651432775dcb lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.781643:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1600/0xa24651432775dcb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.781681:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1600/0xa24651432775dcb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.781817:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1200/0xa24651432775dc4 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27f8 expref: 46 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.781834:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1600/0xa24651432775dcb lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27f8 expref: 45 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.781852:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff8c045a897d00) 00010000:00010000:3.0:1780340955.781855:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1780340955.781859:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03485a1600, rc 0) 00000100:00100000:3.0:1780340955.783280:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+45:72985:x1866818940516224:12345-192.168.203.16@tcp:101:dd.0 Request processed in 1722us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340955.783291:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1538 00000100:00100000:1.0:1780340955.784791:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940515840 00000100:00100000:1.0:1780340955.784803:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940515840 00000100:00100000:1.0:1780340955.784863:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5961 00000100:00100000:1.0:1780340955.784871:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04587b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:72984:x1866818940515840:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:1.0:1780340955.784893:0:25490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340955.787098:0:25490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa24651432775dd2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced27f1 expref: -99 pid: 25490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340955.787135:0:25490:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x363:0x0] initial LVB size: 0, mtime: 0x6a1dd8ce, atime: 0x6a1dd8ce, ctime: 0x6a1dd8ce, blocks: 0x0 00010000:00010000:1.0:1780340955.787161:0:25490:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340955.787163:0:25490:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340955.787172:0:25490:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa24651432775dd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27f1 expref: 8 pid: 25490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.787210:0:25490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa24651432775dd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27f1 expref: 8 pid: 25490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.787224:0:25490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722ae200, rc 0) 00010000:00000080:1.0:1780340955.787233:0:25490:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04587b6a00 x1866818940515840/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 328/400 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340955.787311:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04587b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:72984:x1866818940515840:12345-192.168.203.16@tcp:101:dd.0 Request processed in 2440us (13590us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340955.787320:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5961 00000100:00100000:2.0:1780340955.791325:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340955.791410:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940516480 00000100:00100000:3.0:1780340955.791420:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940516480 00000100:00100000:3.0:1780340955.791485:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1539 00000100:00100000:3.0:1780340955.791495:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+45:72989:x1866818940516480:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340955.791514:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340955.791828:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775dd9 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced27ff expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.791984:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1400/0xa24651432775de0 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792000:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1400/0xa24651432775de0 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792022:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1400/0xa24651432775de0 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792037:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775de7 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792044:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775de7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792050:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775de7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792108:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775dee lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792117:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775dee lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792123:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775dee lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340955.792133:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0xc:0x0]: returning size 0 00010000:00010000:3.0:1780340955.792209:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1400/0xa24651432775de0 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792215:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1400/0xa24651432775de0 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792221:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1400/0xa24651432775de0 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792227:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1400/0xa24651432775de0 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792237:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340955.792242:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1400/0xa24651432775de0 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792250:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1400/0xa24651432775de0 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792262:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:3.0:1780340955.792265:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340955.792269:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1400/0xa24651432775de0 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792275:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1400/0xa24651432775de0 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792289:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775de7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792295:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775de7 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792300:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775de7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792305:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340955.792308:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775de7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792314:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775de7 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792331:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff8c04506cfb00) 00010000:00010000:3.0:1780340955.792334:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340955.792337:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775de7 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792342:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775de7 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.792380:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775dd9 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27ff expref: 48 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.793903:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775dee lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27ff expref: 47 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.793915:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff8c0477219700) 00010000:00010000:3.0:1780340955.793918:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780340955.793920:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03485a0a00, rc 0) 00000100:00100000:3.0:1780340955.794009:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+47:72989:x1866818940516480:12345-192.168.203.16@tcp:101:dd.0 Request processed in 2514us (2691us total) trans 120259084365 rc 0/0 00000100:00100000:3.0:1780340955.794018:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1539 00000100:00100000:2.0:1780340955.802574:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.802609:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.802631:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340955.802799:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940516736 00000100:00100000:3.0:1780340955.802809:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940516736 00000100:00100000:3.0:1780340955.802857:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940516992 00000100:00100000:3.0:1780340955.802859:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940516992 00000100:00100000:3.0:1780340955.802886:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1540 00000100:00100000:3.0:1780340955.802895:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+48:72985:x1866818940516736:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:3.0:1780340955.802948:0:63712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340955.802993:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0800/0xa24651432775db6 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27ea expref: 48 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.803010:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff8c045a897d00) 00010000:00010000:3.0:1780340955.803015:0:63712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1780340955.803170:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775dfc lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.803183:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775dfc lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.803193:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775dfc lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1780340955.803234:0:63712:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084366 00000004:00010000:3.0:1780340955.803254:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000556d1caf reply state 00000000e72ecf3e transno 120259084367 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775dfc lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.803265:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775dfc lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.803271:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff8c045a897d00) 00010000:00010000:3.0:1780340955.803273:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340955.803276:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1780340955.803360:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+50:72985:x1866818940516736:12345-192.168.203.16@tcp:36:dd.0 Request processed in 466us (792us total) trans 120259084367 rc 0/0 00000100:00100000:3.0:1780340955.803367:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1540 00000020:00080000:3.0:1780340955.803373:0:63712:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1780340955.803390:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1541 00000100:00100000:3.0:1780340955.803397:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+49:72989:x1866818940516992:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340955.803406:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340955.803422:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775e03 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2806 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.803442:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1400/0xa24651432775e0a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.803449:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1400/0xa24651432775e0a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.803456:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1400/0xa24651432775e0a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.803536:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0400/0xa24651432775e03 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2806 expref: 51 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.803550:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1400/0xa24651432775e0a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2806 expref: 50 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.803557:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff8c0477219700) 00010000:00010000:3.0:1780340955.803559:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1780340955.803562:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03485a1400, rc 0) 00000100:00100000:3.0:1780340955.803587:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+50:72989:x1866818940516992:12345-192.168.203.16@tcp:101:dd.0 Request processed in 191us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340955.803593:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1541 00000100:00100000:0.0:1780340955.804108:0:24762:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940516864 00000100:00100000:0.0:1780340955.804115:0:24762:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940516864 00002000:00010000:0.0:1780340955.804140:0:24762:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/867 (0->18446744073709551615) 00002000:00100000:0.0:1780340955.804144:0:24762:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0476d9f480 with x1866818940516864 ext(0->18446744073709551615) 00002000:00010000:0.0:1780340955.804153:0:24762:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0476d9f480. 00000100:00100000:0.0:1780340955.804172:0:24762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1009 00000100:00100000:0.0:1780340955.804180:0:24762:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2409:x1866818940516864:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:0.0:1780340955.804279:0:24762:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x363:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1780340955.804283:0:24762:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x363:0x0] updating lvb mtime from disk: 1780340942 -> 1780340956 00002000:00010000:0.0:1780340955.804286:0:24762:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x363:0x0] updating lvb atime from disk: 1780340942 -> 1780340942 00002000:00010000:0.0:1780340955.804288:0:24762:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x363:0x0] updating lvb ctime from disk: 1780340942 -> 1780340956 00002000:00010000:0.0:1780340955.804299:0:24762:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x363:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1780340955.804308:0:24762:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0476d9f480 x1866818940516864/t4294969480(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 440/432 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340955.804345:0:24762:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2409:x1866818940516864:12345-192.168.203.16@tcp:10:dd.0 Request processed in 166us (1736us total) trans 4294969480 rc 0/0 00000100:00100000:0.0:1780340955.804351:0:24762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1009 00002000:00010000:0.0:1780340955.804354:0:24762:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/867 (0->18446744073709551615) 00002000:00100000:0.0:1780340955.804356:0:24762:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0476d9f480 with x1866818940516864 ext(0->18446744073709551615) 00002000:00010000:0.0:1780340955.804361:0:24762:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0476d9f480. 00000100:00100000:2.0:1780340955.804597:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340955.804675:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940517248 00000100:00100000:1.0:1780340955.804680:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940517248 00000100:00100000:1.0:1780340955.804716:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1542 00000100:00100000:1.0:1780340955.804723:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+50:72986:x1866818940517248:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:1.0:1780340955.804733:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340955.804744:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af800/0xa24651432775e11 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced280d expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.804855:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e18 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.804867:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e18 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.804996:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e18 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805022:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e1f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805028:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e1f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805035:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e1f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805079:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aee00/0xa24651432775e26 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805088:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aee00/0xa24651432775e26 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805094:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aee00/0xa24651432775e26 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340955.805103:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x9:0x0]: returning size 0 00010000:00010000:1.0:1780340955.805156:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e18 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805164:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e18 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805169:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e18 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805175:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e18 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805180:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722afa00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340955.805190:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e18 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805197:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e18 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805208:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:1.0:1780340955.805210:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340955.805214:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e18 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805220:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e18 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805232:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e1f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805238:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e1f lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805243:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e1f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805249:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340955.805251:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e1f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805257:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e1f lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805264:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff8c0471ec0000) 00010000:00010000:1.0:1780340955.805266:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340955.805275:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e1f lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805281:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e1f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805319:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af800/0xa24651432775e11 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced280d expref: 53 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805330:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aee00/0xa24651432775e26 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced280d expref: 52 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.805337:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff8c0455c3b300) 00010000:00010000:1.0:1780340955.805340:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780340955.805342:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722aee00, rc 0) 00000100:00100000:1.0:1780340955.805382:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+52:72986:x1866818940517248:12345-192.168.203.16@tcp:101:dd.0 Request processed in 659us (785us total) trans 120259084368 rc 0/0 00000100:00100000:1.0:1780340955.805389:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1542 00000100:00100000:1.0:1780340955.810084:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340955.810132:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.810226:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940517504 00000100:00100000:2.0:1780340955.810237:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940517504 00000100:00100000:2.0:1780340955.810287:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940517632 00000100:00100000:2.0:1780340955.810291:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940517632 00000100:00100000:2.0:1780340955.810312:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1543 00000100:00100000:2.0:1780340955.810321:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+53:72989:x1866818940517504:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:2.0:1780340955.810369:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340955.810398:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775dee lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27ff expref: 53 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.810414:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff8c0477219700) 00010000:00010000:2.0:1780340955.810419:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340955.810601:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1544 00000100:00100000:1.0:1780340955.810610:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+52:72986:x1866818940517632:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:1.0:1780340955.810620:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340955.810635:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432775e34 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2814 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.810661:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432775e3b lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.810684:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432775e3b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.810694:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432775e3b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.810790:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af600/0xa24651432775e34 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2814 expref: 54 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.810805:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae000/0xa24651432775e3b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2814 expref: 53 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.810812:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff8c0455c3b300) 00010000:00010000:1.0:1780340955.810814:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1780340955.810816:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722ae000, rc 0) 00000100:00100000:1.0:1780340955.810870:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+53:72986:x1866818940517632:12345-192.168.203.16@tcp:101:dd.0 Request processed in 261us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340955.810887:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1544 00010000:00010000:2.0:1780340955.811077:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6400/0xa24651432775e42 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.811087:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6400/0xa24651432775e42 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.811101:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6400/0xa24651432775e42 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780340955.811147:0:63711:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084369 00000004:00010000:2.0:1780340955.811167:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a02623a8 reply state 00000000a1f86e30 transno 120259084370 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6400/0xa24651432775e42 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.811177:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6400/0xa24651432775e42 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.811183:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff8c0477219700) 00010000:00010000:2.0:1780340955.811185:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340955.811188:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340955.811245:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+55:72989:x1866818940517504:12345-192.168.203.16@tcp:36:dd.0 Request processed in 925us (1171us total) trans 120259084370 rc 0/0 00000100:00100000:2.0:1780340955.811252:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1543 00000020:00080000:2.0:1780340955.811256:0:63711:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1780340955.812392:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.812451:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940517888 00000100:00100000:2.0:1780340955.812459:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940517888 00000100:00100000:2.0:1780340955.812505:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1545 00000100:00100000:2.0:1780340955.812513:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+55:72987:x1866818940517888:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340955.814154:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340955.814180:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7800/0xa24651432775e49 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced281b expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.814318:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7a00/0xa24651432775e50 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.814332:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7a00/0xa24651432775e50 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.814354:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7a00/0xa24651432775e50 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.814369:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7c00/0xa24651432775e57 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.814375:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7c00/0xa24651432775e57 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.814381:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7c00/0xa24651432775e57 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.814434:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6a00/0xa24651432775e5e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.814441:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6a00/0xa24651432775e5e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.814447:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6a00/0xa24651432775e5e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340955.814456:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0xa:0x0]: returning size 0 00010000:00010000:2.0:1780340955.816243:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7a00/0xa24651432775e50 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.816258:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7a00/0xa24651432775e50 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.816265:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7a00/0xa24651432775e50 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.816271:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7a00/0xa24651432775e50 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.816293:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04445c7a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340955.816297:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7a00/0xa24651432775e50 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.816304:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7a00/0xa24651432775e50 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.816319:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:2.0:1780340955.816322:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340955.816327:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7a00/0xa24651432775e50 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.816332:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7a00/0xa24651432775e50 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.816345:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7c00/0xa24651432775e57 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.816351:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7c00/0xa24651432775e57 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.816357:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7c00/0xa24651432775e57 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.816362:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04445c7c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340955.816364:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7c00/0xa24651432775e57 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.816370:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7c00/0xa24651432775e57 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.816388:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff8c045a8c6700) 00010000:00010000:2.0:1780340955.816390:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340955.816393:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7c00/0xa24651432775e57 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.816399:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7c00/0xa24651432775e57 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.816456:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7800/0xa24651432775e49 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced281b expref: 58 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.816469:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6a00/0xa24651432775e5e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced281b expref: 57 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.816475:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff8c0477219300) 00010000:00010000:2.0:1780340955.816477:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340955.816480:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04445c6a00, rc 0) 00000100:00100000:2.0:1780340955.816675:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+57:72987:x1866818940517888:12345-192.168.203.16@tcp:101:dd.0 Request processed in 4161us (4286us total) trans 120259084371 rc 0/0 00000100:00100000:2.0:1780340955.816682:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1545 00000100:00100000:1.0:1780340955.826889:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340955.826928:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340955.826971:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.827109:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940518272 00000100:00100000:2.0:1780340955.827120:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940518272 00000100:00100000:2.0:1780340955.827176:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 268 00000100:00100000:2.0:1780340955.827185:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+57:72984:x1866818940518272:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:2.0:1780340955.827443:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+58:72984:x1866818940518272:12345-192.168.203.16@tcp:35:dd.0 Request processed in 259us (512us total) trans 120259084372 rc 0/0 00000100:00100000:2.0:1780340955.827450:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 268 00000100:00100000:3.0:1780340955.827545:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940518016 00000100:00100000:3.0:1780340955.827550:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940518016 00000100:00100000:3.0:1780340955.827582:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940518400 00000100:00100000:3.0:1780340955.827585:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940518400 00000100:00100000:3.0:1780340955.827607:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5962 00000100:00100000:3.0:1780340955.827614:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:72985:x1866818940518016:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340955.827631:0:8400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340955.827651:0:8400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad294175/0xa24651432775e6c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2822 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780340955.827687:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x364:0x0] initial LVB size: 0, mtime: 0x6a1dd8ce, atime: 0x6a1dd8ce, ctime: 0x6a1dd8ce, blocks: 0x0 00010000:00010000:3.0:1780340955.827702:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340955.827705:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340955.827711:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad294175/0xa24651432775e6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2822 expref: 11 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.827727:0:8400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ad294175/0xa24651432775e6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2822 expref: 11 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.827738:0:8400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03485a0400, rc 0) 00010000:00000080:3.0:1780340955.827745:0:8400:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04592b1f80 x1866818940518016/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 328/400 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340955.827801:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:72985:x1866818940518016:12345-192.168.203.16@tcp:101:dd.0 Request processed in 187us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340955.827807:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5962 00000100:00100000:3.0:1780340955.827820:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5963 00000100:00100000:3.0:1780340955.827827:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:72989:x1866818940518400:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340955.827833:0:8400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340955.827842:0:8400:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a00c3152/0xa24651432775e73 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2829 expref: -99 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780340955.827855:0:8400:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x368:0x0] initial LVB size: 0, mtime: 0x6a1dd8ce, atime: 0x6a1dd8ce, ctime: 0x6a1dd8ce, blocks: 0x0 00010000:00010000:3.0:1780340955.827869:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340955.827871:0:8400:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340955.827885:0:8400:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a00c3152/0xa24651432775e73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2829 expref: 11 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.827898:0:8400:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a00c3152/0xa24651432775e73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2829 expref: 11 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.827906:0:8400:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03485a0800, rc 0) 00010000:00000080:3.0:1780340955.827910:0:8400:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04592b0e00 x1866818940518400/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 328/400 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340955.827934:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:72989:x1866818940518400:12345-192.168.203.16@tcp:101:dd.0 Request processed in 108us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340955.827940:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5963 00000100:00100000:0.0:1780340955.841746:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340955.841863:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340955.849182:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.849559:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940518528 00000100:00100000:2.0:1780340955.849570:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940518528 00000100:00100000:2.0:1780340955.849628:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940518784 00000100:00100000:2.0:1780340955.849631:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940518784 00000100:00100000:2.0:1780340955.849655:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1546 00000100:00100000:2.0:1780340955.850575:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+59:72987:x1866818940518528:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340955.850601:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340955.850622:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7800/0xa24651432775e7a lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2830 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.850655:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7c00/0xa24651432775e81 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.850680:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7c00/0xa24651432775e81 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.850690:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7c00/0xa24651432775e81 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.850817:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7800/0xa24651432775e7a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2830 expref: 61 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.850834:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7c00/0xa24651432775e81 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2830 expref: 60 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.850842:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff8c0477219300) 00010000:00010000:2.0:1780340955.850844:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780340955.850847:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04445c7c00, rc 0) 00000100:00100000:2.0:1780340955.851477:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+60:72987:x1866818940518528:12345-192.168.203.16@tcp:101:dd.0 Request processed in 913us (9737us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340955.851722:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1547 00000100:00100000:1.0:1780340955.851737:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+60:72988:x1866818940518784:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:1.0:1780340955.851753:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340955.851775:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af800/0xa24651432775e88 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2837 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.855885:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e8f lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.855911:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e8f lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.855922:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e8f lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.855938:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e96 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.855944:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e96 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.855950:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e96 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856036:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432775e9d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856044:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432775e9d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856051:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432775e9d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1780340955.856062:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0xb:0x0]: returning size 0 00010000:00010000:1.0:1780340955.856143:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e8f lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856151:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e8f lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856168:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e8f lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856174:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e8f lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856179:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340955.856183:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e8f lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856190:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e8f lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856202:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:1.0:1780340955.856205:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340955.856209:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e8f lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856214:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa24651432775e8f lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856227:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e96 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856232:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e96 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856237:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e96 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856241:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722afa00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:1.0:1780340955.856249:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e96 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856255:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e96 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856261:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff8c0471ec0000) 00010000:00010000:1.0:1780340955.856263:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1780340955.856265:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e96 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856270:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa24651432775e96 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856318:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af800/0xa24651432775e88 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2837 expref: 63 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856330:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432775e9d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2837 expref: 62 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856337:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff8c04506cfd00) 00010000:00010000:1.0:1780340955.856339:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1780340955.856342:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722afe00, rc 0) 00000100:00100000:1.0:1780340955.856404:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+62:72988:x1866818940518784:12345-192.168.203.16@tcp:101:dd.0 Request processed in 4672us (14540us total) trans 120259084373 rc 0/0 00000100:00100000:1.0:1780340955.856414:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1547 00000100:00100000:1.0:1780340955.856441:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940519040 00000100:00100000:1.0:1780340955.856448:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940519040 00000100:00100000:1.0:1780340955.856479:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1548 00000100:00100000:1.0:1780340955.856487:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047aa68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+62:72986:x1866818940519040:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:1.0:1780340955.856546:0:64454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340955.856561:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722aee00/0xa24651432775e26 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced280d expref: 62 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856570:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff8c0455c3b300) 00010000:00010000:1.0:1780340955.856573:0:64454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780340955.856672:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae400/0xa24651432775eab lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856681:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae400/0xa24651432775eab lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856688:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae400/0xa24651432775eab lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1780340955.856727:0:64454:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084374 00000004:00010000:1.0:1780340955.856746:0:64454:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003c7a3f39 reply state 000000000b571a09 transno 120259084375 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae400/0xa24651432775eab lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856802:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae400/0xa24651432775eab lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.856809:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff8c0455c3b300) 00010000:00010000:1.0:1780340955.856812:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340955.856814:0:64454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780340955.856860:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047aa68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+64:72986:x1866818940519040:12345-192.168.203.16@tcp:36:dd.0 Request processed in 373us (7687us total) trans 120259084375 rc 0/0 00000100:00100000:1.0:1780340955.856867:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1548 00000020:00080000:1.0:1780340955.856870:0:64454:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1780340955.857357:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1546 00000100:00100000:0.0:1780340955.858563:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340955.858600:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.858671:0:24179:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940519168 00000100:00100000:2.0:1780340955.858681:0:24179:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940519168 00002000:00010000:2.0:1780340955.858710:0:24179:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/872 (0->18446744073709551615) 00002000:00100000:2.0:1780340955.858715:0:24179:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0446efdc00 with x1866818940519168 ext(0->18446744073709551615) 00002000:00010000:2.0:1780340955.858724:0:24179:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0446efdc00. 00000100:00100000:2.0:1780340955.858749:0:24179:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940519296 00000100:00100000:2.0:1780340955.858752:0:24179:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940519296 00002000:00010000:2.0:1780340955.858797:0:24179:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/868 (0->18446744073709551615) 00002000:00100000:2.0:1780340955.858801:0:24179:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0446efd880 with x1866818940519296 ext(0->18446744073709551615) 00002000:00010000:2.0:1780340955.858806:0:24179:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0446efd880. 00000100:00100000:2.0:1780340955.858824:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1010 00000100:00100000:2.0:1780340955.858832:0:24179:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2409:x1866818940519168:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:2.0:1780340955.858980:0:24179:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x368:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1780340955.858984:0:24179:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x368:0x0] updating lvb mtime from disk: 1780340942 -> 1780340956 00002000:00010000:2.0:1780340955.858987:0:24179:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x368:0x0] updating lvb atime from disk: 1780340942 -> 1780340942 00002000:00010000:2.0:1780340955.858989:0:24179:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x368:0x0] updating lvb ctime from disk: 1780340942 -> 1780340956 00002000:00010000:2.0:1780340955.858991:0:24179:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x368:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1780340955.858999:0:24179:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0446efdc00 x1866818940519168/t4294969481(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 440/432 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340955.859045:0:24179:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:2409:x1866818940519168:12345-192.168.203.16@tcp:10:dd.0 Request processed in 214us (486us total) trans 4294969481 rc 0/0 00000100:00100000:2.0:1780340955.859052:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1010 00002000:00010000:2.0:1780340955.859055:0:24179:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/872 (0->18446744073709551615) 00002000:00100000:2.0:1780340955.859057:0:24179:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0446efdc00 with x1866818940519168 ext(0->18446744073709551615) 00002000:00010000:2.0:1780340955.859069:0:24179:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0446efdc00. 00000100:00100000:2.0:1780340955.859085:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1011 00000100:00100000:2.0:1780340955.859091:0:24179:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2410:x1866818940519296:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:2.0:1780340955.859144:0:24179:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x364:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1780340955.859147:0:24179:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x364:0x0] updating lvb mtime from disk: 1780340942 -> 1780340956 00002000:00010000:2.0:1780340955.859148:0:24179:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x364:0x0] updating lvb atime from disk: 1780340942 -> 1780340942 00002000:00010000:2.0:1780340955.859151:0:24179:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x364:0x0] updating lvb ctime from disk: 1780340942 -> 1780340956 00002000:00010000:2.0:1780340955.859153:0:24179:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x364:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1780340955.859159:0:24179:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0446efd880 x1866818940519296/t4294969482(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 440/432 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340955.859182:0:24179:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:2410:x1866818940519296:12345-192.168.203.16@tcp:10:dd.0 Request processed in 91us (582us total) trans 4294969482 rc 0/0 00000100:00100000:2.0:1780340955.859188:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1011 00002000:00010000:2.0:1780340955.859191:0:24179:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/868 (0->18446744073709551615) 00002000:00100000:2.0:1780340955.859193:0:24179:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0446efd880 with x1866818940519296 ext(0->18446744073709551615) 00002000:00010000:2.0:1780340955.859197:0:24179:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0446efd880. 00000100:00100000:1.0:1780340955.863993:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340955.864039:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340955.864068:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340955.864205:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940519424 00000100:00100000:0.0:1780340955.864215:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940519424 00000100:00100000:0.0:1780340955.864270:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5964 00000100:00100000:0.0:1780340955.864279:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:72986:x1866818940519424:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:0.0:1780340955.864294:0:23153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340955.864312:0:23153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa24651432775eb2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced283e expref: -99 pid: 23153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340955.864337:0:23153:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x365:0x0] initial LVB size: 0, mtime: 0x6a1dd8ce, atime: 0x6a1dd8ce, ctime: 0x6a1dd8ce, blocks: 0x0 00010000:00010000:0.0:1780340955.864356:0:23153:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340955.864359:0:23153:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340955.864365:0:23153:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa24651432775eb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced283e expref: 14 pid: 23153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.864394:0:23153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa24651432775eb2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced283e expref: 14 pid: 23153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.864407:0:23153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440031000, rc 0) 00010000:00000080:0.0:1780340955.864414:0:23153:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04592b2d80 x1866818940519424/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 328/400 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340955.864468:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+14:72986:x1866818940519424:12345-192.168.203.16@tcp:101:dd.0 Request processed in 190us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340955.864475:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5964 00000100:00100000:2.0:1780340955.864845:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940519680 00000100:00100000:2.0:1780340955.864850:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940519680 00000100:00100000:2.0:1780340955.864890:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940519808 00000100:00100000:2.0:1780340955.864893:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940519808 00000100:00100000:2.0:1780340955.864915:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1549 00000100:00100000:2.0:1780340955.864923:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+64:72987:x1866818940519680:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:2.0:1780340955.864974:0:64454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340955.864995:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6a00/0xa24651432775e5e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced281b expref: 64 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.865021:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff8c0477219300) 00010000:00010000:2.0:1780340955.865026:0:64454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340955.865167:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7800/0xa24651432775eb9 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.865180:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7800/0xa24651432775eb9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.865188:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7800/0xa24651432775eb9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780340955.865229:0:64454:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084376 00000004:00010000:2.0:1780340955.865249:0:64454:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dfad0771 reply state 000000000170957b transno 120259084377 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7800/0xa24651432775eb9 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.865259:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7800/0xa24651432775eb9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.865265:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff8c0477219300) 00010000:00010000:2.0:1780340955.865268:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340955.865271:0:64454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340955.865333:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+66:72987:x1866818940519680:12345-192.168.203.16@tcp:36:dd.0 Request processed in 411us (1294us total) trans 120259084377 rc 0/0 00000100:00100000:2.0:1780340955.865340:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1549 00000020:00080000:2.0:1780340955.865344:0:64454:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1780340955.865359:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1550 00000100:00100000:2.0:1780340955.865366:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+65:72988:x1866818940519808:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340955.865374:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340955.865391:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7a00/0xa24651432775ec0 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2845 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.865413:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6c00/0xa24651432775ec7 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.865421:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6c00/0xa24651432775ec7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.865429:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6c00/0xa24651432775ec7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.865493:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7a00/0xa24651432775ec0 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2845 expref: 67 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.865505:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6c00/0xa24651432775ec7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2845 expref: 66 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.865512:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff8c04506cfd00) 00010000:00010000:2.0:1780340955.865514:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780340955.865516:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04445c6c00, rc 0) 00000100:00100000:2.0:1780340955.865556:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+66:72988:x1866818940519808:12345-192.168.203.16@tcp:101:dd.0 Request processed in 190us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340955.865561:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1550 00000100:00100000:0.0:1780340955.869138:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340955.870464:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940520064 00000100:00100000:3.0:1780340955.870477:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940520064 00000100:00100000:3.0:1780340955.870550:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1551 00000100:00100000:3.0:1780340955.870561:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+66:72990:x1866818940520064:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340955.870580:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340955.870599:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1200/0xa24651432775ece lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced284c expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.870729:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775ed5 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.870744:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775ed5 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.870793:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775ed5 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.870808:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775edc lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.870816:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775edc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.870822:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775edc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.871592:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1000/0xa24651432775ee3 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.871605:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1000/0xa24651432775ee3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.871614:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1000/0xa24651432775ee3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340955.871627:0:70100:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0xd:0x0]: returning size 0 00010000:00010000:3.0:1780340955.871807:0:70100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775ed5 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.871815:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775ed5 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.871821:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775ed5 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.871826:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775ed5 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.871841:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340955.871845:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775ed5 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.871852:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775ed5 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.871864:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:3.0:1780340955.871867:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340955.871871:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775ed5 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.872614:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775ed5 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.872630:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775edc lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.872636:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775edc lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.872642:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775edc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.872647:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340955.872650:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775edc lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.872656:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775edc lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.872690:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff8c04506cf700) 00010000:00010000:3.0:1780340955.872692:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340955.872696:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775edc lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.872702:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775edc lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.873620:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1200/0xa24651432775ece lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced284c expref: 69 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.873644:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1000/0xa24651432775ee3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced284c expref: 68 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.873652:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff8c0477219000) 00010000:00010000:3.0:1780340955.873664:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780340955.873668:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03485a1000, rc 0) 00000100:00100000:3.0:1780340955.873747:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+68:72990:x1866818940520064:12345-192.168.203.16@tcp:101:dd.0 Request processed in 3188us (4616us total) trans 120259084378 rc 0/0 00000100:00100000:3.0:1780340955.874634:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1551 00000100:00100000:1.0:1780340955.878591:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.879288:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940520320 00000100:00100000:2.0:1780340955.879300:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940520320 00000100:00100000:2.0:1780340955.879348:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 269 00000100:00100000:2.0:1780340955.879359:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+68:72985:x1866818940520320:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:2.0:1780340955.879637:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+69:72985:x1866818940520320:12345-192.168.203.16@tcp:35:dd.0 Request processed in 279us (1055us total) trans 120259084379 rc 0/0 00000100:00100000:2.0:1780340955.879654:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 269 00000100:00100000:2.0:1780340955.880105:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340955.880381:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940520576 00000100:00100000:3.0:1780340955.880387:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940520576 00000100:00100000:3.0:1780340955.880426:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5965 00000100:00100000:3.0:1780340955.880435:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+14:72987:x1866818940520576:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340955.880446:0:8830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340955.880464:0:8830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd19e2c8/0xa24651432775ef1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2853 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780340955.880505:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x366:0x0] initial LVB size: 0, mtime: 0x6a1dd8ce, atime: 0x6a1dd8ce, ctime: 0x6a1dd8ce, blocks: 0x0 00010000:00010000:3.0:1780340955.880532:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340955.880535:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340955.880543:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd19e2c8/0xa24651432775ef1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2853 expref: 15 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.880559:0:8830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fd19e2c8/0xa24651432775ef1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2853 expref: 15 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.880570:0:8830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03485a0600, rc 0) 00010000:00000080:3.0:1780340955.880577:0:8830:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0476d9dc00 x1866818940520576/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 328/400 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340955.880620:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+15:72987:x1866818940520576:12345-192.168.203.16@tcp:101:dd.0 Request processed in 187us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340955.880626:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5965 00000100:00100000:2.0:1780340955.887161:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.887204:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.887231:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940520832 00000100:00100000:2.0:1780340955.887240:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940520832 00000100:00100000:2.0:1780340955.887289:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1552 00000100:00100000:2.0:1780340955.887299:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+69:72988:x1866818940520832:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:2.0:1780340955.887355:0:63712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340955.887382:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afe00/0xa24651432775e9d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2837 expref: 69 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.887400:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff8c04506cfd00) 00010000:00010000:2.0:1780340955.887405:0:63712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340955.887563:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6a00/0xa24651432775ef8 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.887579:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6a00/0xa24651432775ef8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.887589:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6a00/0xa24651432775ef8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780340955.887630:0:63712:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084380 00000004:00010000:2.0:1780340955.887650:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008be2d641 reply state 00000000d1de974c transno 120259084381 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6a00/0xa24651432775ef8 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.887661:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6a00/0xa24651432775ef8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.887682:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff8c04506cfd00) 00010000:00010000:2.0:1780340955.887684:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340955.887687:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340955.887800:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+71:72988:x1866818940520832:12345-192.168.203.16@tcp:36:dd.0 Request processed in 501us (594us total) trans 120259084381 rc 0/0 00000100:00100000:2.0:1780340955.887808:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1552 00000020:00080000:2.0:1780340955.887813:0:63712:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1780340955.888418:0:8407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940520448 00000100:00100000:3.0:1780340955.888425:0:8407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940520448 00002000:00010000:3.0:1780340955.888448:0:8407:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/869 (0->18446744073709551615) 00002000:00100000:3.0:1780340955.888452:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0476d9d880 with x1866818940520448 ext(0->18446744073709551615) 00002000:00010000:3.0:1780340955.888459:0:8407:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0476d9d880. 00000100:00100000:3.0:1780340955.888489:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1012 00000100:00100000:3.0:1780340955.888496:0:8407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+15:2410:x1866818940520448:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:3.0:1780340955.888612:0:8407:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x365:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1780340955.888615:0:8407:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x365:0x0] updating lvb mtime from disk: 1780340942 -> 1780340956 00002000:00010000:3.0:1780340955.888625:0:8407:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x365:0x0] updating lvb atime from disk: 1780340942 -> 1780340942 00002000:00010000:3.0:1780340955.888627:0:8407:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x365:0x0] updating lvb ctime from disk: 1780340942 -> 1780340956 00002000:00010000:3.0:1780340955.888629:0:8407:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x365:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1780340955.888638:0:8407:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0476d9d880 x1866818940520448/t4294969483(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 440/432 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340955.888688:0:8407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+16:2410:x1866818940520448:12345-192.168.203.16@tcp:10:dd.0 Request processed in 192us (1538us total) trans 4294969483 rc 0/0 00000100:00100000:3.0:1780340955.888696:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1012 00002000:00010000:3.0:1780340955.888699:0:8407:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/869 (0->18446744073709551615) 00002000:00100000:3.0:1780340955.888701:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0476d9d880 with x1866818940520448 ext(0->18446744073709551615) 00002000:00010000:3.0:1780340955.888706:0:8407:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0476d9d880. 00000100:00100000:2.0:1780340955.889595:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340955.889854:0:24191:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940520960 00000100:00100000:1.0:1780340955.889861:0:24191:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940520960 00002000:00010000:1.0:1780340955.889950:0:24191:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/870 (0->18446744073709551615) 00002000:00100000:1.0:1780340955.889954:0:24191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0476d9ea00 with x1866818940520960 ext(0->18446744073709551615) 00002000:00010000:1.0:1780340955.889970:0:24191:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0476d9ea00. 00000100:00100000:1.0:1780340955.889992:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1013 00000100:00100000:1.0:1780340955.890000:0:24191:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+16:2407:x1866818940520960:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:1.0:1780340955.890102:0:24191:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x366:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1780340955.890105:0:24191:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x366:0x0] updating lvb mtime from disk: 1780340942 -> 1780340956 00002000:00010000:1.0:1780340955.890108:0:24191:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x366:0x0] updating lvb atime from disk: 1780340942 -> 1780340942 00002000:00010000:1.0:1780340955.890110:0:24191:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x366:0x0] updating lvb ctime from disk: 1780340942 -> 1780340956 00002000:00010000:1.0:1780340955.890111:0:24191:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x366:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1780340955.890119:0:24191:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0476d9ea00 x1866818940520960/t4294969484(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 440/432 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340955.890171:0:24191:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+17:2407:x1866818940520960:12345-192.168.203.16@tcp:10:dd.0 Request processed in 172us (578us total) trans 4294969484 rc 0/0 00000100:00100000:1.0:1780340955.890178:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1013 00002000:00010000:1.0:1780340955.890181:0:24191:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/870 (0->18446744073709551615) 00002000:00100000:1.0:1780340955.890184:0:24191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0476d9ea00 with x1866818940520960 ext(0->18446744073709551615) 00002000:00010000:1.0:1780340955.890189:0:24191:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0476d9ea00. 00000100:00100000:2.0:1780340955.913223:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.913269:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.913301:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.913321:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.913340:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.913362:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.913398:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940522112 00000100:00100000:2.0:1780340955.913408:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940522112 00000100:00100000:2.0:1780340955.913454:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940522240 00000100:00100000:2.0:1780340955.913456:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940522240 00000100:00100000:2.0:1780340955.913479:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1553 00000100:00100000:2.0:1780340955.913487:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+72:72999:x1866818940522112:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340955.913511:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340955.913541:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432775eff lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2861 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.913677:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432775f06 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.913694:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432775f06 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.913718:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432775f06 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.913734:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f0d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.913741:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f0d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.913747:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f0d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.913833:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6000/0xa24651432775f14 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.913852:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6000/0xa24651432775f14 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.913858:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6000/0xa24651432775f14 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340955.913868:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x16:0x0]: returning size 0 00010000:00010000:2.0:1780340955.914123:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432775f06 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914131:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432775f06 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914137:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432775f06 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914142:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432775f06 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914154:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04445c6600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340955.914158:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432775f06 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914165:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432775f06 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914177:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:2.0:1780340955.914180:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340955.914184:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432775f06 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914190:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432775f06 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914202:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f0d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914207:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f0d lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914213:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f0d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914218:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04445c7200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340955.914220:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f0d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914226:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f0d lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914242:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff8c045a8c6700) 00010000:00010000:2.0:1780340955.914244:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340955.914247:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f0d lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914253:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f0d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914296:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432775eff lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2861 expref: 75 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914310:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6000/0xa24651432775f14 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2861 expref: 74 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914317:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff8c04506cfe00) 00010000:00010000:2.0:1780340955.914320:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340955.914322:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04445c6000, rc 0) 00000100:00100000:2.0:1780340955.914391:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+74:72999:x1866818940522112:12345-192.168.203.16@tcp:101:dd.0 Request processed in 903us (1047us total) trans 120259084382 rc 0/0 00000100:00100000:2.0:1780340955.914399:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1553 00000100:00100000:2.0:1780340955.914421:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1554 00000100:00100000:2.0:1780340955.914430:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+73:72990:x1866818940522240:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340955.914439:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340955.914449:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775f22 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2868 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914465:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7a00/0xa24651432775f29 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914479:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7a00/0xa24651432775f29 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.914486:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7a00/0xa24651432775f29 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340955.914631:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940521216 00000100:00100000:3.0:1780340955.914636:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940521216 00000100:00100000:3.0:1780340955.914657:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940521472 00000100:00100000:3.0:1780340955.914659:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940521472 00000100:00100000:3.0:1780340955.914669:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940521856 00000100:00100000:3.0:1780340955.914671:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940521856 00000100:00100000:3.0:1780340955.914682:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 270 00000100:00100000:3.0:1780340955.914688:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+77:72987:x1866818940521216:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:3.0:1780340955.914888:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+78:72987:x1866818940521216:12345-192.168.203.16@tcp:35:dd.0 Request processed in 187us (1661us total) trans 120259084383 rc 0/0 00000100:00100000:3.0:1780340955.914895:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 270 00000100:00100000:3.0:1780340955.914909:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 271 00000100:00100000:3.0:1780340955.914915:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047723bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+77:72989:x1866818940521472:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:3.0:1780340955.915014:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047723bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+78:72989:x1866818940521472:12345-192.168.203.16@tcp:35:dd.0 Request processed in 98us (1744us total) trans 120259084384 rc 0/0 00000100:00100000:3.0:1780340955.915030:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 271 00000100:00100000:3.0:1780340955.915068:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 272 00000100:00100000:3.0:1780340955.915074:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+77:72986:x1866818940521856:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:3.0:1780340955.915169:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+78:72986:x1866818940521856:12345-192.168.203.16@tcp:35:dd.0 Request processed in 94us (1846us total) trans 120259084385 rc 0/0 00000100:00100000:3.0:1780340955.915176:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 272 00010000:00010000:2.0:1780340955.916375:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775f22 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2868 expref: 78 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.916396:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7a00/0xa24651432775f29 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2868 expref: 77 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.916404:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff8c0477219000) 00010000:00010000:2.0:1780340955.916406:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780340955.916409:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04445c7a00, rc 0) 00000100:00100000:2.0:1780340955.916452:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+77:72990:x1866818940522240:12345-192.168.203.16@tcp:101:dd.0 Request processed in 2023us (3087us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340955.916458:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1554 00000100:00100000:0.0:1780340955.916635:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940521600 00000100:00100000:0.0:1780340955.916642:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940521600 00000100:00100000:0.0:1780340955.916681:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5966 00000100:00100000:0.0:1780340955.916688:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+17:72988:x1866818940521600:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:0.0:1780340955.916700:0:25487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340955.916729:0:25487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa24651432775f30 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced285a expref: -99 pid: 25487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340955.916752:0:25487:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x367:0x0] initial LVB size: 0, mtime: 0x6a1dd8ce, atime: 0x6a1dd8ce, ctime: 0x6a1dd8ce, blocks: 0x0 00010000:00010000:0.0:1780340955.916791:0:25487:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340955.916794:0:25487:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340955.916800:0:25487:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa24651432775f30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced285a expref: 18 pid: 25487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.916830:0:25487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa24651432775f30 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced285a expref: 18 pid: 25487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.916851:0:25487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440031c00, rc 0) 00010000:00000080:0.0:1780340955.916857:0:25487:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0476d9c380 x1866818940521600/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 328/400 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340955.916899:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+18:72988:x1866818940521600:12345-192.168.203.16@tcp:101:dd.0 Request processed in 211us (3598us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340955.916906:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5966 00000100:00100000:3.0:1780340955.921024:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.921169:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940522496 00000100:00100000:2.0:1780340955.921180:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940522496 00000100:00100000:2.0:1780340955.921239:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1555 00000100:00100000:2.0:1780340955.921250:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+77:72990:x1866818940522496:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:2.0:1780340955.921305:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340955.921332:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1000/0xa24651432775ee3 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced284c expref: 77 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.921351:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff8c0477219000) 00010000:00010000:2.0:1780340955.921371:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340955.921667:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6800/0xa24651432775f37 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.921681:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6800/0xa24651432775f37 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.921690:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6800/0xa24651432775f37 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780340955.921735:0:63711:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084386 00000004:00010000:2.0:1780340955.921846:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001446525f reply state 00000000c2faf3cb transno 120259084387 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6800/0xa24651432775f37 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.921860:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6800/0xa24651432775f37 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.921867:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff8c0477219000) 00010000:00010000:2.0:1780340955.921870:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340955.921938:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340955.922097:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+79:72990:x1866818940522496:12345-192.168.203.16@tcp:36:dd.0 Request processed in 849us (1079us total) trans 120259084387 rc 0/0 00000100:00100000:2.0:1780340955.922105:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1555 00000020:00080000:2.0:1780340955.922110:0:63711:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1780340955.924392:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.924622:0:24178:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940522624 00000100:00100000:2.0:1780340955.924634:0:24178:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940522624 00002000:00010000:2.0:1780340955.924801:0:24178:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/871 (0->18446744073709551615) 00002000:00100000:2.0:1780340955.924806:0:24178:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0446efea00 with x1866818940522624 ext(0->18446744073709551615) 00002000:00010000:2.0:1780340955.924816:0:24178:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0446efea00. 00000100:00100000:2.0:1780340955.924845:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1014 00000100:00100000:2.0:1780340955.924855:0:24178:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+18:2410:x1866818940522624:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:2.0:1780340955.925025:0:24178:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x367:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1780340955.925029:0:24178:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x367:0x0] updating lvb mtime from disk: 1780340942 -> 1780340956 00002000:00010000:2.0:1780340955.925031:0:24178:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x367:0x0] updating lvb atime from disk: 1780340942 -> 1780340942 00002000:00010000:2.0:1780340955.925034:0:24178:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x367:0x0] updating lvb ctime from disk: 1780340942 -> 1780340956 00002000:00010000:2.0:1780340955.925036:0:24178:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x367:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1780340955.925045:0:24178:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0446efea00 x1866818940522624/t4294969485(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 440/432 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340955.925108:0:24178:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+19:2410:x1866818940522624:12345-192.168.203.16@tcp:10:dd.0 Request processed in 255us (726us total) trans 4294969485 rc 0/0 00000100:00100000:2.0:1780340955.925116:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1014 00002000:00010000:2.0:1780340955.925119:0:24178:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/871 (0->18446744073709551615) 00002000:00100000:2.0:1780340955.925122:0:24178:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0446efea00 with x1866818940522624 ext(0->18446744073709551615) 00002000:00010000:2.0:1780340955.925126:0:24178:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0446efea00. 00000100:00100000:1.0:1780340955.931461:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340955.931507:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.931682:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940522880 00000100:00100000:2.0:1780340955.931692:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940522880 00000100:00100000:2.0:1780340955.931754:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940523008 00000100:00100000:2.0:1780340955.931793:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940523008 00000100:00100000:2.0:1780340955.931818:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1556 00000100:00100000:2.0:1780340955.931828:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+80:72991:x1866818940522880:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340955.931864:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340955.931890:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775f3e lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced286f expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932025:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432775f45 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932041:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432775f45 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932066:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432775f45 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932083:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f4c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932090:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f4c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932096:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f4c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932149:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432775f53 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932158:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432775f53 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932165:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432775f53 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340955.932175:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0xe:0x0]: returning size 0 00010000:00010000:2.0:1780340955.932246:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432775f45 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932254:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432775f45 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932260:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432775f45 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932265:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432775f45 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932277:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04445c6e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340955.932281:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432775f45 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932287:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432775f45 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932298:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:2.0:1780340955.932300:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340955.932305:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432775f45 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932311:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432775f45 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932322:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f4c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932327:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f4c lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932331:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f4c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932335:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04445c7200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340955.932338:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f4c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932342:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f4c lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932360:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff8c045a8c6700) 00010000:00010000:2.0:1780340955.932362:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340955.932365:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f4c lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932370:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa24651432775f4c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932408:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775f3e lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced286f expref: 83 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932423:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432775f53 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced286f expref: 82 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932430:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff8c0455c3b700) 00010000:00010000:2.0:1780340955.932433:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340955.932435:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04445c6600, rc 0) 00000100:00100000:2.0:1780340955.932503:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+82:72991:x1866818940522880:12345-192.168.203.16@tcp:101:dd.0 Request processed in 675us (1050us total) trans 120259084388 rc 0/0 00000100:00100000:2.0:1780340955.932511:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1556 00000100:00100000:2.0:1780340955.932541:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1557 00000100:00100000:2.0:1780340955.932550:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+81:72999:x1866818940523008:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340955.932557:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340955.932565:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7400/0xa24651432775f61 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2876 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932582:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6200/0xa24651432775f68 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932596:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6200/0xa24651432775f68 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932603:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6200/0xa24651432775f68 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932669:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7400/0xa24651432775f61 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2876 expref: 83 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932680:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6200/0xa24651432775f68 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2876 expref: 82 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.932685:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff8c04506cfe00) 00010000:00010000:2.0:1780340955.932687:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780340955.932689:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04445c6200, rc 0) 00000100:00100000:2.0:1780340955.932713:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+82:72999:x1866818940523008:12345-192.168.203.16@tcp:101:dd.0 Request processed in 166us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340955.932719:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1557 00000100:00100000:1.0:1780340955.934517:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.935097:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940523136 00000100:00100000:2.0:1780340955.935105:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940523136 00000100:00100000:2.0:1780340955.935154:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5967 00000100:00100000:2.0:1780340955.935163:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+19:72990:x1866818940523136:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340955.935178:0:25486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340955.935196:0:25486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7a81d51/0xa24651432775f6f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced287d expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340955.935220:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x369:0x0] initial LVB size: 0, mtime: 0x6a1dd8ce, atime: 0x6a1dd8ce, ctime: 0x6a1dd8ce, blocks: 0x0 00010000:00010000:2.0:1780340955.935248:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340955.935250:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340955.935257:0:25486:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7a81d51/0xa24651432775f6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced287d expref: 20 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.935272:0:25486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c7a81d51/0xa24651432775f6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced287d expref: 20 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.935284:0:25486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04445c7600, rc 0) 00010000:00000080:2.0:1780340955.935291:0:25486:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04592b1880 x1866818940523136/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 328/400 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340955.935338:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+20:72990:x1866818940523136:12345-192.168.203.16@tcp:101:dd.0 Request processed in 177us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340955.935344:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5967 00000100:00100000:0.0:1780340955.936439:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.936542:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940523264 00000100:00100000:2.0:1780340955.936549:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940523264 00000100:00100000:2.0:1780340955.936600:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1558 00000100:00100000:2.0:1780340955.936610:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+82:72991:x1866818940523264:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340955.936632:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340955.936648:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7e00/0xa24651432775f76 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2884 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.936691:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775f7d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.937198:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775f7d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.937228:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775f7d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.937327:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7e00/0xa24651432775f76 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2884 expref: 84 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.937344:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366a00/0xa24651432775f7d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2884 expref: 83 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.937352:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff8c0455c3b700) 00010000:00010000:2.0:1780340955.937355:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780340955.937358:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0486366a00, rc 0) 00000100:00100000:2.0:1780340955.939035:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+83:72991:x1866818940523264:12345-192.168.203.16@tcp:101:dd.0 Request processed in 2419us (2592us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340955.939045:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1558 00000100:00100000:0.0:1780340955.939121:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.939258:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940523520 00000100:00100000:2.0:1780340955.939265:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940523520 00000100:00100000:2.0:1780340955.939304:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1559 00000100:00100000:2.0:1780340955.939312:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+83:72992:x1866818940523520:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340955.939327:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340955.939344:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775f84 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced288b expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939450:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775f8b lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939463:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775f8b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939494:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775f8b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939508:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775f92 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939514:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775f92 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939527:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775f92 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939578:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa24651432775f99 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939585:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa24651432775f99 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939591:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa24651432775f99 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340955.939600:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0xf:0x0]: returning size 0 00010000:00010000:2.0:1780340955.939681:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775f8b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939689:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775f8b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939694:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775f8b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939699:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775f8b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939712:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486367000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340955.939716:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775f8b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939723:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775f8b lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939734:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:2.0:1780340955.939737:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340955.939741:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775f8b lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939749:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa24651432775f8b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939788:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775f92 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939794:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775f92 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939800:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775f92 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939805:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486366200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340955.939807:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775f92 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939812:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775f92 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939828:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff8c045a8c6500) 00010000:00010000:2.0:1780340955.939830:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340955.939833:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775f92 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.939838:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa24651432775f92 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.940200:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775f84 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced288b expref: 86 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.940214:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa24651432775f99 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced288b expref: 85 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.940221:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff8c045312ed00) 00010000:00010000:2.0:1780340955.940223:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340955.940226:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0486367e00, rc 0) 00000100:00100000:2.0:1780340955.941508:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+85:72992:x1866818940523520:12345-192.168.203.16@tcp:101:dd.0 Request processed in 2190us (2381us total) trans 120259084389 rc 0/0 00000100:00100000:2.0:1780340955.941525:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1559 00000100:00100000:3.0:1780340955.941747:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340955.941920:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340955.941946:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940524032 00000100:00100000:3.0:1780340955.941954:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940524032 00000100:00100000:3.0:1780340955.942009:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 273 00000100:00100000:3.0:1780340955.942017:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+85:72988:x1866818940524032:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:3.0:1780340955.942254:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+86:72988:x1866818940524032:12345-192.168.203.16@tcp:35:dd.0 Request processed in 238us (334us total) trans 120259084390 rc 0/0 00000100:00100000:3.0:1780340955.942261:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 273 00000100:00100000:2.0:1780340955.942423:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940523776 00000100:00100000:2.0:1780340955.942428:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940523776 00000100:00100000:2.0:1780340955.942460:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1560 00000100:00100000:2.0:1780340955.942475:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ecbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+86:72999:x1866818940523776:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:2.0:1780340955.942510:0:64454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340955.942543:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6000/0xa24651432775f14 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2861 expref: 86 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.942574:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff8c04506cfe00) 00010000:00010000:2.0:1780340955.942579:0:64454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340955.942671:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa24651432775fa7 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.942685:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa24651432775fa7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.942693:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa24651432775fa7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780340955.942732:0:64454:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084391 00000004:00010000:2.0:1780340955.942753:0:64454:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e6c59da4 reply state 0000000030d88f29 transno 120259084392 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa24651432775fa7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.942783:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa24651432775fa7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.942788:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff8c04506cfe00) 00010000:00010000:2.0:1780340955.942791:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340955.942793:0:64454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340955.942836:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ecbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+88:72999:x1866818940523776:12345-192.168.203.16@tcp:36:dd.0 Request processed in 370us (1090us total) trans 120259084392 rc 0/0 00000100:00100000:2.0:1780340955.942842:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1560 00000020:00080000:2.0:1780340955.942845:0:64454:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1780340955.945381:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.947919:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.947968:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940524416 00000100:00100000:2.0:1780340955.947978:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940524416 00000100:00100000:2.0:1780340955.948039:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1561 00000100:00100000:2.0:1780340955.948049:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+88:72991:x1866818940524416:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:2.0:1780340955.948099:0:63710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340955.948125:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432775f53 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced286f expref: 88 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.948143:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff8c0455c3b700) 00010000:00010000:2.0:1780340955.948148:0:63710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340955.948300:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa24651432775fae lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.948314:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa24651432775fae lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.948324:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa24651432775fae lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780340955.948363:0:63710:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084393 00000004:00010000:2.0:1780340955.948384:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000547543f7 reply state 00000000538ba2f1 transno 120259084394 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa24651432775fae lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.948394:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa24651432775fae lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.948401:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff8c0455c3b700) 00010000:00010000:2.0:1780340955.948403:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340955.948406:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340955.948481:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+90:72991:x1866818940524416:12345-192.168.203.16@tcp:36:dd.0 Request processed in 433us (568us total) trans 120259084394 rc 0/0 00000100:00100000:2.0:1780340955.948488:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1561 00000020:00080000:2.0:1780340955.948503:0:63710:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1780340955.949035:0:8406:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940524160 00000100:00100000:2.0:1780340955.949042:0:8406:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940524160 00002000:00010000:2.0:1780340955.949066:0:8406:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/873 (0->18446744073709551615) 00002000:00100000:2.0:1780340955.949071:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0476d9c700 with x1866818940524160 ext(0->18446744073709551615) 00002000:00010000:2.0:1780340955.949080:0:8406:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0476d9c700. 00000100:00100000:2.0:1780340955.949110:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1015 00000100:00100000:2.0:1780340955.949117:0:8406:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+20:2407:x1866818940524160:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:2.0:1780340955.949218:0:8406:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x369:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1780340955.949221:0:8406:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x369:0x0] updating lvb mtime from disk: 1780340942 -> 1780340956 00002000:00010000:2.0:1780340955.949224:0:8406:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x369:0x0] updating lvb atime from disk: 1780340942 -> 1780340942 00002000:00010000:2.0:1780340955.949226:0:8406:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x369:0x0] updating lvb ctime from disk: 1780340942 -> 1780340956 00002000:00010000:2.0:1780340955.949228:0:8406:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x369:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1780340955.949235:0:8406:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0476d9c700 x1866818940524160/t4294969486(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 440/432 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340955.949281:0:8406:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+21:2407:x1866818940524160:12345-192.168.203.16@tcp:10:dd.0 Request processed in 165us (4763us total) trans 4294969486 rc 0/0 00000100:00100000:2.0:1780340955.949287:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1015 00002000:00010000:2.0:1780340955.949290:0:8406:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/873 (0->18446744073709551615) 00002000:00100000:2.0:1780340955.949293:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0476d9c700 with x1866818940524160 ext(0->18446744073709551615) 00002000:00010000:2.0:1780340955.949297:0:8406:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0476d9c700. 00000100:00100000:1.0:1780340955.956259:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340955.956740:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940524672 00000100:00100000:3.0:1780340955.956753:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940524672 00000100:00100000:3.0:1780340955.957042:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1562 00000100:00100000:3.0:1780340955.957054:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+90:72993:x1866818940524672:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340955.957077:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340955.957094:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1200/0xa24651432775fb5 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2892 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.957213:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775fbc lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.957705:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775fbc lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.957719:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775fbc lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.957735:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775fc3 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.957742:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775fc3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.957747:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775fc3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.957829:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775fca lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.957837:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775fca lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.957914:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775fca lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340955.957925:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x10:0x0]: returning size 0 00010000:00010000:3.0:1780340955.958006:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775fbc lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.958014:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775fbc lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.958020:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775fbc lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.958034:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775fbc lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.958040:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a0200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340955.958044:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775fbc lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.958053:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775fbc lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.958065:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:3.0:1780340955.958067:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340955.958072:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775fbc lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.958078:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0200/0xa24651432775fbc lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.958091:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775fc3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.958097:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775fc3 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.958102:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775fc3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.958107:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340955.958109:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775fc3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.958126:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775fc3 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.958134:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff8c04506cf700) 00010000:00010000:3.0:1780340955.958136:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340955.958139:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775fc3 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.958144:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1a00/0xa24651432775fc3 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.958185:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1200/0xa24651432775fb5 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2892 expref: 93 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.958198:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775fca lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2892 expref: 92 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.958205:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff8c0477219600) 00010000:00010000:3.0:1780340955.958207:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780340955.958210:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03485a1c00, rc 0) 00000100:00100000:3.0:1780340955.958710:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+92:72993:x1866818940524672:12345-192.168.203.16@tcp:101:dd.0 Request processed in 1657us (2470us total) trans 120259084395 rc 0/0 00000100:00100000:3.0:1780340955.958719:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1562 00000100:00100000:1.0:1780340955.962311:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.964640:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940524800 00000100:00100000:2.0:1780340955.964666:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940524800 00000100:00100000:2.0:1780340955.964737:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1563 00000100:00100000:2.0:1780340955.964748:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+92:72992:x1866818940524800:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340955.964783:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340955.964818:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7400/0xa24651432775fd8 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2899 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.964862:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775fdf lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.964876:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775fdf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.964888:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775fdf lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.964998:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7400/0xa24651432775fd8 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2899 expref: 94 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.965014:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7000/0xa24651432775fdf lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2899 expref: 93 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.965022:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff8c045312ed00) 00010000:00010000:2.0:1780340955.965025:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780340955.965028:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04445c7000, rc 0) 00000100:00100000:2.0:1780340955.966090:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+93:72992:x1866818940524800:12345-192.168.203.16@tcp:101:dd.0 Request processed in 1338us (3782us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340955.966100:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1563 00000100:00100000:0.0:1780340955.966264:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340955.967044:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940524928 00000100:00100000:3.0:1780340955.967055:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940524928 00000100:00100000:3.0:1780340955.967837:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5968 00000100:00100000:3.0:1780340955.967952:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+21:72991:x1866818940524928:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340955.967992:0:8399:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340955.968013:0:8399:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036c68481/0xa24651432775fe6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced28a0 expref: -99 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780340955.968036:0:8399:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x36a:0x0] initial LVB size: 0, mtime: 0x6a1dd8ce, atime: 0x6a1dd8ce, ctime: 0x6a1dd8ce, blocks: 0x0 00010000:00010000:3.0:1780340955.968058:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340955.968060:0:8399:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340955.968067:0:8399:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036c68481/0xa24651432775fe6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28a0 expref: 22 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.968082:0:8399:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036c68481/0xa24651432775fe6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28a0 expref: 22 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.968093:0:8399:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03485a1000, rc 0) 00010000:00000080:3.0:1780340955.968100:0:8399:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0446efd500 x1866818940524928/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 328/400 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340955.968169:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+22:72991:x1866818940524928:12345-192.168.203.16@tcp:101:dd.0 Request processed in 226us (1905us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340955.968176:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5968 00000100:00100000:2.0:1780340955.970103:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.970144:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340955.970219:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940525312 00000100:00100000:1.0:1780340955.970227:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940525312 00000100:00100000:1.0:1780340955.970290:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5969 00000100:00100000:1.0:1780340955.970299:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+22:72999:x1866818940525312:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:1.0:1780340955.970314:0:25489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340955.970331:0:25489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d096c3c9/0xa24651432775fed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced28a7 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340955.970352:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x372:0x0] initial LVB size: 0, mtime: 0x6a1dd8cf, atime: 0x6a1dd8cf, ctime: 0x6a1dd8cf, blocks: 0x0 00010000:00010000:1.0:1780340955.970369:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340955.970371:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340955.970376:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d096c3c9/0xa24651432775fed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28a7 expref: 23 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.970389:0:25489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d096c3c9/0xa24651432775fed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28a7 expref: 23 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340955.970412:0:25489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722aee00, rc 0) 00010000:00000080:1.0:1780340955.970419:0:25489:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c9c380 x1866818940525312/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 328/400 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340955.970475:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+23:72999:x1866818940525312:12345-192.168.203.16@tcp:101:dd.0 Request processed in 177us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340955.970481:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5969 00000100:00100000:1.0:1780340955.971991:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340955.972054:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940525440 00000100:00100000:3.0:1780340955.972062:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940525440 00000100:00100000:3.0:1780340955.972112:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1564 00000100:00100000:3.0:1780340955.972122:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+93:72993:x1866818940525440:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340955.972142:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340955.972159:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775ff4 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced28ae expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.972210:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775ffb lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.972224:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775ffb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.972234:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775ffb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.972340:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a0a00/0xa24651432775ff4 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28ae expref: 95 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.972354:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366400/0xa24651432775ffb lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28ae expref: 94 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340955.972362:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff8c0477219600) 00010000:00010000:3.0:1780340955.972365:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1780340955.972368:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0486366400, rc 0) 00000100:00100000:3.0:1780340955.972431:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+94:72993:x1866818940525440:12345-192.168.203.16@tcp:101:dd.0 Request processed in 312us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340955.972437:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1564 00000100:00100000:0.0:1780340955.974127:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940525184 00000100:00100000:0.0:1780340955.974139:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940525184 00000100:00100000:0.0:1780340955.974196:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 274 00000100:00100000:0.0:1780340955.974205:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+94:72990:x1866818940525184:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:0.0:1780340955.974477:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+95:72990:x1866818940525184:12345-192.168.203.16@tcp:35:dd.0 Request processed in 273us (4381us total) trans 120259084396 rc 0/0 00000100:00100000:0.0:1780340955.974486:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 274 00000100:00100000:1.0:1780340955.978194:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340955.978239:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.978326:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940525696 00000100:00100000:2.0:1780340955.978336:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940525696 00000100:00100000:2.0:1780340955.978401:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940525952 00000100:00100000:2.0:1780340955.978404:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940525952 00000100:00100000:2.0:1780340955.978446:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1565 00000100:00100000:2.0:1780340955.978456:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+96:72992:x1866818940525696:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:2.0:1780340955.978515:0:63710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340955.978553:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa24651432775f99 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced288b expref: 96 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.978573:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff8c045312ed00) 00010000:00010000:2.0:1780340955.978578:0:63710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340955.978736:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7400/0xa24651432776002 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.978750:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7400/0xa24651432776002 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.978786:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7400/0xa24651432776002 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780340955.978831:0:63710:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084397 00000100:00100000:0.0:1780340955.979095:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1566 00000100:00100000:0.0:1780340955.979106:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+97:72994:x1866818940525952:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:0.0:1780340955.979118:0:63712:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340955.979137:0:63712:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432776009 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced28b5 expref: -99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979228:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432776010 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979237:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432776010 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979245:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432776010 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979257:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432776017 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979263:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432776017 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979269:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432776017 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979307:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa2465143277601e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979313:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa2465143277601e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979320:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa2465143277601e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340955.979328:0:63712:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x11:0x0]: returning size 0 00010000:00010000:0.0:1780340955.979374:0:63712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432776010 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979391:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432776010 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979397:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432776010 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979404:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432776010 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979410:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440030800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340955.979414:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432776010 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979421:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432776010 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979430:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:0.0:1780340955.979432:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340955.979436:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432776010 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979442:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030800/0xa24651432776010 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979452:0:63712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432776017 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979457:0:63712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432776017 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979462:0:63712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432776017 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979484:0:63712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440030e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340955.979487:0:63712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432776017 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979494:0:63712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432776017 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979503:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff8c0345328000) 00010000:00010000:0.0:1780340955.979506:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340955.979508:0:63712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432776017 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979513:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030e00/0xa24651432776017 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979563:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440031400/0xa24651432776009 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28b5 expref: 100 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979577:0:63712:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa2465143277601e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28b5 expref: 99 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340955.979584:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff8c0477219500) 00010000:00010000:0.0:1780340955.979586:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780340955.979588:0:63712:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440030200, rc 0) 00000100:00100000:0.0:1780340955.979651:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+99:72994:x1866818940525952:12345-192.168.203.16@tcp:101:dd.0 Request processed in 547us (1410us total) trans 120259084399 rc 0/0 00000100:00100000:0.0:1780340955.979658:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1566 00000004:00010000:2.0:1780340955.980184:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000015baa511 reply state 00000000dbb686f0 transno 120259084398 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7400/0xa24651432776002 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.980199:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7400/0xa24651432776002 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.980205:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff8c045312ed00) 00010000:00010000:2.0:1780340955.980207:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340955.980210:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340955.980271:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+99:72992:x1866818940525696:12345-192.168.203.16@tcp:36:dd.0 Request processed in 1816us (2086us total) trans 120259084398 rc 0/0 00000100:00100000:2.0:1780340955.980277:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1565 00000020:00080000:2.0:1780340955.980289:0:63710:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1780340955.984228:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340955.984276:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.984432:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940526336 00000100:00100000:2.0:1780340955.984443:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940526336 00000100:00100000:2.0:1780340955.984510:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1567 00000100:00100000:2.0:1780340955.984803:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+99:72993:x1866818940526336:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:2.0:1780340955.984863:0:64454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340955.984891:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1c00/0xa24651432775fca lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2892 expref: 99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.984911:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff8c0477219600) 00010000:00010000:2.0:1780340955.984916:0:64454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340955.985082:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6000/0xa2465143277602c lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.985097:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6000/0xa2465143277602c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.985107:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6000/0xa2465143277602c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780340955.985151:0:64454:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084400 00000004:00010000:2.0:1780340955.985170:0:64454:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003c37aab1 reply state 000000004a2bbde9 transno 120259084401 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6000/0xa2465143277602c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.985181:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6000/0xa2465143277602c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340955.985187:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff8c0477219600) 00010000:00010000:2.0:1780340955.985190:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340955.985193:0:64454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340955.985278:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+101:72993:x1866818940526336:12345-192.168.203.16@tcp:36:dd.0 Request processed in 758us (1056us total) trans 120259084401 rc 0/0 00000100:00100000:2.0:1780340955.985298:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1567 00000020:00080000:2.0:1780340955.985303:0:64454:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1780340955.985512:0:24180:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940526080 00000100:00100000:3.0:1780340955.985527:0:24180:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940526080 00002000:00010000:3.0:1780340955.985551:0:24180:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/874 (0->18446744073709551615) 00002000:00100000:3.0:1780340955.985555:0:24180:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c04592b2300 with x1866818940526080 ext(0->18446744073709551615) 00002000:00010000:3.0:1780340955.985563:0:24180:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c04592b2300. 00000100:00100000:3.0:1780340955.985593:0:24180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1016 00000100:00100000:3.0:1780340955.985607:0:24180:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04592b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+23:2408:x1866818940526080:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:3.0:1780340955.985708:0:24180:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1780340955.985711:0:24180:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x36a:0x0] updating lvb mtime from disk: 1780340942 -> 1780340956 00002000:00010000:3.0:1780340955.985714:0:24180:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x36a:0x0] updating lvb atime from disk: 1780340942 -> 1780340942 00002000:00010000:3.0:1780340955.985716:0:24180:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x36a:0x0] updating lvb ctime from disk: 1780340942 -> 1780340956 00002000:00010000:3.0:1780340955.985718:0:24180:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36a:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1780340955.985727:0:24180:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04592b2300 x1866818940526080/t4294969487(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 440/432 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340955.985783:0:24180:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04592b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+24:2408:x1866818940526080:12345-192.168.203.16@tcp:10:dd.0 Request processed in 154us (1482us total) trans 4294969487 rc 0/0 00000100:00100000:3.0:1780340955.985789:0:24180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1016 00002000:00010000:3.0:1780340955.985793:0:24180:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/874 (0->18446744073709551615) 00002000:00100000:3.0:1780340955.985795:0:24180:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c04592b2300 with x1866818940526080 ext(0->18446744073709551615) 00002000:00010000:3.0:1780340955.985800:0:24180:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c04592b2300. 00000100:00100000:3.0:1780340955.986331:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340955.990043:0:24177:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940526464 00000100:00100000:2.0:1780340955.990059:0:24177:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940526464 00002000:00010000:2.0:1780340955.990103:0:24177:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/882 (0->18446744073709551615) 00002000:00100000:2.0:1780340955.990108:0:24177:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c98700 with x1866818940526464 ext(0->18446744073709551615) 00002000:00010000:2.0:1780340955.990119:0:24177:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c98700. 00000100:00100000:2.0:1780340955.990231:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1017 00000100:00100000:2.0:1780340955.990254:0:24177:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+24:2407:x1866818940526464:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:2.0:1780340955.990403:0:24177:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x372:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1780340955.990407:0:24177:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x372:0x0] updating lvb mtime from disk: 1780340943 -> 1780340956 00002000:00010000:2.0:1780340955.990409:0:24177:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x372:0x0] updating lvb atime from disk: 1780340943 -> 1780340943 00002000:00010000:2.0:1780340955.990411:0:24177:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x372:0x0] updating lvb ctime from disk: 1780340943 -> 1780340956 00002000:00010000:2.0:1780340955.990414:0:24177:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x372:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1780340955.990423:0:24177:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c98700 x1866818940526464/t4294969488(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:381/0 lens 440/432 e 0 to 0 dl 1780340966 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340955.990548:0:24177:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2407:x1866818940526464:12345-192.168.203.16@tcp:10:dd.0 Request processed in 307us (4218us total) trans 4294969488 rc 0/0 00000100:00100000:2.0:1780340955.990556:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1017 00002000:00010000:2.0:1780340955.990560:0:24177:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/882 (0->18446744073709551615) 00002000:00100000:2.0:1780340955.990562:0:24177:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c98700 with x1866818940526464 ext(0->18446744073709551615) 00002000:00010000:2.0:1780340955.990567:0:24177:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c98700. 00000100:00100000:2.0:1780340956.003162:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.003200:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.003229:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.003321:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.003349:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940526720 00000100:00100000:2.0:1780340956.003358:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940526720 00000100:00100000:2.0:1780340956.003400:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940527104 00000100:00100000:2.0:1780340956.003404:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940527104 00000100:00100000:2.0:1780340956.003424:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1568 00000100:00100000:2.0:1780340956.003434:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+102:72994:x1866818940526720:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340956.003458:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340956.003476:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7e00/0xa24651432776033 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced28c3 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.003508:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa2465143277603a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.003634:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa2465143277603a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.003647:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa2465143277603a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.003745:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7e00/0xa24651432776033 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28c3 expref: 104 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.003790:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7200/0xa2465143277603a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28c3 expref: 103 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.003798:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff8c0477219500) 00010000:00010000:2.0:1780340956.003802:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780340956.003806:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04445c7200, rc 0) 00000100:00100000:2.0:1780340956.003854:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+103:72994:x1866818940526720:12345-192.168.203.16@tcp:101:dd.0 Request processed in 421us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340956.003866:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1568 00000100:00100000:2.0:1780340956.003888:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1569 00000100:00100000:2.0:1780340956.003893:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+102:72995:x1866818940527104:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340956.003904:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340956.003913:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432776041 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced28d1 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004012:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776048 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004023:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776048 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004030:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776048 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004044:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa2465143277604f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004051:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa2465143277604f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004057:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa2465143277604f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004095:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa24651432776056 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004102:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa24651432776056 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004119:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa24651432776056 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340956.004129:0:70100:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x12:0x0]: returning size 0 00010000:00010000:2.0:1780340956.004200:0:70100:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776048 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004208:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776048 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004214:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776048 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004221:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776048 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004226:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04445c6600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340956.004230:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776048 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004236:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776048 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004244:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:2.0:1780340956.004247:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340956.004250:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776048 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004255:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776048 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004264:0:70100:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa2465143277604f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004275:0:70100:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa2465143277604f lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004281:0:70100:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa2465143277604f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004285:0:70100:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2c800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340956.004288:0:70100:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa2465143277604f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004294:0:70100:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa2465143277604f lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004301:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff8c045a8c6500) 00010000:00010000:2.0:1780340956.004304:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340956.004307:0:70100:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa2465143277604f lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004312:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa2465143277604f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004346:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa24651432776041 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28d1 expref: 105 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004357:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa24651432776056 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28d1 expref: 104 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.004364:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff8c0455c3ba00) 00010000:00010000:2.0:1780340956.004366:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340956.004375:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0470f2c200, rc 0) 00000100:00100000:2.0:1780340956.004406:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+104:72995:x1866818940527104:12345-192.168.203.16@tcp:101:dd.0 Request processed in 512us (1085us total) trans 120259084402 rc 0/0 00000100:00100000:2.0:1780340956.004412:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1569 00000100:00100000:1.0:1780340956.005805:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940526592 00000100:00100000:1.0:1780340956.005817:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940526592 00000100:00100000:1.0:1780340956.005869:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940526848 00000100:00100000:1.0:1780340956.005872:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940526848 00000100:00100000:1.0:1780340956.005893:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5970 00000100:00100000:1.0:1780340956.005902:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+26:72993:x1866818940526592:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:1.0:1780340956.005916:0:25495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340956.005933:0:25495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa24651432776064 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced28bc expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340956.005953:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x36c:0x0] initial LVB size: 0, mtime: 0x6a1dd8cf, atime: 0x6a1dd8cf, ctime: 0x6a1dd8cf, blocks: 0x0 00010000:00010000:1.0:1780340956.005977:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340956.005979:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340956.005985:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa24651432776064 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28bc expref: 27 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.005998:0:25495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa24651432776064 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28bc expref: 27 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.006008:0:25495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722afc00, rc 0) 00010000:00000080:1.0:1780340956.006014:0:25495:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c9f800 x1866818940526592/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 328/400 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340956.006061:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:72993:x1866818940526592:12345-192.168.203.16@tcp:101:dd.0 Request processed in 160us (2860us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340956.006083:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5970 00000100:00100000:1.0:1780340956.006098:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5971 00000100:00100000:1.0:1780340956.006104:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+26:72992:x1866818940526848:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:1.0:1780340956.006110:0:25495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340956.006118:0:25495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa2465143277606b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced28ca expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340956.006129:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x36b:0x0] initial LVB size: 0, mtime: 0x6a1dd8cf, atime: 0x6a1dd8cf, ctime: 0x6a1dd8cf, blocks: 0x0 00010000:00010000:1.0:1780340956.006137:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340956.006139:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340956.006142:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa2465143277606b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28ca expref: 27 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.006152:0:25495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa2465143277606b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28ca expref: 27 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.006160:0:25495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722af600, rc 0) 00010000:00000080:1.0:1780340956.006164:0:25495:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c9fb80 x1866818940526848/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 328/400 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340956.006184:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:72992:x1866818940526848:12345-192.168.203.16@tcp:101:dd.0 Request processed in 81us (2956us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340956.006189:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5971 00000100:00100000:1.0:1780340956.007315:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340956.007391:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940527488 00000100:00100000:0.0:1780340956.007407:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940527488 00000100:00100000:0.0:1780340956.007452:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 275 00000100:00100000:0.0:1780340956.007460:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+104:72999:x1866818940527488:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:0.0:1780340956.007849:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+105:72999:x1866818940527488:12345-192.168.203.16@tcp:35:dd.0 Request processed in 389us (537us total) trans 120259084403 rc 0/0 00000100:00100000:0.0:1780340956.007856:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 275 00000100:00100000:2.0:1780340956.008234:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.008323:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.008341:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340956.009837:0:24754:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940528000 00000100:00100000:3.0:1780340956.009848:0:24754:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940528000 00002000:00010000:3.0:1780340956.009881:0:24754:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/875 (0->18446744073709551615) 00002000:00100000:3.0:1780340956.009888:0:24754:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c9c000 with x1866818940528000 ext(0->18446744073709551615) 00002000:00010000:3.0:1780340956.009899:0:24754:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c9c000. 00000100:00100000:3.0:1780340956.010013:0:24754:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940528128 00000100:00100000:3.0:1780340956.010018:0:24754:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940528128 00002000:00010000:3.0:1780340956.010031:0:24754:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/876 (0->18446744073709551615) 00002000:00100000:3.0:1780340956.010035:0:24754:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c9ce00 with x1866818940528128 ext(0->18446744073709551615) 00002000:00010000:3.0:1780340956.010040:0:24754:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c9ce00. 00000100:00100000:1.0:1780340956.013658:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1018 00000100:00100000:2.0:1780340956.014033:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1019 00000100:00100000:2.0:1780340956.014048:0:8407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+28:2408:x1866818940528128:12345-192.168.203.16@tcp:10:dd.0 00000100:00100000:1.0:1780340956.014150:0:24191:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+28:2409:x1866818940528000:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:2.0:1780340956.014200:0:8407:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1780340956.014204:0:8407:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x36c:0x0] updating lvb mtime from disk: 1780340943 -> 1780340956 00002000:00010000:2.0:1780340956.014207:0:8407:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x36c:0x0] updating lvb atime from disk: 1780340943 -> 1780340943 00002000:00010000:2.0:1780340956.014209:0:8407:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x36c:0x0] updating lvb ctime from disk: 1780340943 -> 1780340956 00002000:00010000:2.0:1780340956.014211:0:8407:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36c:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1780340956.014221:0:8407:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c9ce00 x1866818940528128/t4294969489(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 440/432 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00010000:1.0:1780340956.014248:0:24191:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1780340956.014252:0:24191:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x36b:0x0] updating lvb mtime from disk: 1780340943 -> 1780340956 00002000:00010000:1.0:1780340956.014255:0:24191:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x36b:0x0] updating lvb atime from disk: 1780340943 -> 1780340943 00002000:00010000:1.0:1780340956.014257:0:24191:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x36b:0x0] updating lvb ctime from disk: 1780340943 -> 1780340956 00002000:00010000:1.0:1780340956.014259:0:24191:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36b:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1780340956.014268:0:24191:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c9c000 x1866818940528000/t4294969490(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 440/432 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340956.014291:0:8407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+30:2408:x1866818940528128:12345-192.168.203.16@tcp:10:dd.0 Request processed in 248us (5946us total) trans 4294969489 rc 0/0 00000100:00100000:2.0:1780340956.014299:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1019 00002000:00010000:2.0:1780340956.014305:0:8407:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/876 (0->18446744073709551615) 00000100:00100000:1.0:1780340956.014305:0:24191:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+30:2409:x1866818940528000:12345-192.168.203.16@tcp:10:dd.0 Request processed in 633us (5978us total) trans 4294969490 rc 0/0 00002000:00100000:2.0:1780340956.014312:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c9ce00 with x1866818940528128 ext(0->18446744073709551615) 00000100:00100000:1.0:1780340956.014317:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1018 00002000:00010000:2.0:1780340956.014320:0:8407:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c9ce00. 00002000:00010000:1.0:1780340956.014321:0:24191:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/875 (0->18446744073709551615) 00002000:00100000:1.0:1780340956.014326:0:24191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c9c000 with x1866818940528000 ext(0->18446744073709551615) 00002000:00010000:1.0:1780340956.014332:0:24191:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c9c000. 00000100:00100000:2.0:1780340956.014356:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940527872 00000100:00100000:2.0:1780340956.014364:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940527872 00000100:00100000:2.0:1780340956.014404:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1570 00000100:00100000:2.0:1780340956.014411:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+105:72994:x1866818940527872:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:2.0:1780340956.014458:0:64454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340956.014485:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa2465143277601e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28b5 expref: 105 pid: 63712 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.014503:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff8c0477219500) 00010000:00010000:2.0:1780340956.014509:0:64454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340956.014640:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432776072 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.014677:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432776072 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.014686:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432776072 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780340956.014724:0:64454:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084404 00000004:00010000:2.0:1780340956.014745:0:64454:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b79afda6 reply state 00000000a4396527 transno 120259084405 ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432776072 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.014775:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432776072 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.014782:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff8c0477219500) 00010000:00010000:2.0:1780340956.014785:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340956.014788:0:64454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340956.014837:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+107:72994:x1866818940527872:12345-192.168.203.16@tcp:36:dd.0 Request processed in 426us (6603us total) trans 120259084405 rc 0/0 00000100:00100000:2.0:1780340956.014844:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1570 00000020:00080000:2.0:1780340956.014847:0:64454:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1780340956.016409:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340956.016503:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940527616 00000100:00100000:3.0:1780340956.016525:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940527616 00000100:00100000:3.0:1780340956.016577:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 276 00000100:00100000:3.0:1780340956.016586:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+107:72991:x1866818940527616:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:3.0:1780340956.016827:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+108:72991:x1866818940527616:12345-192.168.203.16@tcp:35:dd.0 Request processed in 242us (425us total) trans 120259084406 rc 0/0 00000100:00100000:3.0:1780340956.016835:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 276 00000100:00100000:0.0:1780340956.026713:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.026836:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940528384 00000100:00100000:2.0:1780340956.026845:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940528384 00000100:00100000:2.0:1780340956.026901:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1571 00000100:00100000:2.0:1780340956.026911:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+108:72996:x1866818940528384:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340956.026935:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340956.026955:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa24651432776079 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced28d8 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027091:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa24651432776080 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027107:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa24651432776080 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027118:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa24651432776080 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027132:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432776087 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027139:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432776087 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027145:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432776087 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027192:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa2465143277608e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027199:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa2465143277608e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027221:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa2465143277608e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340956.027231:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x13:0x0]: returning size 0 00010000:00010000:2.0:1780340956.027317:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa24651432776080 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027324:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa24651432776080 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027329:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa24651432776080 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027335:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa24651432776080 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027340:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340956.027344:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa24651432776080 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027361:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa24651432776080 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027372:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:2.0:1780340956.027375:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340956.027380:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa24651432776080 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027386:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa24651432776080 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027400:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432776087 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027412:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432776087 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027418:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432776087 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027423:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eae00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340956.027426:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432776087 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027432:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432776087 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027440:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff8c045a8c6700) 00010000:00010000:2.0:1780340956.027442:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340956.027445:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432776087 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027450:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa24651432776087 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027493:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa24651432776079 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28d8 expref: 111 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027506:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa2465143277608e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28d8 expref: 110 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.027513:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff8c0455c3bc00) 00010000:00010000:2.0:1780340956.027516:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340956.027524:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c034d9ea400, rc 0) 00000100:00100000:2.0:1780340956.027591:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+110:72996:x1866818940528384:12345-192.168.203.16@tcp:101:dd.0 Request processed in 682us (888us total) trans 120259084407 rc 0/0 00000100:00100000:2.0:1780340956.027599:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1571 00000100:00100000:2.0:1780340956.029745:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340956.033410:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940528512 00000100:00100000:3.0:1780340956.033427:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940528512 00000100:00100000:3.0:1780340956.033483:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1572 00000100:00100000:3.0:1780340956.033492:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+110:72995:x1866818940528512:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340956.033513:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340956.033536:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa2465143277609c lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced28df expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.033571:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa246514327760a3 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.033587:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa246514327760a3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.033599:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa246514327760a3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.033716:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa2465143277609c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28df expref: 112 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.033734:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367000/0xa246514327760a3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28df expref: 111 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.033754:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff8c0455c3ba00) 00010000:00010000:3.0:1780340956.033776:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1780340956.033781:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0486367000, rc 0) 00000100:00100000:3.0:1780340956.033840:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+111:72995:x1866818940528512:12345-192.168.203.16@tcp:101:dd.0 Request processed in 348us (4107us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340956.033846:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1572 00000100:00100000:2.0:1780340956.034115:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.034243:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340956.034345:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940529024 00000100:00100000:0.0:1780340956.034349:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940529024 00000100:00100000:0.0:1780340956.034381:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940528768 00000100:00100000:0.0:1780340956.034383:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940528768 00000100:00100000:0.0:1780340956.034397:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 277 00000100:00100000:0.0:1780340956.034404:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047723b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+112:72993:x1866818940529024:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:0.0:1780340956.034609:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047723b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+113:72993:x1866818940529024:12345-192.168.203.16@tcp:35:dd.0 Request processed in 205us (494us total) trans 120259084408 rc 0/0 00000100:00100000:0.0:1780340956.034617:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 277 00000100:00100000:0.0:1780340956.034653:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 278 00000100:00100000:0.0:1780340956.034661:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+112:72992:x1866818940528768:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:0.0:1780340956.034784:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+113:72992:x1866818940528768:12345-192.168.203.16@tcp:35:dd.0 Request processed in 97us (513us total) trans 120259084409 rc 0/0 00000100:00100000:0.0:1780340956.034791:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 278 00000100:00100000:2.0:1780340956.038161:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.038195:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.038224:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.038259:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340956.038338:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940529536 00000100:00100000:1.0:1780340956.038351:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940529536 00000100:00100000:1.0:1780340956.038412:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5972 00000100:00100000:1.0:1780340956.038423:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+29:72994:x1866818940529536:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:1.0:1780340956.038442:0:25493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340956.038461:0:25493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327760aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced28f4 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340956.038486:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x36d:0x0] initial LVB size: 0, mtime: 0x6a1dd8cf, atime: 0x6a1dd8cf, ctime: 0x6a1dd8cf, blocks: 0x0 00010000:00010000:1.0:1780340956.038506:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340956.038508:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340956.038515:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327760aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28f4 expref: 30 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.038564:0:25493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327760aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28f4 expref: 30 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.038578:0:25493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722afe00, rc 0) 00010000:00000080:1.0:1780340956.038585:0:25493:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c9dc00 x1866818940529536/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 328/400 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340956.038645:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+30:72994:x1866818940529536:12345-192.168.203.16@tcp:101:dd.0 Request processed in 224us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340956.038652:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5972 00000100:00100000:3.0:1780340956.039746:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940529280 00000100:00100000:3.0:1780340956.039755:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940529280 00000100:00100000:3.0:1780340956.039819:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940529408 00000100:00100000:3.0:1780340956.039823:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940529408 00000100:00100000:3.0:1780340956.039839:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940529792 00000100:00100000:3.0:1780340956.039842:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940529792 00000100:00100000:3.0:1780340956.039856:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1573 00000100:00100000:3.0:1780340956.039864:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+115:72997:x1866818940529280:12345-192.168.203.16@tcp:101:dd.0 00000100:00100000:2.0:1780340956.039982:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1574 00000100:00100000:2.0:1780340956.039992:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+115:72996:x1866818940529408:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340956.040001:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340956.040017:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa246514327760b1 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced28ed expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.040051:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa246514327760b8 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.040064:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa246514327760b8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.040074:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa246514327760b8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.040175:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb200/0xa246514327760b1 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28ed expref: 117 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.040206:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eae00/0xa246514327760b8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28ed expref: 116 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.040214:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff8c0455c3bc00) 00010000:00010000:2.0:1780340956.040217:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780340956.040220:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c034d9eae00, rc 0) 00000100:00100000:2.0:1780340956.040268:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+116:72996:x1866818940529408:12345-192.168.203.16@tcp:101:dd.0 Request processed in 278us (2071us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340956.040275:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1574 00000100:00100000:2.0:1780340956.040293:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1575 00000100:00100000:2.0:1780340956.040301:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+115:72995:x1866818940529792:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:2.0:1780340956.040329:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340956.040344:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa24651432776056 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28d1 expref: 115 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.040354:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff8c0455c3ba00) 00010000:00010000:2.0:1780340956.040358:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340956.040481:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327760bf lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.040490:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327760bf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.040497:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327760bf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.040651:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340956.040663:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366c00/0xa246514327760c6 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced28e6 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.040746:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa246514327760cd lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.040755:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa246514327760cd lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.041263:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa246514327760cd lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.041282:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327760d4 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.041299:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327760d4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.041306:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327760d4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.041355:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa246514327760db lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.041363:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa246514327760db lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.041369:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa246514327760db lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340956.041377:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x14:0x0]: returning size 0 00010000:00010000:3.0:1780340956.041427:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa246514327760cd lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.041434:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa246514327760cd lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.041441:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa246514327760cd lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.041447:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa246514327760cd lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.041453:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486367e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340956.041457:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa246514327760cd lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.041475:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa246514327760cd lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.041485:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:3.0:1780340956.041488:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340956.041492:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa246514327760cd lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.041499:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367e00/0xa246514327760cd lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.041510:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327760d4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.041515:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327760d4 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.041521:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327760d4 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.041526:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2c800 already unused, calling callback (ffffffffc18134f0) 00000001:00080000:2.0:1780340956.042831:0:63711:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084410 00000004:00010000:2.0:1780340956.043751:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005450473d reply state 00000000a2af6ba0 transno 120259084412 ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327760bf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.043811:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327760bf lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.043820:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff8c0455c3ba00) 00010000:00010000:2.0:1780340956.043823:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340956.043827:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340956.043952:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+119:72995:x1866818940529792:12345-192.168.203.16@tcp:36:dd.0 Request processed in 3649us (5688us total) trans 120259084412 rc 0/0 00000100:00100000:2.0:1780340956.043970:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1575 00000020:00080000:2.0:1780340956.043976:0:63711:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1780340956.044190:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327760d4 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.044199:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327760d4 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.044210:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff8c044120f900) 00010000:00010000:3.0:1780340956.044212:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340956.044215:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327760d4 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.044235:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327760d4 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.044293:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366c00/0xa246514327760c6 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28e6 expref: 119 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.044306:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa246514327760db lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28e6 expref: 118 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.044313:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff8c045312ec00) 00010000:00010000:3.0:1780340956.044315:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780340956.044317:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0470f2d000, rc 0) 00000100:00100000:3.0:1780340956.044350:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+118:72997:x1866818940529280:12345-192.168.203.16@tcp:101:dd.0 Request processed in 4486us (6200us total) trans 120259084411 rc 0/0 00000100:00100000:3.0:1780340956.044356:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1573 00000100:00100000:0.0:1780340956.050611:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961268864:0@lo:400:kworker.0 00000100:00100000:0.0:1780340956.050682:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340956.050711:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961269376:0@lo:400:kworker.0 00000100:00100000:0.0:1780340956.050736:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340956.050790:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0476d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961269888:0@lo:400:kworker.0 00000100:00100000:0.0:1780340956.050813:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340956.050834:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1780340956.050840:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818961268736:0@lo:400:kworker.0 00000100:00100000:0.0:1780340956.050860:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340956.050876:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961269248:0@lo:400:kworker.0 00000100:00100000:0.0:1780340956.050896:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340956.050912:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961269760:0@lo:400:kworker.0 00000100:00100000:0.0:1780340956.050932:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340956.050970:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961269376 00000100:00100000:0.0:1780340956.050978:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961269376 00000100:00100000:0.0:1780340956.051019:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961269888 00000100:00100000:0.0:1780340956.051022:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961269888 00000100:00100000:0.0:1780340956.051051:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669 00000100:00100000:0.0:1780340956.051058:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961269376:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1780340956.051080:0:23153:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045f291180 x1866818961269376/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:382/0 lens 224/224 e 0 to 0 dl 1780340967 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340956.051121:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3660:x1866818961269376:12345-0@lo:400:kworker.0 Request processed in 63us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340956.051128:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669 00000100:00100000:0.0:1780340956.051143:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2670 00000100:00100000:0.0:1780340956.051149:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961269888:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1780340956.051159:0:23153:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045f293480 x1866818961269888/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:382/0 lens 224/224 e 0 to 0 dl 1780340967 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340956.051182:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961269888:12345-0@lo:400:kworker.0 Request processed in 34us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340956.051196:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2670 00000100:00100000:0.0:1780340956.051215:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961269248 00000100:00100000:0.0:1780340956.051218:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961269248 00000100:00100000:0.0:1780340956.051238:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961269760 00000100:00100000:0.0:1780340956.051241:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961269760 00000100:00100000:0.0:1780340956.051254:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4000 00000100:00100000:0.0:1780340956.051259:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1866818961269248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340956.051289:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1866818961269248:12345-0@lo:400:kworker.0 Request processed in 31us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340956.051295:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4000 00000100:00100000:0.0:1780340956.051305:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4001 00000100:00100000:0.0:1780340956.051310:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961269760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340956.051333:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961269760:12345-0@lo:400:kworker.0 Request processed in 23us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340956.051338:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4001 00000100:00080000:0.0:1780340956.051354:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1780340956.051388:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961269248:0@lo:400:kworker.0 00000100:00100000:0.0:1780340956.051398:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961269760:0@lo:400:kworker.0 00000100:00100000:0.0:1780340956.051406:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961269376:0@lo:400:kworker.0 00000100:00100000:0.0:1780340956.051416:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0476d9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961269888:0@lo:400:kworker.0 00000100:00100000:0.0:1780340956.051447:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961268864 00000100:00100000:0.0:1780340956.051450:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961268864 00000100:00080000:0.0:1780340956.051465:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1780340956.051483:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961268736 00000100:00100000:0.0:1780340956.051486:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961268736 00000100:00080000:0.0:1780340956.051502:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780340956.051521:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:0.0:1780340956.051527:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961268864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340956.051562:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961268864:12345-0@lo:400:kworker.0 Request processed in 35us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340956.051568:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00100000:0.0:1780340956.051589:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961268864:0@lo:400:kworker.0 00000100:00100000:0.0:1780340956.051606:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:0.0:1780340956.051612:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1866818961268736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340956.051643:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1866818961268736:12345-0@lo:400:kworker.0 Request processed in 31us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340956.051648:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00100000:0.0:1780340956.051668:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818961268736:0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.051917:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961268992:0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.051948:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340956.051981:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961269504:0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052003:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340956.052021:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961270016:0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052040:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340956.052056:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1780340956.052062:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961268608:0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052085:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340956.052110:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961269120:0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052130:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340956.052144:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961269632:0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052163:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340956.052189:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961270144:0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052210:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340956.052236:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961269504 00000100:00100000:1.0:1780340956.052239:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961269504 00000100:00100000:1.0:1780340956.052265:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961270016 00000100:00100000:1.0:1780340956.052268:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961270016 00000100:00100000:1.0:1780340956.052289:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671 00000100:00100000:1.0:1780340956.052294:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961269504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052325:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3661:x1866818961269504:12345-0@lo:400:kworker.0 Request processed in 32us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340956.052330:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671 00000100:00100000:1.0:1780340956.052339:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672 00000100:00100000:1.0:1780340956.052344:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961270016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052363:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961270016:12345-0@lo:400:kworker.0 Request processed in 19us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340956.052367:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672 00000100:00100000:1.0:1780340956.052386:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961268608 00000100:00100000:1.0:1780340956.052389:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961268608 00000100:00100000:1.0:1780340956.052413:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1780340956.052419:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961268608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052443:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477381450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3661:x1866818961268608:12345-0@lo:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340956.052448:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:1.0:1780340956.052478:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340956.052491:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961268608:0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052500:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961269504:0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052535:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961270016:0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052560:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961268992 00000100:00100000:1.0:1780340956.052563:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961268992 00000100:00080000:1.0:1780340956.052575:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1780340956.052589:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961269120 00000100:00100000:1.0:1780340956.052591:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961269120 00000100:00080000:1.0:1780340956.052600:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340956.052609:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961269632 00000100:00100000:1.0:1780340956.052611:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961269632 00000100:00100000:1.0:1780340956.052619:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961270144 00000100:00100000:1.0:1780340956.052621:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961270144 00000100:00100000:1.0:1780340956.052630:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:1.0:1780340956.052634:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961268992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052663:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1866818961268992:12345-0@lo:400:kworker.0 Request processed in 28us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340956.052668:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00100000:1.0:1780340956.052688:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1866818961268992:0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052703:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:1.0:1780340956.052708:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961269120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052734:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961269120:12345-0@lo:400:kworker.0 Request processed in 27us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340956.052739:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:1.0:1780340956.052756:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961269120:0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052792:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499 00000100:00100000:1.0:1780340956.052798:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961269632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052826:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1866818961269632:12345-0@lo:400:kworker.0 Request processed in 29us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340956.052837:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499 00000100:00100000:1.0:1780340956.052858:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1866818961269632:0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052872:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500 00000100:00100000:1.0:1780340956.052878:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961270144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340956.052904:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961270144:12345-0@lo:400:kworker.0 Request processed in 27us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340956.052909:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500 00000100:00100000:1.0:1780340956.052927:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f290e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961270144:0@lo:400:kworker.0 00010000:00010000:2.0:1780340956.053559:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340956.053612:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.053694:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340956.053943:0:24752:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940529920 00000100:00100000:3.0:1780340956.053950:0:24752:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940529920 00000100:00100000:0.0:1780340956.053970:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1780340956.053986:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471c98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961270272:0@lo:41:osp-pre-1-0.0 00002000:00010000:3.0:1780340956.053992:0:24752:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/877 (0->18446744073709551615) 00002000:00100000:3.0:1780340956.053997:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c9f100 with x1866818940529920 ext(0->18446744073709551615) 00002000:00010000:3.0:1780340956.054008:0:24752:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c9f100. 00000100:00100000:0.0:1780340956.054030:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340956.054065:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1020 00000100:00100000:3.0:1780340956.054074:0:24752:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+30:2407:x1866818940529920:12345-192.168.203.16@tcp:10:dd.0 00000100:00100000:0.0:1780340956.054091:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340956.054113:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.054166:0:25497:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940530304 00000100:00100000:2.0:1780340956.054171:0:25497:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940530304 00002000:00010000:3.0:1780340956.054208:0:24752:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36d:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:2.0:1780340956.054213:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5973 00002000:00010000:3.0:1780340956.054214:0:24752:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x36d:0x0] updating lvb mtime from disk: 1780340943 -> 1780340956 00002000:00010000:3.0:1780340956.054219:0:24752:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x36d:0x0] updating lvb atime from disk: 1780340943 -> 1780340943 00002000:00010000:3.0:1780340956.054222:0:24752:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x36d:0x0] updating lvb ctime from disk: 1780340943 -> 1780340956 00000100:00100000:2.0:1780340956.054224:0:25497:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+32:72995:x1866818940530304:12345-192.168.203.16@tcp:101:dd.0 00002000:00010000:3.0:1780340956.054235:0:24752:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36d:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00010000:2.0:1780340956.054235:0:25497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000080:3.0:1780340956.054247:0:24752:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c9f100 x1866818940529920/t4294969491(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 440/432 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1780340956.054255:0:25497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa246514327760e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced28fb expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340956.054277:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x36e:0x0] initial LVB size: 0, mtime: 0x6a1dd8cf, atime: 0x6a1dd8cf, ctime: 0x6a1dd8cf, blocks: 0x0 00010000:00010000:2.0:1780340956.054294:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340956.054296:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1780340956.054304:0:25497:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa246514327760e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28fb expref: 33 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340956.054319:0:24752:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+33:2407:x1866818940529920:12345-192.168.203.16@tcp:10:dd.0 Request processed in 245us (707us total) trans 4294969491 rc 0/0 00000100:00100000:3.0:1780340956.054336:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1020 00002000:00010000:3.0:1780340956.054340:0:24752:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/877 (0->18446744073709551615) 00002000:00100000:3.0:1780340956.054342:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c9f100 with x1866818940529920 ext(0->18446744073709551615) 00010000:00010000:2.0:1780340956.054346:0:25497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa246514327760e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28fb expref: 33 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780340956.054348:0:24752:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c9f100. 00010000:00010000:2.0:1780340956.054363:0:25497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c034d9eb200, rc 0) 00010000:00000080:2.0:1780340956.054368:0:25497:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045f293100 x1866818940530304/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 328/400 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340956.054396:0:25497:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+32:72995:x1866818940530304:12345-192.168.203.16@tcp:101:dd.0 Request processed in 174us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340956.054398:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961270272 00000100:00100000:3.0:1780340956.054403:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961270272 00000100:00100000:2.0:1780340956.054405:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5973 00000100:00100000:3.0:1780340956.054434:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4002 00000100:00100000:3.0:1780340956.054441:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961270272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780340956.054473:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:3.0:1780340956.054526:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f291880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961270272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340956.054532:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4002 00000100:00100000:2.0:1780340956.054665:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471c98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961270272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340956.054740:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940530176 00000100:00100000:1.0:1780340956.054744:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940530176 00000100:00100000:1.0:1780340956.054799:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940530432 00000100:00100000:1.0:1780340956.054803:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940530432 00000100:00100000:1.0:1780340956.054823:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1576 00000100:00100000:1.0:1780340956.054830:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+119:72996:x1866818940530176:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:1.0:1780340956.054869:0:63710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340956.054893:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea400/0xa2465143277608e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28d8 expref: 119 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.054907:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff8c0455c3bc00) 00010000:00010000:1.0:1780340956.054911:0:63710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780340956.055045:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa246514327760f0 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.055056:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa246514327760f0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.055077:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa246514327760f0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1780340956.055113:0:63710:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084413 00000004:00010000:1.0:1780340956.055130:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e4dcdc1e reply state 000000000e11a588 transno 120259084414 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa246514327760f0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.055139:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa246514327760f0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.055145:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff8c0455c3bc00) 00010000:00010000:1.0:1780340956.055147:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340956.055149:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1780340956.055208:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+121:72996:x1866818940530176:12345-192.168.203.16@tcp:36:dd.0 Request processed in 379us (1514us total) trans 120259084414 rc 0/0 00000100:00100000:1.0:1780340956.055214:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1576 00000020:00080000:1.0:1780340956.055218:0:63710:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1780340956.055230:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1577 00000100:00100000:1.0:1780340956.055235:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+120:72997:x1866818940530432:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:1.0:1780340956.055245:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340956.055254:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af800/0xa246514327760f7 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2902 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.055272:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327760fe lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.055280:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327760fe lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.055298:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327760fe lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.055362:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af800/0xa246514327760f7 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2902 expref: 122 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.055376:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453122600/0xa246514327760fe lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2902 expref: 121 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.055383:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff8c045312ec00) 00010000:00010000:1.0:1780340956.055385:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1780340956.055387:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453122600, rc 0) 00000100:00100000:1.0:1780340956.055414:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+121:72997:x1866818940530432:12345-192.168.203.16@tcp:101:dd.0 Request processed in 180us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340956.055420:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1577 00000100:00100000:1.0:1780340956.056321:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.056384:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940530688 00000100:00100000:2.0:1780340956.056392:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940530688 00000100:00100000:2.0:1780340956.056435:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1578 00000100:00100000:2.0:1780340956.056444:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+121:73000:x1866818940530688:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340956.056456:0:63711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340956.056469:0:63711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa24651432776105 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2909 expref: -99 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056607:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa2465143277610c lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056619:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa2465143277610c lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056629:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa2465143277610c lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056650:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa24651432776113 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056658:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa24651432776113 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056664:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa24651432776113 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056713:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa2465143277611a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056721:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa2465143277611a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056728:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa2465143277611a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340956.056737:0:63711:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x17:0x0]: returning size 0 00010000:00010000:2.0:1780340956.056845:0:63711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa2465143277610c lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056853:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa2465143277610c lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056859:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa2465143277610c lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056866:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa2465143277610c lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056872:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340956.056882:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa2465143277610c lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056891:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa2465143277610c lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056902:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:2.0:1780340956.056905:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340956.056908:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa2465143277610c lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056915:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea200/0xa2465143277610c lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056926:0:63711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa24651432776113 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056933:0:63711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa24651432776113 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056938:0:63711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa24651432776113 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056943:0:63711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ebe00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340956.056946:0:63711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa24651432776113 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056952:0:63711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa24651432776113 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056972:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff8c045a8c6f00) 00010000:00010000:2.0:1780340956.056975:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340956.056984:0:63711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa24651432776113 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.056990:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebe00/0xa24651432776113 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.057031:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ebc00/0xa24651432776105 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2909 expref: 124 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.057044:0:63711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa2465143277611a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2909 expref: 123 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.057051:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff8c04506cf000) 00010000:00010000:2.0:1780340956.057053:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340956.057055:0:63711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04445c6e00, rc 0) 00000100:00100000:2.0:1780340956.057098:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+123:73000:x1866818940530688:12345-192.168.203.16@tcp:101:dd.0 Request processed in 656us (781us total) trans 120259084415 rc 0/0 00000100:00100000:2.0:1780340956.057106:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1578 00000100:00100000:0.0:1780340956.066284:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340956.066326:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340956.066379:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340956.066399:0:8405:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940530816 00000100:00100000:3.0:1780340956.066409:0:8405:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940530816 00002000:00010000:3.0:1780340956.066447:0:8405:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/878 (0->18446744073709551615) 00002000:00100000:3.0:1780340956.066452:0:8405:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045f290380 with x1866818940530816 ext(0->18446744073709551615) 00000100:00100000:2.0:1780340956.066467:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940531328 00000100:00100000:2.0:1780340956.066472:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940531328 00002000:00010000:3.0:1780340956.066474:0:8405:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045f290380. 00000100:00100000:2.0:1780340956.066510:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 279 00000100:00100000:3.0:1780340956.066512:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1021 00000100:00100000:3.0:1780340956.066522:0:8405:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+32:2408:x1866818940530816:12345-192.168.203.16@tcp:10:dd.0 00000100:00100000:2.0:1780340956.066543:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+123:72994:x1866818940531328:12345-192.168.203.16@tcp:35:dd.0 00002000:00010000:3.0:1780340956.066658:0:8405:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1780340956.066662:0:8405:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x36e:0x0] updating lvb mtime from disk: 1780340943 -> 1780340956 00002000:00010000:3.0:1780340956.066673:0:8405:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x36e:0x0] updating lvb atime from disk: 1780340943 -> 1780340943 00002000:00010000:3.0:1780340956.066675:0:8405:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x36e:0x0] updating lvb ctime from disk: 1780340943 -> 1780340956 00002000:00010000:3.0:1780340956.066677:0:8405:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36e:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1780340956.066687:0:8405:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045f290380 x1866818940530816/t4294969492(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 440/432 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340956.066737:0:8405:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f290380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+33:2408:x1866818940530816:12345-192.168.203.16@tcp:10:dd.0 Request processed in 216us (409us total) trans 4294969492 rc 0/0 00000100:00100000:3.0:1780340956.066744:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1021 00000100:00100000:2.0:1780340956.066749:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+124:72994:x1866818940531328:12345-192.168.203.16@tcp:35:dd.0 Request processed in 216us (366us total) trans 120259084416 rc 0/0 00002000:00010000:3.0:1780340956.066750:0:8405:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/878 (0->18446744073709551615) 00002000:00100000:3.0:1780340956.066756:0:8405:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045f290380 with x1866818940530816 ext(0->18446744073709551615) 00000100:00100000:2.0:1780340956.066786:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 279 00002000:00010000:3.0:1780340956.066793:0:8405:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045f290380. 00000100:00100000:1.0:1780340956.067085:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940531072 00000100:00100000:1.0:1780340956.067090:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940531072 00000100:00100000:1.0:1780340956.067124:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1579 00000100:00100000:1.0:1780340956.067131:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+124:72997:x1866818940531072:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:1.0:1780340956.067173:0:63712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340956.067200:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa246514327760db lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28e6 expref: 124 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.067218:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff8c045312ec00) 00000100:00100000:3.0:1780340956.067225:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00010000:00010000:1.0:1780340956.067226:0:63712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1780340956.067313:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432776128 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.067327:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432776128 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.067336:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432776128 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1780340956.067371:0:63712:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084417 00000004:00010000:1.0:1780340956.067390:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006be9a7de reply state 00000000860b1fdd transno 120259084418 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432776128 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.067401:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432776128 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.067407:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff8c045312ec00) 00010000:00010000:1.0:1780340956.067410:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1780340956.067412:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780340956.067682:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940531712 00000100:00100000:0.0:1780340956.067688:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940531712 00000100:00100000:0.0:1780340956.067713:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1580 00000100:00100000:0.0:1780340956.067720:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+127:72998:x1866818940531712:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:0.0:1780340956.067729:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340956.067745:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa2465143277612f lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2910 expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.067850:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432776136 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.067860:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432776136 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.067867:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432776136 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.067879:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa2465143277613d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.067885:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa2465143277613d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.067891:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa2465143277613d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.067923:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432776144 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.067930:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432776144 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.067936:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432776144 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1780340956.067944:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x15:0x0]: returning size 0 00010000:00010000:0.0:1780340956.068001:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432776136 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.068017:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432776136 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.068024:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432776136 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.068030:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432776136 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.068036:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340956.068041:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432776136 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.068051:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432776136 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.068062:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:0.0:1780340956.068065:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340956.068068:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432776136 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.068073:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5000/0xa24651432776136 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.068085:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa2465143277613d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.068090:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa2465143277613d lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.068095:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa2465143277613d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.068107:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:0.0:1780340956.068109:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa2465143277613d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.068115:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa2465143277613d lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.068122:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff8c0345328000) 00010000:00010000:0.0:1780340956.068124:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1780340956.068126:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa2465143277613d lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.068131:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa2465143277613d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.068162:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa4c00/0xa2465143277612f lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2910 expref: 130 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.068174:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432776144 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2910 expref: 129 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.068180:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff8c0477219a00) 00010000:00010000:0.0:1780340956.068182:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1780340956.068184:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5a00, rc 0) 00000100:00100000:1.0:1780340956.068267:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+129:72997:x1866818940531072:12345-192.168.203.16@tcp:36:dd.0 Request processed in 1136us (1991us total) trans 120259084418 rc 0/0 00000100:00100000:1.0:1780340956.068275:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1579 00000020:00080000:1.0:1780340956.068279:0:63712:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1780340956.068955:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+128:72998:x1866818940531712:12345-192.168.203.16@tcp:101:dd.0 Request processed in 1233us (1732us total) trans 120259084419 rc 0/0 00000100:00100000:0.0:1780340956.068971:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1580 00000100:00100000:1.0:1780340956.075882:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340956.075935:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.076034:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940531456 00000100:00100000:2.0:1780340956.076045:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940531456 00000100:00100000:2.0:1780340956.076101:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1581 00000100:00100000:2.0:1780340956.076112:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+128:73000:x1866818940531456:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340956.076144:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340956.076165:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776152 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2917 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.076201:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7e00/0xa24651432776159 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.076214:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7e00/0xa24651432776159 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.076225:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7e00/0xa24651432776159 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.076324:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776152 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2917 expref: 130 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.076341:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7e00/0xa24651432776159 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2917 expref: 129 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.076349:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff8c04506cf000) 00010000:00010000:2.0:1780340956.076352:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780340956.076355:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04445c7e00, rc 0) 00000100:00100000:2.0:1780340956.076412:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+129:73000:x1866818940531456:12345-192.168.203.16@tcp:101:dd.0 Request processed in 302us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340956.076419:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1581 00000100:00100000:3.0:1780340956.079287:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940531840 00000100:00100000:3.0:1780340956.079301:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940531840 00000100:00100000:3.0:1780340956.079363:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5974 00000100:00100000:3.0:1780340956.079373:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04776c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+33:72996:x1866818940531840:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340956.079397:0:25489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340956.079418:0:25489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000824213ca/0xa24651432776160 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced291e expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780340956.079442:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x36f:0x0] initial LVB size: 0, mtime: 0x6a1dd8cf, atime: 0x6a1dd8cf, ctime: 0x6a1dd8cf, blocks: 0x0 00010000:00010000:3.0:1780340956.079472:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340956.079475:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340956.079482:0:25489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000824213ca/0xa24651432776160 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced291e expref: 34 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.079516:0:25489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000824213ca/0xa24651432776160 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced291e expref: 34 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.079529:0:25489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0486367e00, rc 0) 00010000:00000080:3.0:1780340956.079535:0:25489:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04776c7050 x1866818940531840/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 328/400 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340956.079604:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04776c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+34:72996:x1866818940531840:12345-192.168.203.16@tcp:101:dd.0 Request processed in 233us (3669us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340956.079611:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5974 00000100:00100000:1.0:1780340956.081292:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340956.081329:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340956.081700:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940532224 00000100:00100000:0.0:1780340956.081721:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940532224 00000100:00100000:0.0:1780340956.081815:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5975 00000100:00100000:0.0:1780340956.081825:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+34:72997:x1866818940532224:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:0.0:1780340956.081851:0:25495:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340956.081871:0:25495:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed57d1c5/0xa24651432776167 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2925 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340956.081895:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x370:0x0] initial LVB size: 0, mtime: 0x6a1dd8cf, atime: 0x6a1dd8cf, ctime: 0x6a1dd8cf, blocks: 0x0 00010000:00010000:0.0:1780340956.081913:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340956.081915:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340956.081921:0:25495:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed57d1c5/0xa24651432776167 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2925 expref: 35 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.081936:0:25495:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ed57d1c5/0xa24651432776167 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2925 expref: 35 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.081947:0:25495:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa4c00, rc 0) 00010000:00000080:0.0:1780340956.081954:0:25495:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045ee7f800 x1866818940532224/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 328/400 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340956.082025:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+35:72997:x1866818940532224:12345-192.168.203.16@tcp:101:dd.0 Request processed in 202us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340956.082032:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5975 00000100:00100000:3.0:1780340956.082537:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940532096 00000100:00100000:3.0:1780340956.082543:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940532096 00000100:00100000:3.0:1780340956.082586:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 280 00000100:00100000:3.0:1780340956.082594:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+129:72995:x1866818940532096:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:3.0:1780340956.082843:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+130:72995:x1866818940532096:12345-192.168.203.16@tcp:35:dd.0 Request processed in 250us (1558us total) trans 120259084420 rc 0/0 00000100:00100000:3.0:1780340956.082851:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 280 00000100:00100000:1.0:1780340956.084832:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340956.085139:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340956.092390:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340956.092430:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340956.092476:0:24762:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940532864 00000100:00100000:3.0:1780340956.092486:0:24762:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940532864 00002000:00010000:3.0:1780340956.092544:0:24762:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/880 (0->18446744073709551615) 00002000:00100000:3.0:1780340956.092550:0:24762:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045f293800 with x1866818940532864 ext(0->18446744073709551615) 00002000:00010000:3.0:1780340956.092561:0:24762:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045f293800. 00000100:00100000:3.0:1780340956.092588:0:24762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1022 00000100:00100000:3.0:1780340956.092599:0:24762:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+35:2409:x1866818940532864:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:3.0:1780340956.092753:0:24762:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x370:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1780340956.092756:0:24762:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x370:0x0] updating lvb mtime from disk: 1780340943 -> 1780340956 00002000:00010000:3.0:1780340956.092781:0:24762:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x370:0x0] updating lvb atime from disk: 1780340943 -> 1780340943 00002000:00010000:3.0:1780340956.092783:0:24762:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x370:0x0] updating lvb ctime from disk: 1780340943 -> 1780340956 00002000:00010000:3.0:1780340956.092785:0:24762:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x370:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1780340956.092793:0:24762:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045f293800 x1866818940532864/t4294969493(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 440/432 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340956.092855:0:24762:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+36:2409:x1866818940532864:12345-192.168.203.16@tcp:10:dd.0 Request processed in 258us (475us total) trans 4294969493 rc 0/0 00000100:00100000:3.0:1780340956.092863:0:24762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1022 00002000:00010000:3.0:1780340956.092867:0:24762:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/880 (0->18446744073709551615) 00002000:00100000:3.0:1780340956.092869:0:24762:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045f293800 with x1866818940532864 ext(0->18446744073709551615) 00002000:00010000:3.0:1780340956.092875:0:24762:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045f293800. 00000100:00100000:2.0:1780340956.096849:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940532608 00000100:00100000:2.0:1780340956.096864:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940532608 00000100:00100000:2.0:1780340956.096950:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940532480 00000100:00100000:2.0:1780340956.096954:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940532480 00000100:00100000:2.0:1780340956.097021:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1582 00000100:00100000:2.0:1780340956.097031:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+131:72998:x1866818940532608:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:2.0:1780340956.097054:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340956.097072:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa2465143277616e lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced292c expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.097106:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432776175 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.097119:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432776175 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.097131:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432776175 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.097229:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa2465143277616e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced292c expref: 133 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.097245:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8a00/0xa24651432776175 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced292c expref: 132 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.097253:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff8c0477219a00) 00010000:00010000:2.0:1780340956.097256:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1780340956.097260:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8a00, rc 0) 00000100:00100000:2.0:1780340956.097328:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+132:72998:x1866818940532608:12345-192.168.203.16@tcp:101:dd.0 Request processed in 299us (12504us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340956.097335:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1582 00000100:00100000:2.0:1780340956.097357:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1583 00000100:00100000:2.0:1780340956.097365:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+131:73000:x1866818940532480:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:2.0:1780340956.097399:0:63710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340956.097416:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6e00/0xa2465143277611a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2909 expref: 131 pid: 63711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.097426:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff8c04506cf000) 00010000:00010000:2.0:1780340956.097429:0:63710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340956.098350:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277617c lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.098365:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277617c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.098373:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277617c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780340956.098422:0:63710:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084421 00000004:00010000:2.0:1780340956.098443:0:63710:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005bb6714f reply state 0000000019e4f7c2 transno 120259084422 ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277617c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.098454:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277617c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.098460:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff8c04506cf000) 00010000:00010000:2.0:1780340956.098462:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340956.098465:0:63710:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340956.098933:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+133:73000:x1866818940532480:12345-192.168.203.16@tcp:36:dd.0 Request processed in 1565us (13790us total) trans 120259084422 rc 0/0 00000100:00100000:2.0:1780340956.098940:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1583 00000020:00080000:2.0:1780340956.098946:0:63710:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1780340956.109114:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340956.109150:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340956.109184:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340956.109284:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.109350:0:24179:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940533120 00000100:00100000:2.0:1780340956.109365:0:24179:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940533120 00002000:00010000:2.0:1780340956.109405:0:24179:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/879 (0->18446744073709551615) 00002000:00100000:2.0:1780340956.109411:0:24179:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045f292680 with x1866818940533120 ext(0->18446744073709551615) 00002000:00010000:2.0:1780340956.109422:0:24179:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045f292680. 00000100:00100000:2.0:1780340956.109456:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1023 00000100:00100000:2.0:1780340956.109466:0:24179:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+36:2407:x1866818940533120:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:2.0:1780340956.109607:0:24179:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1780340956.109610:0:24179:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x36f:0x0] updating lvb mtime from disk: 1780340943 -> 1780340956 00002000:00010000:2.0:1780340956.109613:0:24179:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x36f:0x0] updating lvb atime from disk: 1780340943 -> 1780340943 00002000:00010000:2.0:1780340956.109615:0:24179:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x36f:0x0] updating lvb ctime from disk: 1780340943 -> 1780340956 00002000:00010000:2.0:1780340956.109617:0:24179:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36f:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1780340956.109627:0:24179:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045f292680 x1866818940533120/t4294969494(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 440/432 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340956.109681:0:24179:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+37:2407:x1866818940533120:12345-192.168.203.16@tcp:10:dd.0 Request processed in 216us (576us total) trans 4294969494 rc 0/0 00000100:00100000:2.0:1780340956.109688:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1023 00002000:00010000:2.0:1780340956.109692:0:24179:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/879 (0->18446744073709551615) 00002000:00100000:2.0:1780340956.109695:0:24179:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045f292680 with x1866818940533120 ext(0->18446744073709551615) 00002000:00010000:2.0:1780340956.109699:0:24179:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045f292680. 00000100:00100000:2.0:1780340956.109811:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940532992 00000100:00100000:2.0:1780340956.109816:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940532992 00000100:00100000:3.0:1780340956.109843:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940533504 00000100:00100000:2.0:1780340956.109845:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940533376 00000100:00100000:3.0:1780340956.109850:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940533504 00000100:00100000:2.0:1780340956.109850:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940533376 00000100:00100000:2.0:1780340956.109877:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1584 00000100:00100000:2.0:1780340956.109885:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+134:73001:x1866818940532992:12345-192.168.203.16@tcp:101:dd.0 00000100:00100000:3.0:1780340956.109892:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5976 00010000:00010000:2.0:1780340956.109897:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1780340956.109902:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+37:73000:x1866818940533504:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340956.109912:0:25496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1780340956.109921:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432776183 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2933 expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.109928:0:25496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cac4165/0xa2465143277618a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced293a expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1780340956.109947:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x373:0x0] initial LVB size: 0, mtime: 0x6a1dd8cf, atime: 0x6a1dd8cf, ctime: 0x6a1dd8cf, blocks: 0x0 00010000:00010000:3.0:1780340956.109970:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340956.109972:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1780340956.109979:0:25496:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cac4165/0xa2465143277618a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced293a expref: 38 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.110007:0:25496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000cac4165/0xa2465143277618a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced293a expref: 38 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.110019:0:25496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0486366c00, rc 0) 00010000:00000080:3.0:1780340956.110024:0:25496:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045f291f80 x1866818940533504/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 328/400 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1780340956.110045:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa24651432776191 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340956.110055:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f291f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+38:73000:x1866818940533504:12345-192.168.203.16@tcp:101:dd.0 Request processed in 155us (905us total) trans 0 rc 0/0 00010000:00010000:2.0:1780340956.110058:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa24651432776191 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340956.110064:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5976 00010000:00010000:2.0:1780340956.110074:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa24651432776191 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.110087:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432776198 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340956.110094:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1585 00010000:00010000:2.0:1780340956.110096:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432776198 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340956.110103:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+135:72998:x1866818940533376:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:2.0:1780340956.110107:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432776198 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.110131:0:64454:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340956.110149:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5a00/0xa24651432776144 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2910 expref: 135 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.110158:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa2465143277619f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.110164:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff8c0477219a00) 00010000:00010000:2.0:1780340956.110168:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa2465143277619f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.110170:0:64454:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340956.110179:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa2465143277619f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1780340956.110189:0:63710:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x18:0x0]: returning size 0 00010000:00010000:2.0:1780340956.110248:0:63710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa24651432776191 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.110265:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa24651432776191 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.110271:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa24651432776191 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.110277:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa24651432776191 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.110282:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9e00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340956.110287:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa24651432776191 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.110290:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa246514327761ad lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.110297:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa24651432776191 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.110303:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa246514327761ad lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.110308:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:2.0:1780340956.110312:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340956.110314:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa246514327761ad lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.110316:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa24651432776191 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.110330:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9e00/0xa24651432776191 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.110339:0:63710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432776198 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.110346:0:63710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432776198 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.110352:0:63710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432776198 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.110364:0:63710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f8c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:2.0:1780340956.110367:0:63710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432776198 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.110373:0:63710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432776198 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1780340956.110378:0:64454:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084424 00010000:00010000:2.0:1780340956.110382:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff8c045a8c6f00) 00010000:00010000:2.0:1780340956.110385:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1780340956.110388:0:63710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432776198 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.110393:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8c00/0xa24651432776198 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1780340956.110412:0:64454:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000905f0e4d reply state 000000008855f4aa transno 120259084425 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa246514327761ad lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.110424:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa246514327761ad lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.110431:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff8c0477219a00) 00010000:00010000:2.0:1780340956.110434:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9400/0xa24651432776183 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2933 expref: 138 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.110435:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1780340956.110439:0:64454:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1780340956.110451:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa2465143277619f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2933 expref: 137 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.110458:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff8c0345328400) 00010000:00010000:2.0:1780340956.110461:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1780340956.110463:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04445c6600, rc 0) 00000100:00100000:2.0:1780340956.110486:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+138:73001:x1866818940532992:12345-192.168.203.16@tcp:101:dd.0 Request processed in 603us (18056us total) trans 120259084423 rc 0/0 00000100:00100000:2.0:1780340956.110492:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1584 00000100:00100000:3.0:1780340956.110503:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+137:72998:x1866818940533376:12345-192.168.203.16@tcp:36:dd.0 Request processed in 399us (1315us total) trans 120259084425 rc 0/0 00000100:00100000:3.0:1780340956.110510:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1585 00000020:00080000:3.0:1780340956.110515:0:64454:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1780340956.112430:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940533760 00000100:00100000:1.0:1780340956.112443:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940533760 00000100:00100000:1.0:1780340956.112498:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 281 00000100:00100000:1.0:1780340956.112507:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+137:72997:x1866818940533760:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:1.0:1780340956.112791:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+138:72997:x1866818940533760:12345-192.168.203.16@tcp:35:dd.0 Request processed in 285us (3506us total) trans 120259084426 rc 0/0 00000100:00100000:1.0:1780340956.112799:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 281 00000100:00100000:0.0:1780340956.120968:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340956.121011:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340956.121038:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340956.121066:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.121159:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940534272 00000100:00100000:2.0:1780340956.121182:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940534272 00000100:00100000:2.0:1780340956.121261:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 282 00000100:00100000:3.0:1780340956.121264:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940534016 00000100:00100000:2.0:1780340956.121274:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+138:72996:x1866818940534272:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:3.0:1780340956.121278:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940534016 00000100:00100000:3.0:1780340956.121316:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1586 00000100:00100000:3.0:1780340956.121325:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+139:73001:x1866818940534016:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340956.121337:0:70100:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340956.121362:0:70100:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa246514327761b4 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2941 expref: -99 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.121398:0:70100:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa246514327761bb lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.121412:0:70100:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa246514327761bb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.121422:0:70100:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa246514327761bb lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 70100 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.121530:0:70100:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8800/0xa246514327761b4 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2941 expref: 142 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.121549:0:70100:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f8e00/0xa246514327761bb lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2941 expref: 141 pid: 70100 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.121557:0:70100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff8c0345328400) 00010000:00010000:3.0:1780340956.121561:0:70100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1780340956.121565:0:70100:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8e00, rc 0) 00000100:00100000:3.0:1780340956.121623:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+141:73001:x1866818940534016:12345-192.168.203.16@tcp:101:dd.0 Request processed in 299us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340956.121631:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1586 00000100:00100000:2.0:1780340956.121673:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+140:72996:x1866818940534272:12345-192.168.203.16@tcp:35:dd.0 Request processed in 400us (603us total) trans 120259084427 rc 0/0 00000100:00100000:3.0:1780340956.121674:0:24177:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940533888 00000100:00100000:3.0:1780340956.121680:0:24177:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940533888 00000100:00100000:2.0:1780340956.121684:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 282 00002000:00010000:3.0:1780340956.121702:0:24177:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/883 (0->18446744073709551615) 00002000:00100000:3.0:1780340956.121707:0:24177:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045f293100 with x1866818940533888 ext(0->18446744073709551615) 00002000:00010000:3.0:1780340956.121715:0:24177:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045f293100. 00000100:00100000:3.0:1780340956.121745:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1024 00000100:00100000:3.0:1780340956.121751:0:24177:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+38:2408:x1866818940533888:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:3.0:1780340956.122140:0:24177:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x373:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1780340956.122144:0:24177:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x373:0x0] updating lvb mtime from disk: 1780340943 -> 1780340956 00002000:00010000:3.0:1780340956.122147:0:24177:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x373:0x0] updating lvb atime from disk: 1780340943 -> 1780340943 00002000:00010000:3.0:1780340956.122149:0:24177:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x373:0x0] updating lvb ctime from disk: 1780340943 -> 1780340956 00002000:00010000:3.0:1780340956.122152:0:24177:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x373:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1780340956.122161:0:24177:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045f293100 x1866818940533888/t4294969495(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 440/432 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340956.122198:0:24177:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f293100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+39:2408:x1866818940533888:12345-192.168.203.16@tcp:10:dd.0 Request processed in 447us (1249us total) trans 4294969495 rc 0/0 00000100:00100000:1.0:1780340956.122281:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940534400 00000100:00100000:1.0:1780340956.122286:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940534400 00000100:00100000:1.0:1780340956.122328:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5977 00000100:00100000:1.0:1780340956.122335:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+40:72998:x1866818940534400:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:1.0:1780340956.122345:0:25493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1780340956.122363:0:25493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e40ce22/0xa246514327761c2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2948 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1780340956.122382:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x371:0x0] initial LVB size: 0, mtime: 0x6a1dd8cf, atime: 0x6a1dd8cf, ctime: 0x6a1dd8cf, blocks: 0x0 00010000:00010000:1.0:1780340956.122396:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340956.122399:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1780340956.122405:0:25493:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e40ce22/0xa246514327761c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2948 expref: 41 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.122419:0:25493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e40ce22/0xa246514327761c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2948 expref: 41 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340956.122430:0:25493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0453123600, rc 0) 00010000:00000080:1.0:1780340956.122434:0:25493:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045f290000 x1866818940534400/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 328/400 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340956.122461:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+41:72998:x1866818940534400:12345-192.168.203.16@tcp:101:dd.0 Request processed in 127us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340956.122479:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5977 00000100:00100000:3.0:1780340956.135898:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1024 00002000:00010000:3.0:1780340956.135907:0:24177:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/883 (0->18446744073709551615) 00002000:00100000:3.0:1780340956.135913:0:24177:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045f293100 with x1866818940533888 ext(0->18446744073709551615) 00002000:00010000:3.0:1780340956.135924:0:24177:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045f293100. 00000100:00100000:0.0:1780340956.136201:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340956.136233:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340956.136315:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340956.136648:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940534656 00000100:00100000:3.0:1780340956.136657:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940534656 00000100:00100000:3.0:1780340956.136705:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940534912 00000100:00100000:3.0:1780340956.136709:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940534912 00000100:00100000:3.0:1780340956.136731:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1587 00000100:00100000:3.0:1780340956.136740:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+141:73002:x1866818940534656:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340956.136789:0:64454:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340956.136808:0:64454:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa246514327761c9 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced294f expref: -99 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340956.136925:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1588 00000100:00100000:0.0:1780340956.136936:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+142:73001:x1866818940534912:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:0.0:1780340956.136984:0:63712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1780340956.137006:0:63712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa2465143277619f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2933 expref: 142 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.137021:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff8c0345328400) 00010000:00010000:0.0:1780340956.137025:0:63712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1780340956.137175:0:63712:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa246514327761d0 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.137189:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa246514327761d0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.137198:0:63712:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa246514327761d0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1780340956.137242:0:63712:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084428 00000004:00010000:0.0:1780340956.137276:0:63712:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000004764816 reply state 00000000ccf0f362 transno 120259084429 ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa246514327761d0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.137306:0:63712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa246514327761d0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.137312:0:63712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff8c0345328400) 00010000:00010000:0.0:1780340956.137314:0:63712:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1780340956.137317:0:63712:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1780340956.137406:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+144:73001:x1866818940534912:12345-192.168.203.16@tcp:36:dd.0 Request processed in 472us (1170us total) trans 120259084429 rc 0/0 00000100:00100000:0.0:1780340956.137413:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1588 00000020:00080000:0.0:1780340956.137418:0:63712:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1780340956.138013:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327761d7 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138026:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327761d7 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138034:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327761d7 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138049:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa246514327761de lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138069:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa246514327761de lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138076:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa246514327761de lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138121:0:64454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af800/0xa246514327761e5 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138130:0:64454:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af800/0xa246514327761e5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138136:0:64454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af800/0xa246514327761e5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1780340956.138145:0:64454:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x19:0x0]: returning size 0 00010000:00010000:3.0:1780340956.138197:0:64454:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327761d7 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138204:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327761d7 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138211:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327761d7 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138217:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327761d7 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138223:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2c800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340956.138227:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327761d7 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138245:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327761d7 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138531:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff8c04506cf200) 00010000:00010000:3.0:1780340956.138535:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340956.138539:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327761d7 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138546:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c800/0xa246514327761d7 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138559:0:64454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa246514327761de lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138565:0:64454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa246514327761de lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138571:0:64454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa246514327761de lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138576:0:64454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0470f2c200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340956.138579:0:64454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa246514327761de lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138587:0:64454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa246514327761de lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138593:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff8c044120f100) 00010000:00010000:3.0:1780340956.138596:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340956.138598:0:64454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa246514327761de lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138613:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2c200/0xa246514327761de lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138662:0:64454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0470f2d000/0xa246514327761c9 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced294f expref: 145 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138675:0:64454:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af800/0xa246514327761e5 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced294f expref: 144 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.138682:0:64454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff8c0345328100) 00010000:00010000:3.0:1780340956.138684:0:64454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1780340956.138687:0:64454:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c04722af800, rc 0) 00000100:00100000:3.0:1780340956.138728:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+144:73002:x1866818940534656:12345-192.168.203.16@tcp:101:dd.0 Request processed in 1989us (2529us total) trans 120259084430 rc 0/0 00000100:00100000:3.0:1780340956.138735:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1587 00000100:00100000:0.0:1780340956.138975:0:24191:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940535040 00000100:00100000:0.0:1780340956.138983:0:24191:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940535040 00002000:00010000:0.0:1780340956.139014:0:24191:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/881 (0->18446744073709551615) 00002000:00100000:0.0:1780340956.139018:0:24191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0476d9d500 with x1866818940535040 ext(0->18446744073709551615) 00002000:00010000:0.0:1780340956.139027:0:24191:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0476d9d500. 00000100:00100000:0.0:1780340956.139065:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1025 00000100:00100000:0.0:1780340956.139074:0:24191:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+40:2410:x1866818940535040:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:0.0:1780340956.139183:0:24191:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x371:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1780340956.139186:0:24191:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x371:0x0] updating lvb mtime from disk: 1780340943 -> 1780340956 00002000:00010000:0.0:1780340956.139189:0:24191:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x371:0x0] updating lvb atime from disk: 1780340943 -> 1780340943 00002000:00010000:0.0:1780340956.139191:0:24191:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x371:0x0] updating lvb ctime from disk: 1780340943 -> 1780340956 00002000:00010000:0.0:1780340956.139194:0:24191:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x371:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1780340956.139202:0:24191:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0476d9d500 x1866818940535040/t4294969496(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 440/432 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340956.139231:0:24191:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+41:2410:x1866818940535040:12345-192.168.203.16@tcp:10:dd.0 Request processed in 160us (2916us total) trans 4294969496 rc 0/0 00000100:00100000:0.0:1780340956.139248:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1025 00002000:00010000:0.0:1780340956.139262:0:24191:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/881 (0->18446744073709551615) 00002000:00100000:0.0:1780340956.139929:0:24191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0476d9d500 with x1866818940535040 ext(0->18446744073709551615) 00002000:00010000:0.0:1780340956.139940:0:24191:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0476d9d500. 00000100:00100000:2.0:1780340956.141260:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340956.144127:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940535296 00000100:00100000:3.0:1780340956.144140:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940535296 00000100:00100000:3.0:1780340956.144215:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 283 00000100:00100000:3.0:1780340956.144224:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477238850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+144:73000:x1866818940535296:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:3.0:1780340956.144531:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477238850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+145:73000:x1866818940535296:12345-192.168.203.16@tcp:35:dd.0 Request processed in 307us (3282us total) trans 120259084431 rc 0/0 00000100:00100000:3.0:1780340956.144539:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 283 00000100:00100000:2.0:1780340956.146924:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.146969:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.147006:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340956.147065:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940535552 00000100:00100000:3.0:1780340956.147074:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940535552 00000100:00100000:3.0:1780340956.147127:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1589 00000100:00100000:3.0:1780340956.147137:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+145:73002:x1866818940535552:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:3.0:1780340956.147173:0:63710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1780340956.147192:0:63710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa246514327761f3 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced295d expref: -99 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.147223:0:63710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa246514327761fa lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.147238:0:63710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa246514327761fa lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.147248:0:63710:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa246514327761fa lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1780340956.147277:0:63713:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940535808 00000100:00100000:1.0:1780340956.147283:0:63713:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940535808 00000100:00100000:1.0:1780340956.147312:0:63713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 284 00000100:00100000:1.0:1780340956.147318:0:63713:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+147:72998:x1866818940535808:12345-192.168.203.16@tcp:35:dd.0 00010000:00010000:3.0:1780340956.147607:0:63710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af200/0xa246514327761f3 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced295d expref: 149 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.147622:0:63710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0440030200/0xa246514327761fa lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced295d expref: 148 pid: 63710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340956.147630:0:63710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff8c0345328100) 00010000:00010000:3.0:1780340956.147633:0:63710:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1780340956.147636:0:63710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440030200, rc 0) 00000100:00100000:1.0:1780340956.147710:0:63713:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+148:72998:x1866818940535808:12345-192.168.203.16@tcp:35:dd.0 Request processed in 391us (702us total) trans 120259084432 rc 0/0 00000100:00100000:1.0:1780340956.147720:0:63713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 284 00000100:00100000:0.0:1780340956.147721:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940535424 00000100:00100000:0.0:1780340956.147727:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940535424 00000100:00100000:0.0:1780340956.147781:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5978 00000100:00100000:0.0:1780340956.147789:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+41:73001:x1866818940535424:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:0.0:1780340956.147799:0:23153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340956.147812:0:23153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e3987f1/0xa24651432776201 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2956 expref: -99 pid: 23153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340956.147832:0:23153:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x374:0x0] initial LVB size: 0, mtime: 0x6a1dd8cf, atime: 0x6a1dd8cf, ctime: 0x6a1dd8cf, blocks: 0x0 00010000:00010000:0.0:1780340956.147845:0:23153:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340956.147847:0:23153:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340956.147853:0:23153:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e3987f1/0xa24651432776201 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2956 expref: 42 pid: 23153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.147866:0:23153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002e3987f1/0xa24651432776201 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2956 expref: 42 pid: 23153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.147876:0:23153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5a00, rc 0) 00010000:00000080:0.0:1780340956.147881:0:23153:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c9ed80 x1866818940535424/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 328/400 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340956.156971:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+147:73002:x1866818940535552:12345-192.168.203.16@tcp:101:dd.0 Request processed in 9812us (9991us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340956.156984:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1589 00000100:00100000:0.0:1780340956.157075:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+42:73001:x1866818940535424:12345-192.168.203.16@tcp:101:dd.0 Request processed in 9285us (10158us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340956.157100:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5978 00000100:00100000:3.0:1780340956.169943:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.170024:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940536064 00000100:00100000:2.0:1780340956.170034:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940536064 00000100:00100000:2.0:1780340956.170090:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1590 00000100:00100000:2.0:1780340956.170099:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+147:73002:x1866818940536064:12345-192.168.203.16@tcp:36:dd.0 00010000:00010000:2.0:1780340956.170153:0:63711:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340956.170180:0:63711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af800/0xa246514327761e5 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced294f expref: 147 pid: 64454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.170198:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff8c0345328100) 00010000:00010000:2.0:1780340956.170203:0:63711:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340956.170371:0:63711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776208 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.170385:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776208 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.170394:0:63711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776208 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1780340956.170455:0:63711:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084433 00000004:00010000:2.0:1780340956.170478:0:63711:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000022037bfa reply state 000000008d0f26e7 transno 120259084434 ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776208 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.170490:0:63711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776208 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340956.170497:0:63711:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff8c0345328100) 00010000:00010000:2.0:1780340956.170500:0:63711:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1780340956.170502:0:63711:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1780340956.170581:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+149:73002:x1866818940536064:12345-192.168.203.16@tcp:36:dd.0 Request processed in 482us (646us total) trans 120259084434 rc 0/0 00000100:00100000:2.0:1780340956.170589:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1590 00000020:00080000:2.0:1780340956.170593:0:63711:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1780340956.179259:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340956.179301:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340956.179315:0:24174:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940536192 00000100:00100000:1.0:1780340956.179325:0:24174:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940536192 00002000:00010000:1.0:1780340956.179367:0:24174:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/884 (0->18446744073709551615) 00002000:00100000:1.0:1780340956.179372:0:24174:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c9f800 with x1866818940536192 ext(0->18446744073709551615) 00002000:00010000:1.0:1780340956.179385:0:24174:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c9f800. 00000100:00100000:1.0:1780340956.179420:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1026 00000100:00100000:1.0:1780340956.179430:0:24174:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+42:2408:x1866818940536192:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:1.0:1780340956.179595:0:24174:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x374:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1780340956.179599:0:24174:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x374:0x0] updating lvb mtime from disk: 1780340943 -> 1780340956 00002000:00010000:1.0:1780340956.179601:0:24174:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x374:0x0] updating lvb atime from disk: 1780340943 -> 1780340943 00002000:00010000:1.0:1780340956.179604:0:24174:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x374:0x0] updating lvb ctime from disk: 1780340943 -> 1780340956 00002000:00010000:1.0:1780340956.179606:0:24174:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x374:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1780340956.179616:0:24174:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c9f800 x1866818940536192/t4294969497(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 440/432 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340956.179680:0:24174:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+43:2408:x1866818940536192:12345-192.168.203.16@tcp:10:dd.0 Request processed in 251us (449us total) trans 4294969497 rc 0/0 00000100:00100000:1.0:1780340956.179703:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1026 00002000:00010000:1.0:1780340956.179707:0:24174:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/884 (0->18446744073709551615) 00002000:00100000:1.0:1780340956.179710:0:24174:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c9f800 with x1866818940536192 ext(0->18446744073709551615) 00002000:00010000:1.0:1780340956.179714:0:24174:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c9f800. 00000100:00100000:0.0:1780340956.179854:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940536320 00000100:00100000:0.0:1780340956.179859:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940536320 00000100:00100000:0.0:1780340956.179889:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5979 00000100:00100000:0.0:1780340956.179897:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+43:73002:x1866818940536320:12345-192.168.203.16@tcp:101:dd.0 00010000:00010000:0.0:1780340956.179906:0:8830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1780340956.179924:0:8830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f7173b1/0xa2465143277620f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced2964 expref: -99 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1780340956.179941:0:8830:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x375:0x0] initial LVB size: 0, mtime: 0x6a1dd8cf, atime: 0x6a1dd8cf, ctime: 0x6a1dd8cf, blocks: 0x0 00010000:00010000:0.0:1780340956.179970:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340956.179972:0:8830:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1780340956.179979:0:8830:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f7173b1/0xa2465143277620f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2964 expref: 44 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.179996:0:8830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f7173b1/0xa2465143277620f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2964 expref: 44 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340956.180008:0:8830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0475fa5c00, rc 0) 00010000:00000080:0.0:1780340956.180014:0:8830:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c9fb80 x1866818940536320/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 328/400 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340956.180050:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+44:73002:x1866818940536320:12345-192.168.203.16@tcp:101:dd.0 Request processed in 155us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340956.180058:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5979 00000100:00100000:2.0:1780340956.187659:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340956.187793:0:77826:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940536576 00000100:00100000:0.0:1780340956.187817:0:77826:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940536576 00000100:00100000:0.0:1780340956.187867:0:77826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 285 00000100:00100000:0.0:1780340956.187876:0:77826:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+149:73001:x1866818940536576:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:0.0:1780340956.188161:0:77826:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+150:73001:x1866818940536576:12345-192.168.203.16@tcp:35:dd.0 Request processed in 286us (510us total) trans 120259084435 rc 0/0 00000100:00100000:0.0:1780340956.188169:0:77826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 285 00000100:00100000:2.0:1780340956.193500:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340956.193805:0:24178:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940536704 00000100:00100000:3.0:1780340956.193815:0:24178:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940536704 00002000:00010000:3.0:1780340956.193856:0:24178:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/885 (0->18446744073709551615) 00002000:00100000:3.0:1780340956.193875:0:24178:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0349339c00 with x1866818940536704 ext(0->18446744073709551615) 00002000:00010000:3.0:1780340956.193885:0:24178:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0349339c00. 00000100:00100000:3.0:1780340956.193916:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1027 00000100:00100000:3.0:1780340956.193925:0:24178:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+44:2410:x1866818940536704:12345-192.168.203.16@tcp:10:dd.0 00002000:00010000:3.0:1780340956.194054:0:24178:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x375:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1780340956.194057:0:24178:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x375:0x0] updating lvb mtime from disk: 1780340943 -> 1780340956 00002000:00010000:3.0:1780340956.194060:0:24178:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x375:0x0] updating lvb atime from disk: 1780340943 -> 1780340943 00002000:00010000:3.0:1780340956.194062:0:24178:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x375:0x0] updating lvb ctime from disk: 1780340943 -> 1780340956 00002000:00010000:3.0:1780340956.194065:0:24178:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x375:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1780340956.194072:0:24178:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0349339c00 x1866818940536704/t4294969498(0) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:382/0 lens 440/432 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340956.194131:0:24178:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349339c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+45:2410:x1866818940536704:12345-192.168.203.16@tcp:10:dd.0 Request processed in 208us (650us total) trans 4294969498 rc 0/0 00000100:00100000:3.0:1780340956.194138:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1027 00002000:00010000:3.0:1780340956.194142:0:24178:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/885 (0->18446744073709551615) 00002000:00100000:3.0:1780340956.194145:0:24178:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0349339c00 with x1866818940536704 ext(0->18446744073709551615) 00002000:00010000:3.0:1780340956.194149:0:24178:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0349339c00. 00000100:00100000:3.0:1780340956.201839:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340956.202532:0:63714:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940536960 00000100:00100000:1.0:1780340956.202542:0:63714:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940536960 00000100:00100000:1.0:1780340956.202597:0:63714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 286 00000100:00100000:1.0:1780340956.202605:0:63714:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+150:73002:x1866818940536960:12345-192.168.203.16@tcp:35:dd.0 00000100:00100000:1.0:1780340956.203531:0:63714:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+151:73002:x1866818940536960:12345-192.168.203.16@tcp:35:dd.0 Request processed in 918us (1693us total) trans 120259084436 rc 0/0 00000100:00100000:1.0:1780340956.203541:0:63714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 286 00000100:00100000:1.0:1780340956.554226:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1780340956.554252:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961270400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340956.554326:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340956.554521:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961270400 00000100:00100000:3.0:1780340956.554529:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961270400 00000100:00100000:3.0:1780340956.554583:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003 00000100:00100000:3.0:1780340956.554592:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961270400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340956.554628:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445199872 avail 1298960384 00000100:00100000:3.0:1780340956.554688:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961270400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340956.554712:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003 00000100:00100000:1.0:1780340956.554817:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961270400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340956.554875:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045ee7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961270528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1780340956.554915:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340956.554949:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961270528 00000100:00100000:1.0:1780340956.554952:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961270528 00000100:00100000:1.0:1780340956.554989:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2182 00000100:00100000:1.0:1780340956.554996:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961270528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1780340956.555013:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00010000:00000080:1.0:1780340956.555024:0:8403:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045ee7c000 x1866818961270528/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:382/0 lens 224/368 e 0 to 0 dl 1780340967 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340956.555068:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961270528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340956.555074:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2182 00000100:00100000:1.0:1780340956.555105:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045ee7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961270528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1780340956.555741:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780340956.555751:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961270656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340956.555809:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340956.555851:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961270656 00000100:00100000:0.0:1780340956.555855:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961270656 00000100:00100000:0.0:1780340956.555885:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2183 00000100:00100000:0.0:1780340956.555891:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0476d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961270656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1780340956.555915:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340956.555952:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0476d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961270656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340956.555968:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2183 00000100:00100000:0.0:1780340956.556005:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471c98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961270656:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1780340957.067004:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340957.740735:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340957.740871:0:8406:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940537088 00000100:00100000:0.0:1780340957.740882:0:8406:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940537088 00002000:00100000:0.0:1780340957.740955:0:8406:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x362:0x0] (0->1023) req@ffff8c045ee7df80 x1866818940537088/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780340957.740966:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045ee7df80 with x1866818940537088 ext(0->1023) 00002000:00010000:0.0:1780340957.740973:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045ee7df80 00000100:00100000:0.0:1780340957.741002:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1028 00000100:00100000:0.0:1780340957.741013:0:8406:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+45:2408:x1866818940537088:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:0.0:1780340957.741407:0:8406:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045ee7df80 x1866818940537088/t4294969499(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340957.741475:0:8406:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+47:2408:x1866818940537088:12345-192.168.203.16@tcp:4:dd.0 Request processed in 465us (750us total) trans 4294969499 rc 0/0 00000100:00100000:0.0:1780340957.741483:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1028 00002000:00100000:0.0:1780340957.741489:0:8406:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x362:0x0] (0->1023) req@ffff8c045ee7df80 x1866818940537088/t4294969499(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780340957.741497:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045ee7df80 with x1866818940537088 ext(0->1023) 00002000:00010000:0.0:1780340957.741499:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045ee7df80 00000100:00080000:1.0:1780340957.741797:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1780340957.743930:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340957.743978:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340957.744006:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340957.744033:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340957.744054:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340957.744077:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340957.744100:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940537600 00000100:00100000:2.0:1780340957.744108:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940537600 00000100:00100000:2.0:1780340957.744153:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940537472 00000100:00100000:2.0:1780340957.744167:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940537472 00000100:00100000:2.0:1780340957.744196:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1501 00000100:00100000:2.0:1780340957.744206:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2408:x1866818940537600:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340957.744274:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2408:x1866818940537600:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 70us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340957.744282:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1501 00000100:00100000:2.0:1780340957.744298:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1502 00000100:00100000:2.0:1780340957.744304:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+151:2408:x1866818940537472:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340957.744329:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349863480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+151:2408:x1866818940537472:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 26us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340957.744334:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1502 00000100:00100000:1.0:1780340957.744483:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940537856 00000100:00100000:1.0:1780340957.744487:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940537856 00000100:00100000:1.0:1780340957.744532:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940537216 00000100:00100000:1.0:1780340957.744535:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940537216 00000100:00100000:1.0:1780340957.744563:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940537728 00000100:00100000:1.0:1780340957.744566:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940537728 00000100:00100000:1.0:1780340957.744582:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2673 00000100:00100000:1.0:1780340957.744588:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940537856:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340957.744615:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f16ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940537856:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 28us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340957.744621:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2673 00000100:00100000:1.0:1780340957.744632:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2674 00000100:00100000:1.0:1780340957.744637:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+48:2408:x1866818940537728:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000080:1.0:1780340957.744651:0:25487:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0349860000 x1866818940537728/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 224/224 e 0 to 0 dl 1780340968 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340957.744669:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349860000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+48:2408:x1866818940537728:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 33us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340957.744674:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2674 00000100:00100000:1.0:1780340957.744683:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5980 00000100:00100000:1.0:1780340957.744696:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04529d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+47:2408:x1866818940537216:12345-192.168.203.16@tcp:16:kworker.0 00000100:00080000:1.0:1780340957.744987:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1780340957.744992:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1780340957.744995:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:1.0:1780340957.745128:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969499 is committed 00010000:00000080:1.0:1780340957.745228:0:25487:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c04529d6300 x1866818940537216/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340957.745264:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04529d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2408:x1866818940537216:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 568us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340957.745270:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5980 00000100:00100000:0.0:1780340957.747740:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940537344 00000100:00100000:0.0:1780340957.747752:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940537344 00000100:00100000:0.0:1780340957.747849:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 181 00000100:00100000:0.0:1780340957.747978:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0477380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940537344:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340957.748042:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0477380850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940537344:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 184us (4121us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340957.748049:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 181 00000100:00100000:1.0:1780340957.763487:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340957.763795:0:24180:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940537984 00000100:00100000:3.0:1780340957.763805:0:24180:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940537984 00002000:00100000:3.0:1780340957.763869:0:24180:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x363:0x0] (0->1023) req@ffff8c045ee7ce00 x1866818940537984/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.763881:0:24180:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045ee7ce00 with x1866818940537984 ext(0->1023) 00002000:00010000:3.0:1780340957.763887:0:24180:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045ee7ce00 00000100:00100000:3.0:1780340957.763918:0:24180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1029 00000100:00100000:3.0:1780340957.763927:0:24180:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2410:x1866818940537984:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:3.0:1780340957.764319:0:24180:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045ee7ce00 x1866818940537984/t4294969500(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340957.764372:0:24180:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2410:x1866818940537984:12345-192.168.203.16@tcp:4:dd.0 Request processed in 446us (894us total) trans 4294969500 rc 0/0 00000100:00100000:3.0:1780340957.764379:0:24180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1029 00002000:00100000:3.0:1780340957.764385:0:24180:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x363:0x0] (0->1023) req@ffff8c045ee7ce00 x1866818940537984/t4294969500(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.764393:0:24180:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045ee7ce00 with x1866818940537984 ext(0->1023) 00002000:00010000:3.0:1780340957.764397:0:24180:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045ee7ce00 00000100:00100000:2.0:1780340957.769506:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340957.769646:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940538112 00000100:00100000:3.0:1780340957.769656:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940538112 00000100:00100000:3.0:1780340957.769736:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5981 00000100:00100000:3.0:1780340957.769746:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2410:x1866818940538112:12345-192.168.203.16@tcp:16:kworker.0 00000001:00080000:2.0:1780340957.770216:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969500 is committed 00010000:00000080:3.0:1780340957.770293:0:25489:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c03498ee300 x1866818940538112/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340957.770366:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2410:x1866818940538112:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 621us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340957.770374:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5981 00000100:00100000:0.0:1780340957.777818:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340957.778010:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340957.778078:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940538368 00000100:00100000:1.0:1780340957.778088:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940538368 00000100:00100000:1.0:1780340957.778147:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5982 00000100:00100000:1.0:1780340957.778157:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2408:x1866818940538368:12345-192.168.203.16@tcp:16:kworker.0 00010000:00000080:1.0:1780340957.778209:0:25495:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0446efd500 x1866818940538368/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340957.778265:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2408:x1866818940538368:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 110us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340957.778272:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5982 00000100:00100000:3.0:1780340957.778821:0:24176:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940538240 00000100:00100000:3.0:1780340957.778835:0:24176:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940538240 00002000:00100000:3.0:1780340957.778871:0:24176:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x364:0x0] (0->1023) req@ffff8c0446efe300 x1866818940538240/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.778881:0:24176:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0446efe300 with x1866818940538240 ext(0->1023) 00002000:00010000:3.0:1780340957.778886:0:24176:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0446efe300 00000100:00100000:3.0:1780340957.778915:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1030 00000100:00100000:3.0:1780340957.778922:0:24176:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2408:x1866818940538240:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:3.0:1780340957.780055:0:24176:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0446efe300 x1866818940538240/t4294969501(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340957.780331:0:24176:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2408:x1866818940538240:12345-192.168.203.16@tcp:4:dd.0 Request processed in 1408us (2320us total) trans 4294969501 rc 0/0 00000100:00100000:3.0:1780340957.780340:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1030 00002000:00100000:3.0:1780340957.780348:0:24176:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x364:0x0] (0->1023) req@ffff8c0446efe300 x1866818940538240/t4294969501(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.780357:0:24176:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0446efe300 with x1866818940538240 ext(0->1023) 00002000:00010000:3.0:1780340957.780361:0:24176:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0446efe300 00000100:00100000:1.0:1780340957.787122:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340957.791155:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340957.791301:0:24191:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940538496 00000100:00100000:1.0:1780340957.791311:0:24191:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940538496 00002000:00100000:1.0:1780340957.791356:0:24191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x365:0x0] (0->1023) req@ffff8c0471c98e00 x1866818940538496/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780340957.791368:0:24191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c98e00 with x1866818940538496 ext(0->1023) 00002000:00010000:1.0:1780340957.791386:0:24191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c98e00 00000100:00100000:1.0:1780340957.791420:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1031 00000100:00100000:1.0:1780340957.791429:0:24191:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2409:x1866818940538496:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:1.0:1780340957.791801:0:24191:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c98e00 x1866818940538496/t4294969502(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340957.792120:0:24191:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+29:2409:x1866818940538496:12345-192.168.203.16@tcp:4:dd.0 Request processed in 690us (972us total) trans 4294969502 rc 0/0 00000100:00100000:1.0:1780340957.792139:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1031 00002000:00100000:1.0:1780340957.792147:0:24191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x365:0x0] (0->1023) req@ffff8c0471c98e00 x1866818940538496/t4294969502(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780340957.792155:0:24191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c98e00 with x1866818940538496 ext(0->1023) 00002000:00010000:1.0:1780340957.792158:0:24191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c98e00 00000100:00100000:0.0:1780340957.792532:0:25496:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940538624 00000100:00100000:0.0:1780340957.792538:0:25496:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940538624 00000100:00100000:0.0:1780340957.792578:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5983 00000100:00100000:0.0:1780340957.792586:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+29:2409:x1866818940538624:12345-192.168.203.16@tcp:16:kworker.0 00000001:00080000:0.0:1780340957.792821:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969502 is committed 00010000:00000080:0.0:1780340957.792977:0:25496:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045ee7ed80 x1866818940538624/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340957.793021:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2409:x1866818940538624:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 437us (5909us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340957.793028:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5983 00000100:00100000:1.0:1780340957.800503:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340957.801557:0:24754:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940538752 00000100:00100000:3.0:1780340957.801568:0:24754:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940538752 00002000:00100000:3.0:1780340957.801616:0:24754:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x366:0x0] (0->1023) req@ffff8c045ee7d180 x1866818940538752/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.801638:0:24754:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045ee7d180 with x1866818940538752 ext(0->1023) 00002000:00010000:3.0:1780340957.801645:0:24754:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045ee7d180 00000100:00100000:3.0:1780340957.801719:0:24754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1032 00000100:00100000:3.0:1780340957.801728:0:24754:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2409:x1866818940538752:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:3.0:1780340957.802122:0:24754:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045ee7d180 x1866818940538752/t4294969503(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340957.802187:0:24754:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2409:x1866818940538752:12345-192.168.203.16@tcp:4:dd.0 Request processed in 461us (1694us total) trans 4294969503 rc 0/0 00000100:00100000:3.0:1780340957.802194:0:24754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1032 00002000:00100000:3.0:1780340957.802200:0:24754:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x366:0x0] (0->1023) req@ffff8c045ee7d180 x1866818940538752/t4294969503(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.802208:0:24754:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045ee7d180 with x1866818940538752 ext(0->1023) 00002000:00010000:3.0:1780340957.802211:0:24754:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045ee7d180 00000100:00100000:2.0:1780340957.808845:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340957.809028:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940538880 00000100:00100000:0.0:1780340957.809038:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940538880 00000100:00100000:0.0:1780340957.809091:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5984 00000100:00100000:0.0:1780340957.809101:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c03498ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2409:x1866818940538880:12345-192.168.203.16@tcp:16:kworker.0 00000001:00080000:0.0:1780340957.809328:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969503 is committed 00010000:00000080:0.0:1780340957.809364:0:25493:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c03498ed500 x1866818940538880/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340957.809413:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c03498ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2409:x1866818940538880:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 315us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340957.809421:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5984 00000100:00100000:1.0:1780340957.818288:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340957.819403:0:24174:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940539008 00000100:00100000:3.0:1780340957.819415:0:24174:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940539008 00002000:00100000:3.0:1780340957.819475:0:24174:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x367:0x0] (0->1023) req@ffff8c045ee7d500 x1866818940539008/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.819486:0:24174:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045ee7d500 with x1866818940539008 ext(0->1023) 00002000:00010000:3.0:1780340957.819492:0:24174:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045ee7d500 00000100:00100000:3.0:1780340957.819537:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1033 00000100:00100000:3.0:1780340957.819547:0:24174:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2410:x1866818940539008:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:3.0:1780340957.820033:0:24174:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045ee7d500 x1866818940539008/t4294969504(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340957.820103:0:24174:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2410:x1866818940539008:12345-192.168.203.16@tcp:4:dd.0 Request processed in 557us (1823us total) trans 4294969504 rc 0/0 00000100:00100000:3.0:1780340957.820112:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1033 00002000:00100000:3.0:1780340957.820120:0:24174:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x367:0x0] (0->1023) req@ffff8c045ee7d500 x1866818940539008/t4294969504(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.820467:0:24174:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045ee7d500 with x1866818940539008 ext(0->1023) 00002000:00010000:3.0:1780340957.820472:0:24174:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045ee7d500 00000100:00100000:1.0:1780340957.821034:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340957.821104:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940539136 00000100:00100000:0.0:1780340957.821112:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940539136 00000100:00100000:0.0:1780340957.821165:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5985 00000100:00100000:0.0:1780340957.821174:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2410:x1866818940539136:12345-192.168.203.16@tcp:16:kworker.0 00000001:00080000:3.0:1780340957.821674:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969504 is committed 00010000:00000080:0.0:1780340957.823060:0:23153:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045ee7ca80 x1866818940539136/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340957.823676:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2410:x1866818940539136:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 2500us (2642us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340957.823688:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5985 00000100:00100000:2.0:1780340957.829661:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340957.829814:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340957.829864:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940539392 00000100:00100000:1.0:1780340957.829874:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940539392 00000100:00100000:1.0:1780340957.829922:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5986 00000100:00100000:1.0:1780340957.829932:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2407:x1866818940539392:12345-192.168.203.16@tcp:16:kworker.0 00010000:00000080:1.0:1780340957.829996:0:8830:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045ee7dc00 x1866818940539392/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340957.830049:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2407:x1866818940539392:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 119us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340957.830067:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5986 00000100:00100000:3.0:1780340957.833542:0:8405:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940539264 00000100:00100000:3.0:1780340957.833558:0:8405:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940539264 00000100:00100000:1.0:1780340957.833913:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340957.833967:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340957.833989:0:8406:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940539520 00000100:00100000:1.0:1780340957.833994:0:8406:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940539520 00002000:00100000:1.0:1780340957.834037:0:8406:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x369:0x0] (0->1023) req@ffff8c047758b450 x1866818940539520/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780340957.834046:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c047758b450 with x1866818940539520 ext(0->1023) 00002000:00010000:1.0:1780340957.834052:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c047758b450 00000100:00100000:1.0:1780340957.834077:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1034 00000100:00100000:1.0:1780340957.834086:0:8406:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047758b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+26:2410:x1866818940539520:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:1.0:1780340957.834434:0:8406:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047758b450 x1866818940539520/t4294969505(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340957.834500:0:8406:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047758b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+28:2410:x1866818940539520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 414us (531us total) trans 4294969505 rc 0/0 00000100:00100000:1.0:1780340957.834507:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1034 00002000:00100000:1.0:1780340957.834513:0:8406:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x369:0x0] (0->1023) req@ffff8c047758b450 x1866818940539520/t4294969505(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780340957.834520:0:8406:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c047758b450 with x1866818940539520 ext(0->1023) 00002000:00010000:1.0:1780340957.834523:0:8406:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c047758b450 00000100:00100000:3.0:1780340957.834799:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940539648 00000100:00100000:3.0:1780340957.834804:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940539648 00000100:00100000:3.0:1780340957.834832:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5987 00000100:00100000:3.0:1780340957.834840:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+28:2410:x1866818940539648:12345-192.168.203.16@tcp:16:kworker.0 00000001:00080000:3.0:1780340957.835048:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969505 is committed 00010000:00000080:3.0:1780340957.835077:0:23157:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045ee7f480 x1866818940539648/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340957.835109:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+26:2410:x1866818940539648:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 270us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340957.835116:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5987 00002000:00100000:0.0:1780340957.838194:0:8405:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x368:0x0] (0->1023) req@ffff8c047207c000 x1866818940539264/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780340957.838227:0:8405:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c047207c000 with x1866818940539264 ext(0->1023) 00002000:00010000:0.0:1780340957.838234:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c047207c000 00000100:00100000:0.0:1780340957.838274:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1035 00000100:00100000:0.0:1780340957.838284:0:8405:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2407:x1866818940539264:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:0.0:1780340957.838660:0:8405:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047207c000 x1866818940539264/t4294969506(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340957.838722:0:8405:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2407:x1866818940539264:12345-192.168.203.16@tcp:4:dd.0 Request processed in 440us (9070us total) trans 4294969506 rc 0/0 00000100:00100000:0.0:1780340957.838729:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1035 00002000:00100000:0.0:1780340957.838736:0:8405:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x368:0x0] (0->1023) req@ffff8c047207c000 x1866818940539264/t4294969506(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780340957.838743:0:8405:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c047207c000 with x1866818940539264 ext(0->1023) 00002000:00010000:0.0:1780340957.838746:0:8405:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c047207c000 00000100:00100000:3.0:1780340957.841565:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340957.841682:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340957.842049:0:25497:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940539904 00000100:00100000:1.0:1780340957.842059:0:25497:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940539904 00000100:00100000:1.0:1780340957.842110:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5988 00000100:00100000:1.0:1780340957.842121:0:25497:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2407:x1866818940539904:12345-192.168.203.16@tcp:16:kworker.0 00010000:00000080:1.0:1780340957.842203:0:25497:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c99180 x1866818940539904/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340957.842259:0:25497:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2407:x1866818940539904:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 141us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340957.842266:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5988 00000100:00100000:2.0:1780340957.846085:0:24179:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940539776 00000100:00100000:2.0:1780340957.846098:0:24179:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940539776 00002000:00100000:2.0:1780340957.846156:0:24179:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x36a:0x0] (0->1023) req@ffff8c0471c9ad80 x1866818940539776/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1780340957.846167:0:24179:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c9ad80 with x1866818940539776 ext(0->1023) 00002000:00010000:2.0:1780340957.846173:0:24179:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c9ad80 00000100:00100000:2.0:1780340957.846205:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1036 00000100:00100000:2.0:1780340957.846214:0:24179:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2407:x1866818940539776:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:2.0:1780340957.846559:0:24179:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c9ad80 x1866818940539776/t4294969507(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340957.846642:0:24179:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+29:2407:x1866818940539776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 428us (5085us total) trans 4294969507 rc 0/0 00000100:00100000:2.0:1780340957.846649:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1036 00002000:00100000:2.0:1780340957.846656:0:24179:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x36a:0x0] (0->1023) req@ffff8c0471c9ad80 x1866818940539776/t4294969507(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1780340957.846664:0:24179:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c9ad80 with x1866818940539776 ext(0->1023) 00002000:00010000:2.0:1780340957.846668:0:24179:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c9ad80 00000100:00100000:1.0:1780340957.850513:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340957.850649:0:24176:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940540032 00000100:00100000:3.0:1780340957.850658:0:24176:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940540032 00002000:00100000:3.0:1780340957.850706:0:24176:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x36b:0x0] (0->1023) req@ffff8c045ee7df80 x1866818940540032/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.850730:0:24176:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045ee7df80 with x1866818940540032 ext(0->1023) 00002000:00010000:3.0:1780340957.850736:0:24176:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045ee7df80 00000100:00100000:3.0:1780340957.850796:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1037 00000100:00100000:3.0:1780340957.850806:0:24176:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+29:2409:x1866818940540032:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:3.0:1780340957.851349:0:24176:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045ee7df80 x1866818940540032/t4294969508(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340957.851408:0:24176:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+31:2409:x1866818940540032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 603us (904us total) trans 4294969508 rc 0/0 00000100:00100000:3.0:1780340957.851415:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1037 00002000:00100000:3.0:1780340957.851421:0:24176:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x36b:0x0] (0->1023) req@ffff8c045ee7df80 x1866818940540032/t4294969508(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.851428:0:24176:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045ee7df80 with x1866818940540032 ext(0->1023) 00002000:00010000:3.0:1780340957.851431:0:24176:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045ee7df80 00000100:00100000:3.0:1780340957.860284:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340957.860503:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940540160 00000100:00100000:2.0:1780340957.860513:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940540160 00000100:00100000:2.0:1780340957.860635:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5989 00000100:00100000:2.0:1780340957.860646:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+31:2409:x1866818940540160:12345-192.168.203.16@tcp:16:kworker.0 00000001:00080000:2.0:1780340957.861312:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969508 is committed 00010000:00000080:3.0:1780340957.861471:0:25487:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c9b480 x1866818940540160/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340957.861645:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2409:x1866818940540160:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 1000us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340957.861654:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5989 00000100:00100000:3.0:1780340957.865355:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340957.865388:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340957.865413:0:24177:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940540288 00000100:00100000:3.0:1780340957.865421:0:24177:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940540288 00002000:00100000:3.0:1780340957.865478:0:24177:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x36c:0x0] (0->1023) req@ffff8c0471c9a300 x1866818940540288/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.865489:0:24177:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c9a300 with x1866818940540288 ext(0->1023) 00002000:00010000:3.0:1780340957.865494:0:24177:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c9a300 00000100:00100000:3.0:1780340957.865517:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1038 00000100:00100000:3.0:1780340957.865691:0:24177:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2407:x1866818940540288:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:3.0:1780340957.866263:0:24177:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c9a300 x1866818940540288/t4294969509(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340957.866318:0:24177:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2407:x1866818940540288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 632us (972us total) trans 4294969509 rc 0/0 00000100:00100000:3.0:1780340957.866326:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1038 00002000:00100000:3.0:1780340957.866332:0:24177:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x36c:0x0] (0->1023) req@ffff8c0471c9a300 x1866818940540288/t4294969509(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.866341:0:24177:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c9a300 with x1866818940540288 ext(0->1023) 00002000:00010000:3.0:1780340957.866345:0:24177:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c9a300 00000100:00100000:0.0:1780340957.866670:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940540416 00000100:00100000:0.0:1780340957.866675:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940540416 00000100:00100000:0.0:1780340957.866722:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5990 00000100:00100000:0.0:1780340957.866730:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2407:x1866818940540416:12345-192.168.203.16@tcp:16:kworker.0 00000001:00080000:2.0:1780340957.867370:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969509 is committed 00010000:00000080:2.0:1780340957.867411:0:25494:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c98a80 x1866818940540416/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340957.867470:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2407:x1866818940540416:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 741us (2081us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340957.867477:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5990 00000100:00100000:1.0:1780340957.872085:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340957.872153:0:24754:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940540544 00000100:00100000:3.0:1780340957.872164:0:24754:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940540544 00002000:00100000:3.0:1780340957.872210:0:24754:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x36d:0x0] (0->1023) req@ffff8c045ee7ce00 x1866818940540544/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.872220:0:24754:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045ee7ce00 with x1866818940540544 ext(0->1023) 00002000:00010000:3.0:1780340957.872227:0:24754:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045ee7ce00 00000100:00100000:3.0:1780340957.872260:0:24754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1039 00000100:00100000:3.0:1780340957.872268:0:24754:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2407:x1866818940540544:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:3.0:1780340957.873011:0:24754:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045ee7ce00 x1866818940540544/t4294969510(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340957.876231:0:24754:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2407:x1866818940540544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 3954us (4146us total) trans 4294969510 rc 0/0 00000100:00100000:3.0:1780340957.876245:0:24754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1039 00002000:00100000:3.0:1780340957.876258:0:24754:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x36d:0x0] (0->1023) req@ffff8c045ee7ce00 x1866818940540544/t4294969510(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.876269:0:24754:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045ee7ce00 with x1866818940540544 ext(0->1023) 00002000:00010000:3.0:1780340957.876275:0:24754:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045ee7ce00 00000100:00100000:2.0:1780340957.876555:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340957.876711:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940540672 00000100:00100000:1.0:1780340957.876719:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940540672 00000100:00100000:1.0:1780340957.876796:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5991 00000100:00100000:1.0:1780340957.876813:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2407:x1866818940540672:12345-192.168.203.16@tcp:16:kworker.0 00000001:00080000:2.0:1780340957.877171:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969510 is committed 00010000:00000080:1.0:1780340957.877361:0:25495:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047207ce00 x1866818940540672/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340957.877424:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2407:x1866818940540672:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 621us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340957.877431:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5991 00000100:00100000:3.0:1780340957.881495:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340957.881531:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340957.881590:0:24178:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940540800 00000100:00100000:0.0:1780340957.881600:0:24178:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940540800 00002000:00100000:0.0:1780340957.881647:0:24178:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x36e:0x0] (0->1023) req@ffff8c0471c99c00 x1866818940540800/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780340957.881658:0:24178:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c99c00 with x1866818940540800 ext(0->1023) 00002000:00010000:0.0:1780340957.881663:0:24178:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c99c00 00000100:00100000:0.0:1780340957.881703:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1040 00000100:00100000:0.0:1780340957.881711:0:24178:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2407:x1866818940540800:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:0.0:1780340957.882332:0:24178:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c99c00 x1866818940540800/t4294969511(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340957.882424:0:24178:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2407:x1866818940540800:12345-192.168.203.16@tcp:4:dd.0 Request processed in 713us (936us total) trans 4294969511 rc 0/0 00000100:00100000:0.0:1780340957.882432:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1040 00002000:00100000:0.0:1780340957.882439:0:24178:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x36e:0x0] (0->1023) req@ffff8c0471c99c00 x1866818940540800/t4294969511(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1780340957.882448:0:24178:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c99c00 with x1866818940540800 ext(0->1023) 00002000:00010000:0.0:1780340957.882452:0:24178:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c99c00 00000100:00100000:1.0:1780340957.882599:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940540928 00000100:00100000:1.0:1780340957.882605:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940540928 00000100:00100000:1.0:1780340957.882635:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5992 00000100:00100000:1.0:1780340957.882642:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2408:x1866818940540928:12345-192.168.203.16@tcp:16:kworker.0 00000001:00080000:2.0:1780340957.883689:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969511 is committed 00010000:00000080:1.0:1780340957.884732:0:8400:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c99880 x1866818940540928/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340957.885312:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2408:x1866818940540928:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 2667us (3776us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340957.885335:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5992 00000100:00100000:3.0:1780340957.891582:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340957.891674:0:24762:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940541056 00000100:00100000:1.0:1780340957.891686:0:24762:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940541056 00002000:00100000:1.0:1780340957.891733:0:24762:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x36f:0x0] (0->1023) req@ffff8c0471c9b100 x1866818940541056/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780340957.891745:0:24762:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c9b100 with x1866818940541056 ext(0->1023) 00002000:00010000:1.0:1780340957.891751:0:24762:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c9b100 00000100:00100000:1.0:1780340957.891793:0:24762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1041 00000100:00100000:1.0:1780340957.891813:0:24762:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2408:x1866818940541056:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:1.0:1780340957.892478:0:24762:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c9b100 x1866818940541056/t4294969512(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340957.892532:0:24762:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2408:x1866818940541056:12345-192.168.203.16@tcp:4:dd.0 Request processed in 731us (959us total) trans 4294969512 rc 0/0 00000100:00100000:1.0:1780340957.892540:0:24762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1041 00002000:00100000:1.0:1780340957.892547:0:24762:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_012: refresh rw locks for [0x280000401:0x36f:0x0] (0->1023) req@ffff8c0471c9b100 x1866818940541056/t4294969512(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780340957.892555:0:24762:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0471c9b100 with x1866818940541056 ext(0->1023) 00002000:00010000:1.0:1780340957.892559:0:24762:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0471c9b100 00000100:00100000:3.0:1780340957.893491:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340957.895028:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940541184 00000100:00100000:0.0:1780340957.895047:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940541184 00000100:00100000:0.0:1780340957.895095:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5993 00000100:00100000:0.0:1780340957.895105:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2408:x1866818940541184:12345-192.168.203.16@tcp:16:kworker.0 00000001:00080000:1.0:1780340957.897251:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969512 is committed 00010000:00000080:0.0:1780340957.897737:0:25493:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c98700 x1866818940541184/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340957.897833:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2408:x1866818940541184:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 2729us (4344us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340957.897851:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5993 00000100:00100000:2.0:1780340957.910821:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340957.910987:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340957.911116:0:24179:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940541312 00000100:00100000:3.0:1780340957.911126:0:24179:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940541312 00002000:00100000:3.0:1780340957.911171:0:24179:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x370:0x0] (0->1023) req@ffff8c047207f100 x1866818940541312/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.911181:0:24179:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c047207f100 with x1866818940541312 ext(0->1023) 00002000:00010000:3.0:1780340957.911197:0:24179:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c047207f100 00000100:00100000:3.0:1780340957.911227:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1042 00000100:00100000:3.0:1780340957.911236:0:24179:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2407:x1866818940541312:12345-192.168.203.16@tcp:4:dd.0 00000100:00100000:0.0:1780340957.912197:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940541440 00000100:00100000:0.0:1780340957.912205:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940541440 00000100:00100000:0.0:1780340957.912251:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5994 00000100:00100000:0.0:1780340957.912261:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047207c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+26:2407:x1866818940541440:12345-192.168.203.16@tcp:16:kworker.0 00010000:00000080:0.0:1780340957.912306:0:25492:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047207c000 x1866818940541440/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340957.912369:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+28:2407:x1866818940541440:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 110us (1382us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340957.912377:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5994 00010000:00000080:3.0:1780340957.912379:0:24179:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c047207f100 x1866818940541312/t4294969513(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340957.912405:0:24179:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047207f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2407:x1866818940541312:12345-192.168.203.16@tcp:4:dd.0 Request processed in 1170us (1599us total) trans 4294969513 rc 0/0 00000100:00100000:3.0:1780340957.912416:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1042 00002000:00100000:3.0:1780340957.912429:0:24179:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x370:0x0] (0->1023) req@ffff8c047207f100 x1866818940541312/t4294969513(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.912437:0:24179:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c047207f100 with x1866818940541312 ext(0->1023) 00002000:00010000:3.0:1780340957.912442:0:24179:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c047207f100 00000100:00100000:1.0:1780340957.918051:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340957.918085:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340957.918110:0:8407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940541568 00000100:00100000:1.0:1780340957.918119:0:8407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940541568 00002000:00100000:1.0:1780340957.918164:0:8407:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x371:0x0] (0->1023) req@ffff8c045ee7d180 x1866818940541568/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780340957.918182:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045ee7d180 with x1866818940541568 ext(0->1023) 00002000:00010000:1.0:1780340957.918297:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045ee7d180 00000100:00100000:1.0:1780340957.918353:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1043 00000100:00100000:1.0:1780340957.918362:0:8407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2408:x1866818940541568:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:1.0:1780340957.918849:0:8407:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045ee7d180 x1866818940541568/t4294969514(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340957.918978:0:8407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+29:2408:x1866818940541568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 616us (936us total) trans 4294969514 rc 0/0 00000100:00100000:1.0:1780340957.918986:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1043 00002000:00100000:1.0:1780340957.918993:0:8407:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x371:0x0] (0->1023) req@ffff8c045ee7d180 x1866818940541568/t4294969514(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1780340957.919001:0:8407:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c045ee7d180 with x1866818940541568 ext(0->1023) 00002000:00010000:1.0:1780340957.919005:0:8407:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c045ee7d180 00000100:00100000:1.0:1780340957.919512:0:8830:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940541696 00000100:00100000:1.0:1780340957.919575:0:8830:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940541696 00000100:00100000:1.0:1780340957.919640:0:8830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5995 00000100:00100000:1.0:1780340957.919648:0:8830:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045ee7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+29:2408:x1866818940541696:12345-192.168.203.16@tcp:16:kworker.0 00000001:00080000:1.0:1780340957.920013:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969514 is committed 00010000:00000080:1.0:1780340957.920049:0:8830:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c045ee7d500 x1866818940541696/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340957.920086:0:8830:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045ee7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2408:x1866818940541696:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 440us (2001us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340957.920092:0:8830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5995 00000100:00100000:1.0:1780340957.927720:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340957.927847:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940541952 00000100:00100000:3.0:1780340957.927856:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940541952 00000100:00100000:3.0:1780340957.927906:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5996 00000100:00100000:3.0:1780340957.927915:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2408:x1866818940541952:12345-192.168.203.16@tcp:16:kworker.0 00010000:00000080:3.0:1780340957.927976:0:23157:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046b882a00 x1866818940541952/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340957.928030:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2408:x1866818940541952:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 116us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340957.928037:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5996 00000100:00100000:1.0:1780340957.929379:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340957.930021:0:24191:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940541824 00000100:00100000:3.0:1780340957.930031:0:24191:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940541824 00002000:00100000:3.0:1780340957.930074:0:24191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x372:0x0] (0->1023) req@ffff8c046b881c00 x1866818940541824/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.930085:0:24191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c046b881c00 with x1866818940541824 ext(0->1023) 00002000:00010000:3.0:1780340957.930091:0:24191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c046b881c00 00000100:00100000:3.0:1780340957.930122:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1044 00000100:00100000:3.0:1780340957.930131:0:24191:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2408:x1866818940541824:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:3.0:1780340957.931698:0:24191:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046b881c00 x1866818940541824/t4294969515(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340957.931839:0:24191:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2408:x1866818940541824:12345-192.168.203.16@tcp:4:dd.0 Request processed in 1700us (2457us total) trans 4294969515 rc 0/0 00000100:00100000:3.0:1780340957.931855:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1044 00002000:00100000:3.0:1780340957.932083:0:24191:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x372:0x0] (0->1023) req@ffff8c046b881c00 x1866818940541824/t4294969515(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.932092:0:24191:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c046b881c00 with x1866818940541824 ext(0->1023) 00002000:00010000:3.0:1780340957.932097:0:24191:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c046b881c00 00000100:00100000:1.0:1780340957.937702:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340957.937787:0:24752:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940542080 00000100:00100000:2.0:1780340957.937813:0:24752:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940542080 00002000:00100000:2.0:1780340957.938019:0:24752:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x373:0x0] (0->1023) req@ffff8c046b880000 x1866818940542080/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1780340957.938030:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c046b880000 with x1866818940542080 ext(0->1023) 00002000:00010000:2.0:1780340957.938036:0:24752:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c046b880000 00000100:00100000:2.0:1780340957.938070:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1045 00000100:00100000:2.0:1780340957.938080:0:24752:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2408:x1866818940542080:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:2.0:1780340957.938407:0:24752:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046b880000 x1866818940542080/t4294969516(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340957.938465:0:24752:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b880000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+29:2408:x1866818940542080:12345-192.168.203.16@tcp:4:dd.0 Request processed in 387us (770us total) trans 4294969516 rc 0/0 00000100:00100000:2.0:1780340957.938473:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1045 00002000:00100000:2.0:1780340957.938479:0:24752:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x373:0x0] (0->1023) req@ffff8c046b880000 x1866818940542080/t4294969516(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1780340957.938485:0:24752:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c046b880000 with x1866818940542080 ext(0->1023) 00002000:00010000:2.0:1780340957.938489:0:24752:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c046b880000 00000100:00100000:3.0:1780340957.941282:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340957.941342:0:25497:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940542208 00000100:00100000:1.0:1780340957.941351:0:25497:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940542208 00000100:00100000:1.0:1780340957.941429:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5997 00000100:00100000:1.0:1780340957.941439:0:25497:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+29:2408:x1866818940542208:12345-192.168.203.16@tcp:16:kworker.0 00000001:00080000:0.0:1780340957.942024:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969516 is committed 00010000:00000080:1.0:1780340957.943178:0:25497:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c98e00 x1866818940542208/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340957.943331:0:25497:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2408:x1866818940542208:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 1893us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340957.943341:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5997 00000100:00100000:1.0:1780340957.948592:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340957.949607:0:24754:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940542336 00000100:00100000:3.0:1780340957.949617:0:24754:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940542336 00002000:00100000:3.0:1780340957.949663:0:24754:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x374:0x0] (0->1023) req@ffff8c046b883800 x1866818940542336/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.949675:0:24754:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c046b883800 with x1866818940542336 ext(0->1023) 00002000:00010000:3.0:1780340957.949681:0:24754:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c046b883800 00000100:00100000:3.0:1780340957.949756:0:24754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1046 00000100:00100000:3.0:1780340957.949784:0:24754:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2407:x1866818940542336:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:3.0:1780340957.950307:0:24754:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046b883800 x1866818940542336/t4294969517(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340957.950365:0:24754:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b883800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2407:x1866818940542336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 584us (1779us total) trans 4294969517 rc 0/0 00000100:00100000:3.0:1780340957.950373:0:24754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1046 00002000:00100000:3.0:1780340957.950379:0:24754:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x374:0x0] (0->1023) req@ffff8c046b883800 x1866818940542336/t4294969517(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1780340957.950387:0:24754:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c046b883800 with x1866818940542336 ext(0->1023) 00002000:00010000:3.0:1780340957.950391:0:24754:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c046b883800 00000100:00100000:3.0:1780340957.950457:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340957.950673:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940542464 00000100:00100000:1.0:1780340957.950678:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940542464 00000100:00100000:1.0:1780340957.950713:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5998 00000100:00100000:1.0:1780340957.950720:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2407:x1866818940542464:12345-192.168.203.16@tcp:16:kworker.0 00000001:00080000:1.0:1780340957.950935:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969517 is committed 00010000:00000080:1.0:1780340957.950977:0:25488:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0471c98000 x1866818940542464/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340957.951012:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2407:x1866818940542464:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 292us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340957.951030:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5998 00000100:00100000:0.0:1780340957.961395:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340957.961490:0:24178:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940542592 00000100:00100000:2.0:1780340957.961499:0:24178:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940542592 00002000:00100000:2.0:1780340957.961545:0:24178:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x375:0x0] (0->1023) req@ffff8c0446efdc00 x1866818940542592/t0(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/0 e 0 to 0 dl 1780340968 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1780340957.961557:0:24178:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0446efdc00 with x1866818940542592 ext(0->1023) 00002000:00010000:2.0:1780340957.961564:0:24178:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0446efdc00 00000100:00100000:2.0:1780340957.961599:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1047 00000100:00100000:2.0:1780340957.961608:0:24178:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2407:x1866818940542592:12345-192.168.203.16@tcp:4:dd.0 00010000:00000080:2.0:1780340957.962586:0:24178:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c0446efdc00 x1866818940542592/t4294969518(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340957.962653:0:24178:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2407:x1866818940542592:12345-192.168.203.16@tcp:4:dd.0 Request processed in 1045us (1265us total) trans 4294969518 rc 0/0 00000100:00100000:2.0:1780340957.962661:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1047 00002000:00100000:2.0:1780340957.962669:0:24178:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x375:0x0] (0->1023) req@ffff8c0446efdc00 x1866818940542592/t4294969518(0) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 1512/448 e 0 to 0 dl 1780340968 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1780340957.962677:0:24178:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8c0446efdc00 with x1866818940542592 ext(0->1023) 00002000:00010000:2.0:1780340957.962681:0:24178:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c0446efdc00 00000100:00100000:1.0:1780340957.965364:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340957.965441:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940542720 00000100:00100000:3.0:1780340957.965450:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940542720 00000100:00100000:3.0:1780340957.965505:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 5999 00000100:00100000:3.0:1780340957.965515:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2407:x1866818940542720:12345-192.168.203.16@tcp:16:kworker.0 00000001:00080000:1.0:1780340957.965846:0:8395:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969518 is committed 00010000:00000080:3.0:1780340957.966161:0:25489:0:(ldlm_lib.c:3284:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8c046b881180 x1866818940542720/t0(0) o16->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:383/0 lens 440/432 e 0 to 0 dl 1780340968 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340957.966239:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b881180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2407:x1866818940542720:12345-192.168.203.16@tcp:16:kworker.0 Request processed in 726us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340957.966247:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 5999 00010000:00010000:0.0:1780340958.089904:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1780340958.421281:0:92085:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1780340958.421347:0:92085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c034d9eaa00/0xa24651432775837 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277583e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340958.421362:0:92085:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c034d9eaa00/0xa24651432775837 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277583e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340958.421369:0:92085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c034d9eaa00/0xa24651432775837 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2465143277583e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340958.421376:0:92085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c034d9eaa00/0xa24651432775837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2465143277583e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340958.421393:0:92085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1780340958.421397:0:92085:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1780340958.421419:0:92085:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1780340958.421424:0:92085:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1780340958.421429:0:92085:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1780340958.421661:0:92085:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1780340958.421715:0:6504:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1780340958.421722:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c034d9eaa00/0xa24651432775837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2465143277583e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340958.421730:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eaa00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:1.0:1780340958.421733:0:6504:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c034d9eaa00/0xa24651432775837 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2465143277583e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340958.421741:0:6504:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c034d9eaa00/0xa24651432775837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xa2465143277583e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1780340958.421747:0:6504:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c034d9eaa00/0xa24651432775837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xa2465143277583e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1780340958.421781:0:6504:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1780340958.421784:0:6504:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1780340958.421786:0:6504:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1780340958.421814:0:6504:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c034d9eaa00/0xa24651432775837 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2465143277583e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340958.421957:0:6504:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1780340958.421978:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c034d9eaa00/0xa24651432775837 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2465143277583e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340958.421985:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c034d9eaa00/0xa24651432775837 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2465143277583e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340958.421996:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340958.421998:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340958.422000:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340958.422725:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961270912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1780340958.422816:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340958.424401:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961270784:0@lo:39:umount.0 00000100:00100000:1.0:1780340958.424463:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340958.424512:0:6502:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961270912 00000100:00100000:1.0:1780340958.424519:0:6502:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961270912 00000100:00100000:1.0:1780340958.424567:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:1.0:1780340958.424576:0:6502:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961270912:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340958.425115:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961270784 00000100:00100000:3.0:1780340958.425121:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961270784 00000100:00100000:3.0:1780340958.425173:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1591 00000100:00100000:3.0:1780340958.425181:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1866818961270784:12345-0@lo:39:umount.0 00000020:00000080:3.0:1780340958.425210:0:64454:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432775463 00000100:00080000:3.0:1780340958.425224:0:64454:0:(import.c:65:import_set_state_nolock()) ffff8c0345c86000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1780340958.425291:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+1:3658:x1866818961270784:12345-0@lo:39:umount.0 Request processed in 111us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340958.425298:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1591 00000020:00000080:3.0:1780340958.425308:0:64454:0:(genops.c:906:class_export_put()) final put ffff8c0345c80000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00080000:3.0:1780340958.425326:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1780340958.425359:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1780340958.425387:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c0470f6a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1780340958.425399:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961270784:0@lo:39:umount.0 00000020:00000080:3.0:1780340958.425420:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0345c80000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1780340958.425461:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0345c86000 for lustre-MDT0000 00000100:00080000:3.0:1780340958.425489:0:92085:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1780340958.425492:0:92085:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1780340958.425497:0:92085:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1780340958.426869:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1780340958.426892:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453123400/0xa2465143277583e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432775837 expref: 23 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340958.426922:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1780340958.426992:0:6502:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3659:x1866818961270912:12345-0@lo:103:ldlm_bl.0 Request processed in 2416us (4175us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340958.427001:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:1.0:1780340958.427072:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961270912:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1780340958.428568:0:92085:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1780340958.428575:0:92085:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1780340958.428599:0:92085:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1780340958.428619:0:92085:0:(import.c:65:import_set_state_nolock()) ffff8c034530f000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1780340958.429574:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3658:1866818961271040:0@lo:39:umount.0 00000100:00100000:1.0:1780340958.429916:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340958.430122:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961271040 00000100:00100000:2.0:1780340958.430130:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961271040 00000100:00100000:2.0:1780340958.430188:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592 00000100:00100000:2.0:1780340958.430197:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1866818961271040:12345-0@lo:39:umount.0 00000020:00000080:2.0:1780340958.430221:0:63711:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143276f201 00000100:00080000:2.0:1780340958.430230:0:63711:0:(import.c:65:import_set_state_nolock()) ffff8c047a95f000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1780340958.430288:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+1:3658:x1866818961271040:12345-0@lo:39:umount.0 Request processed in 92us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340958.430295:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592 00000020:00000080:2.0:1780340958.430303:0:63711:0:(genops.c:906:class_export_put()) final put ffff8c047a95a800/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:2.0:1780340958.430328:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1780340958.430354:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034530f000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1780340958.430366:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471c99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3658:1866818961271040:0@lo:39:umount.0 00000020:00000080:2.0:1780340958.430390:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047a95a800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1780340958.430427:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047a95f000 for lustre-MDT0001 00000100:00080000:1.0:1780340958.433127:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1780340958.433954:0:92085:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1780340958.433974:0:92085:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1780340958.433980:0:92085:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1780340958.442451:0:92085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea000/0xa24651432775845 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277584c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340958.442469:0:92085:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea000/0xa24651432775845 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277584c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340958.442476:0:92085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea000/0xa24651432775845 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2465143277584c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340958.442482:0:92085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea000/0xa24651432775845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2465143277584c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340958.442499:0:92085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1780340958.442510:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1780340958.442515:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea000/0xa24651432775845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2465143277584c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340958.442523:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea000 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:2.0:1780340958.442526:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea000/0xa24651432775845 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2465143277584c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340958.442535:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea000/0xa24651432775845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xa2465143277584c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1780340958.442541:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea000/0xa24651432775845 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xa2465143277584c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340958.442547:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1780340958.442549:0:7442:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1780340958.442604:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea000/0xa24651432775845 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2465143277584c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340958.442610:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1780340958.442630:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea000/0xa24651432775845 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2465143277584c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340958.442637:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c034d9ea000/0xa24651432775845 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2465143277584c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340958.442648:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340958.442649:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340958.442651:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1780340958.442667:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961271168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1780340958.442729:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340958.442811:0:6501:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961271168 00000100:00100000:2.0:1780340958.442817:0:6501:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961271168 00000100:00100000:2.0:1780340958.442865:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:2.0:1780340958.442874:0:6501:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3660:x1866818961271168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340958.442887:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1780340958.442899:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0470f2de00/0xa2465143277584c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432775845 expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340958.442911:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1780340958.442955:0:6501:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:3660:x1866818961271168:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340958.442962:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:2.0:1780340958.443002:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961271168:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1780340958.443036:0:92085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2a00/0xa24651432775416 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277541d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340958.443051:0:92085:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2a00/0xa24651432775416 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277541d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340958.443057:0:92085:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2a00/0xa24651432775416 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2465143277541d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340958.443062:0:92085:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2a00/0xa24651432775416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa2465143277541d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340958.443075:0:92085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1780340958.443079:0:92085:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1780340958.443082:0:92085:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1780340958.443122:0:92085:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1780340958.443126:0:92085:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:2.0:1780340958.443131:0:92085:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1780340958.443136:0:92085:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00002000:00000080:2.0:1780340958.451512:0:92085:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:2.0:1780340958.451582:0:92085:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000020:00000080:2.0:1780340958.452972:0:92085:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:2.0:1780340958.452984:0:92085:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff8c0475709800 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 192.168.203.16@tcp 24 (0 0 20) 0 0 0 0: 0000000000000000 4294969518 stale:0 00000020:00080000:2.0:1780340958.452992:0:92085:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff8c044d43a800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969474 stale:0 00000020:00080000:2.0:1780340958.452996:0:92085:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff8c0485a51800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969456 stale:0 00000020:00080000:2.0:1780340958.453001:0:92085:0:(genops.c:1574:class_disconnect_exports()) OBD device 18 (ffff8c03450b8000) has exports, disconnecting them 00000020:00080000:2.0:1780340958.453006:0:92085:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.203.16@tcp (ffff8c0475709800), last request at 1780340957 00010000:00010000:3.0:1780340958.453878:0:23160:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340958.453889:0:23160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2a00/0xa24651432775416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2465143277541d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340958.453900:0:23160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c047a8b2a00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340958.453904:0:23160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2a00/0xa24651432775416 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa2465143277541d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340958.453914:0:23160:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2a00/0xa24651432775416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa2465143277541d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340958.453921:0:23160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2a00/0xa24651432775416 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa2465143277541d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340958.453926:0:23160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1780340958.453929:0:23160:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1780340958.453932:0:23160:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1780340958.453978:0:23160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2a00/0xa24651432775416 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2465143277541d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340958.453984:0:23160:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1780340958.454008:0:23160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2a00/0xa24651432775416 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2465143277541d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1780340958.454277:0:92085:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143277591e 00000020:00010000:2.0:1780340958.454286:0:92085:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8c0475709800: total 0 00000100:00080000:2.0:1780340958.454290:0:92085:0:(import.c:65:import_set_state_nolock()) ffff8c047570f800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780340958.454321:0:92085:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.203.16@tcp (ffff8c0475709800): rc 0 00000020:00080000:2.0:1780340958.454326:0:92085:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8c044d43a800), last request at 1780340956 00000020:00000080:2.0:1780340958.454329:0:92085:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432775328 00000100:00080000:2.0:1780340958.454333:0:92085:0:(import.c:65:import_set_state_nolock()) ffff8c044d438000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1780340958.454342:0:92085:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c044d43a800): rc 0 00000020:00000080:2.0:1780340958.454344:0:92085:0:(genops.c:906:class_export_put()) final put ffff8c044d43a800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:2.0:1780340958.454355:0:92085:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff8c0485a51800), last request at 1780340956 00000020:00000080:2.0:1780340958.454358:0:92085:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143276f175 00000100:00080000:2.0:1780340958.454361:0:92085:0:(import.c:65:import_set_state_nolock()) ffff8c0485a50000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1780340958.454376:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c044d43a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1780340958.454416:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c044d438000 for lustre-OST0000 00000020:00010000:2.0:1780340958.454425:0:6505:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8c0475709800: total 0 00010000:00010000:3.0:1780340958.454532:0:23160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c047a8b2a00/0xa24651432775416 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa2465143277541d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340958.454544:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340958.454546:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340958.454548:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340958.454556:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1780340958.454572:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471c98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961271296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1780340958.454737:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1780340958.454800:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340958.454813:0:25498:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961271296 00010000:00010000:2.0:1780340958.455120:0:6505:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8c0475709800, canceled 0 locks, left on hash table 20. 00002000:00010000:2.0:1780340958.455152:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x364:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.455156:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x364:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780340958.455175:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad294175/0xa24651432775e6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2822 expref: 21 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.455198:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36a:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.455200:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780340958.455207:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036c68481/0xa24651432775fe6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28a0 expref: 20 pid: 8399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.455225:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36f:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.455227:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780340958.455234:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000824213ca/0xa24651432776160 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced291e expref: 19 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.455268:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x363:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.455270:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x363:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1780340958.455273:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340958.455280:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6056018/0xa24651432775dd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27f1 expref: 18 pid: 25490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.455295:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x365:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.455298:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x365:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780340958.455305:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d353f586/0xa24651432775eb2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced283e expref: 17 pid: 23153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.455322:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36c:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.455324:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36c:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780340958.455331:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000692bce0c/0xa24651432776064 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28bc expref: 16 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.455346:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36e:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.455349:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780340958.455356:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c6a85c5/0xa246514327760e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28fb expref: 15 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.455372:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x373:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.455375:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x373:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780340958.455381:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cac4165/0xa2465143277618a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced293a expref: 14 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.455415:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36b:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.455418:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780340958.455427:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054b060a7/0xa2465143277606b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28ca expref: 13 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.455444:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x362:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.455446:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x362:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1780340958.455659:0:25498:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961271296 00000100:00100000:3.0:1780340958.455722:0:25498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:3.0:1780340958.455732:0:25498:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:3662:x1866818961271296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340958.455746:0:25498:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1780340958.455781:0:25498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0453123000/0xa2465143277541d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa24651432775416 expref: 21 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340958.455795:0:25498:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1780340958.456029:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de7e248c/0xa24651432775d85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced27dc expref: 12 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.456049:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x367:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.456052:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x367:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780340958.456060:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8df12a1/0xa24651432775f30 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced285a expref: 11 pid: 25487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.456075:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x369:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.456077:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x369:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780340958.456083:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7a81d51/0xa24651432775f6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced287d expref: 10 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.456095:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x372:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.456097:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x372:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780340958.456103:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d096c3c9/0xa24651432775fed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28a7 expref: 9 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.456129:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x370:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.456132:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x370:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780340958.456140:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed57d1c5/0xa24651432776167 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2925 expref: 8 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.456154:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x371:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.456156:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x371:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780340958.456163:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e40ce22/0xa246514327761c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2948 expref: 7 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.456177:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x374:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.456179:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x374:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780340958.456185:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e3987f1/0xa24651432776201 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2956 expref: 6 pid: 23153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.456200:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x368:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.456202:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x368:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780340958.456207:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a00c3152/0xa24651432775e73 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2829 expref: 5 pid: 8400 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.456221:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x375:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.456223:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x375:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780340958.456230:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f7173b1/0xa2465143277620f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2964 expref: 4 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.456258:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36d:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.456261:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780340958.456269:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065ad8028/0xa246514327760aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced28f4 expref: 3 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1780340958.456284:0:6505:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x366:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:2.0:1780340958.456286:0:6505:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x366:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1780340958.456293:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd19e2c8/0xa24651432775ef1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2853 expref: 2 pid: 8830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340958.456305:0:6505:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8c0475709800, canceled 20 locks, left on hash table 0. 00000100:00100000:3.0:1780340958.457069:0:25498:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3662:x1866818961271296:12345-0@lo:103:ldlm_bl.0 Request processed in 1336us (2329us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340958.457079:0:25498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000020:00080000:3.0:1780340958.457131:0:92085:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0485a51800): rc 0 00000020:00000080:3.0:1780340958.457134:0:92085:0:(genops.c:906:class_export_put()) final put ffff8c0485a51800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1780340958.457169:0:92085:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff8c03450b8000) has no exports 00000020:00000080:2.0:1780340958.458412:0:6505:0:(genops.c:906:class_export_put()) final put ffff8c0475709800/7d14eb83-fa7c-40d9-843e-6367bec0a7b4 00010000:00010000:2.0:1780340958.458425:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340958.458427:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340958.458429:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1780340958.458441:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0485a51800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1780340958.461732:0:80497:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0475709800/7d14eb83-fa7c-40d9-843e-6367bec0a7b4 for lustre-OST0000 00000020:00000080:2.0:1780340958.461782:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0485a50000 for lustre-OST0000 00000020:00000080:2.0:1780340958.461787:0:80497:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c047570f800 for lustre-OST0000 00000100:00100000:1.0:1780340958.463395:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0471c98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961271296:0@lo:103:ldlm_bl.0 00000020:01000000:0.0:1780340958.465367:0:92085:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c0341082900 - data ffff8c0471b0b1b0/ffff8c0485a1ec00 00000020:01000000:0.0:1780340958.465559:0:92085:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8c0345cd4900 - data ffff8c0471965948/ffff8c0345304800 00100000:10000000:0.0:1780340958.484951:0:92085:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1780340958.499484:0:92085:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143272860e 00000020:00000080:2.0:1780340958.499494:0:92085:0:(genops.c:906:class_export_put()) final put ffff8c047a28f800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1780340958.499519:0:92085:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c047b065000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1780340958.499523:0:92085:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c047b065000 2 00000020:01000004:2.0:1780340958.499526:0:92085:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8c047b065000 from lustre-OST0000 00000020:00000080:2.0:1780340958.499564:0:92085:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1780340958.499579:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047a28f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1780340958.501506:0:92085:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1780340958.501526:0:92085:0:(genops.c:906:class_export_put()) final put ffff8c047a288000/lustre-OST0000_UUID 00000020:00000080:2.0:1780340958.501531:0:92085:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047a288000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1780340958.501542:0:92085:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1780340958.502119:0:92085:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:2.0:1780340958.502124:0:92085:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1780340958.502129:0:92085:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780340958.502140:0:92085:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1780340958.502152:0:92085:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8c047b062800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780340958.502158:0:92085:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff8c0345368000) has exports, disconnecting them 00000020:00080000:2.0:1780340958.502164:0:92085:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8c047b062800), last request at 1780337427 00000020:00000080:2.0:1780340958.502169:0:92085:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa24651432728638 00000020:00080000:2.0:1780340958.502186:0:92085:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c047b062800): rc 0 00000020:00000080:2.0:1780340958.502192:0:92085:0:(genops.c:906:class_export_put()) final put ffff8c047b062800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1780340958.502262:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047b062800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1780340958.504819:0:92085:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1780340958.504827:0:92085:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1780340958.504832:0:92085:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1780340958.504839:0:92085:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1780340958.504977:0:92085:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1780340958.504991:0:92085:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1780340958.504997:0:92085:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1780340958.505002:0:92085:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1780340958.505007:0:92085:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1780340958.505014:0:92085:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8c0345c85800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1780340958.505020:0:92085:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff8c034536b380) has exports, disconnecting them 00000020:00080000:2.0:1780340958.505024:0:92085:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8c0345c85800), last request at 1780337427 00000020:00000080:2.0:1780340958.505028:0:92085:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa2465143272864d 00000020:00080000:2.0:1780340958.505042:0:92085:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c0345c85800): rc 0 00000020:00000080:2.0:1780340958.505047:0:92085:0:(genops.c:906:class_export_put()) final put ffff8c0345c85800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1780340958.505707:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c0470f6a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1780340958.505716:0:71335:0:(genops.c:906:class_export_put()) final put ffff8c04775e7800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1780340958.505719:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c04775e7800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1780340958.505725:0:71335:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1780340958.505820:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c0345c85800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1780340958.513398:0:92085:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1780340958.513406:0:92085:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1780340958.513410:0:92085:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1780340958.513417:0:92085:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1780340958.513552:0:92085:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1780340958.513565:0:92085:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1780340958.513572:0:92085:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c047b065000 1 00000020:00000080:3.0:1780340958.513578:0:92085:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xa246514327285d6 00000020:00000080:3.0:1780340958.513586:0:92085:0:(genops.c:906:class_export_put()) final put ffff8c047b1ff800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1780340958.513590:0:92085:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1780340958.513595:0:92085:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1780340958.513599:0:92085:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1780340958.513602:0:92085:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff8c04765899c0) has no exports 00000020:00000080:0.0:1780340958.513835:0:71335:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8c034530f000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1780340958.513842:0:71335:0:(genops.c:906:class_export_put()) final put ffff8c047a1eb800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1780340958.513845:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047a1eb800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1780340958.513855:0:71335:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1780340958.513936:0:71335:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047b1ff800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1780340958.535557:0:92085:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1780340958.535574:0:92085:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1780340958.535580:0:92085:0:(genops.c:906:class_export_put()) final put ffff8c047b063000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1780340958.535584:0:92085:0:(genops.c:865:class_export_destroy()) destroying export ffff8c047b063000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1780340958.535595:0:92085:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1780340958.535707:0:92085:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8c047b060800 00000020:02000400:1.0:1780340958.535832:0:92085:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1780340959.114045:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340960.141412:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340960.657891:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961271424:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340960.657974:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340960.658028:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961271424 00000100:00100000:1.0:1780340960.658036:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961271424 00000100:00100000:1.0:1780340960.658091:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2184 00000100:00100000:1.0:1780340960.658100:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961271424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340960.658144:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340960.658200:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961271424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340960.658207:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2184 00000100:00080000:1.0:1780340960.658229:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340960.658265:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961271424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340960.658590:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1780340960.658601:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0471c98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961271552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1780340960.658636:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340960.658665:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961271552 00000100:00100000:3.0:1780340960.658669:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961271552 00000100:00100000:3.0:1780340960.658694:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2185 00000100:00100000:3.0:1780340960.658699:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471c99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3660:x1866818961271552:12345-0@lo:13:osp-pre-0-1.0 00000020:00080000:3.0:1780340960.658705:0:10290:0:(tgt_handler.c:804:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1780340960.658739:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471c99f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3660:x1866818961271552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (101us total) trans 0 rc -107/-107 00000100:00100000:3.0:1780340960.658745:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2185 00000100:02020000:3.0:1780340960.658789:0:3660:0:(client.c:1491:ptlrpc_check_status()) lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1780340960.658794:0:3660:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1780340960.658798:0:3660:0:(import.c:65:import_set_state_nolock()) ffff8c034a39f800 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1780340960.658802:0:3660:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:3.0:1780340960.658831:0:3660:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000100:00080000:3.0:1780340960.658835:0:3660:0:(import.c:65:import_set_state_nolock()) ffff8c034a39f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1780340960.658839:0:3660:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 2808 00000100:00080000:3.0:1780340960.658845:0:3660:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c034a39f800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340960.658866:0:3660:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c045f290380 x1866818961271680/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340960.658895:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961271680:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:3.0:1780340960.658938:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340960.658968:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961271680 00000100:00100000:3.0:1780340960.658972:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961271680 00000100:00100000:3.0:1780340960.658994:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6000 00000100:00100000:3.0:1780340960.658999:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3658:x1866818961271680:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:3.0:1780340960.659018:0:25490:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340960.659050:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3658:x1866818961271680:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 49us (126us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340960.659055:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6000 00000100:00080000:3.0:1780340960.659083:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340960.659087:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340960.659091:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961271680:0@lo:8:ptlrpcd_00_01.0 00000100:00080000:2.0:1780340961.162750:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340961.162756:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1780340961.162776:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340961.162793:0:80497:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3740 00000100:00080000:2.0:1780340961.162799:0:80497:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1780340961.162805:0:80497:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c034a39f800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:2.0:1780340961.162827:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c0485a19f80 x1866818961272320/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340961.162858:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961272320:0@lo:8:kworker.0 00000100:00100000:2.0:1780340961.163203:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1780340961.163413:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340961.163424:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961272192:0@lo:400:kworker.0 00000100:00100000:1.0:1780340961.163458:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340961.163487:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961272832:0@lo:400:kworker.0 00000100:00100000:1.0:1780340961.163508:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340961.163535:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1780340961.163541:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961271808:0@lo:400:kworker.0 00000100:00100000:2.0:1780340961.163658:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961272320 00000100:00100000:2.0:1780340961.163666:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961272320 00000100:00100000:2.0:1780340961.163695:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961272832 00000100:00100000:2.0:1780340961.163698:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961272832 00000100:00100000:2.0:1780340961.163720:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6001 00000100:00100000:2.0:1780340961.163726:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3658:x1866818961272320:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1780340961.163747:0:8400:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340961.163833:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961272192 00000100:00100000:3.0:1780340961.163838:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961272192 00000100:00100000:3.0:1780340961.163869:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4004 00000100:00100000:3.0:1780340961.163876:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961272192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340961.164032:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6002 00000100:00100000:0.0:1780340961.164037:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3659:x1866818961272832:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1780340961.164044:0:25496:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1780340961.164093:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340961.169691:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3658:x1866818961272320:12345-0@lo:8:kworker.0 Request processed in 5953us (6759us total) trans 0 rc -19/-19 00000100:00100000:2.0:1780340961.169706:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6001 00000100:00080000:2.0:1780340961.169821:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1780340961.169828:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1780340961.169833:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961272320:0@lo:8:kworker.0 00000100:00100000:2.0:1780340961.170212:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961272064:0@lo:400:kworker.0 00000100:00100000:2.0:1780340961.170258:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340961.170293:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961272704:0@lo:400:kworker.0 00000100:00100000:2.0:1780340961.170319:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340961.170337:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961273216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1780340961.170356:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340961.170376:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1780340961.170382:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961271936:0@lo:400:kworker.0 00000100:00100000:2.0:1780340961.170401:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340961.170416:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961272576:0@lo:400:kworker.0 00000100:00100000:2.0:1780340961.170437:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340961.170454:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961273088:0@lo:400:kworker.0 00000100:00100000:2.0:1780340961.170473:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340961.170502:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961272064 00000100:00100000:2.0:1780340961.170508:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961272064 00000100:00100000:2.0:1780340961.170558:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961271936 00000100:00100000:2.0:1780340961.170562:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961271936 00000100:00100000:2.0:1780340961.170575:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961272576 00000100:00100000:2.0:1780340961.170577:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961272576 00000100:00100000:2.0:1780340961.170587:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961273088 00000100:00100000:2.0:1780340961.170589:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961273088 00000100:00100000:2.0:1780340961.170600:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:2.0:1780340961.170607:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961272064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340961.170650:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961272064:12345-0@lo:400:kworker.0 Request processed in 43us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340961.170656:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00100000:2.0:1780340961.170668:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504 00000100:00100000:2.0:1780340961.170673:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961271936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340961.170695:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1866818961271936:12345-0@lo:400:kworker.0 Request processed in 22us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340961.170706:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504 00000100:00100000:2.0:1780340961.170717:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00100000:2.0:1780340961.170721:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818961272576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340961.170744:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818961272576:12345-0@lo:400:kworker.0 Request processed in 23us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340961.170749:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00100000:2.0:1780340961.170785:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:2.0:1780340961.170792:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961273088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340961.170818:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961273088:12345-0@lo:400:kworker.0 Request processed in 27us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340961.170823:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:2.0:1780340961.170860:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1866818961271936:0@lo:400:kworker.0 00000100:00100000:2.0:1780340961.170869:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961272576:0@lo:400:kworker.0 00000100:00100000:2.0:1780340961.170876:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961273088:0@lo:400:kworker.0 00000100:00100000:2.0:1780340961.170883:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961272064:0@lo:400:kworker.0 00000100:00100000:2.0:1780340961.170933:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961272704 00000100:00100000:2.0:1780340961.170936:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961272704 00000100:00100000:2.0:1780340961.170957:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961273216 00000100:00100000:2.0:1780340961.170959:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961273216 00000100:00100000:2.0:1780340961.170968:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4005 00000100:00100000:2.0:1780340961.170973:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961272704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340961.171004:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3662:x1866818961272704:12345-0@lo:400:kworker.0 Request processed in 31us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340961.171009:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4005 00000100:00100000:2.0:1780340961.171026:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006 00000100:00100000:2.0:1780340961.171031:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961273216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340961.171052:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:2.0:1780340961.171079:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961273216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340961.171084:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006 00000100:00100000:2.0:1780340961.171112:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961272704:0@lo:400:kworker.0 00000100:00100000:2.0:1780340961.171125:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961273216:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1780340961.171194:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1780340961.171198:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1780340961.171209:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961271808 00000100:00100000:2.0:1780340961.171213:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961271808 00000100:00100000:2.0:1780340961.171238:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1780340961.171244:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3659:x1866818961271808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340961.171275:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348d90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3659:x1866818961271808:12345-0@lo:400:kworker.0 Request processed in 32us (7182us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340961.171281:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1780340961.175881:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961272192:12345-0@lo:400:kworker.0 Request processed in 11879us (12296us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340961.175912:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4004 00000001:00080000:2.0:1780340961.180124:0:90562:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084436 is committed 00010000:00010000:3.0:1780340961.181423:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af400/0xa24651432775d5b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181439:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af400/0xa24651432775d5b lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181447:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af400/0xa24651432775d5b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181453:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722af400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.181458:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af400/0xa24651432775d5b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181465:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af400/0xa24651432775d5b lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181483:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff8c045312ea00) 00010000:00010000:3.0:1780340961.181486:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.181491:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af400/0xa24651432775d5b lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181497:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722af400/0xa24651432775d5b lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181524:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775da8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181530:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775da8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181535:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775da8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181557:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.181561:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775da8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181577:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775da8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181586:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff8c045312e900) 00010000:00010000:3.0:1780340961.181589:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.181592:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775da8 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181598:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae800/0xa24651432775da8 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181611:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775dfc lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181617:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775dfc lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181623:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775dfc lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181628:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03485a1800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.181630:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775dfc lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181636:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775dfc lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181653:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff8c045a897d00) 00010000:00010000:3.0:1780340961.181656:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.181658:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775dfc lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181663:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03485a1800/0xa24651432775dfc lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181674:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6400/0xa24651432775e42 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181680:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6400/0xa24651432775e42 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181684:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6400/0xa24651432775e42 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181689:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04445c6400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.181691:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6400/0xa24651432775e42 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181697:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6400/0xa24651432775e42 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181703:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff8c0477219700) 00010000:00010000:3.0:1780340961.181705:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.181707:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6400/0xa24651432775e42 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181712:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6400/0xa24651432775e42 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181732:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae400/0xa24651432775eab lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181738:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae400/0xa24651432775eab lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181744:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae400/0xa24651432775eab lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181748:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722ae400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.181750:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae400/0xa24651432775eab lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181756:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae400/0xa24651432775eab lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181831:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff8c0455c3b300) 00010000:00010000:3.0:1780340961.181834:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.181837:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae400/0xa24651432775eab lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181843:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722ae400/0xa24651432775eab lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181855:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7800/0xa24651432775eb9 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181862:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7800/0xa24651432775eb9 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181867:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7800/0xa24651432775eb9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181879:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04445c7800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.181882:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7800/0xa24651432775eb9 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181888:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7800/0xa24651432775eb9 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181896:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff8c0477219300) 00010000:00010000:3.0:1780340961.181898:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.181902:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7800/0xa24651432775eb9 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181907:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7800/0xa24651432775eb9 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181918:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6a00/0xa24651432775ef8 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181943:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6a00/0xa24651432775ef8 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181949:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6a00/0xa24651432775ef8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181954:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04445c6a00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.181956:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6a00/0xa24651432775ef8 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181961:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6a00/0xa24651432775ef8 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181980:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff8c04506cfd00) 00010000:00010000:3.0:1780340961.181982:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.181985:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6a00/0xa24651432775ef8 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.181990:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6a00/0xa24651432775ef8 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182001:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6800/0xa24651432775f37 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182007:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6800/0xa24651432775f37 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182012:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6800/0xa24651432775f37 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182017:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04445c6800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.182019:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6800/0xa24651432775f37 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182025:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6800/0xa24651432775f37 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182032:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff8c0477219000) 00010000:00010000:3.0:1780340961.182034:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.182036:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6800/0xa24651432775f37 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182042:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6800/0xa24651432775f37 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182064:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa24651432775fa7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182071:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa24651432775fa7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182077:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa24651432775fa7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182082:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486367400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.182085:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa24651432775fa7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182090:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa24651432775fa7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182098:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff8c04506cfe00) 00010000:00010000:3.0:1780340961.182100:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.182103:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa24651432775fa7 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182109:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486367400/0xa24651432775fa7 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182435:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa24651432775fae lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182443:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa24651432775fae lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182449:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa24651432775fae lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182463:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486366600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.182466:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa24651432775fae lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182470:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa24651432775fae lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182479:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff8c0455c3b700) 00010000:00010000:3.0:1780340961.182481:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.182484:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa24651432775fae lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182489:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366600/0xa24651432775fae lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182501:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7400/0xa24651432776002 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182506:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7400/0xa24651432776002 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182511:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7400/0xa24651432776002 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182516:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04445c7400 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.182518:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7400/0xa24651432776002 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182523:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7400/0xa24651432776002 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182538:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff8c045312ed00) 00010000:00010000:3.0:1780340961.182541:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.182544:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7400/0xa24651432776002 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182549:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c7400/0xa24651432776002 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182574:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6000/0xa2465143277602c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182579:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6000/0xa2465143277602c lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182584:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6000/0xa2465143277602c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182588:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04445c6000 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.182591:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6000/0xa2465143277602c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182596:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6000/0xa2465143277602c lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182603:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff8c0477219600) 00010000:00010000:3.0:1780340961.182605:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.182607:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6000/0xa2465143277602c lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182612:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6000/0xa2465143277602c lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182633:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432776072 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182638:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432776072 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182643:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432776072 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182647:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9ea800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.182650:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432776072 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182655:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432776072 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182661:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff8c0477219500) 00010000:00010000:3.0:1780340961.182663:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.182666:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432776072 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182670:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9ea800/0xa24651432776072 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182679:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327760bf lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182684:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327760bf lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182689:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327760bf lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182699:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c034d9eb600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.182702:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327760bf lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182706:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327760bf lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182713:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff8c0455c3ba00) 00010000:00010000:3.0:1780340961.182715:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.182718:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327760bf lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182723:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c034d9eb600/0xa246514327760bf lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182735:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa246514327760f0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182740:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa246514327760f0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182746:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa246514327760f0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182749:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04722afa00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.182752:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa246514327760f0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.182757:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa246514327760f0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.183010:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff8c0455c3bc00) 00010000:00010000:3.0:1780340961.183012:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.183016:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa246514327760f0 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.183021:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04722afa00/0xa246514327760f0 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.183036:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432776128 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.183042:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432776128 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.183048:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432776128 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.183053:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123c00 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.183056:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432776128 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.183061:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432776128 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.183069:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff8c045312ec00) 00010000:00010000:3.0:1780340961.183071:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.183074:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432776128 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.183079:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0453123c00/0xa24651432776128 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.183102:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277617c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.183107:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277617c lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.183113:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277617c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.184440:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c03476f9200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.184447:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277617c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.184456:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277617c lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.184470:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff8c04506cf000) 00010000:00010000:3.0:1780340961.184473:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.184477:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277617c lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.184484:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c03476f9200/0xa2465143277617c lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63710 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.184507:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa246514327761ad lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.184514:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa246514327761ad lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.184520:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa246514327761ad lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.184539:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0486366200 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.184542:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa246514327761ad lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.184548:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa246514327761ad lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.185065:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff8c0477219a00) 00010000:00010000:3.0:1780340961.185070:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.185075:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa246514327761ad lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.185081:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0486366200/0xa246514327761ad lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64454 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.185097:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa246514327761d0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.185103:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa246514327761d0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.185109:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa246514327761d0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.185638:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa5800 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.185646:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa246514327761d0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.185653:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa246514327761d0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.185681:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff8c0345328400) 00010000:00010000:3.0:1780340961.185684:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.185687:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa246514327761d0 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.185692:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c0475fa5800/0xa246514327761d0 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63712 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.185709:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776208 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.185715:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776208 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.185721:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776208 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.185726:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c04445c6600 already unused, calling callback (ffffffffc18134f0) 00010000:00010000:3.0:1780340961.185729:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776208 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.185735:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776208 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.185743:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff8c0345328100) 00010000:00010000:3.0:1780340961.185745:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1780340961.185748:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776208 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340961.185754:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c04445c6600/0xa24651432776208 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63711 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1780340961.186273:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3659:x1866818961272832:12345-0@lo:400:kworker.0 Request processed in 22230us (22759us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780340961.186291:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6002 00000100:00100000:1.0:1780340961.190290:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961271808:0@lo:400:kworker.0 00000100:00100000:1.0:1780340961.190306:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961272448:0@lo:400:kworker.0 00000100:00100000:1.0:1780340961.190367:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340961.190443:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961272960:0@lo:400:kworker.0 00000100:00100000:1.0:1780340961.190466:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340961.193011:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961272192:0@lo:400:kworker.0 00000100:00080000:1.0:1780340961.193029:0:3659:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1780340961.193035:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c046b9a9000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1780340961.193038:0:3659:0:(import.c:182:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:1.0:1780340961.193063:0:3659:0:(osp_dev.c:1611:osp_import_event()) got disconnected 00000100:00080000:1.0:1780340961.193067:0:3659:0:(import.c:65:import_set_state_nolock()) ffff8c046b9a9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340961.193089:0:3659:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3684 00000100:00080000:1.0:1780340961.193097:0:3659:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c046b9a9000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:1.0:1780340961.193284:0:3659:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a8c8000 x1866818961273344/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1780340961.193313:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961272832:0@lo:400:kworker.0 00000100:00100000:3.0:1780340961.193388:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961273344:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:3.0:1780340961.193446:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340961.198946:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961272448 00000100:00100000:0.0:1780340961.198964:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961272448 00000100:00100000:0.0:1780340961.199036:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961272960 00000100:00100000:0.0:1780340961.199040:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961272960 00000100:00100000:0.0:1780340961.199083:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675 00000100:00100000:0.0:1780340961.199095:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961272448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340961.199391:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961272448:12345-0@lo:400:kworker.0 Request processed in 298us (9023us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340961.199400:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675 00000100:00100000:0.0:1780340961.199420:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676 00000100:00100000:0.0:1780340961.199427:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961272960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340961.199457:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961272960:12345-0@lo:400:kworker.0 Request processed in 32us (8990us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340961.199463:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676 00000100:00080000:0.0:1780340961.199487:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340961.199709:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961273344 00000100:00100000:0.0:1780340961.199713:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961273344 00000100:00100000:0.0:1780340961.199739:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6003 00000100:00100000:0.0:1780340961.199744:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3658:x1866818961273344:12345-0@lo:8:ptlrpcd_00_00.0 00010000:00020000:0.0:1780340961.199793:0:23157:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1780340961.199828:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3658:x1866818961273344:12345-0@lo:8:ptlrpcd_00_00.0 Request processed in 82us (6382us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340961.199834:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6003 00000100:00100000:1.0:1780340961.200433:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961272448:0@lo:400:kworker.0 00000100:00100000:1.0:1780340961.200449:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961272960:0@lo:400:kworker.0 00000100:00080000:3.0:1780340961.200561:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c046b9a9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340961.200630:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340961.200634:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961273344:0@lo:8:ptlrpcd_00_00.0 00000100:00100000:1.0:1780340961.674158:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961273472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340961.674226:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340961.674290:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961273472 00000100:00100000:1.0:1780340961.674298:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961273472 00000100:00100000:1.0:1780340961.674340:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4007 00000100:00100000:1.0:1780340961.674349:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961273472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780340961.674381:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445199872 avail 1298960384 00000100:00100000:1.0:1780340961.674439:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961273472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340961.674447:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4007 00000100:00100000:1.0:1780340961.674497:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961273472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1780340961.696338:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961273600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340961.696414:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340961.698489:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961273600 00000100:00100000:1.0:1780340961.698512:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961273600 00000100:00100000:1.0:1780340961.700784:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2186 00000100:00100000:1.0:1780340961.701475:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961273600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780340961.701521:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340961.701946:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961273600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1151us (5530us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340961.701954:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2186 00000100:00100000:1.0:1780340961.702015:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961273600:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1780340962.186254:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340962.860397:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340962.860465:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340962.860499:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340962.860523:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340962.860561:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940543232 00000100:00100000:0.0:1780340962.860571:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940543232 00000100:00100000:0.0:1780340962.860622:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6004 00000100:00100000:0.0:1780340962.860630:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2409:x1866818940543232:12345-192.168.203.16@tcp:400:kworker.0 00000020:00080000:0.0:1780340962.860639:0:8399:0:(tgt_handler.c:804:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.203.16@tcp 00000100:00100000:0.0:1780340962.860695:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2409:x1866818940543232:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 65us (229us total) trans 0 rc -107/-107 00000100:00100000:0.0:1780340962.860702:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6004 00000100:00100000:1.0:1780340962.861351:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340962.861373:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940542848 00000100:00100000:1.0:1780340962.861378:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940542848 00000100:00100000:1.0:1780340962.861414:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 183 00000100:00100000:1.0:1780340962.861421:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2409:x1866818940542848:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340962.861464:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348d90c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2409:x1866818940542848:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 44us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340962.861471:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 183 00000100:00100000:1.0:1780340962.861499:0:25497:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940543360 00000100:00100000:1.0:1780340962.861502:0:25497:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940543360 00000100:00100000:1.0:1780340962.861534:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2677 00000100:00100000:1.0:1780340962.861540:0:25497:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2409:x1866818940543360:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340962.861566:0:25497:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2409:x1866818940543360:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 26us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340962.861572:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2677 00000100:00080000:1.0:1780340962.861671:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340962.870115:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940542976 00000100:00100000:3.0:1780340962.870130:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940542976 00000100:00100000:3.0:1780340962.870281:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940543104 00000100:00100000:3.0:1780340962.870286:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940543104 00000100:00100000:3.0:1780340962.870315:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1507 00000100:00100000:3.0:1780340962.870325:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+51:2409:x1866818940542976:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340962.870405:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+51:2409:x1866818940542976:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 81us (10015us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340962.870412:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1507 00000100:00100000:3.0:1780340962.870429:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1508 00000100:00100000:3.0:1780340962.870436:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346917850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2409:x1866818940543104:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340962.870459:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346917850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2409:x1866818940543104:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 24us (9936us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340962.870464:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1508 00000100:00080000:3.0:1780340962.871676:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780340962.871682:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780340962.871731:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340962.871882:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940543488 00000100:00100000:3.0:1780340962.871889:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940543488 00000100:00100000:3.0:1780340962.871941:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6005 00000100:00100000:3.0:1780340962.871947:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:2406:x1866818940543488:12345-192.168.203.16@tcp:8:ptlrpcd_01_00.0 00010000:00020000:3.0:1780340962.871970:0:25489:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340962.872019:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:0+-99:2406:x1866818940543488:12345-192.168.203.16@tcp:8:ptlrpcd_01_00.0 Request processed in 71us (291us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340962.872026:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6005 00010000:00010000:2.0:1780340963.214291:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340964.236187:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340965.258059:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340965.770169:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1780340965.770191:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961273728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340965.770251:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340965.770333:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961273728 00000100:00100000:0.0:1780340965.770340:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961273728 00000100:00100000:0.0:1780340965.770388:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2187 00000100:00100000:0.0:1780340965.770396:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961273728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340965.770422:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340965.770457:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961273728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340965.770463:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2187 00000100:00080000:0.0:1780340965.770483:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340965.770531:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961273728:0@lo:13:osp-pre-1-1.0 00000001:02000400:3.0:1780340966.134247:0:92413:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing load_module ../libcfs/libcfs/libcfs 00000100:00100000:3.0:1780340966.282518:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961273856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780340966.282594:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340966.282782:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961273856 00000100:00100000:2.0:1780340966.282791:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961273856 00000100:00100000:2.0:1780340966.282833:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4008 00000100:00100000:2.0:1780340966.282841:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961273856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340966.282874:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:2.0:1780340966.282931:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f292a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961273856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340966.282946:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4008 00000100:00080000:1.0:1780340966.283592:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340966.283597:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1780340966.283600:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340966.283605:0:80497:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3741 00000100:00080000:1.0:1780340966.283609:0:80497:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1780340966.283613:0:80497:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c034a39f800 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340966.283631:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961274240:0@lo:400:kworker.0 00000100:00100000:1.0:1780340966.283632:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a8cb480 x1866818961274496/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340966.283665:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1780340966.283672:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340966.283675:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1780340966.283676:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c046b9a9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340966.283680:0:80497:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3741 00000100:00080000:1.0:1780340966.283682:0:80497:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1780340966.283686:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1780340966.283686:0:80497:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c046b9a9000 using connection 192.168.203.116@tcp/0@lo 00000100:00100000:3.0:1780340966.283691:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961274368:0@lo:400:kworker.0 00000100:00100000:1.0:1780340966.283696:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a8c9500 x1866818961274880/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340966.283711:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340966.283729:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961275008:0@lo:400:kworker.0 00000100:00100000:3.0:1780340966.283749:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340966.283790:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1780340966.283796:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961275136:0@lo:400:kworker.0 00000100:00100000:3.0:1780340966.283815:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1780340966.283825:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340966.283834:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961273984:0@lo:400:kworker.0 00000100:00100000:3.0:1780340966.283839:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961275008 00000100:00100000:3.0:1780340966.283843:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961275008 00000100:00100000:1.0:1780340966.283864:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340966.283879:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678 00000100:00100000:3.0:1780340966.283899:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961275008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340966.283899:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961274624:0@lo:400:kworker.0 00000100:00100000:1.0:1780340966.283919:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340966.283934:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961275008:12345-0@lo:400:kworker.0 Request processed in 37us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340966.283935:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1780340966.283939:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961274112:0@lo:400:kworker.0 00000100:00100000:3.0:1780340966.283947:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678 00000100:00100000:3.0:1780340966.283958:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961274624 00000100:00100000:3.0:1780340966.283961:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961274624 00000100:00100000:1.0:1780340966.283965:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340966.283978:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2679 00000100:00100000:1.0:1780340966.283980:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961274752:0@lo:400:kworker.0 00000100:00100000:3.0:1780340966.283983:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961274624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340966.283998:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340966.284007:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961274624:12345-0@lo:400:kworker.0 Request processed in 24us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340966.284012:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2679 00000100:00100000:3.0:1780340966.284028:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961274240 00000100:00100000:1.0:1780340966.284028:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961274624:0@lo:400:kworker.0 00000100:00100000:3.0:1780340966.284031:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961274240 00000100:00100000:3.0:1780340966.284053:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961275136 00000100:00100000:3.0:1780340966.284056:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961275136 00000100:00100000:1.0:1780340966.284057:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961274496:0@lo:8:kworker.0 00000100:00100000:3.0:1780340966.284067:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961274112 00000100:00100000:3.0:1780340966.284069:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961274112 00000100:00100000:1.0:1780340966.284079:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340966.284080:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961274752 00000100:00100000:3.0:1780340966.284082:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961274752 00000100:00100000:1.0:1780340966.284093:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961274880:0@lo:8:kworker.0 00000100:00100000:3.0:1780340966.284096:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:3.0:1780340966.284100:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961274240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340966.284113:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340966.284126:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961274240:12345-0@lo:400:kworker.0 Request processed in 25us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340966.284132:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00100000:1.0:1780340966.284138:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961274368 00000100:00100000:1.0:1780340966.284141:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961274368 00000100:00100000:3.0:1780340966.284143:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:3.0:1780340966.284148:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961275136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340966.284165:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4009 00000100:00100000:1.0:1780340966.284170:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961274368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340966.284172:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961275136:12345-0@lo:400:kworker.0 Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340966.284177:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:3.0:1780340966.284187:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:1.0:1780340966.284196:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961274368:12345-0@lo:400:kworker.0 Request processed in 27us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340966.284199:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961274112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340966.284202:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4009 00000100:00100000:3.0:1780340966.284228:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961274112:12345-0@lo:400:kworker.0 Request processed in 30us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340966.284234:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00100000:3.0:1780340966.284245:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:3.0:1780340966.284250:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961274752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340966.284274:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961274752:12345-0@lo:400:kworker.0 Request processed in 23us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340966.284279:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00100000:3.0:1780340966.284294:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961274496 00000100:00100000:3.0:1780340966.284297:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961274496 00000100:00100000:3.0:1780340966.284312:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961274880 00000100:00100000:3.0:1780340966.284315:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961274880 00000100:00100000:3.0:1780340966.284327:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6006 00000100:00100000:3.0:1780340966.284331:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3658:x1866818961274496:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1780340966.284348:0:25495:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340966.284377:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b882680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3658:x1866818961274496:12345-0@lo:8:kworker.0 Request processed in 44us (297us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340966.284383:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6006 00000100:00100000:3.0:1780340966.284393:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6007 00000100:00100000:3.0:1780340966.284396:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04776c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3658:x1866818961274880:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1780340966.284404:0:25495:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340966.284424:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04776c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3658:x1866818961274880:12345-0@lo:8:kworker.0 Request processed in 26us (311us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340966.284429:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6007 00000100:00100000:3.0:1780340966.284578:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961274112:0@lo:400:kworker.0 00000100:00100000:3.0:1780340966.284595:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961274752:0@lo:400:kworker.0 00000100:00080000:3.0:1780340966.284620:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340966.284624:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340966.284627:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961274496:0@lo:8:kworker.0 00000100:00080000:3.0:1780340966.284634:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c046b9a9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1780340966.284637:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1780340966.284640:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961274880:0@lo:8:kworker.0 00000100:00100000:3.0:1780340966.284668:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f292300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961273856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1780340966.284689:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b880e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961275136:0@lo:400:kworker.0 00000100:00100000:3.0:1780340966.284698:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961275008:0@lo:400:kworker.0 00000100:00100000:3.0:1780340966.284705:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961274368:0@lo:400:kworker.0 00000100:00100000:3.0:1780340966.284713:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961274240:0@lo:400:kworker.0 00000100:00100000:2.0:1780340966.287118:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961273984 00000100:00100000:2.0:1780340966.287130:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961273984 00000100:00100000:2.0:1780340966.287207:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1780340966.287218:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0348d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3659:x1866818961273984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340966.287309:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0348d92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3659:x1866818961273984:12345-0@lo:400:kworker.0 Request processed in 93us (3443us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340966.287317:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1780340966.287338:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961273984:0@lo:400:kworker.0 00000100:00080000:0.0:1780340966.289716:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780340966.289724:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340966.289727:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340966.794298:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1780340966.794320:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961275264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340966.794392:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340966.794436:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961275264 00000100:00100000:1.0:1780340966.794444:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961275264 00000100:00100000:1.0:1780340966.794501:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188 00000100:00100000:1.0:1780340966.794511:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961275264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1780340966.794543:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1780340966.794593:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961275264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340966.794616:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188 00000100:00100000:1.0:1780340966.794675:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961275264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340966.795511:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1780340966.795535:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961275392:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340966.795593:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340966.795632:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961275392 00000100:00100000:2.0:1780340966.795898:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961275392 00000100:00100000:2.0:1780340966.795943:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4010 00000100:00100000:2.0:1780340966.795950:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961275392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780340966.796054:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445199872 avail 1298960384 00000100:00100000:2.0:1780340966.796099:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961275392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340966.796106:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4010 00000100:00100000:2.0:1780340966.796151:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961275392:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1780340967.306519:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340967.977562:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340967.977601:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340967.977640:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340967.977668:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340967.977695:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940543744 00000100:00100000:3.0:1780340967.977704:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940543744 00000100:00100000:3.0:1780340967.977780:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940543872 00000100:00100000:3.0:1780340967.977784:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940543872 00000100:00100000:3.0:1780340967.977809:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1513 00000100:00100000:3.0:1780340967.977819:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+51:2407:x1866818940543744:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:2.0:1780340967.977865:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1514 00000100:00100000:2.0:1780340967.977884:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2408:x1866818940543872:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340967.977912:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f292300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+51:2407:x1866818940543744:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 95us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340967.977912:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2408:x1866818940543872:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 39us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340967.977919:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1513 00000100:00100000:2.0:1780340967.977926:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1514 00000100:00100000:3.0:1780340967.977942:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940544000 00000100:00100000:3.0:1780340967.977945:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940544000 00000100:00100000:3.0:1780340967.977978:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6008 00000100:00100000:3.0:1780340967.977982:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2406:x1866818940544000:12345-192.168.203.16@tcp:8:kworker.0 00010000:00020000:3.0:1780340967.978002:0:25491:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1780340967.978028:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2406:x1866818940544000:12345-192.168.203.16@tcp:8:kworker.0 Request processed in 44us (359us total) trans 0 rc -19/-19 00000100:00100000:3.0:1780340967.978034:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6008 00000100:00080000:3.0:1780340967.978049:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1780340967.978053:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780340967.978080:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940543616 00000100:00100000:0.0:1780340967.978085:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940543616 00000100:00100000:0.0:1780340967.978114:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 185 00000100:00100000:0.0:1780340967.978121:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940543616:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340967.978146:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a376450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940543616:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 27us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340967.978159:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 185 00000100:00100000:3.0:1780340967.985703:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340967.985961:0:25486:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940544128 00000100:00100000:1.0:1780340967.985972:0:25486:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940544128 00000100:00100000:1.0:1780340967.986040:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2680 00000100:00100000:1.0:1780340967.986051:0:25486:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940544128:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340967.986118:0:25486:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f293800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940544128:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 69us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340967.986126:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2680 00000100:00080000:0.0:1780340967.986326:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1780340968.336149:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340969.355090:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1780340970.382198:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:2.0:1780340970.890006:0:72692:0:(genops.c:1231:class_import_get()) import ffff8c0346ee9000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1780340970.890047:0:72692:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000c600a94] to pc [ptlrpcd_00_02+2] req@ffff8c046ba2ce00 x1866818961275520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340970.890110:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:0.0:1780340970.890124:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2ce00 x1866818961275520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340970.890137:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961275520:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1780340970.890169:0:3662:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2ce00 x1866818961275520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340986 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340970.890178:0:3662:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340970.890223:0:3662:0:(events.c:337:request_in_callback()) incoming req@ffff8c0446efea00 x1866818961275520 msgsize 224 00000100:00100000:0.0:1780340970.890228:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340970.890258:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2ce00 x1866818961275520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340986 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340970.890270:0:3662:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5036 usecs (6 jiffies) 00000100:00100000:2.0:1780340970.890321:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961275520 00000100:00100000:2.0:1780340970.890330:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961275520 00000020:00000040:2.0:1780340970.890333:0:10290:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f183 00000020:00000040:2.0:1780340970.890337:0:10290:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0442c08800 refcount=5 00000020:00000040:2.0:1780340970.890353:0:10290:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00000040:2.0:1780340970.890383:0:10290:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:2.0:1780340970.890412:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189 00000100:00000040:2.0:1780340970.890416:0:10290:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0442c08800 : new rpc_count 1 00000100:00000040:2.0:1780340970.890421:0:10290:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0446efea00 x1866818961275520/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:396/0 lens 224/0 e 0 to 0 dl 1780340981 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340970.890433:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961275520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1780340970.890460:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:2.0:1780340970.890469:0:10290:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969444, transno 0, xid 1866818961275520 00000100:00000040:2.0:1780340970.890479:0:10290:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:2.0:1780340970.890484:0:10290:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340970.890503:0:10290:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8c046ba2ce00 x1866818961275520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340986 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340970.890522:0:10290:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:2.0:1780340970.890527:0:10290:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446efea00 x1866818961275520/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:396/0 lens 224/368 e 0 to 0 dl 1780340981 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340970.890537:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961275520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340970.890557:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189 00000100:00000040:2.0:1780340970.890560:0:10290:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0442c08800 : new rpc_count 0 00000020:00000040:2.0:1780340970.890570:0:10290:0:(genops.c:900:class_export_put()) PUTting export ffff8c0442c08800 : new refcount 4 00000100:00000040:2.0:1780340970.890605:0:3662:0:(client.c:3098:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969444 00000100:00000040:2.0:1780340970.890611:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2ce00 x1866818961275520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1780340970.890619:0:3662:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:2.0:1780340970.890621:0:3662:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:2.0:1780340970.890628:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2ce00 x1866818961275520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340986 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340970.890635:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961275520:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1780340970.890640:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2ce00 x1866818961275520/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340986 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340970.890649:0:3662:0:(genops.c:1244:class_import_put()) import ffff8c0346ee9000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00080000:0.0:1780340970.893957:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1780340970.893967:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00010000:00010000:0.0:1780340971.402633:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:2.0:1780340971.403133:0:90579:0:(genops.c:1231:class_import_get()) import ffff8c0450113000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1780340971.403169:0:90579:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000c600a94] to pc [ptlrpcd_00_03+3] req@ffff8c046ba2ce00 x1866818961275648/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340971.403205:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:2.0:1780340971.403221:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2ce00 x1866818961275648/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340971.403234:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961275648:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1780340971.403273:0:3661:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2ce00 x1866818961275648/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340987 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.403282:0:3661:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340971.403332:0:3661:0:(events.c:337:request_in_callback()) incoming req@ffff8c0485810c50 x1866818961275648 msgsize 224 00000100:00100000:2.0:1780340971.403337:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340971.403339:0:3661:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1780340971.403359:0:3661:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2ce00 x1866818961275648/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340987 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.403382:0:3661:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3621 usecs (4 jiffies) 00000100:00100000:2.0:1780340971.403408:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961275648 00000100:00100000:2.0:1780340971.403415:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961275648 00000020:00000040:2.0:1780340971.403418:0:26074:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277530c 00000020:00000040:2.0:1780340971.403421:0:26074:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c04514b0800 refcount=5 00000100:00000040:2.0:1780340971.403443:0:26074:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1780340971.403470:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4011 00000100:00000040:2.0:1780340971.403474:0:26074:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c04514b0800 : new rpc_count 1 00000100:00000040:2.0:1780340971.403480:0:26074:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0485810c50 x1866818961275648/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:397/0 lens 224/0 e 0 to 0 dl 1780340982 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340971.403492:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961275648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340971.403525:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00010000:00000040:2.0:1780340971.403542:0:26074:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961275648 00000100:00000040:2.0:1780340971.403552:0:26074:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:2.0:1780340971.403557:0:26074:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340971.403574:0:26074:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8c046ba2ce00 x1866818961275648/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.404081:0:26074:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:2.0:1780340971.404086:0:26074:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0485810c50 x1866818961275648/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:397/0 lens 224/368 e 0 to 0 dl 1780340982 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340971.404094:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485810c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961275648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 604us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340971.404101:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4011 00000100:00000040:2.0:1780340971.404112:0:26074:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c04514b0800 : new rpc_count 0 00000020:00000040:2.0:1780340971.404122:0:26074:0:(genops.c:900:class_export_put()) PUTting export ffff8c04514b0800 : new refcount 4 00000100:00000040:2.0:1780340971.404422:0:3661:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1780340971.404428:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2ce00 x1866818961275648/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1780340971.404439:0:3661:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352898 avail=317195 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023684 state=0: rc = 0 00000100:00000040:2.0:1780340971.404448:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2ce00 x1866818961275648/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340987 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340971.404455:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961275648:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1780340971.404462:0:3661:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2ce00 x1866818961275648/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340987 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340971.404471:0:3661:0:(genops.c:1244:class_import_put()) import ffff8c0450113000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1780340971.410600:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340971.410618:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000100:00000040:2.0:1780340971.410643:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS req@ffff8c046ba2ce00 x1866818961275776/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340971.410660:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000c600a94] to pc [ptlrpcd_00_00+0] req@ffff8c046ba2ce00 x1866818961275776/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.410691:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340971.410697:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c0346bb9800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1780340971.410705:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff8c046ba2d500 x1866818961275904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340971.410714:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000414ead72] to pc [ptlrpcd_00_01+1] req@ffff8c046ba2d500 x1866818961275904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.410785:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340971.410790:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c0346bbc000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1780340971.410797:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff8c046ba2dc00 x1866818961276032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340971.410807:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002ca63663] to pc [ptlrpcd_00_02+2] req@ffff8c046ba2dc00 x1866818961276032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.410822:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340971.410826:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c034a39c800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1780340971.410831:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff8c046ba2c380 x1866818961276160/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340971.410839:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000074e99cbe] to pc [ptlrpcd_00_03+3] req@ffff8c046ba2c380 x1866818961276160/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340971.410858:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340971.410861:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1780340971.410864:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340971.410869:0:80497:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3746 00000100:00080000:2.0:1780340971.410874:0:80497:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00000040:2.0:1780340971.410876:0:80497:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 50 to 0@lo 00000100:00000040:2.0:1780340971.410880:0:80497:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 51 to 0@lo 00000020:00000040:2.0:1780340971.410883:0:80497:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f160 00000020:00000040:2.0:1780340971.410886:0:80497:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0475fab800 refcount=4 00000100:00000040:2.0:1780340971.410889:0:80497:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 50 to 0@lo 00000100:00000040:2.0:1780340971.410891:0:80497:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 51 to 0@lo 00000020:00000040:2.0:1780340971.410894:0:80497:0:(genops.c:900:class_export_put()) PUTting export ffff8c0475fab800 : new refcount 3 00000100:00080000:2.0:1780340971.410896:0:80497:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c034a39f800 using connection 192.168.203.116@tcp/0@lo 00000020:00000040:2.0:1780340971.410911:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c034a39f800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:2.0:1780340971.410922:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046ba2c000 x1866818961276288/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340971.410931:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f989b013] to pc [ptlrpcd_rcv+-1] req@ffff8c046ba2c000 x1866818961276288/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.410946:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340971.410950:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c0346ee9000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1780340971.410957:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff8c046ba2df80 x1866818961276416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340971.410965:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006a73e119] to pc [ptlrpcd_00_00+0] req@ffff8c046ba2df80 x1866818961276416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.410971:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340971.410976:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c0346eef800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1780340971.410981:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff8c046ba2e680 x1866818961276544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340971.410987:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000024a80fc2] to pc [ptlrpcd_00_01+1] req@ffff8c046ba2e680 x1866818961276544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340971.410994:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340971.410997:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1780340971.410998:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c046b9a9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340971.411002:0:80497:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3746 00000100:00080000:2.0:1780340971.411009:0:80497:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00000040:2.0:1780340971.411012:0:80497:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 50 to 0@lo 00000100:00000040:2.0:1780340971.411015:0:80497:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 51 to 0@lo 00000020:00000040:2.0:1780340971.411022:0:80497:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775313 00000020:00000040:2.0:1780340971.411025:0:80497:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0445b41800 refcount=4 00000100:00000040:2.0:1780340971.411027:0:80497:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 50 to 0@lo 00000100:00000040:2.0:1780340971.411038:0:80497:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 51 to 0@lo 00000020:00000040:2.0:1780340971.411041:0:80497:0:(genops.c:900:class_export_put()) PUTting export ffff8c0445b41800 : new refcount 3 00000100:00080000:2.0:1780340971.411042:0:80497:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c046b9a9000 using connection 192.168.203.116@tcp/0@lo 00000020:00000040:2.0:1780340971.411049:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c046b9a9000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:2.0:1780340971.411057:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046ba2f480 x1866818961276672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340971.411066:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ee1753a1] to pc [ptlrpcd_rcv+-1] req@ffff8c046ba2f480 x1866818961276672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.411072:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340971.411077:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c046bae0000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1780340971.411083:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff8c046ba2d180 x1866818961276800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340971.411091:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009ca96525] to pc [ptlrpcd_00_02+2] req@ffff8c046ba2d180 x1866818961276800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.411098:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340971.411102:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c0442c0f800 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1780340971.411108:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff8c046ba2e300 x1866818961276928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340971.411115:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000912d2e8d] to pc [ptlrpcd_00_03+3] req@ffff8c046ba2e300 x1866818961276928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.411123:0:80497:0:(pinger.c:306:ptlrpc_pinger_main()) next wakeup in 5 (3756) 00000100:00000040:2.0:1780340971.411141:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2c000 x1866818961276288/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340971.411165:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961276288:0@lo:8:kworker.0 00000100:00000040:2.0:1780340971.411190:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2c000 x1866818961276288/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780340996 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.411199:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340971.411237:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff8c046ba2d880 x1866818961276288 msgsize 520 00000100:00100000:2.0:1780340971.411241:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340971.411263:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2c000 x1866818961276288/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780340996 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.411274:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5440 usecs (6 jiffies) 00000100:00000040:2.0:1780340971.411282:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2f480 x1866818961276672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340971.411291:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961276672:0@lo:8:kworker.0 00000100:00000040:2.0:1780340971.411301:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2f480 x1866818961276672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780340991 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.411307:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340971.411317:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff8c046ba2fb80 x1866818961276672 msgsize 520 00000100:00100000:2.0:1780340971.411320:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340971.411332:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2f480 x1866818961276672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780340991 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.411340:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 10187 usecs (11 jiffies) 00000100:00000040:0.0:1780340971.411528:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2ce00 x1866818961275776/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.411539:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961275776:0@lo:400:kworker.0 00000100:00000040:0.0:1780340971.411553:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2ce00 x1866818961275776/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340987 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.411560:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340971.411579:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a375050 x1866818961275776 msgsize 224 00000100:00100000:0.0:1780340971.411583:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340971.411585:0:3659:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1780340971.411599:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2ce00 x1866818961275776/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340987 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.411628:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2df80 x1866818961276416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.411635:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961276416:0@lo:400:kworker.0 00000100:00000040:0.0:1780340971.411647:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2df80 x1866818961276416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340987 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.411653:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340971.411665:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff8c0446efe300 x1866818961276416 msgsize 224 00000100:00100000:0.0:1780340971.411668:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340971.411680:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2df80 x1866818961276416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340987 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.411689:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5025 usecs (6 jiffies) 00000100:00100000:0.0:1780340971.411697:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00000040:0.0:1780340971.411702:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2d500 x1866818961275904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.411709:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961275904:0@lo:400:kworker.0 00000100:00000040:0.0:1780340971.411721:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2d500 x1866818961275904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.411727:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340971.411740:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff8c0446efce00 x1866818961275904 msgsize 224 00000100:00100000:0.0:1780340971.411743:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340971.411755:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2d500 x1866818961275904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.411781:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 7350 usecs (8 jiffies) 00000100:00000040:0.0:1780340971.411786:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2e680 x1866818961276544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.411794:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961276544:0@lo:400:kworker.0 00000100:00000040:0.0:1780340971.411813:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2e680 x1866818961276544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.411819:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340971.411833:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff8c0446efc000 x1866818961276544 msgsize 224 00000100:00100000:0.0:1780340971.411837:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340971.411862:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2e680 x1866818961276544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.411870:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 130215 usecs (131 jiffies) 00000100:00100000:0.0:1780340971.411888:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961275776 00000100:00100000:0.0:1780340971.411895:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961275776 00000020:00000040:0.0:1780340971.411897:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:0.0:1780340971.411900:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=20 00000100:00000040:0.0:1780340971.411920:0:90573:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1780340971.411946:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00000040:0.0:1780340971.411950:0:90573:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:0.0:1780340971.411955:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a375050 x1866818961275776/t0(0) o400->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:397/0 lens 224/0 e 0 to 0 dl 1780340982 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.411966:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3659:x1866818961275776:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1780340971.411983:0:90573:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961275776 00000100:00000040:0.0:1780340971.411991:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340971.411995:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340971.412012:0:90573:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046ba2ce00 x1866818961275776/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.412039:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:0.0:1780340971.412043:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a375050 x1866818961275776/t0(0) o400->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:397/0 lens 224/224 e 0 to 0 dl 1780340982 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.412052:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a375050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3659:x1866818961275776:12345-0@lo:400:kworker.0 Request processed in 88us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340971.412067:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00000040:0.0:1780340971.412070:0:90573:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:0.0:1780340971.412079:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 19 00000100:00100000:0.0:1780340971.412106:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961276288 00000100:00100000:0.0:1780340971.412110:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961276288 00000020:00000040:0.0:1780340971.412112:0:25488:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f175 00000100:00100000:0.0:1780340971.412129:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961276672 00000100:00100000:0.0:1780340971.412132:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961276672 00000020:00000040:0.0:1780340971.412133:0:25488:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775328 00000100:00100000:0.0:1780340971.412147:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961276416 00000100:00100000:0.0:1780340971.412149:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961276416 00000020:00000040:0.0:1780340971.412151:0:25488:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f183 00000020:00000040:0.0:1780340971.412153:0:25488:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0442c08800 refcount=5 00000100:00000040:0.0:1780340971.412163:0:25488:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1780340971.412178:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681 00000100:00000040:0.0:1780340971.412180:0:25488:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0442c08800 : new rpc_count 1 00000100:00000040:0.0:1780340971.412184:0:25488:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0446efe300 x1866818961276416/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:397/0 lens 224/0 e 0 to 0 dl 1780340982 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.412194:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961276416:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1780340971.412204:0:25488:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969444, transno 0, xid 1866818961276416 00000100:00000040:0.0:1780340971.412209:0:25488:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340971.412213:0:25488:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340971.412228:0:25488:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046ba2df80 x1866818961276416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.412238:0:25488:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:0.0:1780340971.412242:0:25488:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446efe300 x1866818961276416/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:397/0 lens 224/224 e 0 to 0 dl 1780340982 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.412249:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961276416:12345-0@lo:400:kworker.0 Request processed in 56us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340971.412261:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681 00000100:00000040:0.0:1780340971.412263:0:25488:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0442c08800 : new rpc_count 0 00000020:00000040:0.0:1780340971.412270:0:25488:0:(genops.c:900:class_export_put()) PUTting export ffff8c0442c08800 : new refcount 4 00000100:00100000:0.0:1780340971.412279:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6009 00000100:00000040:0.0:1780340971.412283:0:25488:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c046ba2d880 x1866818961276288/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780340991 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.412290:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3658:x1866818961276288:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1780340971.412310:0:25488:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:0.0:1780340971.412320:0:25488:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340971.412323:0:25488:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340971.412325:0:25488:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340971.412339:0:25488:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8c046ba2c000 x1866818961276288/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780340996 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.412355:0:25488:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:0.0:1780340971.412359:0:25488:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2d880 x1866818961276288/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1780340991 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.412486:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3658:x1866818961276288:12345-0@lo:8:kworker.0 Request processed in 75us (1127us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340971.412493:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6009 00000100:00100000:0.0:1780340971.412505:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6010 00000100:00000040:0.0:1780340971.412510:0:25488:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c046ba2fb80 x1866818961276672/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780340991 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.412517:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3658:x1866818961276672:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1780340971.412525:0:25488:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:0.0:1780340971.412534:0:25488:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340971.412542:0:25488:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340971.412545:0:25488:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340971.412559:0:25488:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8c046ba2f480 x1866818961276672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780340991 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.412570:0:25488:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:0.0:1780340971.412573:0:25488:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2fb80 x1866818961276672/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1780340991 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.412580:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3658:x1866818961276672:12345-0@lo:8:kworker.0 Request processed in 63us (1262us total) trans 0 rc -19/-19 00000100:00100000:0.0:1780340971.412587:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6010 00000100:00100000:0.0:1780340971.412607:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961275904 00000100:00100000:0.0:1780340971.412611:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961275904 00000020:00000040:0.0:1780340971.412613:0:70100:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277546a 00000020:00000040:0.0:1780340971.412615:0:70100:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0458280800 refcount=5 00000020:00000040:0.0:1780340971.412625:0:70100:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff8c0445ba19c0) now 14 - evictor 00000100:00000040:0.0:1780340971.412639:0:70100:0:(service.c:1435:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1780340971.412654:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961276544 00000100:00100000:0.0:1780340971.412657:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961276544 00000020:00000040:0.0:1780340971.412658:0:70100:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775471 00000020:00000040:0.0:1780340971.412660:0:70100:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046b908800 refcount=5 00000100:00100000:0.0:1780340971.412677:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515 00000100:00000040:0.0:1780340971.412679:0:70100:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0458280800 : new rpc_count 1 00000100:00000040:0.0:1780340971.412684:0:70100:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0446efce00 x1866818961275904/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:397/0 lens 224/0 e 0 to 0 dl 1780340982 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.412693:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961275904:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1780340971.412702:0:70100:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961275904 00000100:00000040:0.0:1780340971.412707:0:70100:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340971.412710:0:70100:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340971.412725:0:70100:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046ba2d500 x1866818961275904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.412749:0:70100:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:0.0:1780340971.412753:0:70100:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446efce00 x1866818961275904/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:397/0 lens 224/224 e 0 to 0 dl 1780340982 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.412782:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961275904:12345-0@lo:400:kworker.0 Request processed in 89us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340971.412788:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515 00000100:00000040:0.0:1780340971.412791:0:70100:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0458280800 : new rpc_count 0 00000020:00000040:0.0:1780340971.412797:0:70100:0:(genops.c:900:class_export_put()) PUTting export ffff8c0458280800 : new refcount 4 00000100:00100000:0.0:1780340971.412806:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00000040:0.0:1780340971.412808:0:70100:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046b908800 : new rpc_count 1 00000100:00000040:0.0:1780340971.412812:0:70100:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0446efc000 x1866818961276544/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:397/0 lens 224/0 e 0 to 0 dl 1780340982 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.412822:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961276544:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1780340971.412831:0:70100:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961276544 00000100:00000040:0.0:1780340971.412835:0:70100:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340971.412839:0:70100:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340971.412864:0:70100:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046ba2e680 x1866818961276544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.412876:0:70100:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:0.0:1780340971.412880:0:70100:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446efc000 x1866818961276544/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:397/0 lens 224/224 e 0 to 0 dl 1780340982 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.412887:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961276544:12345-0@lo:400:kworker.0 Request processed in 67us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340971.412893:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00000040:0.0:1780340971.412895:0:70100:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046b908800 : new rpc_count 0 00000020:00000040:0.0:1780340971.412906:0:70100:0:(genops.c:900:class_export_put()) PUTting export ffff8c046b908800 : new refcount 4 00000100:00080000:0.0:1780340971.412934:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1780340971.412938:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff8c0445ba19c0) now 14 - evictor 00000100:00000040:0.0:1780340971.412970:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2c380 x1866818961276160/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.412980:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961276160:0@lo:400:kworker.0 00000100:00000040:0.0:1780340971.412996:0:3662:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2c380 x1866818961276160/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340987 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.413004:0:3662:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340971.413020:0:3662:0:(events.c:337:request_in_callback()) incoming req@ffff8c0446eff480 x1866818961276160 msgsize 224 00000100:00100000:0.0:1780340971.413024:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340971.413052:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2c380 x1866818961276160/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340987 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.413063:0:3662:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 849947 usecs (850 jiffies) 00000100:00000040:0.0:1780340971.413070:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2e300 x1866818961276928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.413078:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961276928:0@lo:400:kworker.0 00000100:00000040:0.0:1780340971.413089:0:3662:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2e300 x1866818961276928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.413095:0:3662:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340971.413106:0:3662:0:(events.c:337:request_in_callback()) incoming req@ffff8c0446effb80 x1866818961276928 msgsize 224 00000100:00100000:0.0:1780340971.413110:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340971.413122:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2e300 x1866818961276928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.413131:0:3662:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 7142 usecs (8 jiffies) 00000100:00100000:0.0:1780340971.413142:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00000040:0.0:1780340971.413147:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2dc00 x1866818961276032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.413164:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961276032:0@lo:400:kworker.0 00000100:00000040:0.0:1780340971.413175:0:3662:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2dc00 x1866818961276032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.413180:0:3662:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340971.413192:0:3662:0:(events.c:337:request_in_callback()) incoming req@ffff8c0446efe680 x1866818961276032 msgsize 224 00000100:00100000:0.0:1780340971.413195:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340971.413205:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2dc00 x1866818961276032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.413214:0:3662:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7011 usecs (8 jiffies) 00000100:00000040:0.0:1780340971.413219:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2d180 x1866818961276800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.413226:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961276800:0@lo:400:kworker.0 00000100:00000040:0.0:1780340971.413236:0:3662:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2d180 x1866818961276800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340987 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.413242:0:3662:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340971.413252:0:3662:0:(events.c:337:request_in_callback()) incoming req@ffff8c0446efdf80 x1866818961276800 msgsize 224 00000100:00100000:0.0:1780340971.413255:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340971.413267:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2d180 x1866818961276800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340987 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.413275:0:3662:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 9021 usecs (10 jiffies) 00000100:00100000:0.0:1780340971.413290:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961276928 00000100:00100000:0.0:1780340971.413294:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961276928 00000020:00000040:0.0:1780340971.413295:0:63711:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775478 00000020:00000040:0.0:1780340971.413297:0:63711:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a0a2800 refcount=5 00000100:00000040:0.0:1780340971.413308:0:63711:0:(service.c:1435:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1780340971.413322:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961276032 00000100:00100000:0.0:1780340971.413324:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961276032 00000020:00000040:0.0:1780340971.413331:0:63711:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f208 00000020:00000040:0.0:1780340971.413333:0:63711:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046ba26800 refcount=5 00000020:00000040:0.0:1780340971.413340:0:63711:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff8c03475519c0) now 10 - evictor 00000100:00100000:0.0:1780340971.413360:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00000100:00000040:0.0:1780340971.413363:0:63711:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a0a2800 : new rpc_count 1 00000100:00000040:0.0:1780340971.413377:0:63711:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0446effb80 x1866818961276928/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:397/0 lens 224/0 e 0 to 0 dl 1780340982 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.413389:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961276928:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1780340971.413399:0:63711:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961276928 00000100:00000040:0.0:1780340971.413404:0:63711:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340971.413407:0:63711:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340971.413422:0:63711:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046ba2e300 x1866818961276928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.413438:0:63711:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:0.0:1780340971.413441:0:63711:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446effb80 x1866818961276928/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:397/0 lens 224/224 e 0 to 0 dl 1780340982 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.413448:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961276928:12345-0@lo:400:kworker.0 Request processed in 61us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340971.413452:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00000040:0.0:1780340971.413454:0:63711:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a0a2800 : new rpc_count 0 00000020:00000040:0.0:1780340971.413460:0:63711:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a0a2800 : new refcount 4 00000100:00100000:0.0:1780340971.413467:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1518 00000100:00000040:0.0:1780340971.413469:0:63711:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046ba26800 : new rpc_count 1 00000100:00000040:0.0:1780340971.413472:0:63711:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0446efe680 x1866818961276032/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:397/0 lens 224/0 e 0 to 0 dl 1780340982 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.413481:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961276032:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1780340971.413489:0:63711:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961276032 00000100:00000040:0.0:1780340971.413500:0:63711:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340971.413503:0:63711:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340971.413517:0:63711:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046ba2dc00 x1866818961276032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.413527:0:63711:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:0.0:1780340971.413531:0:63711:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446efe680 x1866818961276032/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:397/0 lens 224/224 e 0 to 0 dl 1780340982 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.413537:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961276032:12345-0@lo:400:kworker.0 Request processed in 58us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340971.413542:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1518 00000100:00000040:0.0:1780340971.413544:0:63711:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046ba26800 : new rpc_count 0 00000020:00000040:0.0:1780340971.413549:0:63711:0:(genops.c:900:class_export_put()) PUTting export ffff8c046ba26800 : new refcount 4 00000100:00100000:0.0:1780340971.413563:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961276800 00000100:00100000:0.0:1780340971.413567:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961276800 00000020:00000040:0.0:1780340971.413569:0:25490:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775336 00000020:00000040:0.0:1780340971.413570:0:25490:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0452a6e000 refcount=5 00000020:00000040:0.0:1780340971.413578:0:25490:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00000040:0.0:1780340971.413585:0:25490:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1780340971.413600:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682 00000100:00000040:0.0:1780340971.413602:0:25490:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0452a6e000 : new rpc_count 1 00000100:00000040:0.0:1780340971.413606:0:25490:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0446efdf80 x1866818961276800/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:397/0 lens 224/0 e 0 to 0 dl 1780340982 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.413616:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961276800:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1780340971.413625:0:25490:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1866818961276800 00000100:00000040:0.0:1780340971.413629:0:25490:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340971.413632:0:25490:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340971.413644:0:25490:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046ba2d180 x1866818961276800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.413666:0:25490:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:0.0:1780340971.413669:0:25490:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446efdf80 x1866818961276800/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:397/0 lens 224/224 e 0 to 0 dl 1780340982 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.413676:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961276800:12345-0@lo:400:kworker.0 Request processed in 62us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340971.413683:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682 00000100:00000040:0.0:1780340971.413684:0:25490:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0452a6e000 : new rpc_count 0 00000020:00000040:0.0:1780340971.413689:0:25490:0:(genops.c:900:class_export_put()) PUTting export ffff8c0452a6e000 : new refcount 4 00000100:00080000:0.0:1780340971.413706:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1780340971.413708:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00080000:0.0:1780340971.413710:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1780340971.413712:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff8c03475519c0) now 10 - evictor 00000100:00000040:0.0:1780340971.413738:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2c000 x1866818961276288/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780340996 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340971.413748:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340971.413752:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:0.0:1780340971.413756:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2c000 x1866818961276288/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780340996 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.413785:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961276288:0@lo:8:kworker.0 00000100:00000040:0.0:1780340971.413796:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2f480 x1866818961276672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780340991 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340971.413803:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c046b9a9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340971.413805:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:0.0:1780340971.413808:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2f480 x1866818961276672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780340991 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.413824:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961276672:0@lo:8:kworker.0 00000100:00000040:0.0:1780340971.413829:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2c000 x1866818961276288/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780340996 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340971.413837:0:3658:0:(genops.c:1244:class_import_put()) import ffff8c034a39f800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1780340971.413855:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2f480 x1866818961276672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780340991 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340971.413862:0:3658:0:(genops.c:1244:class_import_put()) import ffff8c046b9a9000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:0.0:1780340971.413888:0:3662:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1780340971.413892:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2dc00 x1866818961276032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.413900:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2dc00 x1866818961276032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.413907:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961276032:0@lo:400:kworker.0 00000100:00000040:0.0:1780340971.413915:0:3662:0:(client.c:3098:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969457 00000100:00000040:0.0:1780340971.413919:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2d180 x1866818961276800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.413926:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2d180 x1866818961276800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.413933:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961276800:0@lo:400:kworker.0 00000100:00000040:0.0:1780340971.413942:0:3662:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1780340971.413945:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2e300 x1866818961276928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.413952:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2e300 x1866818961276928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.413965:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961276928:0@lo:400:kworker.0 00000100:00000040:0.0:1780340971.413970:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2dc00 x1866818961276032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340971.413977:0:3662:0:(genops.c:1244:class_import_put()) import ffff8c0346bbc000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1780340971.413983:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2d180 x1866818961276800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340971.413989:0:3662:0:(genops.c:1244:class_import_put()) import ffff8c046bae0000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1780340971.413995:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2e300 x1866818961276928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340971.414001:0:3662:0:(genops.c:1244:class_import_put()) import ffff8c0442c0f800 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1780340971.414026:0:3659:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1780340971.414031:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2d500 x1866818961275904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.414038:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2d500 x1866818961275904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.414044:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961275904:0@lo:400:kworker.0 00000100:00000040:0.0:1780340971.414053:0:3659:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:0.0:1780340971.414057:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2e680 x1866818961276544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.414065:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2e680 x1866818961276544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.414071:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961276544:0@lo:400:kworker.0 00000100:00000040:0.0:1780340971.414080:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2ce00 x1866818961275776/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.414095:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2ce00 x1866818961275776/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.414101:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961275776:0@lo:400:kworker.0 00000100:00000040:0.0:1780340971.414114:0:3659:0:(client.c:3098:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969444 00000100:00000040:0.0:1780340971.414118:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2df80 x1866818961276416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340971.414126:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2df80 x1866818961276416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340971.414131:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961276416:0@lo:400:kworker.0 00000100:00000040:0.0:1780340971.414135:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2d500 x1866818961275904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340971.414141:0:3659:0:(genops.c:1244:class_import_put()) import ffff8c0346bb9800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1780340971.414146:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2e680 x1866818961276544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340971.414151:0:3659:0:(genops.c:1244:class_import_put()) import ffff8c0346eef800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1780340971.414155:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2ce00 x1866818961275776/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340971.414160:0:3659:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000100:00000040:0.0:1780340971.414167:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2df80 x1866818961276416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340971.414172:0:3659:0:(genops.c:1244:class_import_put()) import ffff8c0346ee9000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00100000:2.0:1780340971.414254:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961276160 00000100:00100000:2.0:1780340971.414259:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961276160 00000020:00000040:2.0:1780340971.414260:0:22660:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa246514327752c6 00000020:00000040:2.0:1780340971.414264:0:22660:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0475fad800 refcount=7 00000100:00000040:2.0:1780340971.414276:0:22660:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1780340971.414302:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4012 00000100:00000040:2.0:1780340971.414304:0:22660:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0475fad800 : new rpc_count 1 00000100:00000040:2.0:1780340971.414314:0:22660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0446eff480 x1866818961276160/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:397/0 lens 224/0 e 0 to 0 dl 1780340982 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340971.414325:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961276160:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1780340971.414337:0:22660:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1866818961276160 00000100:00000040:2.0:1780340971.414341:0:22660:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:2.0:1780340971.414346:0:22660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340971.414366:0:22660:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046ba2c380 x1866818961276160/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.414383:0:22660:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:2.0:1780340971.414386:0:22660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446eff480 x1866818961276160/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:397/0 lens 224/224 e 0 to 0 dl 1780340982 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340971.414393:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446eff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961276160:12345-0@lo:400:kworker.0 Request processed in 70us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340971.414398:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4012 00000100:00000040:2.0:1780340971.414400:0:22660:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0475fad800 : new rpc_count 0 00000020:00000040:2.0:1780340971.414406:0:22660:0:(genops.c:900:class_export_put()) PUTting export ffff8c0475fad800 : new refcount 6 00000100:00000040:2.0:1780340971.414429:0:3662:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:2.0:1780340971.414434:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2c380 x1866818961276160/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.414441:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2c380 x1866818961276160/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340971.414448:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961276160:0@lo:400:kworker.0 00000100:00000040:2.0:1780340971.414452:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2c380 x1866818961276160/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340971.414458:0:3662:0:(genops.c:1244:class_import_put()) import ffff8c034a39c800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000020:00000040:2.0:1780340971.913910:0:72688:0:(genops.c:1231:class_import_get()) import ffff8c034a39c800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1780340971.913960:0:72688:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000074e99cbe] to pc [ptlrpcd_00_00+0] req@ffff8c046ba2c380 x1866818961277056/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340971.914981:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:3.0:1780340971.915001:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2c380 x1866818961277056/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340971.915016:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961277056:0@lo:41:osp-pre-0-1.0 00000100:00000040:3.0:1780340971.915046:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2c380 x1866818961277056/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340987 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340971.915054:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340971.915092:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff8c045f292680 x1866818961277056 msgsize 224 00000100:00100000:3.0:1780340971.915095:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340971.915125:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2c380 x1866818961277056/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340987 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340971.915149:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 847503 usecs (848 jiffies) 00000100:00100000:2.0:1780340971.915216:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961277056 00000100:00100000:2.0:1780340971.915224:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961277056 00000020:00000040:2.0:1780340971.915227:0:26074:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa246514327752c6 00000020:00000040:2.0:1780340971.915231:0:26074:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0475fad800 refcount=7 00000100:00000040:2.0:1780340971.915252:0:26074:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1780340971.915286:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4013 00000100:00000040:2.0:1780340971.915290:0:26074:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0475fad800 : new rpc_count 1 00000100:00000040:2.0:1780340971.915295:0:26074:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c045f292680 x1866818961277056/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:397/0 lens 224/0 e 0 to 0 dl 1780340982 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340971.915307:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1866818961277056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780340971.915340:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445199872 avail 1298960384 00010000:00000040:2.0:1780340971.915350:0:26074:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1866818961277056 00000100:00000040:2.0:1780340971.915360:0:26074:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:2.0:1780340971.915365:0:26074:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340971.915384:0:26074:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8c046ba2c380 x1866818961277056/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.915403:0:26074:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:2.0:1780340971.915408:0:26074:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f292680 x1866818961277056/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:397/0 lens 224/368 e 0 to 0 dl 1780340982 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340971.915416:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f292680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1866818961277056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340971.915423:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4013 00000100:00000040:2.0:1780340971.915426:0:26074:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0475fad800 : new rpc_count 0 00000020:00000040:2.0:1780340971.915435:0:26074:0:(genops.c:900:class_export_put()) PUTting export ffff8c0475fad800 : new refcount 6 00000100:00000040:2.0:1780340971.915464:0:3660:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:2.0:1780340971.915469:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2c380 x1866818961277056/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1780340971.915487:0:3660:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352832 avail=317129 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023573 state=0: rc = 0 00000100:00000040:2.0:1780340971.915495:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2c380 x1866818961277056/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340987 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340971.915503:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961277056:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1780340971.915510:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2c380 x1866818961277056/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340987 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340971.915519:0:3660:0:(genops.c:1244:class_import_put()) import ffff8c034a39c800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000020:00000040:3.0:1780340971.917457:0:90583:0:(genops.c:1231:class_import_get()) import ffff8c046bae0000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1780340971.917493:0:90583:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004da9b303] to pc [ptlrpcd_00_01+1] req@ffff8c045f292d80 x1866818961277184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.917570:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c045f292d80 x1866818961277184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340971.917584:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961277184:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1780340971.917609:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c045f292d80 x1866818961277184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340987 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.917618:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340971.917651:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff8c046ba2c380 x1866818961277184 msgsize 224 00000100:00100000:2.0:1780340971.917656:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340971.917683:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c045f292d80 x1866818961277184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340987 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340971.917695:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 8831 usecs (9 jiffies) 00000100:00100000:3.0:1780340971.917779:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961277184 00000100:00100000:3.0:1780340971.917786:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961277184 00000020:00000040:3.0:1780340971.917789:0:8403:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775336 00000020:00000040:3.0:1780340971.917793:0:8403:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0452a6e000 refcount=5 00000100:00000040:3.0:1780340971.917814:0:8403:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1780340971.917852:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2190 00000100:00000040:3.0:1780340971.917856:0:8403:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0452a6e000 : new rpc_count 1 00000100:00000040:3.0:1780340971.917861:0:8403:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c046ba2c380 x1866818961277184/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:397/0 lens 224/0 e 0 to 0 dl 1780340982 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340971.917873:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961277184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1780340971.917893:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:3.0:1780340971.917911:0:8403:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1866818961277184 00000100:00000040:3.0:1780340971.917921:0:8403:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:3.0:1780340971.917926:0:8403:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340971.917944:0:8403:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8c045f292d80 x1866818961277184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340971.917962:0:8403:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:3.0:1780340971.917966:0:8403:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2c380 x1866818961277184/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:397/0 lens 224/368 e 0 to 0 dl 1780340982 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340971.917974:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961277184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340971.917980:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2190 00000100:00000040:3.0:1780340971.917991:0:8403:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0452a6e000 : new rpc_count 0 00000020:00000040:3.0:1780340971.918001:0:8403:0:(genops.c:900:class_export_put()) PUTting export ffff8c0452a6e000 : new refcount 4 00000100:00000040:2.0:1780340971.918073:0:3660:0:(client.c:3098:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969457 00000100:00000040:2.0:1780340971.918079:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c045f292d80 x1866818961277184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1780340971.918088:0:3660:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:2.0:1780340971.918091:0:3660:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:2.0:1780340971.918099:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f292d80 x1866818961277184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340987 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340971.918122:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f292d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961277184:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1780340971.918131:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c045f292d80 x1866818961277184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340987 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340971.918140:0:3660:0:(genops.c:1244:class_import_put()) import ffff8c046bae0000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00010000:00010000:1.0:1780340972.428350:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1780340973.100150:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c045f291180 x1866818940544640 msgsize 520 00000100:00100000:3.0:1780340973.100165:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00000040:3.0:1780340973.100204:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a377450 x1866818940544256 msgsize 224 00000100:00100000:3.0:1780340973.100209:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00000040:3.0:1780340973.100211:0:3652:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780340973.100236:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c045f293100 x1866818940544512 msgsize 224 00000100:00100000:3.0:1780340973.100240:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00000040:3.0:1780340973.100261:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c045f291500 x1866818940544384 msgsize 224 00000100:00100000:3.0:1780340973.100265:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00000040:3.0:1780340973.100296:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c045f293480 x1866818940544768 msgsize 224 00000100:00100000:3.0:1780340973.100301:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340973.100326:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940544256 00000100:00100000:3.0:1780340973.100335:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940544256 00000020:00000040:3.0:1780340973.100338:0:90570:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775440 00000020:00000040:3.0:1780340973.100342:0:90570:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0346fd5800 refcount=9 00000100:00000040:3.0:1780340973.100363:0:90570:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1780340973.100390:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 187 00000100:00000040:3.0:1780340973.100395:0:90570:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0346fd5800 : new rpc_count 1 00000100:00000040:3.0:1780340973.100402:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a377450 x1866818940544256/t0(0) o400->540506f4-4e8e-4fb6-b537-f45d44291964@192.168.203.16@tcp:399/0 lens 224/0 e 0 to 0 dl 1780340984 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340973.100414:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940544256:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000040:3.0:1780340973.100432:0:90570:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818940544256 00000100:00000040:3.0:1780340973.100442:0:90570:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 9 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340973.100448:0:90570:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340973.100482:0:90570:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 8 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340973.100486:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a377450 x1866818940544256/t0(0) o400->540506f4-4e8e-4fb6-b537-f45d44291964@192.168.203.16@tcp:399/0 lens 224/224 e 0 to 0 dl 1780340984 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340973.100507:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a377450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940544256:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 95us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340973.100514:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 187 00000100:00000040:3.0:1780340973.100517:0:90570:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0346fd5800 : new rpc_count 0 00000020:00000040:3.0:1780340973.100526:0:90570:0:(genops.c:900:class_export_put()) PUTting export ffff8c0346fd5800 : new refcount 8 00000100:00100000:3.0:1780340973.100552:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940544512 00000100:00100000:3.0:1780340973.100556:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940544512 00000020:00000040:3.0:1780340973.100557:0:63711:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa246514327748d9 00000020:00000040:3.0:1780340973.100560:0:63711:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047b1fc000 refcount=11 00000020:00000040:3.0:1780340973.100570:0:63711:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff8c03475519c0) now 10 - evictor 00000100:00000040:3.0:1780340973.100586:0:63711:0:(service.c:1435:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1780340973.100603:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940544384 00000100:00100000:3.0:1780340973.100606:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940544384 00000020:00000040:3.0:1780340973.100608:0:63711:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa246514327752cd 00000020:00000040:3.0:1780340973.100610:0:63711:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0475faa800 refcount=51 00000020:00000040:3.0:1780340973.100616:0:63711:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff8c0445ba19c0) now 14 - evictor 00000100:00100000:3.0:1780340973.100634:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1519 00000100:00000040:3.0:1780340973.100636:0:63711:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047b1fc000 : new rpc_count 1 00000100:00000040:3.0:1780340973.100640:0:63711:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c045f293100 x1866818940544512/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:399/0 lens 224/0 e 0 to 0 dl 1780340984 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340973.100650:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2407:x1866818940544512:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000040:3.0:1780340973.100663:0:63711:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 81604378768, transno 0, xid 1866818940544512 00000100:00000040:3.0:1780340973.100669:0:63711:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 9 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340973.100672:0:63711:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340973.100687:0:63711:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 8 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340973.100691:0:63711:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f293100 x1866818940544512/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:399/0 lens 224/224 e 0 to 0 dl 1780340984 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340973.100709:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2407:x1866818940544512:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 60us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340973.100715:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1519 00000100:00000040:3.0:1780340973.100718:0:63711:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047b1fc000 : new rpc_count 0 00000020:00000040:3.0:1780340973.100725:0:63711:0:(genops.c:900:class_export_put()) PUTting export ffff8c047b1fc000 : new refcount 10 00000100:00100000:3.0:1780340973.100735:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1520 00000100:00000040:3.0:1780340973.100737:0:63711:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0475faa800 : new rpc_count 1 00000100:00000040:3.0:1780340973.100740:0:63711:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c045f291500 x1866818940544384/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:399/0 lens 224/0 e 0 to 0 dl 1780340984 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340973.100751:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+51:2407:x1866818940544384:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000040:3.0:1780340973.100788:0:63711:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 120259084436, transno 0, xid 1866818940544384 00000100:00000040:3.0:1780340973.100794:0:63711:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 9 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340973.100799:0:63711:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340973.100811:0:63711:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 8 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340973.100816:0:63711:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f291500 x1866818940544384/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:399/0 lens 224/224 e 0 to 0 dl 1780340984 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340973.100824:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+51:2407:x1866818940544384:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 76us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340973.100830:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1520 00000100:00000040:3.0:1780340973.100842:0:63711:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0475faa800 : new rpc_count 0 00000020:00000040:3.0:1780340973.100848:0:63711:0:(genops.c:900:class_export_put()) PUTting export ffff8c0475faa800 : new refcount 50 00000100:00080000:3.0:1780340973.100938:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1780340973.100942:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff8c0445ba19c0) now 14 - evictor 00000100:00080000:3.0:1780340973.100945:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:3.0:1780340973.100946:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff8c03475519c0) now 10 - evictor 00000100:00100000:2.0:1780340973.101657:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940544640 00000100:00100000:2.0:1780340973.101663:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940544640 00000020:00000040:2.0:1780340973.101665:0:8400:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277591e 00000100:00100000:2.0:1780340973.101695:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940544768 00000100:00100000:2.0:1780340973.101699:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940544768 00000020:00000040:2.0:1780340973.101701:0:8400:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277567e 00000020:00000040:2.0:1780340973.101704:0:8400:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047570b000 refcount=7 00000020:00000040:2.0:1780340973.101714:0:8400:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00000040:2.0:1780340973.101725:0:8400:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1780340973.101750:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2683 00000100:00000040:2.0:1780340973.101753:0:8400:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047570b000 : new rpc_count 1 00000100:00100000:0.0:1780340973.101780:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6011 00000100:00000040:2.0:1780340973.101783:0:8400:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c045f293480 x1866818940544768/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:399/0 lens 224/0 e 0 to 0 dl 1780340984 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340973.101788:0:25496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c045f291180 x1866818940544640/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780340993 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340973.101800:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940544768:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000040:2.0:1780340973.101813:0:8400:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818940544768 00000100:00100000:0.0:1780340973.101818:0:25496:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2406:x1866818940544640:12345-192.168.203.16@tcp:8:kworker.0 00000100:00000040:2.0:1780340973.101822:0:8400:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 9 to 192.168.203.16@tcp 00000100:00000040:2.0:1780340973.101829:0:8400:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00010000:00020000:0.0:1780340973.101850:0:25496:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:2.0:1780340973.101864:0:8400:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 8 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340973.101867:0:25496:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 9 to 192.168.203.16@tcp 00000100:00000040:2.0:1780340973.101873:0:8400:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f293480 x1866818940544768/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:399/0 lens 224/224 e 0 to 0 dl 1780340984 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340973.101874:0:25496:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8c0346e3c480 refcount 9 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340973.101882:0:25496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00100000:2.0:1780340973.101892:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940544768:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 95us (1593us total) trans 0 rc 0/0 00000100:00000040:0.0:1780340973.101901:0:25496:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 8 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340973.101907:0:25496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f291180 x1866818940544640/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1780340993 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340973.101914:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2683 00000100:00000040:2.0:1780340973.101920:0:8400:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047570b000 : new rpc_count 0 00000100:00100000:0.0:1780340973.101925:0:25496:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f291180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2406:x1866818940544640:12345-192.168.203.16@tcp:8:kworker.0 Request processed in 107us (1773us total) trans 0 rc -19/-19 00000020:00000040:2.0:1780340973.101931:0:8400:0:(genops.c:900:class_export_put()) PUTting export ffff8c047570b000 : new refcount 6 00000100:00100000:0.0:1780340973.101934:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6011 00000100:00080000:3.0:1780340973.102107:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1780340973.102111:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00010000:00010000:1.0:1780340973.450325:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340974.474394:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1780340975.498935:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:2.0:1780340976.012569:0:72692:0:(genops.c:1231:class_import_get()) import ffff8c0346ee9000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1780340976.012608:0:72692:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ece7be4d] to pc [ptlrpcd_00_02+2] req@ffff8c046ba2ed80 x1866818961277312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340976.012651:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:2.0:1780340976.012666:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2ed80 x1866818961277312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340976.012678:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961277312:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1780340976.012705:0:3662:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2ed80 x1866818961277312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340992 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340976.012713:0:3662:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340976.013349:0:3662:0:(events.c:337:request_in_callback()) incoming req@ffff8c046ba2f100 x1866818961277312 msgsize 224 00000100:00100000:2.0:1780340976.013356:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340976.013391:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2ed80 x1866818961277312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340992 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340976.013405:0:3662:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5021 usecs (6 jiffies) 00000100:00100000:3.0:1780340976.013531:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961277312 00000100:00100000:3.0:1780340976.013539:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961277312 00000020:00000040:3.0:1780340976.013542:0:10290:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f183 00000020:00000040:3.0:1780340976.013547:0:10290:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0442c08800 refcount=5 00000020:00000040:3.0:1780340976.013561:0:10290:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00000040:3.0:1780340976.013588:0:10290:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1780340976.013611:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2191 00000100:00000040:3.0:1780340976.013614:0:10290:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0442c08800 : new rpc_count 1 00000100:00000040:3.0:1780340976.013619:0:10290:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c046ba2f100 x1866818961277312/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:402/0 lens 224/0 e 0 to 0 dl 1780340987 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340976.013631:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961277312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340976.013659:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:3.0:1780340976.013669:0:10290:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969444, transno 0, xid 1866818961277312 00000100:00000040:3.0:1780340976.013679:0:10290:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:3.0:1780340976.013683:0:10290:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340976.013705:0:10290:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8c046ba2ed80 x1866818961277312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340992 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340976.013720:0:10290:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:3.0:1780340976.013723:0:10290:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2f100 x1866818961277312/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:402/0 lens 224/368 e 0 to 0 dl 1780340987 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340976.013730:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961277312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340976.013752:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2191 00000100:00000040:3.0:1780340976.013754:0:10290:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0442c08800 : new rpc_count 0 00000020:00000040:3.0:1780340976.013788:0:10290:0:(genops.c:900:class_export_put()) PUTting export ffff8c0442c08800 : new refcount 4 00000100:00000040:3.0:1780340976.013841:0:3662:0:(client.c:3098:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969444 00000100:00000040:3.0:1780340976.013847:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2ed80 x1866818961277312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1780340976.013856:0:3662:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:3.0:1780340976.013859:0:3662:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:3.0:1780340976.013870:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2ed80 x1866818961277312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340992 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340976.013877:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961277312:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1780340976.013882:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2ed80 x1866818961277312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340992 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340976.013891:0:3662:0:(genops.c:1244:class_import_put()) import ffff8c0346ee9000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00080000:2.0:1780340976.014721:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1780340976.014726:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000020:00000040:2.0:1780340976.521905:0:90579:0:(genops.c:1231:class_import_get()) import ffff8c0450113000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1780340976.521942:0:90579:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000089525d21] to pc [ptlrpcd_00_03+3] req@ffff8c046ba2c700 x1866818961277440/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340976.522054:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2c700 x1866818961277440/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340976.522069:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961277440:0@lo:41:osp-pre-1-0.0 00000100:00000040:3.0:1780340976.522096:0:3662:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2c700 x1866818961277440/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340992 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340976.522104:0:3662:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340976.522141:0:3662:0:(events.c:337:request_in_callback()) incoming req@ffff8c045f292d80 x1866818961277440 msgsize 224 00000100:00100000:3.0:1780340976.522145:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340976.522164:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2c700 x1866818961277440/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340992 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340976.522175:0:3662:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3543 usecs (4 jiffies) 00000100:00100000:2.0:1780340976.522241:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961277440 00000100:00100000:2.0:1780340976.522248:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961277440 00000020:00000040:2.0:1780340976.522250:0:22660:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277530c 00000020:00000040:2.0:1780340976.522254:0:22660:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c04514b0800 refcount=5 00000100:00000040:2.0:1780340976.522288:0:22660:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1780340976.522322:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4014 00000100:00000040:2.0:1780340976.522326:0:22660:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c04514b0800 : new rpc_count 1 00000100:00000040:2.0:1780340976.522331:0:22660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c045f292d80 x1866818961277440/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:402/0 lens 224/0 e 0 to 0 dl 1780340987 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340976.522343:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961277440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1780340976.522378:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00010000:00000040:2.0:1780340976.522389:0:22660:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961277440 00000100:00000040:2.0:1780340976.522398:0:22660:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:2.0:1780340976.522404:0:22660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340976.522421:0:22660:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8c046ba2c700 x1866818961277440/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340992 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340976.522439:0:22660:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:2.0:1780340976.522444:0:22660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f292d80 x1866818961277440/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:402/0 lens 224/368 e 0 to 0 dl 1780340987 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340976.522453:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f292d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961277440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340976.522460:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4014 00000100:00000040:2.0:1780340976.522463:0:22660:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c04514b0800 : new rpc_count 0 00000020:00000040:2.0:1780340976.522471:0:22660:0:(genops.c:900:class_export_put()) PUTting export ffff8c04514b0800 : new refcount 4 00000100:00000040:2.0:1780340976.522498:0:3662:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1780340976.522503:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2c700 x1866818961277440/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340992 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1780340976.522513:0:3662:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352898 avail=317195 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023684 state=0: rc = 0 00000100:00000040:2.0:1780340976.522520:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2c700 x1866818961277440/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340992 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340976.522539:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961277440:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1780340976.522545:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2c700 x1866818961277440/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340992 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340976.522556:0:3662:0:(genops.c:1244:class_import_put()) import ffff8c0450113000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:1.0:1780340976.522853:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1780340976.522862:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000100:00000040:1.0:1780340976.522875:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS req@ffff8c046b881880 x1866818961277568/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780340976.522886:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008d5117e0] to pc [ptlrpcd_00_00+0] req@ffff8c046b881880 x1866818961277568/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.522911:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1780340976.522917:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c0346bb9800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1780340976.522924:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff8c046b882a00 x1866818961277696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780340976.522933:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006a116cc2] to pc [ptlrpcd_00_01+1] req@ffff8c046b882a00 x1866818961277696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.522954:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1780340976.522958:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c0346bbc000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:1.0:1780340976.522967:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff8c046b881180 x1866818961277824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780340976.522974:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000592bd064] to pc [ptlrpcd_00_02+2] req@ffff8c046b881180 x1866818961277824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.522984:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1780340976.522988:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c034a39c800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1780340976.522995:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff8c046b882300 x1866818961277952/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780340976.523003:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000aefe8ac4] to pc [ptlrpcd_00_03+3] req@ffff8c046b882300 x1866818961277952/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340976.523009:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340976.523013:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1780340976.523016:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c034a39f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340976.523020:0:80497:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3751 00000100:00080000:1.0:1780340976.523024:0:80497:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00000040:1.0:1780340976.523026:0:80497:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 50 to 0@lo 00000100:00000040:1.0:1780340976.523028:0:80497:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 51 to 0@lo 00000020:00000040:1.0:1780340976.523030:0:80497:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f160 00000020:00000040:1.0:1780340976.523033:0:80497:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0475fab800 refcount=4 00000100:00000040:1.0:1780340976.523035:0:80497:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 50 to 0@lo 00000100:00000040:1.0:1780340976.523037:0:80497:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 51 to 0@lo 00000020:00000040:1.0:1780340976.523038:0:80497:0:(genops.c:900:class_export_put()) PUTting export ffff8c0475fab800 : new refcount 3 00000100:00080000:1.0:1780340976.523040:0:80497:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c034a39f800 using connection 192.168.203.116@tcp/0@lo 00000020:00000040:1.0:1780340976.523055:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c034a39f800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:1.0:1780340976.523066:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046b882680 x1866818961278080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780340976.523074:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000eeac354c] to pc [ptlrpcd_rcv+-1] req@ffff8c046b882680 x1866818961278080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.523088:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1780340976.523092:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c0346eef800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1780340976.523098:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff8c046b881f80 x1866818961278208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780340976.523107:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000085f89b02] to pc [ptlrpcd_00_00+0] req@ffff8c046b881f80 x1866818961278208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340976.523114:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340976.523117:0:80497:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1780340976.523119:0:80497:0:(import.c:65:import_set_state_nolock()) ffff8c046b9a9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1780340976.523122:0:80497:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3751 00000100:00080000:1.0:1780340976.523125:0:80497:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00000040:1.0:1780340976.523127:0:80497:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 50 to 0@lo 00000100:00000040:1.0:1780340976.523129:0:80497:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 51 to 0@lo 00000020:00000040:1.0:1780340976.523131:0:80497:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775313 00000020:00000040:1.0:1780340976.523133:0:80497:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0445b41800 refcount=4 00000100:00000040:1.0:1780340976.523136:0:80497:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 50 to 0@lo 00000100:00000040:1.0:1780340976.523138:0:80497:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 51 to 0@lo 00000020:00000040:1.0:1780340976.523140:0:80497:0:(genops.c:900:class_export_put()) PUTting export ffff8c0445b41800 : new refcount 3 00000100:00080000:1.0:1780340976.523142:0:80497:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c046b9a9000 using connection 192.168.203.116@tcp/0@lo 00000020:00000040:1.0:1780340976.523147:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c046b9a9000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:1.0:1780340976.523155:0:80497:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046b881500 x1866818961278336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780340976.523169:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000037a7ac4e] to pc [ptlrpcd_rcv+-1] req@ffff8c046b881500 x1866818961278336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.523175:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1780340976.523179:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c046bae0000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1780340976.523185:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff8c046b883100 x1866818961278464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780340976.523207:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c208fcd6] to pc [ptlrpcd_00_01+1] req@ffff8c046b883100 x1866818961278464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.523213:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:1.0:1780340976.523218:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c0442c0f800 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:1.0:1780340976.523223:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff8c047a8caa00 x1866818961278592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780340976.523230:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000779b64fe] to pc [ptlrpcd_00_02+2] req@ffff8c047a8caa00 x1866818961278592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.523238:0:80497:0:(pinger.c:306:ptlrpc_pinger_main()) next wakeup in 5 (3761) 00000100:00000040:1.0:1780340976.523255:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046b882a00 x1866818961277696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.523264:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961277696:0@lo:400:kworker.0 00000100:00000040:1.0:1780340976.523281:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046b882a00 x1866818961277696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.523287:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340976.523308:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a8c9f80 x1866818961277696 msgsize 224 00000100:00100000:1.0:1780340976.523312:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780340976.523325:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046b882a00 x1866818961277696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.523343:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 7345 usecs (8 jiffies) 00000100:00000040:1.0:1780340976.523351:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046b883100 x1866818961278464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.523358:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961278464:0@lo:400:kworker.0 00000100:00000040:1.0:1780340976.523369:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046b883100 x1866818961278464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340992 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.523375:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340976.523389:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a8cbb80 x1866818961278464 msgsize 224 00000100:00100000:1.0:1780340976.523393:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780340976.523407:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046b883100 x1866818961278464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340992 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.523415:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 8560 usecs (9 jiffies) 00000100:00100000:1.0:1780340976.523428:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00000040:1.0:1780340976.523432:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046b881880 x1866818961277568/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.523439:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961277568:0@lo:400:kworker.0 00000100:00000040:1.0:1780340976.523450:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046b881880 x1866818961277568/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340992 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.523456:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340976.523471:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff8c04505ed450 x1866818961277568 msgsize 224 00000100:00100000:1.0:1780340976.523475:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780340976.523477:0:3660:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1780340976.523489:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046b881880 x1866818961277568/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340992 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.523508:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046b881f80 x1866818961278208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.523527:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961278208:0@lo:400:kworker.0 00000100:00000040:1.0:1780340976.523538:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046b881f80 x1866818961278208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.523544:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340976.523557:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a8c8700 x1866818961278208 msgsize 224 00000100:00100000:1.0:1780340976.523560:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780340976.523572:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046b881f80 x1866818961278208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.523580:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 129607 usecs (130 jiffies) 00000100:00000040:1.0:1780340976.523595:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046b882680 x1866818961278080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.523603:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961278080:0@lo:8:kworker.0 00000100:00000040:1.0:1780340976.523614:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046b882680 x1866818961278080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780341001 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.523634:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340976.523646:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a8ca680 x1866818961278080 msgsize 520 00000100:00100000:1.0:1780340976.523650:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780340976.523662:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046b882680 x1866818961278080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780341001 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.523671:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5433 usecs (6 jiffies) 00000100:00000040:1.0:1780340976.523676:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046b881500 x1866818961278336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.523682:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961278336:0@lo:8:kworker.0 00000100:00000040:1.0:1780340976.523692:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046b881500 x1866818961278336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780341001 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.523698:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340976.523715:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a8c8000 x1866818961278336 msgsize 520 00000100:00100000:1.0:1780340976.523719:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780340976.523731:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046b881500 x1866818961278336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780341001 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.523740:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 9952 usecs (10 jiffies) 00000100:00100000:1.0:1780340976.523794:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961278464 00000100:00100000:1.0:1780340976.523800:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961278464 00000020:00000040:1.0:1780340976.523802:0:25492:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775336 00000020:00000040:1.0:1780340976.523804:0:25492:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0452a6e000 refcount=5 00000020:00000040:1.0:1780340976.523826:0:25492:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00000040:1.0:1780340976.523842:0:25492:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1780340976.523858:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961278080 00000100:00100000:1.0:1780340976.523860:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961278080 00000020:00000040:1.0:1780340976.523862:0:25492:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f175 00000100:00100000:1.0:1780340976.523876:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961278336 00000100:00100000:1.0:1780340976.523879:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961278336 00000020:00000040:1.0:1780340976.523880:0:25492:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775328 00000100:00100000:1.0:1780340976.523894:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684 00000100:00000040:1.0:1780340976.523897:0:25492:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0452a6e000 : new rpc_count 1 00000100:00000040:1.0:1780340976.523902:0:25492:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a8cbb80 x1866818961278464/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:402/0 lens 224/0 e 0 to 0 dl 1780340987 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.523912:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961278464:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1780340976.523927:0:25492:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1866818961278464 00000100:00000040:1.0:1780340976.523933:0:25492:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:1.0:1780340976.523938:0:25492:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340976.523954:0:25492:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046b883100 x1866818961278464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.523969:0:25492:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:1.0:1780340976.523973:0:25492:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8cbb80 x1866818961278464/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:402/0 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.523991:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961278464:12345-0@lo:400:kworker.0 Request processed in 80us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340976.523998:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684 00000100:00000040:1.0:1780340976.524001:0:25492:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0452a6e000 : new rpc_count 0 00000020:00000040:1.0:1780340976.524009:0:25492:0:(genops.c:900:class_export_put()) PUTting export ffff8c0452a6e000 : new refcount 4 00000100:00100000:1.0:1780340976.524019:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6012 00000100:00000040:1.0:1780340976.524023:0:25492:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a8ca680 x1866818961278080/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780340996 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.524029:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3658:x1866818961278080:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1780340976.524046:0:25492:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1780340976.524056:0:25492:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:1.0:1780340976.524058:0:25492:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:1.0:1780340976.524061:0:25492:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340976.524075:0:25492:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8c046b882680 x1866818961278080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780341001 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.524090:0:25492:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:1.0:1780340976.524093:0:25492:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8ca680 x1866818961278080/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1780340996 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.524099:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3658:x1866818961278080:12345-0@lo:8:kworker.0 Request processed in 70us (452us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340976.524104:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6012 00000100:00100000:1.0:1780340976.524114:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6013 00000100:00000040:1.0:1780340976.524117:0:25492:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a8c8000 x1866818961278336/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780340996 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.524123:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3658:x1866818961278336:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1780340976.524139:0:25492:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1780340976.524146:0:25492:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:1.0:1780340976.524149:0:25492:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:1.0:1780340976.524151:0:25492:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340976.524164:0:25492:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8c046b881500 x1866818961278336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780341001 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.524174:0:25492:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:1.0:1780340976.524178:0:25492:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8c8000 x1866818961278336/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1780340996 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.524185:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:3658:x1866818961278336:12345-0@lo:8:kworker.0 Request processed in 61us (468us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340976.524191:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6013 00000100:00100000:1.0:1780340976.524208:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961277568 00000100:00100000:1.0:1780340976.524212:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961277568 00000020:00000040:1.0:1780340976.524214:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:1.0:1780340976.524216:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=20 00000100:00000040:1.0:1780340976.524225:0:90573:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1780340976.524243:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00000040:1.0:1780340976.524245:0:90573:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:1.0:1780340976.524249:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c04505ed450 x1866818961277568/t0(0) o400->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:402/0 lens 224/0 e 0 to 0 dl 1780340987 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.524258:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04505ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3660:x1866818961277568:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1780340976.524266:0:90573:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961277568 00000100:00000040:1.0:1780340976.524271:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:1.0:1780340976.524274:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340976.524288:0:90573:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046b881880 x1866818961277568/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.524311:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:1.0:1780340976.524316:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c04505ed450 x1866818961277568/t0(0) o400->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:402/0 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.524322:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04505ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:3660:x1866818961277568:12345-0@lo:400:kworker.0 Request processed in 66us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340976.524328:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00000040:1.0:1780340976.524330:0:90573:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:1.0:1780340976.524335:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 19 00000100:00100000:1.0:1780340976.524358:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961277696 00000100:00100000:1.0:1780340976.524362:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961277696 00000020:00000040:1.0:1780340976.524364:0:63711:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277546a 00000020:00000040:1.0:1780340976.524366:0:63711:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0458280800 refcount=5 00000020:00000040:1.0:1780340976.524372:0:63711:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff8c0445ba19c0) now 14 - evictor 00000100:00000040:1.0:1780340976.524386:0:63711:0:(service.c:1435:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1780340976.524399:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961278208 00000100:00100000:1.0:1780340976.524401:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961278208 00000020:00000040:1.0:1780340976.524403:0:63711:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775471 00000020:00000040:1.0:1780340976.524405:0:63711:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046b908800 refcount=5 00000100:00100000:1.0:1780340976.524425:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1521 00000100:00000040:1.0:1780340976.524427:0:63711:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0458280800 : new rpc_count 1 00000100:00000040:1.0:1780340976.524431:0:63711:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a8c9f80 x1866818961277696/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:402/0 lens 224/0 e 0 to 0 dl 1780340987 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.524441:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961277696:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1780340976.524449:0:63711:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961277696 00000100:00000040:1.0:1780340976.524453:0:63711:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:1.0:1780340976.524456:0:63711:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340976.524471:0:63711:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046b882a00 x1866818961277696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.524495:0:63711:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:1.0:1780340976.524502:0:63711:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8c9f80 x1866818961277696/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:402/0 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.524510:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961277696:12345-0@lo:400:kworker.0 Request processed in 71us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340976.524515:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1521 00000100:00000040:1.0:1780340976.524517:0:63711:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0458280800 : new rpc_count 0 00000020:00000040:1.0:1780340976.524522:0:63711:0:(genops.c:900:class_export_put()) PUTting export ffff8c0458280800 : new refcount 4 00000100:00100000:1.0:1780340976.524531:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1522 00000100:00000040:1.0:1780340976.524533:0:63711:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046b908800 : new rpc_count 1 00000100:00000040:1.0:1780340976.524536:0:63711:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a8c8700 x1866818961278208/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:402/0 lens 224/0 e 0 to 0 dl 1780340987 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.524545:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961278208:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1780340976.524554:0:63711:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961278208 00000100:00000040:1.0:1780340976.524558:0:63711:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:1.0:1780340976.524561:0:63711:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340976.524574:0:63711:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046b881f80 x1866818961278208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.524585:0:63711:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:1.0:1780340976.524588:0:63711:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8c8700 x1866818961278208/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:402/0 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.524595:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961278208:12345-0@lo:400:kworker.0 Request processed in 52us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340976.524600:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1522 00000100:00000040:1.0:1780340976.524602:0:63711:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046b908800 : new rpc_count 0 00000020:00000040:1.0:1780340976.524612:0:63711:0:(genops.c:900:class_export_put()) PUTting export ffff8c046b908800 : new refcount 4 00000100:00000040:1.0:1780340976.524663:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046b882680 x1866818961278080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780341001 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340976.524673:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340976.524677:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:1.0:1780340976.524681:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046b882680 x1866818961278080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780341001 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.524687:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b882680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961278080:0@lo:8:kworker.0 00000100:00000040:1.0:1780340976.524698:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046b881500 x1866818961278336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780341001 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340976.524704:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c046b9a9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1780340976.524707:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:1.0:1780340976.524710:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046b881500 x1866818961278336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780341001 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.524716:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961278336:0@lo:8:kworker.0 00000100:00000040:1.0:1780340976.524720:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046b882680 x1866818961278080/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780341001 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780340976.524729:0:3658:0:(genops.c:1244:class_import_put()) import ffff8c034a39f800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1780340976.524736:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046b881500 x1866818961278336/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780341001 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780340976.524742:0:3658:0:(genops.c:1244:class_import_put()) import ffff8c046b9a9000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:1.0:1780340976.524783:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046b881880 x1866818961277568/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.524792:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046b881880 x1866818961277568/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.524818:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961277568:0@lo:400:kworker.0 00000100:00000040:1.0:1780340976.524833:0:3660:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:1.0:1780340976.524837:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046b881f80 x1866818961278208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.524845:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046b881f80 x1866818961278208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.524851:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b881f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961278208:0@lo:400:kworker.0 00000100:00000040:1.0:1780340976.524860:0:3660:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1780340976.524863:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046b882a00 x1866818961277696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.524870:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046b882a00 x1866818961277696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.524877:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961277696:0@lo:400:kworker.0 00000100:00000040:1.0:1780340976.524886:0:3660:0:(client.c:3098:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969457 00000100:00000040:1.0:1780340976.524889:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046b883100 x1866818961278464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.524896:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046b883100 x1866818961278464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.524901:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961278464:0@lo:400:kworker.0 00000100:00000040:1.0:1780340976.524906:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046b881880 x1866818961277568/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780340976.524913:0:3660:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000100:00000040:1.0:1780340976.524924:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046b881f80 x1866818961278208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780340976.524930:0:3660:0:(genops.c:1244:class_import_put()) import ffff8c0346eef800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:1.0:1780340976.524934:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046b882a00 x1866818961277696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780340976.524939:0:3660:0:(genops.c:1244:class_import_put()) import ffff8c0346bb9800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1780340976.524943:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046b883100 x1866818961278464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780340976.524948:0:3660:0:(genops.c:1244:class_import_put()) import ffff8c046bae0000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00080000:2.0:1780340976.526238:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:2.0:1780340976.526245:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff8c0445ba19c0) now 14 - evictor 00000100:00080000:2.0:1780340976.526250:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1780340976.526252:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00000040:2.0:1780340976.526266:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046b882300 x1866818961277952/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340976.526278:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961277952:0@lo:400:kworker.0 00000100:00000040:2.0:1780340976.526299:0:3662:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046b882300 x1866818961277952/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340992 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340976.526306:0:3662:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340976.526330:0:3662:0:(events.c:337:request_in_callback()) incoming req@ffff8c046ba2c700 x1866818961277952 msgsize 224 00000100:00100000:2.0:1780340976.526334:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340976.526347:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046b882300 x1866818961277952/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340992 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340976.526357:0:3662:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 845066 usecs (846 jiffies) 00000100:00100000:2.0:1780340976.526368:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00000040:2.0:1780340976.526373:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046b881180 x1866818961277824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340976.526381:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961277824:0@lo:400:kworker.0 00000100:00000040:2.0:1780340976.526391:0:3662:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046b881180 x1866818961277824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340976.526398:0:3662:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340976.526415:0:3662:0:(events.c:337:request_in_callback()) incoming req@ffff8c046ba2f800 x1866818961277824 msgsize 224 00000100:00100000:2.0:1780340976.526419:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340976.526431:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046b881180 x1866818961277824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340976.526439:0:3662:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7006 usecs (8 jiffies) 00000100:00000040:2.0:1780340976.526444:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c047a8caa00 x1866818961278592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340976.526453:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961278592:0@lo:400:kworker.0 00000100:00000040:2.0:1780340976.526462:0:3662:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c047a8caa00 x1866818961278592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340976.526469:0:3662:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340976.526476:0:3662:0:(events.c:337:request_in_callback()) incoming req@ffff8c046ba2ed80 x1866818961278592 msgsize 224 00000100:00100000:2.0:1780340976.526480:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340976.526489:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c047a8caa00 x1866818961278592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340976.526497:0:3662:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 6883 usecs (7 jiffies) 00000100:00100000:2.0:1780340976.526513:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961277824 00000100:00100000:2.0:1780340976.526518:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961277824 00000020:00000040:2.0:1780340976.526520:0:70100:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f208 00000020:00000040:2.0:1780340976.526523:0:70100:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046ba26800 refcount=5 00000020:00000040:2.0:1780340976.526532:0:70100:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff8c03475519c0) now 10 - evictor 00000100:00000040:2.0:1780340976.526545:0:70100:0:(service.c:1435:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1780340976.526560:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961278592 00000100:00100000:2.0:1780340976.526562:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961278592 00000020:00000040:2.0:1780340976.526563:0:70100:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775478 00000020:00000040:2.0:1780340976.526566:0:70100:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a0a2800 refcount=5 00000100:00100000:2.0:1780340976.526579:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1523 00000100:00000040:2.0:1780340976.526582:0:70100:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046ba26800 : new rpc_count 1 00000100:00000040:2.0:1780340976.526586:0:70100:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c046ba2f800 x1866818961277824/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:402/0 lens 224/0 e 0 to 0 dl 1780340987 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340976.526605:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961277824:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1780340976.526619:0:70100:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961277824 00000100:00000040:2.0:1780340976.526625:0:70100:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:2.0:1780340976.526628:0:70100:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340976.526642:0:70100:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046b881180 x1866818961277824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340976.526655:0:70100:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:2.0:1780340976.526658:0:70100:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2f800 x1866818961277824/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:402/0 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340976.526665:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1866818961277824:12345-0@lo:400:kworker.0 Request processed in 62us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340976.526671:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1523 00000100:00000040:2.0:1780340976.526673:0:70100:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046ba26800 : new rpc_count 0 00000020:00000040:2.0:1780340976.526680:0:70100:0:(genops.c:900:class_export_put()) PUTting export ffff8c046ba26800 : new refcount 4 00000100:00100000:2.0:1780340976.526687:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524 00000100:00000040:2.0:1780340976.526689:0:70100:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a0a2800 : new rpc_count 1 00000100:00000040:2.0:1780340976.526692:0:70100:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c046ba2ed80 x1866818961278592/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:402/0 lens 224/0 e 0 to 0 dl 1780340987 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340976.526699:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961278592:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1780340976.526706:0:70100:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961278592 00000100:00000040:2.0:1780340976.526709:0:70100:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:2.0:1780340976.526712:0:70100:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340976.526721:0:70100:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c047a8caa00 x1866818961278592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340976.526729:0:70100:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:2.0:1780340976.526737:0:70100:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2ed80 x1866818961278592/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:402/0 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340976.526744:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961278592:12345-0@lo:400:kworker.0 Request processed in 46us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340976.526749:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524 00000100:00000040:2.0:1780340976.526751:0:70100:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a0a2800 : new rpc_count 0 00000020:00000040:2.0:1780340976.526755:0:70100:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a0a2800 : new refcount 4 00000100:00080000:2.0:1780340976.526781:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:2.0:1780340976.526783:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff8c03475519c0) now 10 - evictor 00000100:00000040:2.0:1780340976.526804:0:3662:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1780340976.526819:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046b881180 x1866818961277824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340976.526826:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046b881180 x1866818961277824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340976.526832:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1866818961277824:0@lo:400:kworker.0 00000100:00000040:2.0:1780340976.526840:0:3662:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1780340976.526842:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c047a8caa00 x1866818961278592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340976.526848:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8caa00 x1866818961278592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340976.526854:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961278592:0@lo:400:kworker.0 00000100:00000040:2.0:1780340976.526858:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046b881180 x1866818961277824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340976.526865:0:3662:0:(genops.c:1244:class_import_put()) import ffff8c0346bbc000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1780340976.526871:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c047a8caa00 x1866818961278592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340976.526886:0:3662:0:(genops.c:1244:class_import_put()) import ffff8c0442c0f800 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00010000:00010000:0.0:1780340976.527009:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340976.527342:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961277952 00000100:00100000:1.0:1780340976.527347:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961277952 00000020:00000040:1.0:1780340976.527349:0:26074:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa246514327752c6 00000020:00000040:1.0:1780340976.527351:0:26074:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0475fad800 refcount=7 00000100:00000040:1.0:1780340976.527364:0:26074:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1780340976.527410:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4015 00000100:00000040:1.0:1780340976.527413:0:26074:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0475fad800 : new rpc_count 1 00000100:00000040:1.0:1780340976.527417:0:26074:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c046ba2c700 x1866818961277952/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:402/0 lens 224/0 e 0 to 0 dl 1780340987 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.527426:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961277952:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1780340976.527437:0:26074:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1866818961277952 00000100:00000040:1.0:1780340976.527441:0:26074:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:1.0:1780340976.527444:0:26074:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340976.527461:0:26074:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046b882300 x1866818961277952/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340976.527481:0:26074:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:1.0:1780340976.527485:0:26074:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2c700 x1866818961277952/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:402/0 lens 224/224 e 0 to 0 dl 1780340987 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340976.527492:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961277952:12345-0@lo:400:kworker.0 Request processed in 67us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340976.527503:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4015 00000100:00000040:1.0:1780340976.527505:0:26074:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0475fad800 : new rpc_count 0 00000020:00000040:1.0:1780340976.527510:0:26074:0:(genops.c:900:class_export_put()) PUTting export ffff8c0475fad800 : new refcount 6 00000100:00000040:2.0:1780340976.527553:0:3662:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:2.0:1780340976.527557:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046b882300 x1866818961277952/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340976.527564:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046b882300 x1866818961277952/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340976.527570:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961277952:0@lo:400:kworker.0 00000100:00000040:2.0:1780340976.527573:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046b882300 x1866818961277952/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340992 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340976.527580:0:3662:0:(genops.c:1244:class_import_put()) import ffff8c034a39c800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000020:00000040:2.0:1780340977.033928:0:90583:0:(genops.c:1231:class_import_get()) import ffff8c046bae0000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1780340977.033968:0:90583:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006a73e119] to pc [ptlrpcd_00_03+3] req@ffff8c046ba2df80 x1866818961278720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340977.034059:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2df80 x1866818961278720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340977.034073:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961278720:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1780340977.034099:0:3662:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2df80 x1866818961278720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340993 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340977.034108:0:3662:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340977.034142:0:3662:0:(events.c:337:request_in_callback()) incoming req@ffff8c046ba2ce00 x1866818961278720 msgsize 224 00000100:00100000:2.0:1780340977.034147:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340977.034166:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2df80 x1866818961278720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340993 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340977.034178:0:3662:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 8351 usecs (9 jiffies) 00000100:00100000:2.0:1780340977.034209:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961278720 00000100:00100000:2.0:1780340977.034223:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961278720 00000020:00000040:2.0:1780340977.034226:0:8403:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775336 00000020:00000040:2.0:1780340977.034230:0:8403:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0452a6e000 refcount=5 00000100:00000040:2.0:1780340977.034250:0:8403:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:2.0:1780340977.034273:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192 00000100:00000040:2.0:1780340977.034276:0:8403:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0452a6e000 : new rpc_count 1 00000100:00000040:2.0:1780340977.034280:0:8403:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c046ba2ce00 x1866818961278720/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:403/0 lens 224/0 e 0 to 0 dl 1780340988 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340977.034291:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961278720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780340977.034316:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:2.0:1780340977.034326:0:8403:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1866818961278720 00000100:00000040:2.0:1780340977.034336:0:8403:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:2.0:1780340977.034341:0:8403:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340977.034359:0:8403:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8c046ba2df80 x1866818961278720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340993 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340977.034376:0:8403:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:2.0:1780340977.034380:0:8403:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2ce00 x1866818961278720/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:403/0 lens 224/368 e 0 to 0 dl 1780340988 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340977.034387:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961278720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340977.034393:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192 00000100:00000040:2.0:1780340977.034396:0:8403:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0452a6e000 : new rpc_count 0 00000020:00000040:2.0:1780340977.034404:0:8403:0:(genops.c:900:class_export_put()) PUTting export ffff8c0452a6e000 : new refcount 4 00000100:00000040:2.0:1780340977.034436:0:3662:0:(client.c:3098:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969457 00000100:00000040:2.0:1780340977.034441:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2df80 x1866818961278720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1780340977.034450:0:3662:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:2.0:1780340977.034453:0:3662:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:2.0:1780340977.034466:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2df80 x1866818961278720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340993 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340977.034472:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961278720:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1780340977.034478:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2df80 x1866818961278720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340993 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340977.034487:0:3662:0:(genops.c:1244:class_import_put()) import ffff8c046bae0000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000020:00000040:1.0:1780340977.034677:0:72688:0:(genops.c:1231:class_import_get()) import ffff8c034a39c800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1780340977.034693:0:72688:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000209a824f] to pc [ptlrpcd_00_00+0] req@ffff8c047a8c9500 x1866818961278848/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340977.034730:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:1.0:1780340977.034738:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c047a8c9500 x1866818961278848/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340977.034746:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961278848:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1780340977.034785:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c047a8c9500 x1866818961278848/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340993 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340977.034792:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340977.034823:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a8cb480 x1866818961278848 msgsize 224 00000100:00100000:1.0:1780340977.034827:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780340977.034842:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c047a8c9500 x1866818961278848/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340993 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340977.034852:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 842655 usecs (843 jiffies) 00000100:00100000:2.0:1780340977.037038:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961278848 00000100:00100000:2.0:1780340977.037051:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961278848 00000020:00000040:2.0:1780340977.037054:0:22660:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa246514327752c6 00000020:00000040:2.0:1780340977.037059:0:22660:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0475fad800 refcount=7 00000100:00000040:2.0:1780340977.037089:0:22660:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1780340977.037123:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4016 00000100:00000040:2.0:1780340977.037126:0:22660:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0475fad800 : new rpc_count 1 00000100:00000040:2.0:1780340977.037132:0:22660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a8cb480 x1866818961278848/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:403/0 lens 224/0 e 0 to 0 dl 1780340988 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340977.037144:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1866818961278848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1780340977.037179:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445199872 avail 1298960384 00010000:00000040:2.0:1780340977.037190:0:22660:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1866818961278848 00000100:00000040:2.0:1780340977.037199:0:22660:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:2.0:1780340977.037204:0:22660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340977.037251:0:22660:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8c047a8c9500 x1866818961278848/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340993 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340977.037282:0:22660:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:2.0:1780340977.037286:0:22660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8cb480 x1866818961278848/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:403/0 lens 224/368 e 0 to 0 dl 1780340988 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340977.037295:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1866818961278848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 153us (2471us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340977.037324:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4016 00000100:00000040:2.0:1780340977.037328:0:22660:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0475fad800 : new rpc_count 0 00000020:00000040:2.0:1780340977.037336:0:22660:0:(genops.c:900:class_export_put()) PUTting export ffff8c0475fad800 : new refcount 6 00000100:00000040:1.0:1780340977.037403:0:3660:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:1.0:1780340977.037410:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c047a8c9500 x1866818961278848/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1780340977.037421:0:3660:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352832 avail=317129 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023573 state=0: rc = 0 00000100:00000040:1.0:1780340977.037429:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8c9500 x1866818961278848/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340993 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340977.037436:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1866818961278848:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1780340977.037452:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c047a8c9500 x1866818961278848/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340993 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780340977.037461:0:3660:0:(genops.c:1244:class_import_put()) import ffff8c034a39c800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00010000:00010000:1.0:1780340977.545929:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1780340977.985090:0:93007:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1780340977.985093:0:93007:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1780340977.985094:0:93007:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1780340977.985211:0:93007:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8c0351be9000 00000020:01000004:2.0:1780340977.985225:0:93007:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1780340977.985239:0:93007:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1780340977.985250:0:93007:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8c047ac719c0) 00000020:00000040:2.0:1780340977.985255:0:93007:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c0351bee800 with handle 0xa24651432776216 to hash 00000020:00000040:2.0:1780340977.985261:0:93007:0:(genops.c:900:class_export_put()) PUTting export ffff8c0351bee800 : new refcount 1 00000020:00000040:2.0:1780340977.985270:0:93007:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff8c047ac719c0) now 2 - obd_device_list 00000020:00000080:2.0:1780340977.985274:0:93007:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00000100:00000040:3.0:1780340978.225859:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c04505ee850 x1866818940544896 msgsize 224 00000100:00100000:3.0:1780340978.225873:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00000040:3.0:1780340978.225875:0:3652:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780340978.226549:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c045f290a80 x1866818940545024 msgsize 224 00000100:00100000:3.0:1780340978.226567:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340978.227819:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940545024 00000100:00100000:1.0:1780340978.227834:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940545024 00000020:00000040:1.0:1780340978.227836:0:64454:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa246514327752cd 00000020:00000040:1.0:1780340978.227842:0:64454:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0475faa800 refcount=51 00000020:00000040:1.0:1780340978.227860:0:64454:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff8c0445ba19c0) now 14 - evictor 00000100:00000040:1.0:1780340978.227882:0:64454:0:(service.c:1435:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1780340978.227915:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1525 00000100:00000040:1.0:1780340978.227918:0:64454:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0475faa800 : new rpc_count 1 00000100:00000040:1.0:1780340978.227926:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c045f290a80 x1866818940545024/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:404/0 lens 224/0 e 0 to 0 dl 1780340989 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340978.227938:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+51:2409:x1866818940545024:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000040:1.0:1780340978.227960:0:64454:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 120259084436, transno 0, xid 1866818940545024 00000100:00000040:1.0:1780340978.227971:0:64454:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 9 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340978.227977:0:64454:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:1.0:1780340978.228018:0:64454:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 8 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340978.228024:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f290a80 x1866818940545024/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:404/0 lens 224/224 e 0 to 0 dl 1780340989 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340978.228034:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+51:2409:x1866818940545024:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 98us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340978.228041:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1525 00000100:00000040:1.0:1780340978.228044:0:64454:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0475faa800 : new rpc_count 0 00000020:00000040:1.0:1780340978.228054:0:64454:0:(genops.c:900:class_export_put()) PUTting export ffff8c0475faa800 : new refcount 50 00000100:00080000:3.0:1780340978.229142:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1780340978.229149:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff8c0445ba19c0) now 14 - evictor 00000100:00000040:1.0:1780340978.230316:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a8c9500 x1866818940545408 msgsize 224 00000100:00100000:1.0:1780340978.230342:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00000040:1.0:1780340978.230383:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a8c9880 x1866818940545152 msgsize 224 00000100:00100000:1.0:1780340978.230388:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340978.230557:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940545408 00000100:00100000:2.0:1780340978.230567:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940545408 00000020:00000040:2.0:1780340978.230570:0:25488:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277567e 00000020:00000040:2.0:1780340978.230574:0:25488:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047570b000 refcount=7 00000020:00000040:2.0:1780340978.230587:0:25488:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00000040:2.0:1780340978.230624:0:25488:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1780340978.230726:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2685 00000100:00000040:2.0:1780340978.230730:0:25488:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047570b000 : new rpc_count 1 00000100:00000040:2.0:1780340978.230737:0:25488:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a8c9500 x1866818940545408/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:404/0 lens 224/0 e 0 to 0 dl 1780340989 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.230750:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2410:x1866818940545408:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000040:2.0:1780340978.230800:0:25488:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818940545408 00000100:00000040:2.0:1780340978.230811:0:25488:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 9 to 192.168.203.16@tcp 00000100:00000040:2.0:1780340978.230838:0:25488:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:2.0:1780340978.230872:0:25488:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 8 to 192.168.203.16@tcp 00000100:00000040:2.0:1780340978.230884:0:25488:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8c9500 x1866818940545408/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:404/0 lens 224/224 e 0 to 0 dl 1780340989 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.230893:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2410:x1866818940545408:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 146us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340978.230900:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2685 00000100:00000040:2.0:1780340978.230903:0:25488:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047570b000 : new rpc_count 0 00000020:00000040:2.0:1780340978.230912:0:25488:0:(genops.c:900:class_export_put()) PUTting export ffff8c047570b000 : new refcount 6 00000100:00100000:3.0:1780340978.231783:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940545152 00000100:00100000:3.0:1780340978.231792:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940545152 00000020:00000040:3.0:1780340978.231803:0:63712:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa246514327748d9 00000020:00000040:3.0:1780340978.231806:0:63712:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047b1fc000 refcount=11 00000020:00000040:3.0:1780340978.231817:0:63712:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff8c03475519c0) now 10 - evictor 00000100:00000040:3.0:1780340978.231828:0:63712:0:(service.c:1435:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1780340978.231853:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1526 00000100:00000040:3.0:1780340978.231856:0:63712:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047b1fc000 : new rpc_count 1 00000100:00000040:3.0:1780340978.231861:0:63712:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a8c9880 x1866818940545152/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:404/0 lens 224/0 e 0 to 0 dl 1780340989 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.231872:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2410:x1866818940545152:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000040:3.0:1780340978.231887:0:63712:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 81604378768, transno 0, xid 1866818940545152 00000100:00000040:3.0:1780340978.231894:0:63712:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 9 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340978.231897:0:63712:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340978.231920:0:63712:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 8 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340978.231924:0:63712:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8c9880 x1866818940545152/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:404/0 lens 224/224 e 0 to 0 dl 1780340989 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.231932:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2410:x1866818940545152:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 62us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340978.231938:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1526 00000100:00000040:3.0:1780340978.231941:0:63712:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047b1fc000 : new rpc_count 0 00000020:00000040:3.0:1780340978.231948:0:63712:0:(genops.c:900:class_export_put()) PUTting export ffff8c047b1fc000 : new refcount 10 00000100:00000040:3.0:1780340978.231987:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c045f291c00 x1866818940545280 msgsize 520 00000100:00100000:3.0:1780340978.231993:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340978.232066:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940545280 00000100:00080000:1.0:1780340978.232177:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:1.0:1780340978.232183:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff8c03475519c0) now 10 - evictor 00000100:00080000:1.0:1780340978.232187:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1780340978.232188:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00100000:3.0:1780340978.232248:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940545280 00000020:00000040:3.0:1780340978.232250:0:25489:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277591e 00000100:00100000:1.0:1780340978.232310:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6014 00000100:00000040:1.0:1780340978.232315:0:25494:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c045f291c00 x1866818940545280/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780340998 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340978.232325:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2406:x1866818940545280:12345-192.168.203.16@tcp:8:kworker.0 00010000:00020000:1.0:1780340978.232346:0:25494:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.203.16@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:1.0:1780340978.232360:0:25494:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 9 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340978.232363:0:25494:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8c0346e3c480 refcount 9 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340978.232366:0:25494:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:1.0:1780340978.232386:0:25494:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 8 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340978.232391:0:25494:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f291c00 x1866818940545280/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1780340998 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340978.232399:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f291c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2406:x1866818940545280:12345-192.168.203.16@tcp:8:kworker.0 Request processed in 74us (410us total) trans 0 rc -19/-19 00000100:00100000:1.0:1780340978.232405:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6014 00000100:00100000:0.0:1780340978.235951:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940544896 00000100:00100000:0.0:1780340978.235966:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940544896 00000020:00000040:0.0:1780340978.235969:0:90570:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775440 00000020:00000040:0.0:1780340978.235974:0:90570:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0346fd5800 refcount=9 00000100:00000040:0.0:1780340978.235999:0:90570:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1780340978.236080:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 189 00000100:00000040:0.0:1780340978.236084:0:90570:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0346fd5800 : new rpc_count 1 00000100:00000040:0.0:1780340978.236091:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c04505ee850 x1866818940544896/t0(0) o400->540506f4-4e8e-4fb6-b537-f45d44291964@192.168.203.16@tcp:404/0 lens 224/0 e 0 to 0 dl 1780340989 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.236105:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04505ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2409:x1866818940544896:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000040:0.0:1780340978.236124:0:90570:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818940544896 00000100:00000040:0.0:1780340978.236134:0:90570:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 9 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340978.236139:0:90570:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:0.0:1780340978.236192:0:90570:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 8 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340978.236204:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c04505ee850 x1866818940544896/t0(0) o400->540506f4-4e8e-4fb6-b537-f45d44291964@192.168.203.16@tcp:404/0 lens 224/224 e 0 to 0 dl 1780340989 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.236214:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04505ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2409:x1866818940544896:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 111us (10355us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340978.236222:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 189 00000100:00000040:0.0:1780340978.236225:0:90570:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0346fd5800 : new rpc_count 0 00000020:00000040:0.0:1780340978.236235:0:90570:0:(genops.c:900:class_export_put()) PUTting export ffff8c0346fd5800 : new refcount 8 00010000:00010000:1.0:1780340978.583736:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000040:3.0:1780340978.844473:0:93007:0:(osd_compat.c:233:osd_last_rcvd_subdir_count()) read last_rcvd header, uuid = lustre-OST0000_UUID, subdir count = 32 00100000:10000000:3.0:1780340978.850516:0:93007:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1780340978.852125:0:93007:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1780340978.852150:0:93007:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1780340978.852171:0:93007:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1780340978.852190:0:93007:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1780340978.852209:0:93007:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1780340978.852228:0:93007:0:(osd_scrub.c:1794:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1780340978.852847:0:93007:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000040:3.0:1780340978.853041:0:93007:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff8c047ac719c0) now 3 - setup 00000020:00000080:3.0:1780340978.853046:0:93007:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1780340978.853057:0:93007:0:(osd_handler.c:8933:osd_obd_connect()) connect #0 00000020:00000040:3.0:1780340978.853063:0:93007:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c046bae2800 with handle 0xa2465143277621d to hash 00000020:00000040:3.0:1780340978.853068:0:93007:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff8c047ac719c0) now 4 - export 00000020:00000040:3.0:1780340978.853071:0:93007:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae2800 : new refcount 1 00000020:00000080:3.0:1780340978.853074:0:93007:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa2465143277621d 00000020:00000040:3.0:1780340978.853077:0:93007:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277621d 00000020:00000040:3.0:1780340978.853079:0:93007:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae2800 refcount=2 00000020:01000004:3.0:1780340978.853084:0:93007:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1780340978.853106:0:93007:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.203.116@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1780340978.853109:0:93007:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.116@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1780340978.853114:0:93007:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1780340978.853140:0:93007:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1780340978.853144:0:93007:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.116@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000020:00000040:3.0:1780340978.853968:0:93007:0:(genops.c:889:class_export_get()) GET export ffff8c0351bee800 refcount=2 00000040:00000040:3.0:1780340978.853974:0:93007:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0461148b40 : new refcount 2 00000040:00000040:2.0:1780340978.869567:0:93007:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c0461148b40 : new refcount 1 00000040:01000000:2.0:1780340978.869575:0:93007:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.116@tcp ctxt 0 is initialized 10000000:00000040:2.0:1780340978.869580:0:93007:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0461148b40 : new refcount 2 10000000:00000040:2.0:1780340978.869582:0:93007:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c0461148b40 : new refcount 1 00000020:00000040:2.0:1780340978.869585:0:93007:0:(obd_config.c:994:class_incref()) incref MGC192.168.203.116@tcp (ffff8c0471e119c0) now 6 - mgc_fs 00000020:01000004:2.0:1780340978.869627:0:93007:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.116@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1780340978.869632:0:93007:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1780340978.869633:0:93007:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1780340978.869635:0:93007:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340978.869636:0:93007:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340978.869637:0:93007:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340978.869638:0:93007:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340978.869639:0:93007:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780340978.869641:0:93007:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340978.869642:0:93007:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1780340978.869646:0:93007:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1780340978.869648:0:93007:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1780340978.869649:0:93007:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1780340978.869650:0:93007:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1780340978.869651:0:93007:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1780340978.869652:0:93007:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1780340978.869652:0:93007:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1780340978.869654:0:93007:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1780340978.869654:0:93007:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1780340978.869655:0:93007:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000020:00000040:2.0:1780340978.869662:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 10000000:01000000:2.0:1780340978.869944:0:93007:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:2.0:1780340978.869970:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2df80 x1866818961278976/t0(0) o253->MGC192.168.203.116@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.869985:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961278976:0@lo:253:mount.lustre.0 00000100:00000040:2.0:1780340978.870012:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2df80 x1866818961278976/t0(0) o253->MGC192.168.203.116@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780340994 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340978.870020:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340978.870063:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c046b851050 x1866818961278976 msgsize 4848 00000100:00100000:2.0:1780340978.870068:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340978.870069:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1780340978.870087:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c046ba2df80 x1866818961278976/t0(0) o253->MGC192.168.203.116@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780340994 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.870114:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348210540 going to sleep for 11 seconds 00000100:00100000:0.0:1780340978.870186:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961278976 00000100:00100000:0.0:1780340978.870195:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961278976 00000020:00000040:0.0:1780340978.870198:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:0.0:1780340978.870202:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=20 00000100:00000040:0.0:1780340978.870227:0:90573:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1780340978.870268:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00000040:0.0:1780340978.870272:0:90573:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:0.0:1780340978.870278:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c046b851050 x1866818961278976/t0(0) o253->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 4848/0 e 0 to 0 dl 1780340989 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.870290:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:93007:x1866818961278976:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1780340978.870321:0:90573:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1780340978.870325:0:90573:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1780340978.870339:0:90573:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:0.0:1780340978.870815:0:90573:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961278976 00000100:00000040:0.0:1780340978.870827:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340978.870833:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340978.870859:0:90573:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff8c046ba2df80 x1866818961278976/t0(0) o253->MGC192.168.203.116@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340978.870883:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:0.0:1780340978.870888:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046b851050 x1866818961278976/t0(0) o253->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 4848/4768 e 0 to 0 dl 1780340989 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.870909:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b851050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:93007:x1866818961278976:12345-0@lo:253:mount.lustre.0 Request processed in 622us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340978.870917:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00000040:0.0:1780340978.870920:0:90573:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:0.0:1780340978.870930:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 19 00000100:00000040:3.0:1780340978.871046:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2df80 x1866818961278976/t0(0) o253->MGC192.168.203.116@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340978.871069:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2df80 x1866818961278976/t0(0) o253->MGC192.168.203.116@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780340994 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.871078:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961278976:0@lo:253:mount.lustre.0 00000100:00000040:3.0:1780340978.871086:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2df80 x1866818961278976/t0(0) o253->MGC192.168.203.116@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780340994 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1780340978.871097:0:93007:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1780340978.871100:0:93007:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1780340978.871101:0:93007:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1780340978.871103:0:93007:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780340978.871104:0:93007:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780340978.871106:0:93007:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780340978.871107:0:93007:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780340978.871108:0:93007:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780340978.871110:0:93007:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780340978.871111:0:93007:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000100:00000040:3.0:1780340978.871114:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2df80 x1866818961278976/t0(0) o253->MGC192.168.203.116@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780340994 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340978.871126:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000020:01000004:3.0:1780340978.871142:0:93007:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8c0351be9000 from lustre-OST0000 10000000:01000000:3.0:1780340978.871172:0:93007:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1780340978.871176:0:93007:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:00000040:3.0:1780340978.871184:0:93007:0:(mgc_request.c:108:config_log_get()) log lustre-sptlrpc (ffff8c0445b21e00) refs 5 10000000:01000000:3.0:1780340978.871188:0:93007:0:(mgc_request_server.c:870:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8c0471e119c0 local copy 00000020:00000040:3.0:1780340978.871192:0:93007:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0470f2ca00 refcount=2 00010000:00010000:3.0:1780340978.871201:0:93007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0470f2ca00/0xa24651432775853 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277585a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:3.0:1780340978.871229:0:93007:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c04509be600 : new refcount 2 10000000:00000040:3.0:1780340978.871232:0:93007:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0461148b40 : new refcount 2 10000000:00000040:3.0:1780340978.871235:0:93007:0:(mgc_request_server.c:800:mgc_process_server_cfg_log()) MGC192.168.203.116@tcp: copy local log lustre-sptlrpc 00000020:00000040:3.0:1780340978.871278:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:3.0:1780340978.871283:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=5 obd=MGC192.168.203.116@tcp 00000100:00000040:3.0:1780340978.871304:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c045f291880 x1866818961279104/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.871315:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f291880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961279104:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1780340978.871343:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c045f291880 x1866818961279104/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340978.871351:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340978.871369:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c046b850c50 x1866818961279104 msgsize 512 00000100:00100000:3.0:1780340978.871373:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340978.871375:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780340978.871386:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c045f291880 x1866818961279104/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.871405:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348388780 going to sleep for 11 seconds 00000100:00100000:0.0:1780340978.871512:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961279104 00000100:00100000:0.0:1780340978.871518:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961279104 00000020:00000040:0.0:1780340978.871520:0:90568:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:0.0:1780340978.871522:0:90568:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=20 00000100:00000040:0.0:1780340978.871534:0:90568:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1780340978.871559:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00000040:0.0:1780340978.871562:0:90568:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:0.0:1780340978.871567:0:90568:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c046b850c50 x1866818961279104/t0(0) o501->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 512/0 e 0 to 0 dl 1780340989 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.871578:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:93007:x1866818961279104:12345-0@lo:501:mount.lustre.0 00000040:00000040:0.0:1780340978.871592:0:90568:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-sptlrpc 00000040:00000040:0.0:1780340978.871596:0:90568:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0347781900 : new refcount 2 00000040:00000040:0.0:1780340978.871618:0:90568:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c0347781900 : new refcount 1 00010000:00000040:0.0:1780340978.871622:0:90568:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961279104 00000100:00000040:0.0:1780340978.871627:0:90568:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340978.871631:0:90568:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340978.871649:0:90568:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff8c045f291880 x1866818961279104/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340978.871665:0:90568:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:0.0:1780340978.871681:0:90568:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046b850c50 x1866818961279104/t0(0) o501->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 512/272 e 0 to 0 dl 1780340989 ref 1 fl Interpret:/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.871690:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b850c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:93007:x1866818961279104:12345-0@lo:501:mount.lustre.0 Request processed in 114us (319us total) trans 0 rc -2/-2 00000100:00100000:0.0:1780340978.871702:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00000040:0.0:1780340978.871705:0:90568:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:0.0:1780340978.871711:0:90568:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 19 00000100:00000040:3.0:1780340978.871870:0:93007:0:(client.c:1496:ptlrpc_check_status()) @@@ check status: rc = -2 req@ffff8c045f291880 x1866818961279104/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQU/200/0 rc 0/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340978.871880:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c045f291880 x1866818961279104/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340978.871888:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f291880 x1866818961279104/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 2 fl Interpret:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.871896:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f291880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961279104:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1780340978.871902:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c045f291880 x1866818961279104/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 2 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340978.871910:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000100:00000040:3.0:1780340978.871913:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c045f291880 x1866818961279104/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 1 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340978.871932:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 10000000:01000000:3.0:1780340978.871939:0:93007:0:(mgc_request_server.c:763:mgc_llog_local_copy()) MGC192.168.203.116@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1780340978.871955:0:93007:0:(mgc_request_server.c:893:mgc_get_local_copy()) MGC192.168.203.116@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00000020:00000040:3.0:1780340978.871959:0:93007:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0470f2ca00 refcount=3 00010000:00010000:3.0:1780340978.871963:0:93007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0470f2ca00/0xa24651432775853 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277585a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340978.871972:0:93007:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0470f2ca00/0xa24651432775853 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277585a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340978.871997:0:93007:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8c0351be9000 10000000:01000000:3.0:1780340978.872002:0:93007:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000020:00000040:3.0:1780340978.872005:0:93007:0:(genops.c:889:class_export_get()) GET export ffff8c0475494000 refcount=18 10000000:00000040:3.0:1780340978.872008:0:93007:0:(mgc_request.c:108:config_log_get()) log nodemap (ffff8c047a27f000) refs 4 10000000:01000000:3.0:1780340978.872010:0:93007:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1780340978.872012:0:93007:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:3.0:1780340978.872014:0:93007:0:(genops.c:889:class_export_get()) GET export ffff8c0475494000 refcount=19 10000000:01000000:3.0:1780340978.872017:0:93007:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1780340978.872019:0:93007:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000020:00000040:3.0:1780340978.872022:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00010000:00000040:3.0:1780340978.872033:0:93007:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff8c04428a8100 count: 8 00000020:00000040:3.0:1780340978.872039:0:93007:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c0440030e00 with handle 0xa24651432776224 to hash 00010000:00010000:3.0:1780340978.872044:0:93007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440030e00/0xa24651432776224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340978.872052:0:93007:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0440030e00/0xa24651432776224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340978.872061:0:93007:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0440030e00/0xa24651432776224 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1780340978.872079:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c045f291880 x1866818961279232/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.872089:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f291880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961279232:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1780340978.872102:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c045f291880 x1866818961279232/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340978.872109:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340978.872125:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c0447d20450 x1866818961279232 msgsize 328 00000100:00100000:3.0:1780340978.872129:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340978.872131:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780340978.872141:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c045f291880 x1866818961279232/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.872157:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348388780 going to sleep for 11 seconds 00000100:00100000:2.0:1780340978.872220:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961279232 00000100:00100000:2.0:1780340978.872225:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961279232 00000020:00000040:2.0:1780340978.872227:0:90567:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:2.0:1780340978.872229:0:90567:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=20 00000100:00000040:2.0:1780340978.872242:0:90567:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780340978.872267:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00000040:2.0:1780340978.872270:0:90567:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:2.0:1780340978.872275:0:90567:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0447d20450 x1866818961279232/t0(0) o101->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 328/0 e 0 to 0 dl 1780340989 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.872287:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+20:93007:x1866818961279232:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1780340978.872296:0:90567:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:2.0:1780340978.872303:0:90567:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff8c0477219900 count: 10 00000020:00000040:2.0:1780340978.872309:0:90567:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c03476f8800 with handle 0xa2465143277622b to hash 00010000:00010000:2.0:1780340978.872313:0:90567:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f8800/0xa2465143277622b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432776224 expref: -99 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780340978.872321:0:90567:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff8c047a289800 : new locks_count 16 00000020:00000040:2.0:1780340978.872456:0:90567:0:(genops.c:889:class_export_get()) GET export ffff8c047a289800 refcount=21 00010000:00000040:2.0:1780340978.872473:0:90567:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff8c0477219900) refcount = 10 00010000:00000040:2.0:1780340978.872477:0:90567:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1780340978.872481:0:90567:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c034d9ea600/0xa2465143277585a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775853 expref: 21 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780340978.872488:0:90567:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c03476f9600/0xa24651432775830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775829 expref: 21 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780340978.872495:0:90567:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c0470f2c400/0xa24651432775822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277581b expref: 21 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780340978.872502:0:90567:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c0470f2da00/0xa24651432775814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277580d expref: 21 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780340978.872509:0:90567:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c0470f2dc00/0xa24651432775806 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327757ff expref: 21 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780340978.872519:0:90567:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c0453122200/0xa246514327757f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2670 expref: 8 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780340978.872526:0:90567:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c034d9eba00/0xa246514327757f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327757ea expref: 21 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780340978.872533:0:90567:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c034d9eb400/0xa246514327757e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327757dc expref: 21 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780340978.872540:0:90567:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c0453122400/0xa246514327757d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2669 expref: 8 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340978.872546:0:90567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f8800/0xa2465143277622b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432776224 expref: 21 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340978.872557:0:90567:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f8800/0xa2465143277622b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432776224 expref: 21 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340978.872572:0:90567:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8800, rc 0) 00010000:00000040:2.0:1780340978.872575:0:90567:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961279232 00000100:00000040:2.0:1780340978.872581:0:90567:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:2.0:1780340978.872585:0:90567:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340978.872603:0:90567:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff8c045f291880 x1866818961279232/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340978.872629:0:90567:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:2.0:1780340978.872633:0:90567:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0447d20450 x1866818961279232/t0(0) o101->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 328/344 e 0 to 0 dl 1780340989 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.872641:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:93007:x1866818961279232:12345-0@lo:101:mount.lustre.0 Request processed in 357us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340978.872648:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00000040:2.0:1780340978.872651:0:90567:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:2.0:1780340978.872658:0:90567:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 20 00000100:00000040:3.0:1780340978.872784:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c045f291880 x1866818961279232/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340978.872803:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f291880 x1866818961279232/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.872810:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f291880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961279232:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1780340978.872816:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c045f291880 x1866818961279232/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340978.872824:0:93007:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0440030e00 refcount=4 00010000:00000040:3.0:1780340978.872828:0:93007:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff8c0440030e00, remote cookie: 0xa2465143277622b, flags: 0x0 00010000:00000040:3.0:1780340978.872832:0:93007:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff8c04428a8100) refcount = 8 00010000:00000040:3.0:1780340978.872834:0:93007:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1780340978.872836:0:93007:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c0470f2ca00/0xa24651432775853 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277585a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340978.872852:0:93007:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432775829 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775830 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340978.872857:0:93007:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa2465143277581b lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775822 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340978.872862:0:93007:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa2465143277580d lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775814 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340978.872867:0:93007:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa246514327757ff lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775806 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340978.872872:0:93007:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c03476f9000/0xa246514327757ea lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327757f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340978.872877:0:93007:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c0470f2c000/0xa246514327757dc lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327757e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340978.872882:0:93007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0440030e00/0xa24651432776224 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277622b expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340978.872890:0:93007:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0440030e00/0xa24651432776224 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277622b expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1780340978.872899:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c045f291880 x1866818961279232/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340978.872907:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 10000000:00000040:3.0:1780340978.872911:0:93007:0:(mgc_request.c:108:config_log_get()) log lustre-OST0000 (ffff8c034931ec00) refs 2 00000020:00000040:3.0:1780340978.872914:0:93007:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0440030e00 refcount=3 10000000:00000040:3.0:1780340978.872933:0:93007:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c04509be600 : new refcount 2 10000000:00000040:3.0:1780340978.872941:0:93007:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0461148b40 : new refcount 2 10000000:00000040:3.0:1780340978.872943:0:93007:0:(mgc_request_server.c:800:mgc_process_server_cfg_log()) MGC192.168.203.116@tcp: copy local log lustre-OST0000 00000040:00080000:3.0:1780340978.873067:0:93007:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1780340978.873445:0:93007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1780340978.900293:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1780340978.900516:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1780340978.900534:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1780340978.900546:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1780340978.900556:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1780340978.900567:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1780340978.900600:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1780340978.900605:0:93007:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000020:00000040:1.0:1780340978.900689:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:1.0:1780340978.900696:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=5 obd=MGC192.168.203.116@tcp 00000100:00000040:1.0:1780340978.900732:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c047a8ca300 x1866818961279360/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340978.900746:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961279360:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1780340978.900942:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c047a8ca300 x1866818961279360/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340978.900950:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340978.900988:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c0447d23850 x1866818961279360 msgsize 512 00000100:00100000:1.0:1780340978.900993:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780340978.900995:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1780340978.901054:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c047a8ca300 x1866818961279360/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340978.901080:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b058e40 going to sleep for 11 seconds 00000100:00100000:3.0:1780340978.902528:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961279360 00000100:00100000:3.0:1780340978.902541:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961279360 00000020:00000040:3.0:1780340978.902543:0:90570:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:3.0:1780340978.902548:0:90570:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=21 00000100:00000040:3.0:1780340978.902577:0:90570:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1780340978.902657:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00000040:3.0:1780340978.902661:0:90570:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:3.0:1780340978.902678:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0447d23850 x1866818961279360/t0(0) o501->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 512/0 e 0 to 0 dl 1780340989 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.902691:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:93007:x1866818961279360:12345-0@lo:501:mount.lustre.0 00000040:00000040:3.0:1780340978.902713:0:90570:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-OST0000 00000040:00000040:3.0:1780340978.902716:0:90570:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0347781900 : new refcount 2 00000040:00000040:3.0:1780340978.902808:0:90570:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c0347781900 : new refcount 1 00000020:00000040:3.0:1780340978.902816:0:90570:0:(genops.c:889:class_export_get()) GET export ffff8c047a289800 refcount=22 00000020:00000040:3.0:1780340978.902819:0:90570:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 21 00010000:00000040:3.0:1780340978.902823:0:90570:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961279360 00000100:00000040:3.0:1780340978.902832:0:90570:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:3.0:1780340978.902837:0:90570:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340978.902870:0:90570:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff8c047a8ca300 x1866818961279360/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340978.902899:0:90570:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:3.0:1780340978.902903:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0447d23850 x1866818961279360/t0(0) o501->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 512/272 e 0 to 0 dl 1780340989 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.902912:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:93007:x1866818961279360:12345-0@lo:501:mount.lustre.0 Request processed in 223us (1922us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340978.902934:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00000040:3.0:1780340978.902937:0:90570:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:3.0:1780340978.902946:0:90570:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 20 00000100:00000040:1.0:1780340978.903135:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c047a8ca300 x1866818961279360/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340978.903146:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8ca300 x1866818961279360/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340978.903153:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961279360:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1780340978.903160:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c047a8ca300 x1866818961279360/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780340978.903171:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000100:00000040:1.0:1780340978.903175:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c047a8ca300 x1866818961279360/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780340978.903182:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000020:00000040:1.0:1780340978.903199:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:1.0:1780340978.903203:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=5 obd=MGC192.168.203.116@tcp 00000100:00000040:1.0:1780340978.903223:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c047a8ca300 x1866818961279488/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340978.903234:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961279488:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1780340978.903259:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c047a8ca300 x1866818961279488/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340978.903266:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340978.903285:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c0447d22850 x1866818961279488 msgsize 272 00000100:00100000:1.0:1780340978.903290:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780340978.903292:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1780340978.906308:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c047a8ca300 x1866818961279488/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340978.906492:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b058e40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340978.906839:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961279488 00000100:00100000:0.0:1780340978.906849:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961279488 00000020:00000040:0.0:1780340978.906851:0:90568:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:0.0:1780340978.906855:0:90568:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=21 00000100:00000040:0.0:1780340978.906884:0:90568:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1780340978.906917:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00000040:0.0:1780340978.906920:0:90568:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:0.0:1780340978.906926:0:90568:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0447d22850 x1866818961279488/t0(0) o503->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 272/0 e 0 to 0 dl 1780340989 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.906938:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:93007:x1866818961279488:12345-0@lo:503:mount.lustre.0 00000040:00000040:0.0:1780340978.906977:0:90568:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0347781900 : new refcount 2 00000040:00000040:0.0:1780340978.907025:0:90568:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c0347781900 : new refcount 1 00010000:00000040:0.0:1780340978.907030:0:90568:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961279488 00000100:00000040:0.0:1780340978.907039:0:90568:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340978.907044:0:90568:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340978.907081:0:90568:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff8c047a8ca300 x1866818961279488/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340978.907101:0:90568:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:0.0:1780340978.907105:0:90568:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0447d22850 x1866818961279488/t0(0) o503->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 272/8416 e 0 to 0 dl 1780340989 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.907113:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:93007:x1866818961279488:12345-0@lo:503:mount.lustre.0 Request processed in 177us (3826us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340978.907120:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00000040:0.0:1780340978.907123:0:90568:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:0.0:1780340978.907136:0:90568:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 20 00000100:00000040:1.0:1780340978.907250:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c047a8ca300 x1866818961279488/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340978.907260:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8ca300 x1866818961279488/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340978.907266:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961279488:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1780340978.907272:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c047a8ca300 x1866818961279488/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340978.907286:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c047a8ca300 x1866818961279488/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780340978.907299:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:1.0:1780340978.907306:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000040:00080000:1.0:1780340978.907647:0:93007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:1.0:1780340978.907862:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:1.0:1780340978.907867:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=5 obd=MGC192.168.203.116@tcp 00000100:00000040:1.0:1780340978.907890:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c047a8ca300 x1866818961279616/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340978.907902:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961279616:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1780340978.907925:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c047a8ca300 x1866818961279616/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340978.907932:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340978.907954:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c0447d22c50 x1866818961279616 msgsize 272 00000100:00100000:1.0:1780340978.907958:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780340978.907960:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1780340978.907971:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c047a8ca300 x1866818961279616/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340978.907989:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c047b058e40 going to sleep for 11 seconds 00000100:00100000:0.0:1780340978.908050:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961279616 00000100:00100000:0.0:1780340978.908056:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961279616 00000020:00000040:0.0:1780340978.908058:0:90568:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:0.0:1780340978.908061:0:90568:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=21 00000100:00000040:0.0:1780340978.908072:0:90568:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1780340978.908094:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00000040:0.0:1780340978.908097:0:90568:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:0.0:1780340978.908102:0:90568:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0447d22c50 x1866818961279616/t0(0) o502->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 272/0 e 0 to 0 dl 1780340989 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.908112:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:93007:x1866818961279616:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1780340978.908132:0:90568:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0347781900 : new refcount 2 00000040:00000040:0.0:1780340978.911854:0:90568:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c0347781900 : new refcount 1 00010000:00000040:0.0:1780340978.911867:0:90568:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961279616 00000100:00000040:0.0:1780340978.911882:0:90568:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340978.911889:0:90568:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340978.911941:0:90568:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8c047a8ca300 x1866818961279616/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340978.911966:0:90568:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:0.0:1780340978.911972:0:90568:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0447d22c50 x1866818961279616/t0(0) o502->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 272/8472 e 0 to 0 dl 1780340989 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.911981:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:93007:x1866818961279616:12345-0@lo:502:mount.lustre.0 Request processed in 3870us (4025us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340978.911990:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00000040:0.0:1780340978.911993:0:90568:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:0.0:1780340978.912003:0:90568:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 20 00000100:00000040:3.0:1780340978.913633:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c047a8ca300 x1866818961279616/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340978.913648:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8ca300 x1866818961279616/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.913655:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8ca300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961279616:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1780340978.913663:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c047a8ca300 x1866818961279616/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340978.913680:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c047a8ca300 x1866818961279616/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340978.913700:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:3.0:1780340978.913709:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000040:00080000:3.0:1780340978.913958:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1780340978.913991:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1780340978.914005:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1780340978.914017:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1780340978.914027:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1780340978.914038:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1780340978.914048:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1780340978.914058:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1780340978.914070:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1780340978.914081:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1780340978.914092:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1780340978.914104:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000020:00000040:3.0:1780340978.914111:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:3.0:1780340978.914123:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=5 obd=MGC192.168.203.116@tcp 00000100:00000040:3.0:1780340978.914152:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c045f291880 x1866818961279744/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.914165:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f291880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961279744:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1780340978.914195:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c045f291880 x1866818961279744/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340978.914203:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340978.914237:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c0447d23450 x1866818961279744 msgsize 272 00000100:00100000:3.0:1780340978.914242:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340978.914244:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780340978.914463:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c045f291880 x1866818961279744/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.914492:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0348388300 going to sleep for 11 seconds 00000100:00100000:0.0:1780340978.920030:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961279744 00000100:00100000:0.0:1780340978.920046:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961279744 00000020:00000040:0.0:1780340978.920067:0:90570:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:0.0:1780340978.920072:0:90570:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=21 00000100:00000040:0.0:1780340978.920099:0:90570:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1780340978.920138:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00000040:0.0:1780340978.920142:0:90570:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:0.0:1780340978.920149:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0447d23450 x1866818961279744/t0(0) o502->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 272/0 e 0 to 0 dl 1780340989 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.920163:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:93007:x1866818961279744:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1780340978.920193:0:90570:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0347781900 : new refcount 2 00000040:00000040:0.0:1780340978.920240:0:90570:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c0347781900 : new refcount 1 00010000:00000040:0.0:1780340978.920244:0:90570:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961279744 00000100:00000040:0.0:1780340978.920253:0:90570:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340978.920258:0:90570:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340978.920302:0:90570:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8c045f291880 x1866818961279744/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340978.920336:0:90570:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:0.0:1780340978.920341:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0447d23450 x1866818961279744/t0(0) o502->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 272/8472 e 0 to 0 dl 1780340989 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.920350:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:93007:x1866818961279744:12345-0@lo:502:mount.lustre.0 Request processed in 190us (6112us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340978.920359:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00000040:0.0:1780340978.920361:0:90570:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:0.0:1780340978.920369:0:90570:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 20 00000100:00000040:3.0:1780340978.923152:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c045f291880 x1866818961279744/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340978.923168:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f291880 x1866818961279744/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.923176:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f291880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961279744:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1780340978.923185:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c045f291880 x1866818961279744/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340978.923204:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c045f291880 x1866818961279744/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340978.923226:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:3.0:1780340978.923236:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000040:00080000:3.0:1780340978.923315:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1780340978.923342:0:93007:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 10000000:00000040:3.0:1780340978.923612:0:93007:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c04509be600 : new refcount 1 00000020:00000040:3.0:1780340978.923625:0:93007:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-OST0000 00000020:01000000:3.0:1780340978.927239:0:93011:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1780340978.927253:0:93011:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1780340978.927262:0:93011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1780340978.927264:0:93011:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1780340978.927284:0:93011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1780340978.927301:0:93011:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8c0476588000) 00000020:00000040:3.0:1780340978.927308:0:93011:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c047b064000 with handle 0xa24651432776232 to hash 00000020:00000040:3.0:1780340978.927316:0:93011:0:(genops.c:900:class_export_put()) PUTting export ffff8c047b064000 : new refcount 1 00000020:00000040:3.0:1780340978.927331:0:93011:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff8c0476588000) now 2 - obd_device_list 00000020:00000080:3.0:1780340978.927337:0:93011:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000040:3.0:1780340978.927342:0:93011:0:(obd_config.c:1948:class_config_llog_handler()) For 1.8 interoperability, set this index to '0' 00000020:00000080:3.0:1780340978.927345:0:93011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1780340978.927426:0:93011:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0351be9000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1780340978.927435:0:93011:0:(osd_handler.c:8933:osd_obd_connect()) connect #1 00000020:00000040:3.0:1780340978.927438:0:93011:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c047b065000 with handle 0xa24651432776239 to hash 00000020:00000040:3.0:1780340978.927443:0:93011:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff8c047ac719c0) now 5 - export 00000020:00000040:3.0:1780340978.927447:0:93011:0:(genops.c:900:class_export_put()) PUTting export ffff8c047b065000 : new refcount 1 00000020:00000080:3.0:1780340978.927449:0:93011:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa24651432776239 00000020:00000040:3.0:1780340978.927452:0:93011:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432776239 00000020:00000040:3.0:1780340978.927454:0:93011:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047b065000 refcount=2 00010000:00010000:3.0:1780340978.936348:0:93011:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00000040:3.0:1780340978.936357:0:93011:0:(obd_cksum.c:33:obd_cksum_types_supported_server()) lustre-OST0000: checksum speed: crc 579, crc32c 3521, adler 565, t10ip512 2235, t10ip4k 2311, t10crc512 379, t10crc4k 482 00002000:00000040:3.0:1780340978.936460:0:93011:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0xb:0x0] 00000001:00000040:3.0:1780340978.936528:0:93011:0:(tgt_lastrcvd.c:690:tgt_server_data_read()) lustre-OST0000: read last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969457: rc = 0 00000001:00000040:3.0:1780340978.936533:0:93011:0:(tgt_lastrcvd.c:2003:tgt_server_data_init()) lustre-OST0000: restored maximum client count: 0 00000001:00000040:3.0:1780340978.936541:0:93011:0:(tgt_lastrcvd.c:530:tgt_client_data_read()) lustre-OST0000: read lcd @8320 uuid = lustre-MDT0000-mdtlov_UUID, last_transno = 4294969474, last_xid = 1866818961264000, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:3.0:1780340978.936545:0:93011:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 4294969474 srv lr: 4294969457 lx: 1866818961264000 gen 0 00000020:00000040:3.0:1780340978.936554:0:93011:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c047a1eb800 with handle 0xa24651432776240 to hash 00000020:00000040:3.0:1780340978.936581:0:93011:0:(genops.c:889:class_export_get()) GET export ffff8c047a1eb800 refcount=3 00000020:00000040:3.0:1780340978.936587:0:93011:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff8c0476588000) now 3 - export 00000001:00000040:3.0:1780340978.936592:0:93011:0:(tgt_lastrcvd.c:1180:tgt_client_add()) lustre-OST0000: client at idx 0 with UUID 'lustre-MDT0000-mdtlov_UUID' added, generation 0 00000020:00000040:3.0:1780340978.936595:0:93011:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a1eb800 : new refcount 2 00000001:00000040:3.0:1780340978.936601:0:93011:0:(tgt_lastrcvd.c:530:tgt_client_data_read()) lustre-OST0000: read lcd @8448 uuid = lustre-MDT0001-mdtlov_UUID, last_transno = 4294969456, last_xid = 1866818961181312, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:3.0:1780340978.936605:0:93011:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 4294969456 srv lr: 4294969457 lx: 1866818961181312 gen 0 00000020:00000040:3.0:1780340978.936609:0:93011:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c0351be9800 with handle 0xa24651432776247 to hash 00000020:00000040:3.0:1780340978.936618:0:93011:0:(genops.c:889:class_export_get()) GET export ffff8c0351be9800 refcount=3 00000020:00000040:3.0:1780340978.936620:0:93011:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff8c0476588000) now 4 - export 00000001:00000040:3.0:1780340978.936622:0:93011:0:(tgt_lastrcvd.c:1180:tgt_client_add()) lustre-OST0000: client at idx 1 with UUID 'lustre-MDT0001-mdtlov_UUID' added, generation 0 00000020:00000040:3.0:1780340978.936624:0:93011:0:(genops.c:900:class_export_put()) PUTting export ffff8c0351be9800 : new refcount 2 00000001:00000040:3.0:1780340978.936628:0:93011:0:(tgt_lastrcvd.c:530:tgt_client_data_read()) lustre-OST0000: read lcd @8576 uuid = , last_transno = 0, last_xid = 0, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00000040:3.0:1780340978.936631:0:93011:0:(tgt_lastrcvd.c:1746:tgt_clients_data_init()) skipping zeroed client at offset 2 00000001:00000040:3.0:1780340978.936634:0:93011:0:(tgt_lastrcvd.c:530:tgt_client_data_read()) lustre-OST0000: read lcd @8704 uuid = 7d14eb83-fa7c-40d9-843e-6367bec0a7b4, last_transno = 4294969478, last_xid = 1866818940510592, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:3.0:1780340978.936638:0:93011:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 idx: 3 lr: 4294969478 srv lr: 4294969457 lx: 1866818940510592 gen 0 00000020:00000040:3.0:1780340978.936643:0:93011:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c046bae3800 with handle 0xa2465143277624e to hash 00000020:00000040:3.0:1780340978.936654:0:93011:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=3 00000020:00000040:3.0:1780340978.936656:0:93011:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff8c0476588000) now 5 - export 00000001:00000040:3.0:1780340978.936659:0:93011:0:(tgt_lastrcvd.c:1180:tgt_client_add()) lustre-OST0000: client at idx 3 with UUID '7d14eb83-fa7c-40d9-843e-6367bec0a7b4' added, generation 0 00000020:00000040:3.0:1780340978.936661:0:93011:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 2 00000001:00000004:3.0:1780340978.936665:0:93011:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294969478 00000001:00000040:3.0:1780340978.936704:0:93011:0:(tgt_lastrcvd.c:712:tgt_server_data_write()) lustre-OST0000: write last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969478: rc = 0 00000001:00000040:3.0:1780340978.936716:0:93011:0:(tgt_lastrcvd.c:766:tgt_server_data_update()) lustre-OST0000: update last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969478: rc = 0 00002000:00000040:3.0:1780340978.936728:0:93011:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0x5:0x0] 40000000:00000040:3.0:1780340978.936854:0:93011:0:(fid_store.c:166:seq_store_read()) srv-lustre-OST0000: Space - [0x0000000280000402-0x00000002c0000400]:0:ost 40000000:00000040:3.0:1780340978.936903:0:93011:0:(fid_handler.c:57:seq_server_set_cli()) srv-lustre-OST0000: Attached sequence controller cli-lustre-OST0000-super 80000000:00000040:3.0:1780340978.936909:0:93011:0:(fld_cache.c:66:fld_cache_init()) srv-lustre-OST0000: FLD cache - Size: 74898, Threshold: 7489 00002000:00000040:3.0:1780340978.936916:0:93011:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0x3:0x0] 80000000:00000040:3.0:1780340978.936954:0:93011:0:(fld_cache.c:417:fld_cache_insert_nolock()) insert range [0x0000000280000400-0x00000002c0000400]:0:ost 80000000:00000040:3.0:1780340978.936963:0:93011:0:(fld_handler.c:101:fld_name_to_index()) get index from srv-lustre-OST0000 00002000:00000040:3.0:1780340978.937004:0:93011:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0x1018:0x0] 00002000:00000040:3.0:1780340978.937022:0:93011:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0x101e:0x0] 00002000:00000040:3.0:1780340978.937054:0:93011:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0xd:0x0] 00000001:00000040:3.0:1780340978.937095:0:93011:0:(nodemap_storage.c:303:nodemap_cache_find_create()) removing old index, creating new one 00002000:00000040:3.0:1780340978.937119:0:93011:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000003:0x2:0x0] 00002000:00000040:3.0:1780340978.938117:0:93011:0:(ofd_dev.c:464:ofd_object_free()) object free, fid = [0x200000003:0x2:0x0] 00080000:10000000:3.0:1780340978.938923:0:93011:0:(osd_handler.c:5579:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000040:1.0:1780340978.942232:0:93011:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff8c0476588000) now 6 - setup 00000020:00000080:1.0:1780340978.942237:0:93011:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1780340978.942247:0:93011:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340978.942253:0:93011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340978.942255:0:93011:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1780340978.942258:0:93011:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1780340978.942261:0:93011:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1780340978.942263:0:93011:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780340978.942264:0:93011:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1780340978.942265:0:93011:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1780340978.942268:0:93011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340978.942281:0:93011:0:(obd_config.c:1561:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1780340978.942284:0:93011:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780340978.942287:0:93011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340978.942289:0:93011:0:(obd_config.c:1561:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1780340978.942292:0:93011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1780340978.942294:0:93011:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1780340978.942301:0:93011:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340978.942303:0:93011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340978.942305:0:93011:0:(obd_config.c:1561:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1780340978.942307:0:93011:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1780340978.942309:0:93011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340978.942311:0:93011:0:(obd_config.c:1561:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1780340978.942314:0:93011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1780340978.942343:0:93011:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1780340978.942346:0:93011:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1780340978.942347:0:93011:0:(obd_config.c:1561:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1780340978.942350:0:93011:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1780340978.956520:0:93007:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1780340978.956570:0:93007:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00000020:00000040:2.0:1780340978.956591:0:93007:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0440030e00 refcount=3 00010000:00010000:2.0:1780340978.956599:0:93007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440030e00/0xa24651432776224 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277622b expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340978.956611:0:93007:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0440030e00/0xa24651432776224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277622b expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1780340978.956619:0:93007:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8c0351be9000 from 1 10000000:01000000:2.0:1780340978.956622:0:93007:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000020:00000040:2.0:1780340978.956638:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00010000:00000040:2.0:1780340978.956662:0:93007:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff8c047a3b5600 count: 4 00000020:00000040:2.0:1780340978.956682:0:93007:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c03476f9200 with handle 0xa24651432776255 to hash 00010000:00010000:2.0:1780340978.956689:0:93007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f9200/0xa24651432776255 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340978.956696:0:93007:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c03476f9200/0xa24651432776255 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340978.956707:0:93007:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c03476f9200/0xa24651432776255 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1780340978.956730:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2e680 x1866818961279872/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.956743:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961279872:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1780340978.956787:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2e680 x1866818961279872/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340978.956806:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340978.956847:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c0447d21850 x1866818961279872 msgsize 328 00000100:00100000:2.0:1780340978.956852:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340978.956854:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1780340978.956881:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c046ba2e680 x1866818961279872/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.957841:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961279872 00000100:00100000:3.0:1780340978.957852:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961279872 00000020:00000040:3.0:1780340978.957855:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:3.0:1780340978.957858:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=21 00000100:00000040:3.0:1780340978.957883:0:90573:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1780340978.957913:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00000040:3.0:1780340978.957917:0:90573:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:3.0:1780340978.957922:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0447d21850 x1866818961279872/t0(0) o101->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 328/0 e 0 to 0 dl 1780340989 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.957934:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:93007:x1866818961279872:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1780340978.957948:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1780340978.957956:0:90573:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff8c045a87ad00 count: 5 00000020:00000040:3.0:1780340978.957962:0:90573:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c0440031400 with handle 0xa2465143277625c to hash 00010000:00010000:3.0:1780340978.957967:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0440031400/0xa2465143277625c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432776255 expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340978.957974:0:90573:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff8c047a289800 : new locks_count 17 00000020:00000040:3.0:1780340978.957984:0:90573:0:(genops.c:889:class_export_get()) GET export ffff8c047a289800 refcount=22 00010000:00000040:3.0:1780340978.958002:0:90573:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff8c045a87ad00) refcount = 5 00010000:00000040:3.0:1780340978.958005:0:90573:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1780340978.958011:0:90573:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c04754c7000/0xa24651432775455 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2607 expref: 8 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340978.958018:0:90573:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c04754c6600/0xa246514327753f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327753ec expref: 22 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340978.958024:0:90573:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c047a8b2200/0xa246514327753c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327753c2 expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340978.958030:0:90573:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c0475fa4a00/0xa24651432775352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277534b expref: 22 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340978.958036:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0440031400/0xa2465143277625c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432776255 expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340978.958046:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0440031400/0xa2465143277625c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432776255 expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340978.958055:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440031400, rc 0) 00010000:00000040:3.0:1780340978.958058:0:90573:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961279872 00000100:00000040:3.0:1780340978.958067:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:3.0:1780340978.958072:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340978.958105:0:90573:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff8c046ba2e680 x1866818961279872/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340978.958124:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:3.0:1780340978.958128:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0447d21850 x1866818961279872/t0(0) o101->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 328/344 e 0 to 0 dl 1780340989 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.958137:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:93007:x1866818961279872:12345-0@lo:101:mount.lustre.0 Request processed in 204us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340978.958150:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00000040:3.0:1780340978.958153:0:90573:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:3.0:1780340978.958163:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 21 00000100:00100000:2.0:1780340978.961901:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a89f840 going to sleep for 11 seconds 00000100:00000040:2.0:1780340978.961946:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2e680 x1866818961279872/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340978.961958:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2e680 x1866818961279872/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.961965:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961279872:0@lo:101:mount.lustre.0 00000100:00000040:2.0:1780340978.961974:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2e680 x1866818961279872/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340978.961999:0:93007:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c03476f9200 refcount=4 00010000:00000040:2.0:1780340978.962006:0:93007:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff8c03476f9200, remote cookie: 0xa2465143277625c, flags: 0x0 00010000:00000040:2.0:1780340978.962013:0:93007:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff8c047a3b5600) refcount = 4 00010000:00000040:2.0:1780340978.962016:0:93007:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1780340978.962021:0:93007:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c047a8b3400/0xa246514327753ec lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327753f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780340978.962031:0:93007:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c0453122a00/0xa246514327753c2 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327753c9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780340978.962037:0:93007:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c0453123800/0xa2465143277534b lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775352 expref: -99 pid: 90561 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340978.962043:0:93007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c03476f9200/0xa24651432776255 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277625c expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340978.962051:0:93007:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c03476f9200/0xa24651432776255 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277625c expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1780340978.962061:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2e680 x1866818961279872/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340978.962071:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 10000000:00000040:2.0:1780340978.962080:0:93007:0:(mgc_request.c:108:config_log_get()) log params (ffff8c034931ee00) refs 2 00000020:00000040:2.0:1780340978.962083:0:93007:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c03476f9200 refcount=3 10000000:00000040:2.0:1780340978.962114:0:93007:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c04509be600 : new refcount 2 10000000:00000040:2.0:1780340978.962118:0:93007:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0461148b40 : new refcount 2 10000000:00000040:2.0:1780340978.962121:0:93007:0:(mgc_request_server.c:800:mgc_process_server_cfg_log()) MGC192.168.203.116@tcp: copy local log params 00000040:00080000:2.0:1780340978.962297:0:93007:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1780340978.963647:0:93007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1780340978.963890:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1780340978.963923:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1780340978.963942:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1780340978.963947:0:93007:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000020:00000040:2.0:1780340978.963992:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:2.0:1780340978.963998:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=5 obd=MGC192.168.203.116@tcp 00000100:00000040:2.0:1780340978.964033:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2e680 x1866818961280000/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.964047:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961280000:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1780340978.964073:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2e680 x1866818961280000/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1780340994 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340978.964082:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340978.964122:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c0447d21050 x1866818961280000 msgsize 504 00000100:00100000:2.0:1780340978.964127:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340978.964129:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1780340978.964154:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c046ba2e680 x1866818961280000/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1780340994 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.964180:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a89f600 going to sleep for 11 seconds 00000100:00100000:3.0:1780340978.964292:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961280000 00000100:00100000:3.0:1780340978.964299:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961280000 00000020:00000040:3.0:1780340978.964302:0:90570:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:3.0:1780340978.964305:0:90570:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=22 00000100:00000040:3.0:1780340978.964322:0:90570:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1780340978.964351:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00000040:3.0:1780340978.964355:0:90570:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:3.0:1780340978.964360:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0447d21050 x1866818961280000/t0(0) o501->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 504/0 e 0 to 0 dl 1780340989 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.964372:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:93007:x1866818961280000:12345-0@lo:501:mount.lustre.0 00000040:00000040:3.0:1780340978.964392:0:90570:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log params 00000040:00000040:3.0:1780340978.964405:0:90570:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0347781900 : new refcount 2 00000040:00000040:3.0:1780340978.964453:0:90570:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c0347781900 : new refcount 1 00010000:00000040:3.0:1780340978.964460:0:90570:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961280000 00000100:00000040:3.0:1780340978.964469:0:90570:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:3.0:1780340978.964474:0:90570:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340978.964494:0:90570:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff8c046ba2e680 x1866818961280000/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340978.964511:0:90570:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:3.0:1780340978.964516:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0447d21050 x1866818961280000/t0(0) o501->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 504/272 e 0 to 0 dl 1780340989 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.964524:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:93007:x1866818961280000:12345-0@lo:501:mount.lustre.0 Request processed in 154us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340978.964530:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00000040:3.0:1780340978.964541:0:90570:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:3.0:1780340978.964549:0:90570:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 21 00000100:00000040:2.0:1780340978.964942:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2e680 x1866818961280000/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340978.964952:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2e680 x1866818961280000/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1780340994 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.964958:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961280000:0@lo:501:mount.lustre.0 00000100:00000040:2.0:1780340978.964965:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2e680 x1866818961280000/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1780340994 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340978.964973:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000100:00000040:2.0:1780340978.964977:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2e680 x1866818961280000/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1780340994 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340978.964996:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000020:00000040:2.0:1780340978.965005:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:2.0:1780340978.965008:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=5 obd=MGC192.168.203.116@tcp 00000100:00000040:2.0:1780340978.965022:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2e680 x1866818961280128/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.965031:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961280128:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1780340978.965056:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2e680 x1866818961280128/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340978.965063:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340978.965082:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c0447d20850 x1866818961280128 msgsize 272 00000100:00100000:2.0:1780340978.965086:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340978.965087:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1780340978.965102:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c046ba2e680 x1866818961280128/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.965119:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a89f600 going to sleep for 11 seconds 00000100:00100000:3.0:1780340978.965200:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961280128 00000100:00100000:3.0:1780340978.965205:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961280128 00000020:00000040:3.0:1780340978.965208:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:3.0:1780340978.965211:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=22 00000100:00000040:3.0:1780340978.965225:0:90573:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1780340978.965244:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00000040:3.0:1780340978.965247:0:90573:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:3.0:1780340978.965252:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0447d20850 x1866818961280128/t0(0) o503->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 272/0 e 0 to 0 dl 1780340989 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.965263:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:93007:x1866818961280128:12345-0@lo:503:mount.lustre.0 00000040:00000040:3.0:1780340978.965302:0:90573:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0347781900 : new refcount 2 00000040:00000040:3.0:1780340978.965338:0:90573:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c0347781900 : new refcount 1 00010000:00000040:3.0:1780340978.965343:0:90573:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961280128 00000100:00000040:3.0:1780340978.965350:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:3.0:1780340978.965354:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340978.965375:0:90573:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff8c046ba2e680 x1866818961280128/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340978.965405:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:3.0:1780340978.965409:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0447d20850 x1866818961280128/t0(0) o503->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 272/8416 e 0 to 0 dl 1780340989 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.965418:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:93007:x1866818961280128:12345-0@lo:503:mount.lustre.0 Request processed in 156us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340978.965425:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00000040:3.0:1780340978.965428:0:90573:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:3.0:1780340978.965436:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 21 00000100:00000040:2.0:1780340978.966470:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2e680 x1866818961280128/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340978.966482:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2e680 x1866818961280128/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.966488:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961280128:0@lo:503:mount.lustre.0 00000100:00000040:2.0:1780340978.966495:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2e680 x1866818961280128/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340978.966508:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2e680 x1866818961280128/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340978.966524:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:2.0:1780340978.966540:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000040:00080000:2.0:1780340978.966906:0:93007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:2.0:1780340978.966958:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:2.0:1780340978.966962:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=5 obd=MGC192.168.203.116@tcp 00000100:00000040:2.0:1780340978.966982:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2e680 x1866818961280256/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.966992:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961280256:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1780340978.967021:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2e680 x1866818961280256/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340978.967028:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340978.967056:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c0471efa450 x1866818961280256 msgsize 272 00000100:00100000:2.0:1780340978.967060:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340978.967062:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1780340978.967083:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c046ba2e680 x1866818961280256/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.967106:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a89f840 going to sleep for 11 seconds 00000100:00100000:0.0:1780340978.967728:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961280256 00000100:00100000:0.0:1780340978.967736:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961280256 00000020:00000040:0.0:1780340978.967739:0:90570:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:0.0:1780340978.967743:0:90570:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=22 00000100:00000040:0.0:1780340978.967783:0:90570:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1780340978.967818:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00000040:0.0:1780340978.967829:0:90570:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:0.0:1780340978.967835:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0471efa450 x1866818961280256/t0(0) o502->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 272/0 e 0 to 0 dl 1780340989 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.967848:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:93007:x1866818961280256:12345-0@lo:502:mount.lustre.0 00000040:00000040:0.0:1780340978.967876:0:90570:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0347781900 : new refcount 2 00000040:00000040:0.0:1780340978.967919:0:90570:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c0347781900 : new refcount 1 00010000:00000040:0.0:1780340978.967923:0:90570:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961280256 00000100:00000040:0.0:1780340978.967933:0:90570:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340978.967938:0:90570:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340978.967966:0:90570:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8c046ba2e680 x1866818961280256/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340978.967986:0:90570:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:0.0:1780340978.967991:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0471efa450 x1866818961280256/t0(0) o502->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 272/8472 e 0 to 0 dl 1780340989 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.967998:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471efa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:93007:x1866818961280256:12345-0@lo:502:mount.lustre.0 Request processed in 154us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340978.968004:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00000040:0.0:1780340978.968007:0:90570:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:0.0:1780340978.968015:0:90570:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 21 00000100:00000040:2.0:1780340978.968920:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2e680 x1866818961280256/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340978.968932:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2e680 x1866818961280256/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.968939:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961280256:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1780340978.968946:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2e680 x1866818961280256/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340978.968959:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2e680 x1866818961280256/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340978.968978:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:2.0:1780340978.968986:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000040:00080000:2.0:1780340978.969168:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1780340978.969198:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1780340978.969210:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1780340978.969222:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1780340978.969233:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000020:00000040:2.0:1780340978.969240:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:2.0:1780340978.969244:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=5 obd=MGC192.168.203.116@tcp 00000100:00000040:2.0:1780340978.969266:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2e680 x1866818961280384/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.970392:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961280384:0@lo:502:mount.lustre.0 00000100:00000040:2.0:1780340978.970509:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2e680 x1866818961280384/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340978.970518:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340978.970561:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c0447d20c50 x1866818961280384 msgsize 272 00000100:00100000:2.0:1780340978.970566:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340978.970568:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1780340978.970638:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c046ba2e680 x1866818961280384/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.970665:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c034a89f840 going to sleep for 11 seconds 00000100:00100000:3.0:1780340978.974958:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961280384 00000100:00100000:3.0:1780340978.974989:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961280384 00000020:00000040:3.0:1780340978.974992:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:3.0:1780340978.974997:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=22 00000100:00000040:3.0:1780340978.975024:0:90573:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1780340978.975057:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00000040:3.0:1780340978.975061:0:90573:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:3.0:1780340978.975068:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0447d20c50 x1866818961280384/t0(0) o502->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 272/0 e 0 to 0 dl 1780340989 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.975082:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0447d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:93007:x1866818961280384:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1780340978.975118:0:90573:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0347781900 : new refcount 2 00000040:00000040:3.0:1780340978.975178:0:90573:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c0347781900 : new refcount 1 00010000:00000040:3.0:1780340978.975183:0:90573:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961280384 00000100:00000040:3.0:1780340978.975193:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:3.0:1780340978.975199:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340978.975247:0:90573:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8c046ba2e680 x1866818961280384/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340978.975442:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:3.0:1780340978.975448:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0447d20c50 x1866818961280384/t0(0) o502->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 272/8472 e 0 to 0 dl 1780340989 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340978.975468:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0447d20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:93007:x1866818961280384:12345-0@lo:502:mount.lustre.0 Request processed in 379us (4895us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340978.975476:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00000040:3.0:1780340978.975488:0:90573:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:3.0:1780340978.975499:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 21 00000100:00000040:0.0:1780340978.979058:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2e680 x1866818961280384/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340978.979073:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2e680 x1866818961280384/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.979081:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961280384:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1780340978.979090:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2e680 x1866818961280384/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340978.979127:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2e680 x1866818961280384/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340994 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340978.979146:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:0.0:1780340978.979156:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000040:00080000:0.0:1780340978.979226:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1780340978.979240:0:93007:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 10000000:00000040:0.0:1780340978.980152:0:93007:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c04509be600 : new refcount 1 00000020:00000040:0.0:1780340978.980159:0:93007:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog params 00000020:01000000:2.0:1780340978.982955:0:93015:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340978.982968:0:93015:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340978.982970:0:93015:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1780340978.982978:0:93015:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0351be9000 00000020:00000080:2.0:1780340978.982981:0:93015:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1780340978.982988:0:93015:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340978.982990:0:93015:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340978.982991:0:93015:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1780340978.982994:0:93015:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1780340978.982996:0:93015:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340978.982997:0:93015:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1780340978.983000:0:93015:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c0351be9000 00000020:00000080:2.0:1780340978.983012:0:93015:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1780340978.983067:0:93015:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1780340978.983071:0:93015:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1780340978.983072:0:93015:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1780340978.983075:0:93015:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:0.0:1780340978.984574:0:93007:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1780340978.984610:0:93007:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'params' succeeded (0). 00000020:00000040:0.0:1780340978.984630:0:93007:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c03476f9200 refcount=3 00010000:00010000:0.0:1780340978.984638:0:93007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c03476f9200/0xa24651432776255 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277625c expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340978.984650:0:93007:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c03476f9200/0xa24651432776255 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277625c expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1780340978.984704:0:93007:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1780340978.984707:0:93007:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8c0351be9000 10000000:01000000:0.0:1780340978.984710:0:93007:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8c0351be9000 10000000:01000000:0.0:1780340978.984713:0:93007:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:0.0:1780340978.984717:0:93007:0:(genops.c:889:class_export_get()) GET export ffff8c0475494000 refcount=20 10000000:01000000:0.0:1780340978.984721:0:93007:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8c0351be9000 from 1 10000000:01000000:0.0:1780340978.984723:0:93007:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000020:00000040:0.0:1780340978.984728:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00010000:00000040:0.0:1780340978.984749:0:93007:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff8c04428a8100 count: 9 00000020:00000040:0.0:1780340978.984755:0:93007:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c0475fa5000 with handle 0xa24651432776263 to hash 00010000:00010000:0.0:1780340978.984779:0:93007:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432776263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340978.984807:0:93007:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432776263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340978.984818:0:93007:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432776263 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1780340978.984841:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c0446efd180 x1866818961280512/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.984855:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446efd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961280512:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1780340978.984879:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c0446efd180 x1866818961280512/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340978.984889:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340978.984924:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c0471ef8850 x1866818961280512 msgsize 328 00000100:00100000:0.0:1780340978.984929:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340978.984931:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1780340978.984947:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c0446efd180 x1866818961280512/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.984971:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c045a45b840 going to sleep for 11 seconds 00000100:00100000:1.0:1780340978.985028:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961280512 00000100:00100000:1.0:1780340978.985035:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961280512 00000020:00000040:1.0:1780340978.985037:0:90570:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:1.0:1780340978.985040:0:90570:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=22 00000100:00000040:1.0:1780340978.985055:0:90570:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1780340978.985082:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00000040:1.0:1780340978.985086:0:90570:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:1.0:1780340978.985090:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0471ef8850 x1866818961280512/t0(0) o101->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 328/0 e 0 to 0 dl 1780340989 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340978.985101:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:93007:x1866818961280512:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1780340978.985113:0:90570:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1780340978.985120:0:90570:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff8c0477219900 count: 11 00000020:00000040:1.0:1780340978.985125:0:90570:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c034d9ea000 with handle 0xa2465143277626a to hash 00010000:00010000:1.0:1780340978.985128:0:90570:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c034d9ea000/0xa2465143277626a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xa24651432776263 expref: -99 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780340978.985136:0:90570:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff8c047a289800 : new locks_count 18 00000020:00000040:1.0:1780340978.985137:0:90570:0:(genops.c:889:class_export_get()) GET export ffff8c047a289800 refcount=23 00010000:00000040:1.0:1780340978.985152:0:90570:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff8c0477219900) refcount = 11 00010000:00000040:1.0:1780340978.985155:0:90570:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1780340978.985163:0:90570:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c03476f8800/0xa2465143277622b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432776224 expref: 23 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780340978.985170:0:90570:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c034d9ea600/0xa2465143277585a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775853 expref: 23 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780340978.985177:0:90570:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c03476f9600/0xa24651432775830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775829 expref: 23 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780340978.985184:0:90570:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c0470f2c400/0xa24651432775822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277581b expref: 23 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780340978.985190:0:90570:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c0470f2da00/0xa24651432775814 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277580d expref: 23 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780340978.985196:0:90570:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c0470f2dc00/0xa24651432775806 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327757ff expref: 23 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780340978.985205:0:90570:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c0453122200/0xa246514327757f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2670 expref: 8 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780340978.985212:0:90570:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c034d9eba00/0xa246514327757f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327757ea expref: 23 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780340978.985218:0:90570:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c034d9eb400/0xa246514327757e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327757dc expref: 23 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1780340978.985224:0:90570:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c0453122400/0xa246514327757d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced2669 expref: 8 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340978.985230:0:90570:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c034d9ea000/0xa2465143277626a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa24651432776263 expref: 23 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340978.985240:0:90570:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c034d9ea000/0xa2465143277626a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432776263 expref: 23 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1780340978.985251:0:90570:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c034d9ea000, rc 0) 00010000:00000040:1.0:1780340978.985255:0:90570:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961280512 00000100:00000040:1.0:1780340978.985264:0:90570:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:1.0:1780340978.985279:0:90570:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340978.985296:0:90570:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff8c0446efd180 x1866818961280512/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340978.985312:0:90570:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:1.0:1780340978.985317:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0471ef8850 x1866818961280512/t0(0) o101->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 328/344 e 0 to 0 dl 1780340989 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340978.985325:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471ef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:93007:x1866818961280512:12345-0@lo:101:mount.lustre.0 Request processed in 225us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340978.985332:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00000040:1.0:1780340978.985335:0:90570:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:1.0:1780340978.985344:0:90570:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 22 00000100:00000040:0.0:1780340978.986311:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c0446efd180 x1866818961280512/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340978.986323:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446efd180 x1866818961280512/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.986329:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446efd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961280512:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1780340978.986335:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c0446efd180 x1866818961280512/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340978.986344:0:93007:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0475fa5000 refcount=4 00010000:00000040:0.0:1780340978.986355:0:93007:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff8c0475fa5000, remote cookie: 0xa2465143277626a, flags: 0x0 00010000:00000040:0.0:1780340978.986361:0:93007:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff8c04428a8100) refcount = 9 00010000:00000040:0.0:1780340978.986363:0:93007:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1780340978.986366:0:93007:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c0440030e00/0xa24651432776224 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277622b expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1780340978.986374:0:93007:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c0470f2ca00/0xa24651432775853 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277585a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1780340978.986380:0:93007:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c0453122c00/0xa24651432775829 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775830 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1780340978.986386:0:93007:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c0453123200/0xa2465143277581b lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775822 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1780340978.986501:0:93007:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c0453123e00/0xa2465143277580d lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775814 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1780340978.986508:0:93007:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c0453122800/0xa246514327757ff lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa24651432775806 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1780340978.986515:0:93007:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c03476f9000/0xa246514327757ea lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327757f1 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1780340978.986521:0:93007:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c0470f2c000/0xa246514327757dc lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327757e3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340978.986527:0:93007:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432776263 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277626a expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1780340978.986535:0:93007:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432776263 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xa2465143277626a expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1780340978.986553:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c0446efd180 x1866818961280512/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340994 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340978.986564:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 10000000:00000040:0.0:1780340978.986571:0:93007:0:(mgc_request.c:108:config_log_get()) log lustre-client (ffff8c034ab86a00) refs 2 00000020:00000040:0.0:1780340978.986574:0:93007:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0475fa5000 refcount=3 10000000:00000040:0.0:1780340978.986599:0:93007:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c04509be600 : new refcount 2 10000000:00000040:0.0:1780340978.986603:0:93007:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0461148b40 : new refcount 2 10000000:00000040:0.0:1780340978.986605:0:93007:0:(mgc_request_server.c:800:mgc_process_server_cfg_log()) MGC192.168.203.116@tcp: copy local log lustre-client 00000040:00080000:0.0:1780340978.986746:0:93007:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1780340978.986960:0:93007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1780340978.987113:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1780340978.987133:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1780340978.987144:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1780340978.987154:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1780340978.987164:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1780340978.987175:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1780340978.987185:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1780340978.987195:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1780340978.987206:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1780340978.987216:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1780340978.987226:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1780340978.987236:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1780340978.987246:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1780340978.987256:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1780340978.987266:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1780340978.991561:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1780340978.991580:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1780340978.991595:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1780340978.991609:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1780340978.991623:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1780340978.991649:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1780340978.991664:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1780340978.991679:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1780340978.991693:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1780340978.991708:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1780340978.991722:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1780340978.991736:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1780340978.991751:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1780340978.991784:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1780340978.991812:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1780340978.991824:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1780340978.991835:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1780340978.991848:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1780340978.991860:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1780340978.991873:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1780340978.991886:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1780340978.991899:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1780340978.991926:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1780340978.991931:0:93007:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000020:00000040:0.0:1780340978.991999:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:0.0:1780340978.992007:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=5 obd=MGC192.168.203.116@tcp 00000100:00000040:0.0:1780340978.992043:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c0446efd180 x1866818961280640/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.992057:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446efd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961280640:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1780340978.992082:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c0446efd180 x1866818961280640/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340978.992091:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340978.992130:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c0471efb450 x1866818961280640 msgsize 512 00000100:00100000:0.0:1780340978.992135:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340978.992136:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1780340978.992159:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c0446efd180 x1866818961280640/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.992191:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345303e40 going to sleep for 11 seconds 00000100:00100000:2.0:1780340978.993054:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961280640 00000100:00100000:2.0:1780340978.993064:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961280640 00000020:00000040:2.0:1780340978.993066:0:90567:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:2.0:1780340978.993070:0:90567:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=23 00000100:00000040:2.0:1780340978.993096:0:90567:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780340978.993126:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00000040:2.0:1780340978.993130:0:90567:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:2.0:1780340978.993135:0:90567:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0471efb450 x1866818961280640/t0(0) o501->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 512/0 e 0 to 0 dl 1780340989 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.993147:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:93007:x1866818961280640:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1780340978.993167:0:90567:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-client 00000040:00000040:2.0:1780340978.993170:0:90567:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0347781900 : new refcount 2 00000040:00000040:2.0:1780340978.993232:0:90567:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c0347781900 : new refcount 1 00000020:00000040:2.0:1780340978.993241:0:90567:0:(genops.c:889:class_export_get()) GET export ffff8c047a289800 refcount=24 00000020:00000040:2.0:1780340978.993244:0:90567:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 23 00010000:00000040:2.0:1780340978.993249:0:90567:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961280640 00000100:00000040:2.0:1780340978.993258:0:90567:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:2.0:1780340978.993263:0:90567:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340978.993305:0:90567:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff8c0446efd180 x1866818961280640/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340978.993323:0:90567:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:2.0:1780340978.993327:0:90567:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0471efb450 x1866818961280640/t0(0) o501->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 512/272 e 0 to 0 dl 1780340989 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340978.993336:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471efb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:93007:x1866818961280640:12345-0@lo:501:mount.lustre.0 Request processed in 191us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340978.993355:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00000040:2.0:1780340978.993358:0:90567:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:2.0:1780340978.993367:0:90567:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 22 00000100:00000040:0.0:1780340978.995374:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c0446efd180 x1866818961280640/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340978.995388:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446efd180 x1866818961280640/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.995524:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446efd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961280640:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1780340978.995534:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c0446efd180 x1866818961280640/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340978.995547:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000100:00000040:0.0:1780340978.995551:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c0446efd180 x1866818961280640/t0(0) o501->MGC192.168.203.116@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1780340994 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340978.995560:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000020:00000040:0.0:1780340978.995575:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:0.0:1780340978.995579:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=5 obd=MGC192.168.203.116@tcp 00000100:00000040:0.0:1780340978.995598:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c0446efd180 x1866818961280768/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.995609:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446efd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961280768:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1780340978.995639:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c0446efd180 x1866818961280768/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340978.995647:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340978.995677:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c0471efa850 x1866818961280768 msgsize 272 00000100:00100000:0.0:1780340978.995681:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340978.995683:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1780340978.995963:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c0446efd180 x1866818961280768/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340978.996000:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345303e40 going to sleep for 11 seconds 00000100:00100000:2.0:1780340979.005953:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961280768 00000100:00100000:2.0:1780340979.005967:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961280768 00000020:00000040:2.0:1780340979.005969:0:90570:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:2.0:1780340979.005974:0:90570:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=23 00000100:00000040:2.0:1780340979.005998:0:90570:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +5s 00000100:00100000:2.0:1780340979.006031:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00000040:2.0:1780340979.006036:0:90570:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:2.0:1780340979.006043:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0471efa850 x1866818961280768/t0(0) o503->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 272/0 e 0 to 0 dl 1780340989 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340979.006056:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0471efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:93007:x1866818961280768:12345-0@lo:503:mount.lustre.0 00000040:00000040:2.0:1780340979.006092:0:90570:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0347781900 : new refcount 2 00000040:00000040:2.0:1780340979.006138:0:90570:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c0347781900 : new refcount 1 00010000:00000040:2.0:1780340979.006143:0:90570:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961280768 00000100:00000040:2.0:1780340979.006154:0:90570:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:2.0:1780340979.006160:0:90570:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340979.006211:0:90570:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff8c0446efd180 x1866818961280768/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.006237:0:90570:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:2.0:1780340979.006242:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0471efa850 x1866818961280768/t0(0) o503->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:404/0 lens 272/8416 e 0 to 0 dl 1780340989 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340979.006252:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0471efa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:93007:x1866818961280768:12345-0@lo:503:mount.lustre.0 Request processed in 197us (10573us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340979.006259:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00000040:2.0:1780340979.006262:0:90570:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000100:00000040:0.0:1780340979.006408:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c0446efd180 x1866818961280768/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340979.006419:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446efd180 x1866818961280768/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.006427:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446efd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961280768:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1780340979.006435:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c0446efd180 x1866818961280768/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340979.006448:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c0446efd180 x1866818961280768/t0(0) o503->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1780340994 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340979.006464:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:0.0:1780340979.006472:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000040:00080000:0.0:1780340979.006865:0:93007:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:0.0:1780340979.006916:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:0.0:1780340979.006920:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=5 obd=MGC192.168.203.116@tcp 00000100:00000040:0.0:1780340979.006943:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c0446efd180 x1866818961280896/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.006954:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446efd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961280896:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1780340979.006981:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c0446efd180 x1866818961280896/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340979.006988:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340979.007008:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c047b030850 x1866818961280896 msgsize 272 00000100:00100000:0.0:1780340979.007013:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340979.007014:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 62 buffers still posted 00000100:00000040:0.0:1780340979.007030:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c0446efd180 x1866818961280896/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.007066:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345303e40 going to sleep for 11 seconds 00000020:00000040:2.0:1780340979.007265:0:90570:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 22 00000100:00100000:2.0:1780340979.007360:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961280896 00000100:00100000:2.0:1780340979.007365:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961280896 00000020:00000040:2.0:1780340979.007367:0:90570:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:2.0:1780340979.007370:0:90570:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=23 00000100:00000040:2.0:1780340979.007383:0:90570:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780340979.007493:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00000040:2.0:1780340979.007497:0:90570:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:2.0:1780340979.007501:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047b030850 x1866818961280896/t0(0) o502->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:405/0 lens 272/0 e 0 to 0 dl 1780340990 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340979.007514:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:93007:x1866818961280896:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1780340979.007538:0:90570:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0347781900 : new refcount 2 00000040:00000040:2.0:1780340979.007574:0:90570:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c0347781900 : new refcount 1 00010000:00000040:2.0:1780340979.007578:0:90570:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961280896 00000100:00000040:2.0:1780340979.007585:0:90570:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:2.0:1780340979.007589:0:90570:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340979.007611:0:90570:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8c0446efd180 x1866818961280896/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.007627:0:90570:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:2.0:1780340979.007631:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047b030850 x1866818961280896/t0(0) o502->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:405/0 lens 272/8472 e 0 to 0 dl 1780340990 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340979.007639:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b030850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:93007:x1866818961280896:12345-0@lo:502:mount.lustre.0 Request processed in 128us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340979.007646:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00000040:2.0:1780340979.007648:0:90570:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:2.0:1780340979.007655:0:90570:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 22 00000100:00000040:0.0:1780340979.008537:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c0446efd180 x1866818961280896/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340979.008549:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446efd180 x1866818961280896/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.008557:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446efd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961280896:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1780340979.008565:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c0446efd180 x1866818961280896/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340979.008580:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c0446efd180 x1866818961280896/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340979.008594:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:0.0:1780340979.008601:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000040:00080000:0.0:1780340979.008782:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1780340979.008824:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1780340979.008840:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1780340979.008853:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1780340979.008864:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1780340979.008876:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1780340979.008891:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1780340979.008903:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1780340979.008915:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1780340979.008928:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1780340979.008942:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1780340979.008953:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1780340979.008965:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1780340979.008978:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1780340979.008991:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1780340979.009005:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1780340979.009028:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1780340979.009040:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1780340979.009053:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1780340979.009065:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1780340979.009077:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1780340979.009089:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1780340979.009100:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1780340979.009112:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1780340979.009124:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1780340979.009135:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1780340979.009146:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1780340979.009157:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1780340979.009168:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1780340979.009178:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1780340979.009188:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1780340979.009199:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1780340979.009210:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1780340979.009221:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1780340979.009231:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1780340979.009242:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1780340979.009253:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1780340979.009263:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1780340979.009291:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1780340979.009304:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1780340979.009316:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1780340979.009327:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1780340979.009340:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1780340979.009352:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1780340979.009364:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1780340979.009376:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1780340979.009388:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1780340979.009413:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000020:00000040:0.0:1780340979.009431:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:0.0:1780340979.009442:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=5 obd=MGC192.168.203.116@tcp 00000100:00000040:0.0:1780340979.009469:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c0446efd180 x1866818961281024/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.009482:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446efd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961281024:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1780340979.009511:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c0446efd180 x1866818961281024/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340979.009518:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340979.009553:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c047b030c50 x1866818961281024 msgsize 272 00000100:00100000:0.0:1780340979.009557:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340979.009559:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1780340979.014831:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c0446efd180 x1866818961281024/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340979.016017:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961281024 00000100:00100000:1.0:1780340979.016028:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961281024 00000020:00000040:1.0:1780340979.016031:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:1.0:1780340979.016036:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=23 00000100:00000040:1.0:1780340979.016060:0:90573:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1780340979.016086:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00000040:1.0:1780340979.016089:0:90573:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:1.0:1780340979.016096:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047b030c50 x1866818961281024/t0(0) o502->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:405/0 lens 272/0 e 0 to 0 dl 1780340990 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340979.016108:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:93007:x1866818961281024:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1780340979.016141:0:90573:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0347781900 : new refcount 2 00000040:00000040:1.0:1780340979.016193:0:90573:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c0347781900 : new refcount 1 00010000:00000040:1.0:1780340979.016203:0:90573:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961281024 00000100:00000040:1.0:1780340979.016213:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:1.0:1780340979.016218:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340979.016259:0:90573:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8c0446efd180 x1866818961281024/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340979.016276:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:1.0:1780340979.016280:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047b030c50 x1866818961281024/t0(0) o502->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:405/0 lens 272/8472 e 0 to 0 dl 1780340990 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340979.016289:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b030c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:93007:x1866818961281024:12345-0@lo:502:mount.lustre.0 Request processed in 182us (6734us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340979.016297:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00000040:1.0:1780340979.016300:0:90573:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:1.0:1780340979.016307:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 22 00000100:00100000:1.0:1780340979.016843:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0345303e40 going to sleep for 11 seconds 00000100:00000040:1.0:1780340979.016870:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c0446efd180 x1866818961281024/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340979.016881:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446efd180 x1866818961281024/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340979.016888:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0446efd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961281024:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1780340979.016896:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c0446efd180 x1866818961281024/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340979.016909:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c0446efd180 x1866818961281024/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780340979.016925:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:1.0:1780340979.016935:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000040:00080000:1.0:1780340979.017115:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1780340979.017139:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000040:00080000:1.0:1780340979.017157:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1780340979.017168:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].52, 224 off17176 00000040:00080000:1.0:1780340979.017179:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].53, 112 off17288 00000040:00080000:1.0:1780340979.017189:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].54, 224 off17512 00000040:00080000:1.0:1780340979.017200:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].55, 224 off17736 00000040:00080000:1.0:1780340979.017210:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].56, 136 off17872 00000040:00080000:1.0:1780340979.017221:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].57, 224 off18096 00000040:00080000:1.0:1780340979.017231:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].58, 224 off18320 00000040:00080000:1.0:1780340979.017242:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].59, 136 off18456 00000040:00080000:1.0:1780340979.017252:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].60, 224 off18680 00000040:00080000:1.0:1780340979.017262:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].61, 224 off18904 00000040:00080000:1.0:1780340979.017285:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].62, 112 off19016 00000020:00000040:1.0:1780340979.017293:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:1.0:1780340979.017298:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=5 obd=MGC192.168.203.116@tcp 00000100:00000040:1.0:1780340979.017319:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c047a8cb800 x1866818961281152/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340979.017331:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961281152:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1780340979.017358:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c047a8cb800 x1866818961281152/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340979.017366:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340979.017402:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c047b032850 x1866818961281152 msgsize 272 00000100:00100000:1.0:1780340979.017408:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780340979.017410:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1780340979.017429:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c047a8cb800 x1866818961281152/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340979.017450:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961281152 00000100:00100000:1.0:1780340979.017455:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961281152 00000020:00000040:1.0:1780340979.017457:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:1.0:1780340979.017460:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=23 00000100:00000040:1.0:1780340979.017474:0:90573:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1780340979.017497:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00000040:1.0:1780340979.017501:0:90573:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:1.0:1780340979.017505:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047b032850 x1866818961281152/t0(0) o502->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:405/0 lens 272/0 e 0 to 0 dl 1780340990 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340979.017515:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:93007:x1866818961281152:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1780340979.017535:0:90573:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0347781900 : new refcount 2 00000040:00000040:1.0:1780340979.017564:0:90573:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c0347781900 : new refcount 1 00010000:00000040:1.0:1780340979.017568:0:90573:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961281152 00000100:00000040:1.0:1780340979.017574:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:1.0:1780340979.017578:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340979.017593:0:90573:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff8c047a8cb800 x1866818961281152/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340979.017605:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 51 to 0@lo 00000100:00000040:1.0:1780340979.017609:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047b032850 x1866818961281152/t0(0) o502->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:405/0 lens 272/8472 e 0 to 0 dl 1780340990 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340979.017618:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b032850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:93007:x1866818961281152:12345-0@lo:502:mount.lustre.0 Request processed in 104us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340979.017625:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00000040:1.0:1780340979.017628:0:90573:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:1.0:1780340979.017635:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 22 00000100:00100000:1.0:1780340979.017662:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c0471e66300 going to sleep for 11 seconds 00000100:00000040:1.0:1780340979.017676:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c047a8cb800 x1866818961281152/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340979.017684:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8cb800 x1866818961281152/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340979.017690:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961281152:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1780340979.017704:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c047a8cb800 x1866818961281152/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340979.017714:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c047a8cb800 x1866818961281152/t0(0) o502->MGC192.168.203.116@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1780340995 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780340979.017725:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:1.0:1780340979.017731:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000040:00080000:1.0:1780340979.017750:0:93007:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].63, 224 off19240 00000040:00080000:1.0:1780340979.017776:0:93007:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 10000000:00000040:1.0:1780340979.018009:0:93007:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c04509be600 : new refcount 1 00000020:00000040:1.0:1780340979.018013:0:93007:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-client 00000100:00000040:0.0:1780340979.025536:0:93018:0:(lustre_peer.c:111:class_add_uuid()) found uuid 192.168.203.116@tcp 192.168.203.116@tcp cnt=1 00000020:01000004:0.0:1780340979.025563:0:93018:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1780340979.025582:0:93018:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8c03482b0000) 00000020:00000040:0.0:1780340979.025589:0:93018:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c0485a51800 with handle 0xa24651432776271 to hash 00000020:00000040:0.0:1780340979.025598:0:93018:0:(genops.c:900:class_export_put()) PUTting export ffff8c0485a51800 : new refcount 1 00000020:00000040:0.0:1780340979.025613:0:93018:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff8c03482b0000) now 2 - obd_device_list 00000020:00000080:0.0:1780340979.025618:0:93018:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1780340979.026851:0:93018:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0351be9000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1780340979.027490:0:93018:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0351be9000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1780340979.027495:0:93018:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c0351be9000 3 00000020:00000040:0.0:1780340979.027526:0:93018:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff8c03482b0000) now 3 - import 00000020:00000040:0.0:1780340979.027534:0:93018:0:(genops.c:1244:class_import_put()) import ffff8c047a95f000 refcount=1 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:0.0:1780340979.027552:0:93018:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340979.027555:0:93018:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8c044319f100 refcount 52 to 0@lo 00000100:00000040:0.0:1780340979.027558:0:93018:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.203.116@tcp -> ffff8c044319f100 00010000:00080000:0.0:1780340979.027563:0:93018:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c047a95f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.116@tcp at head 00010000:00010000:0.0:1780340979.032378:0:93018:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000040:0.0:1780340979.032486:0:93018:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff8c03482b0000) now 4 - setup 00000020:00000080:0.0:1780340979.032490:0:93018:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1780340979.032536:0:93018:0:(lwp_dev.c:494:lwp_obd_connect()) connect #0 00000020:00000040:0.0:1780340979.032542:0:93018:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c044d43a800 with handle 0xa24651432776278 to hash 00000020:00000040:0.0:1780340979.032548:0:93018:0:(genops.c:889:class_export_get()) GET export ffff8c044d43a800 refcount=3 00000020:00000040:0.0:1780340979.032552:0:93018:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff8c03482b0000) now 5 - export 00000020:00000040:0.0:1780340979.032555:0:93018:0:(genops.c:900:class_export_put()) PUTting export ffff8c044d43a800 : new refcount 2 00000020:00000080:0.0:1780340979.032558:0:93018:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa24651432776278 00000020:00000040:0.0:1780340979.032561:0:93018:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432776278 00000020:00000040:0.0:1780340979.032563:0:93018:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c044d43a800 refcount=3 00000100:00080000:0.0:1780340979.032572:0:93018:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:0.0:1780340979.032577:0:93018:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 53 to 0@lo 00000020:00000040:0.0:1780340979.032580:0:93018:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432776278 00000020:00000040:0.0:1780340979.032581:0:93018:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c044d43a800 refcount=4 00000100:00000040:0.0:1780340979.032583:0:93018:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 54 to 0@lo 00000020:00000040:0.0:1780340979.032585:0:93018:0:(genops.c:900:class_export_put()) PUTting export ffff8c044d43a800 : new refcount 3 00000100:00080000:0.0:1780340979.032588:0:93018:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c047a95f000 using connection 192.168.203.116@tcp/0@lo 00000020:00000040:1.0:1780340979.033803:0:93018:0:(genops.c:1231:class_import_get()) import ffff8c047a95f000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:1.0:1780340979.033830:0:93018:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c047a8cb800 x1866818961281280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1780340979.033846:0:93018:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009c05a6ed] to pc [ptlrpcd_rcv+-1] req@ffff8c047a8cb800 x1866818961281280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1780340979.033879:0:93018:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:00000040:1.0:1780340979.033882:0:93018:0:(genops.c:1231:class_import_get()) import ffff8c047a95f000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1780340979.034115:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340979.034124:0:71335:0:(genops.c:1231:class_import_get()) import ffff8c0346bb9800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1780340979.034139:0:71335:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff8c046ba2d500 x1866818961281408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340979.034152:0:71335:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000414ead72] to pc [ptlrpcd_00_01+1] req@ffff8c046ba2d500 x1866818961281408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.034176:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340979.034183:0:71335:0:(genops.c:1231:class_import_get()) import ffff8c0346bbc000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1780340979.034191:0:71335:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff8c046ba2e300 x1866818961281536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340979.034200:0:71335:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000912d2e8d] to pc [ptlrpcd_00_02+2] req@ffff8c046ba2e300 x1866818961281536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.034216:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340979.034221:0:71335:0:(genops.c:1231:class_import_get()) import ffff8c034a39c800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1780340979.034227:0:71335:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff8c046ba2d180 x1866818961281664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340979.034236:0:71335:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009ca96525] to pc [ptlrpcd_00_03+3] req@ffff8c046ba2d180 x1866818961281664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340979.034244:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340979.034247:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1780340979.034250:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c034a39f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340979.034254:0:71335:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3756 00000100:00080000:2.0:1780340979.034258:0:71335:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00000040:2.0:1780340979.034261:0:71335:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 53 to 0@lo 00000100:00000040:2.0:1780340979.034264:0:71335:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 54 to 0@lo 00000020:00000040:2.0:1780340979.034266:0:71335:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f160 00000020:00000040:2.0:1780340979.034270:0:71335:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0475fab800 refcount=4 00000100:00000040:2.0:1780340979.034278:0:71335:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 53 to 0@lo 00000100:00000040:2.0:1780340979.034280:0:71335:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 54 to 0@lo 00000020:00000040:2.0:1780340979.034283:0:71335:0:(genops.c:900:class_export_put()) PUTting export ffff8c0475fab800 : new refcount 3 00000100:00080000:2.0:1780340979.034285:0:71335:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c034a39f800 using connection 192.168.203.116@tcp/0@lo 00000020:00000040:2.0:1780340979.034292:0:71335:0:(genops.c:1231:class_import_get()) import ffff8c034a39f800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:2.0:1780340979.034301:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046ba2dc00 x1866818961281792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340979.034310:0:71335:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002ca63663] to pc [ptlrpcd_rcv+-1] req@ffff8c046ba2dc00 x1866818961281792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.034318:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340979.034322:0:71335:0:(genops.c:1231:class_import_get()) import ffff8c0346ee9000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1780340979.034328:0:71335:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff8c046ba2f480 x1866818961281920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340979.034336:0:71335:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ee1753a1] to pc [ptlrpcd_00_00+0] req@ffff8c046ba2f480 x1866818961281920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.034344:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340979.034349:0:71335:0:(genops.c:1231:class_import_get()) import ffff8c0346eef800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1780340979.034356:0:71335:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff8c046ba2c000 x1866818961282048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340979.034365:0:71335:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f989b013] to pc [ptlrpcd_00_01+1] req@ffff8c046ba2c000 x1866818961282048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.034372:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340979.034376:0:71335:0:(genops.c:1231:class_import_get()) import ffff8c0450113000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1780340979.034383:0:71335:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff8c046ba2e680 x1866818961282176/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340979.034402:0:71335:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000024a80fc2] to pc [ptlrpcd_00_02+2] req@ffff8c046ba2e680 x1866818961282176/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340979.034409:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340979.034411:0:71335:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1780340979.034413:0:71335:0:(import.c:65:import_set_state_nolock()) ffff8c046b9a9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1780340979.034417:0:71335:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3756 00000100:00080000:2.0:1780340979.034419:0:71335:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00000040:2.0:1780340979.034421:0:71335:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 53 to 0@lo 00000100:00000040:2.0:1780340979.034423:0:71335:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 54 to 0@lo 00000020:00000040:2.0:1780340979.034425:0:71335:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775313 00000020:00000040:2.0:1780340979.034427:0:71335:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0445b41800 refcount=4 00000100:00000040:2.0:1780340979.034430:0:71335:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 53 to 0@lo 00000100:00000040:2.0:1780340979.034432:0:71335:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 54 to 0@lo 00000020:00000040:2.0:1780340979.034434:0:71335:0:(genops.c:900:class_export_put()) PUTting export ffff8c0445b41800 : new refcount 3 00000100:00080000:2.0:1780340979.034436:0:71335:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c046b9a9000 using connection 192.168.203.116@tcp/0@lo 00000020:00000040:2.0:1780340979.034442:0:71335:0:(genops.c:1231:class_import_get()) import ffff8c046b9a9000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:2.0:1780340979.034451:0:71335:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c046ba2df80 x1866818961282304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340979.034458:0:71335:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006a73e119] to pc [ptlrpcd_rcv+-1] req@ffff8c046ba2df80 x1866818961282304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.034466:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340979.034470:0:71335:0:(genops.c:1231:class_import_get()) import ffff8c046bae0000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1780340979.034476:0:71335:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff8c034d4cbb80 x1866818961282432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340979.034484:0:71335:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005b01e003] to pc [ptlrpcd_00_03+3] req@ffff8c034d4cbb80 x1866818961282432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.034496:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340979.034501:0:71335:0:(genops.c:1231:class_import_get()) import ffff8c0442c0f800 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1780340979.034508:0:71335:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff8c034d4c9f80 x1866818961282560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340979.034515:0:71335:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000488a047a] to pc [ptlrpcd_00_00+0] req@ffff8c034d4c9f80 x1866818961282560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.034524:0:71335:0:(pinger.c:306:ptlrpc_pinger_main()) next wakeup in 5 (3764) 00000100:00000040:2.0:1780340979.034540:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2f480 x1866818961281920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340979.034553:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961281920:0@lo:400:kworker.0 00000100:00000040:2.0:1780340979.034578:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2f480 x1866818961281920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.034586:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340979.034622:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d4c9880 x1866818961281920 msgsize 224 00000100:00100000:2.0:1780340979.034627:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340979.034653:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2f480 x1866818961281920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.034664:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5011 usecs (6 jiffies) 00000100:00000040:1.0:1780340979.034754:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2d500 x1866818961281408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340979.034782:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961281408:0@lo:400:kworker.0 00000100:00000040:1.0:1780340979.034808:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2d500 x1866818961281408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340979.034814:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340979.034830:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a8c8e00 x1866818961281408 msgsize 224 00000100:00100000:1.0:1780340979.034835:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780340979.034846:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2d500 x1866818961281408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340979.034881:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 7337 usecs (8 jiffies) 00000100:00000040:1.0:1780340979.034891:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2c000 x1866818961282048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340979.034899:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961282048:0@lo:400:kworker.0 00000100:00000040:1.0:1780340979.034911:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2c000 x1866818961282048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340979.034919:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340979.034930:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a8c8380 x1866818961282048 msgsize 224 00000100:00100000:1.0:1780340979.034934:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1780340979.034947:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2c000 x1866818961282048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340979.034956:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 128997 usecs (129 jiffies) 00000100:00100000:1.0:1780340979.034987:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961281408 00000100:00100000:1.0:1780340979.034993:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961281408 00000020:00000040:1.0:1780340979.034995:0:64454:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277546a 00000020:00000040:1.0:1780340979.034998:0:64454:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0458280800 refcount=5 00000020:00000040:1.0:1780340979.035008:0:64454:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff8c0445ba19c0) now 14 - evictor 00000100:00000040:1.0:1780340979.035027:0:64454:0:(service.c:1435:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1780340979.035047:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961282048 00000100:00100000:1.0:1780340979.035050:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961282048 00000020:00000040:1.0:1780340979.035052:0:64454:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775471 00000020:00000040:1.0:1780340979.035054:0:64454:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046b908800 refcount=5 00000100:00100000:1.0:1780340979.035075:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1527 00000100:00000040:1.0:1780340979.035078:0:64454:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0458280800 : new rpc_count 1 00000100:00000040:1.0:1780340979.035084:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a8c8e00 x1866818961281408/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:405/0 lens 224/0 e 0 to 0 dl 1780340990 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340979.035094:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961281408:12345-0@lo:400:kworker.0 00010000:00000040:1.0:1780340979.035122:0:64454:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961281408 00000100:00000040:1.0:1780340979.035131:0:64454:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 55 to 0@lo 00000100:00000040:1.0:1780340979.035136:0:64454:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1780340979.035146:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961281920 00000100:00100000:3.0:1780340979.035150:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961281920 00000020:00000040:3.0:1780340979.035151:0:25490:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f183 00000100:00000040:1.0:1780340979.035151:0:64454:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046ba2d500 x1866818961281408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340979.035154:0:25490:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0442c08800 refcount=5 00000020:00000040:3.0:1780340979.035161:0:25490:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00000040:1.0:1780340979.035167:0:64454:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 54 to 0@lo 00000100:00000040:1.0:1780340979.035172:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8c8e00 x1866818961281408/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:405/0 lens 224/224 e 0 to 0 dl 1780340990 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340979.035176:0:25490:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:1.0:1780340979.035180:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961281408:12345-0@lo:400:kworker.0 Request processed in 88us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340979.035187:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1527 00000100:00000040:1.0:1780340979.035190:0:64454:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0458280800 : new rpc_count 0 00000100:00100000:3.0:1780340979.035191:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2686 00000100:00000040:3.0:1780340979.035193:0:25490:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0442c08800 : new rpc_count 1 00000100:00000040:3.0:1780340979.035196:0:25490:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d4c9880 x1866818961281920/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:405/0 lens 224/0 e 0 to 0 dl 1780340990 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780340979.035199:0:64454:0:(genops.c:900:class_export_put()) PUTting export ffff8c0458280800 : new refcount 4 00000100:00100000:3.0:1780340979.035206:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961281920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340979.035206:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1528 00000100:00000040:1.0:1780340979.035209:0:64454:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046b908800 : new rpc_count 1 00000100:00000040:1.0:1780340979.035211:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a8c8380 x1866818961282048/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:405/0 lens 224/0 e 0 to 0 dl 1780340990 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1780340979.035215:0:25490:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969444, transno 0, xid 1866818961281920 00000100:00000040:3.0:1780340979.035220:0:25490:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 55 to 0@lo 00000100:00100000:1.0:1780340979.035221:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961282048:12345-0@lo:400:kworker.0 00000100:00000040:3.0:1780340979.035223:0:25490:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00000040:1.0:1780340979.035229:0:64454:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961282048 00000100:00000040:1.0:1780340979.035233:0:64454:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 56 to 0@lo 00000100:00000040:1.0:1780340979.035236:0:64454:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340979.035239:0:25490:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046ba2f480 x1866818961281920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340979.035245:0:64454:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046ba2c000 x1866818961282048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340979.035252:0:25490:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 55 to 0@lo 00000100:00000040:1.0:1780340979.035254:0:64454:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 54 to 0@lo 00000100:00000040:3.0:1780340979.035256:0:25490:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4c9880 x1866818961281920/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:405/0 lens 224/224 e 0 to 0 dl 1780340990 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340979.035257:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8c8380 x1866818961282048/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:405/0 lens 224/224 e 0 to 0 dl 1780340990 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.035265:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961281920:12345-0@lo:400:kworker.0 Request processed in 60us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340979.035276:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961282048:12345-0@lo:400:kworker.0 Request processed in 56us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340979.035282:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1528 00000100:00000040:1.0:1780340979.035284:0:64454:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046b908800 : new rpc_count 0 00000020:00000040:1.0:1780340979.035291:0:64454:0:(genops.c:900:class_export_put()) PUTting export ffff8c046b908800 : new refcount 4 00000100:00080000:1.0:1780340979.035304:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1780340979.035307:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00080000:1.0:1780340979.035310:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:1.0:1780340979.035311:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff8c0445ba19c0) now 14 - evictor 00000100:00000040:1.0:1780340979.035338:0:3660:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:1.0:1780340979.035344:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2d500 x1866818961281408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340979.035353:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2d500 x1866818961281408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340979.035361:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961281408:0@lo:400:kworker.0 00000100:00000040:1.0:1780340979.035370:0:3660:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:1.0:1780340979.035374:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2c000 x1866818961282048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340979.035381:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2c000 x1866818961282048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340979.035388:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961282048:0@lo:400:kworker.0 00000100:00000040:1.0:1780340979.035394:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2d500 x1866818961281408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780340979.035405:0:3660:0:(genops.c:1244:class_import_put()) import ffff8c0346bb9800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:1.0:1780340979.035413:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2c000 x1866818961282048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1780340979.035426:0:3660:0:(genops.c:1244:class_import_put()) import ffff8c0346eef800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1780340979.035847:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c047a8cb800 x1866818961281280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.035918:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961281280:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1780340979.035942:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c047a8cb800 x1866818961281280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1780340989 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340979.035951:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340979.035970:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff8c0446efca80 x1866818961281280 msgsize 520 00000100:00100000:0.0:1780340979.035975:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340979.035990:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c047a8cb800 x1866818961281280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1780340989 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340979.036000:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00000040:0.0:1780340979.036015:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2dc00 x1866818961281792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.036031:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961281792:0@lo:8:kworker.0 00000100:00000040:2.0:1780340979.036958:0:3659:0:(client.c:3098:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969444 00000100:00000040:2.0:1780340979.036970:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2f480 x1866818961281920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.036981:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2f480 x1866818961281920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340979.036988:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961281920:0@lo:400:kworker.0 00000100:00000040:2.0:1780340979.037007:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c034d4c9f80 x1866818961282560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340979.037018:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961282560:0@lo:400:kworker.0 00000100:00000040:2.0:1780340979.037035:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c034d4c9f80 x1866818961282560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.037043:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340979.037065:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d4cb480 x1866818961282560 msgsize 224 00000100:00100000:2.0:1780340979.037070:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340979.037162:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2dc00 x1866818961281792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780341004 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340979.037172:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340979.037189:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff8c0446efed80 x1866818961281792 msgsize 520 00000100:00100000:0.0:1780340979.037192:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340979.037209:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2dc00 x1866818961281792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780341004 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340979.037220:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5425 usecs (6 jiffies) 00000100:00000040:0.0:1780340979.037226:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2df80 x1866818961282304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.037236:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961282304:0@lo:8:kworker.0 00000100:00000040:0.0:1780340979.037248:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2df80 x1866818961282304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780341004 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340979.037255:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340979.037266:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff8c0446efd180 x1866818961282304 msgsize 520 00000100:00100000:0.0:1780340979.037270:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340979.037282:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2df80 x1866818961282304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780341004 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340979.037291:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 9685 usecs (10 jiffies) 00000100:00100000:0.0:1780340979.037314:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961281792 00000100:00100000:0.0:1780340979.037319:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961281792 00000020:00000040:0.0:1780340979.037322:0:25495:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f175 00000100:00100000:0.0:1780340979.037348:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961282304 00000100:00100000:0.0:1780340979.037351:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961282304 00000020:00000040:0.0:1780340979.037352:0:25495:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775328 00000100:00100000:0.0:1780340979.037369:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6015 00000100:00000040:0.0:1780340979.037376:0:25495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0446efed80 x1866818961281792/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780340999 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.037392:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3658:x1866818961281792:12345-0@lo:8:kworker.0 00000020:00000040:0.0:1780340979.037410:0:25495:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff8c0476588000) now 7 - find 00010000:00000040:0.0:1780340979.037416:0:25495:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:0.0:1780340979.037418:0:25495:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff8c0476588000) now 7 - find 00000100:00000040:0.0:1780340979.037431:0:25495:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 55 to 0@lo 00000100:00000040:0.0:1780340979.037434:0:25495:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8c044319f100 refcount 55 to 0@lo 00000100:00000040:0.0:1780340979.037438:0:25495:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340979.037453:0:25495:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8c046ba2dc00 x1866818961281792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780341004 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340979.037471:0:25495:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 54 to 0@lo 00000100:00000040:0.0:1780340979.037475:0:25495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446efed80 x1866818961281792/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1780340999 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.037485:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3658:x1866818961281792:12345-0@lo:8:kworker.0 Request processed in 94us (294us total) trans 0 rc -11/-11 00000100:00100000:0.0:1780340979.037492:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6015 00000100:00100000:0.0:1780340979.037509:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6016 00000100:00000040:0.0:1780340979.037513:0:25495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0446efd180 x1866818961282304/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780340999 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.037521:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3658:x1866818961282304:12345-0@lo:8:kworker.0 00000020:00000040:0.0:1780340979.037528:0:25495:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff8c0476588000) now 7 - find 00010000:00000040:0.0:1780340979.037531:0:25495:0:(ldlm_lib.c:1200:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:0.0:1780340979.037535:0:25495:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff8c0476588000) now 7 - find 00000100:00000040:0.0:1780340979.037541:0:25495:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 55 to 0@lo 00000100:00000040:0.0:1780340979.037543:0:25495:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8c044319f100 refcount 55 to 0@lo 00000100:00000040:0.0:1780340979.037546:0:25495:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340979.037559:0:25495:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff8c046ba2df80 x1866818961282304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780341004 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340979.037582:0:25495:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 54 to 0@lo 00000100:00000040:0.0:1780340979.037586:0:25495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446efd180 x1866818961282304/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1780340999 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.037592:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:3658:x1866818961282304:12345-0@lo:8:kworker.0 Request processed in 71us (325us total) trans 0 rc -11/-11 00000100:00100000:0.0:1780340979.037599:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6016 00000100:00000040:2.0:1780340979.037639:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c034d4c9f80 x1866818961282560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.037649:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 6725 usecs (7 jiffies) 00000100:00000040:2.0:1780340979.037655:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2f480 x1866818961281920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340979.037664:0:3659:0:(genops.c:1244:class_import_put()) import ffff8c0346ee9000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00100000:3.0:1780340979.037722:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2686 00000100:00000040:3.0:1780340979.037725:0:25490:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0442c08800 : new rpc_count 0 00000020:00000040:3.0:1780340979.037735:0:25490:0:(genops.c:900:class_export_put()) PUTting export ffff8c0442c08800 : new refcount 4 00000100:00100000:1.0:1780340979.037743:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961281280 00000100:00100000:1.0:1780340979.037747:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961281280 00000020:00000040:1.0:1780340979.037749:0:64454:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:3.0:1780340979.037750:0:63710:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961282560 00000100:00100000:3.0:1780340979.037753:0:63710:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961282560 00000020:00000040:3.0:1780340979.037754:0:63710:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775478 00000020:00000040:3.0:1780340979.037773:0:63710:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a0a2800 refcount=5 00000100:00000040:3.0:1780340979.037785:0:63710:0:(service.c:1435:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1780340979.037813:0:63710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1529 00000100:00000040:3.0:1780340979.037816:0:63710:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a0a2800 : new rpc_count 1 00000100:00000040:3.0:1780340979.037819:0:63710:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d4cb480 x1866818961282560/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:405/0 lens 224/0 e 0 to 0 dl 1780340990 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.037840:0:63710:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961282560:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780340979.037855:0:63710:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961282560 00000100:00000040:3.0:1780340979.037860:0:63710:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 55 to 0@lo 00000100:00000040:3.0:1780340979.037864:0:63710:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340979.037881:0:63710:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c034d4c9f80 x1866818961282560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340979.037893:0:63710:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 54 to 0@lo 00000100:00000040:3.0:1780340979.037897:0:63710:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4cb480 x1866818961282560/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:405/0 lens 224/224 e 0 to 0 dl 1780340990 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.037905:0:63710:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961282560:12345-0@lo:400:kworker.0 Request processed in 66us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340979.037911:0:63710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1529 00000100:00000040:3.0:1780340979.037913:0:63710:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a0a2800 : new rpc_count 0 00000020:00000040:3.0:1780340979.037919:0:63710:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a0a2800 : new refcount 4 00000100:00100000:1.0:1780340979.038058:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1593 00000100:00000040:1.0:1780340979.038063:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0446efca80 x1866818961281280/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1780340999 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340979.038071:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961281280:12345-0@lo:38:llog_process_th.0 00000020:00000040:1.0:1780340979.038079:0:64454:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff8c0445ba19c0) now 14 - find 00010000:00000040:1.0:1780340979.038087:0:64454:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1780340979.038093:0:64454:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3759 last 0 00000020:00000040:1.0:1780340979.038103:0:64454:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c0345308800 with handle 0xa2465143277627f to hash 00000020:00000040:1.0:1780340979.038125:0:64454:0:(genops.c:889:class_export_get()) GET export ffff8c0345308800 refcount=3 00000020:00000040:1.0:1780340979.038130:0:64454:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff8c0445ba19c0) now 15 - export 00000020:00000040:1.0:1780340979.038133:0:64454:0:(genops.c:900:class_export_put()) PUTting export ffff8c0345308800 : new refcount 2 00000020:00000080:1.0:1780340979.038135:0:64454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa2465143277627f 00000020:00000040:1.0:1780340979.038136:0:64454:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277627f 00000020:00000040:1.0:1780340979.038138:0:64454:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0345308800 refcount=3 00000001:00000040:1.0:1780340979.038148:0:64454:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.203.116@tcp 00000001:00000040:1.0:1780340979.038152:0:64454:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8c044d6a9c00) : new refcount 15 00000020:00000040:1.0:1780340979.038156:0:64454:0:(genops.c:889:class_export_get()) GET export ffff8c0345308800 refcount=4 00000001:00000040:1.0:1780340979.038157:0:64454:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8c044d6a9c00) : new refcount 16 00000001:00000040:1.0:1780340979.038161:0:64454:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff8c044d6a9c00) : new refcount 15 00000004:00100000:1.0:1780340979.038166:0:64454:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:1.0:1780340979.038174:0:64454:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff8c04441317e0 for nid 0@lo - ref 6 00000020:00000040:1.0:1780340979.038180:0:64454:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff8c0445ba19c0) now 16 - import 00000020:00000040:1.0:1780340979.038184:0:64454:0:(genops.c:1244:class_import_put()) import ffff8c034530f000 refcount=1 obd=lustre-MDT0000 00000020:00000040:1.0:1780340979.038189:0:64454:0:(genops.c:889:class_export_get()) GET export ffff8c0345308800 refcount=5 00000100:00000040:1.0:1780340979.038195:0:64454:0:(service.c:1085:ptlrpc_request_change_export()) RPC GETting export ffff8c0345308800 : new rpc_count 1 00000100:00000040:1.0:1780340979.038198:0:64454:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 55 to 0@lo 00000100:00000040:1.0:1780340979.038201:0:64454:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8c044319f100 refcount 55 to 0@lo 00000020:00000040:1.0:1780340979.038203:0:64454:0:(genops.c:889:class_export_get()) GET export ffff8c0345308800 refcount=6 00000100:00000040:1.0:1780340979.038209:0:64454:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 56 to 0@lo 00000100:00080000:1.0:1780340979.038217:0:64454:0:(import.c:65:import_set_state_nolock()) ffff8c034530f000 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1780340979.038221:0:64454:0:(genops.c:900:class_export_put()) PUTting export ffff8c0345308800 : new refcount 5 00000020:00000040:1.0:1780340979.038223:0:64454:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff8c0445ba19c0) now 16 - find 00010000:00000040:1.0:1780340979.038232:0:64454:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961281280 00000100:00000040:1.0:1780340979.038236:0:64454:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 57 to 0@lo 00000100:00000040:1.0:1780340979.038240:0:64454:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340979.038259:0:64454:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff8c047a8cb800 x1866818961281280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1780340989 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340979.038272:0:64454:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 56 to 0@lo 00000100:00000040:1.0:1780340979.038275:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446efca80 x1866818961281280/t0(0) o38->lustre-MDT0000-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1780340999 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340979.038283:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1866818961281280:12345-0@lo:38:llog_process_th.0 Request processed in 211us (2311us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340979.038288:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1593 00000100:00000040:1.0:1780340979.038290:0:64454:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0345308800 : new rpc_count 0 00000020:00000040:1.0:1780340979.038296:0:64454:0:(genops.c:900:class_export_put()) PUTting export ffff8c0345308800 : new refcount 4 00000100:00000040:2.0:1780340979.038382:0:3659:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1780340979.038388:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c034d4c9f80 x1866818961282560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.038396:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4c9f80 x1866818961282560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340979.038403:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961282560:0@lo:400:kworker.0 00000100:00000040:2.0:1780340979.038407:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c034d4c9f80 x1866818961282560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340979.038414:0:3659:0:(genops.c:1244:class_import_put()) import ffff8c0442c0f800 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1780340979.038430:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2e300 x1866818961281536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340979.038451:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961281536:0@lo:400:kworker.0 00000100:00000040:2.0:1780340979.038466:0:3661:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2e300 x1866818961281536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.038472:0:3661:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340979.038485:0:3661:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d4c9f80 x1866818961281536 msgsize 224 00000100:00100000:2.0:1780340979.038489:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340979.038509:0:3661:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2e300 x1866818961281536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.038518:0:3661:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7002 usecs (8 jiffies) 00000100:00000040:2.0:1780340979.038525:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2e680 x1866818961282176/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340979.038532:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961282176:0@lo:400:kworker.0 00000100:00000040:2.0:1780340979.038542:0:3661:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2e680 x1866818961282176/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.038548:0:3661:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340979.038560:0:3661:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d4caa00 x1866818961282176 msgsize 224 00000100:00100000:2.0:1780340979.038564:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340979.038581:0:3661:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2e680 x1866818961282176/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.038589:0:3661:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3441 usecs (4 jiffies) 00000100:00100000:2.0:1780340979.038598:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:2.0:1780340979.038603:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c046ba2d180 x1866818961281664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.038605:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961282176 00000100:00100000:3.0:1780340979.038609:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961282176 00000020:00000040:3.0:1780340979.038610:0:8411:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277530c 00000100:00100000:2.0:1780340979.038611:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961281664:0@lo:400:kworker.0 00000020:00000040:3.0:1780340979.038613:0:8411:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c04514b0800 refcount=5 00000100:00000040:2.0:1780340979.038621:0:3661:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c046ba2d180 x1866818961281664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340979.038624:0:8411:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00000040:2.0:1780340979.038637:0:3661:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1780340979.038642:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4017 00000100:00000040:3.0:1780340979.038644:0:8411:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c04514b0800 : new rpc_count 1 00000100:00000040:3.0:1780340979.038648:0:8411:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d4caa00 x1866818961282176/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:405/0 lens 224/0 e 0 to 0 dl 1780340990 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.038649:0:3661:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d4c8700 x1866818961281664 msgsize 224 00000100:00100000:2.0:1780340979.038653:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340979.038659:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961282176:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1780340979.038663:0:3661:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c046ba2d180 x1866818961281664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1780340979.038670:0:8411:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961282176 00000100:00000040:3.0:1780340979.038675:0:8411:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 57 to 0@lo 00000100:00000040:3.0:1780340979.038685:0:8411:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340979.038701:0:8411:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046ba2e680 x1866818961282176/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340979.038713:0:8411:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 56 to 0@lo 00000100:00000040:3.0:1780340979.038717:0:8411:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4caa00 x1866818961282176/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:405/0 lens 224/224 e 0 to 0 dl 1780340990 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.038724:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961282176:12345-0@lo:400:kworker.0 Request processed in 67us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340979.038731:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4017 00000100:00000040:3.0:1780340979.038733:0:8411:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c04514b0800 : new rpc_count 0 00000020:00000040:3.0:1780340979.038739:0:8411:0:(genops.c:900:class_export_put()) PUTting export ffff8c04514b0800 : new refcount 4 00000100:00100000:3.0:1780340979.038745:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961281664 00000100:00100000:3.0:1780340979.038748:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961281664 00000020:00000040:3.0:1780340979.038750:0:8411:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa246514327752c6 00000020:00000040:3.0:1780340979.038752:0:8411:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0475fad800 refcount=7 00000100:00000040:3.0:1780340979.038775:0:8411:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1780340979.038777:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961281536 00000100:00100000:0.0:1780340979.038781:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961281536 00000020:00000040:0.0:1780340979.038782:0:63711:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f208 00000020:00000040:0.0:1780340979.038785:0:63711:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046ba26800 refcount=5 00000100:00100000:3.0:1780340979.038799:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4018 00000100:00000040:3.0:1780340979.038801:0:8411:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0475fad800 : new rpc_count 1 00000100:00000040:3.0:1780340979.038804:0:8411:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d4c8700 x1866818961281664/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:405/0 lens 224/0 e 0 to 0 dl 1780340990 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340979.038806:0:63711:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff8c03475519c0) now 10 - evictor 00000100:00100000:3.0:1780340979.038814:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961281664:12345-0@lo:400:kworker.0 00000100:00000040:0.0:1780340979.038821:0:63711:0:(service.c:1435:ptlrpc_at_set_timer()) armed mdt at +6s 00010000:00000040:3.0:1780340979.038825:0:8411:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1866818961281664 00000100:00000040:3.0:1780340979.038829:0:8411:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 57 to 0@lo 00000100:00000040:3.0:1780340979.038832:0:8411:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:0.0:1780340979.038836:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530 00000100:00000040:0.0:1780340979.038838:0:63711:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046ba26800 : new rpc_count 1 00000100:00000040:0.0:1780340979.038842:0:63711:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d4c9f80 x1866818961281536/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:405/0 lens 224/0 e 0 to 0 dl 1780340990 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340979.038845:0:8411:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046ba2d180 x1866818961281664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.038853:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961281536:12345-0@lo:400:kworker.0 00000100:00000040:3.0:1780340979.038856:0:8411:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 56 to 0@lo 00000100:00000040:3.0:1780340979.038860:0:8411:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4c8700 x1866818961281664/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:405/0 lens 224/224 e 0 to 0 dl 1780340990 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.038873:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961281664:12345-0@lo:400:kworker.0 Request processed in 60us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340979.038878:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4018 00000100:00000040:3.0:1780340979.038880:0:8411:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0475fad800 : new rpc_count 0 00000020:00000040:3.0:1780340979.038886:0:8411:0:(genops.c:900:class_export_put()) PUTting export ffff8c0475fad800 : new refcount 6 00000100:00000040:2.0:1780340979.039974:0:3661:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 840250 usecs (841 jiffies) 00000100:00000040:2.0:1780340979.039994:0:3661:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:2.0:1780340979.040001:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2d180 x1866818961281664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.040011:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2d180 x1866818961281664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340979.040018:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961281664:0@lo:400:kworker.0 00000100:00000040:2.0:1780340979.040025:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c034d4cbb80 x1866818961282432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340979.040036:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961282432:0@lo:400:kworker.0 00000100:00000040:2.0:1780340979.040050:0:3661:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c034d4cbb80 x1866818961282432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.040057:0:3661:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340979.040077:0:3661:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d4c8000 x1866818961282432 msgsize 224 00000100:00100000:2.0:1780340979.040081:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340979.040097:0:3661:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c034d4cbb80 x1866818961282432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.040105:0:3661:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 8107 usecs (9 jiffies) 00000100:00000040:2.0:1780340979.040115:0:3661:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1780340979.040119:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2e680 x1866818961282176/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.040139:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2e680 x1866818961282176/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340979.040144:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961282176:0@lo:400:kworker.0 00000100:00000040:2.0:1780340979.040150:0:3661:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2d180 x1866818961281664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340979.040160:0:3661:0:(genops.c:1244:class_import_put()) import ffff8c034a39c800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1780340979.040168:0:3661:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2e680 x1866818961282176/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340979.040174:0:3661:0:(genops.c:1244:class_import_put()) import ffff8c0450113000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00010000:00000040:0.0:1780340979.040252:0:63711:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961281536 00000100:00000040:0.0:1780340979.040261:0:63711:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 57 to 0@lo 00000100:00000040:0.0:1780340979.040265:0:63711:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340979.040284:0:63711:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c046ba2e300 x1866818961281536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340979.040298:0:63711:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 56 to 0@lo 00000100:00000040:0.0:1780340979.040303:0:63711:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4c9f80 x1866818961281536/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:405/0 lens 224/224 e 0 to 0 dl 1780340990 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.040312:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961281536:12345-0@lo:400:kworker.0 Request processed in 1460us (1825us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340979.040328:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530 00000100:00000040:0.0:1780340979.040332:0:63711:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046ba26800 : new rpc_count 0 00000020:00000040:0.0:1780340979.040342:0:63711:0:(genops.c:900:class_export_put()) PUTting export ffff8c046ba26800 : new refcount 4 00000100:00100000:0.0:1780340979.040377:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961282432 00000100:00100000:0.0:1780340979.040382:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961282432 00000020:00000040:0.0:1780340979.040384:0:8399:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775336 00000020:00000040:0.0:1780340979.040387:0:8399:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0452a6e000 refcount=5 00000020:00000040:0.0:1780340979.040398:0:8399:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00000040:0.0:1780340979.040409:0:8399:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1780340979.040436:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687 00000100:00000040:0.0:1780340979.040439:0:8399:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0452a6e000 : new rpc_count 1 00000100:00000040:0.0:1780340979.040443:0:8399:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d4c8000 x1866818961282432/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:405/0 lens 224/0 e 0 to 0 dl 1780340990 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.040456:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961282432:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1780340979.040469:0:8399:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1866818961282432 00000100:00000040:0.0:1780340979.040475:0:8399:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 57 to 0@lo 00000100:00000040:0.0:1780340979.040479:0:8399:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340979.040494:0:8399:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c034d4cbb80 x1866818961282432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340979.040507:0:8399:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 56 to 0@lo 00000100:00000040:0.0:1780340979.040511:0:8399:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4c8000 x1866818961282432/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:405/0 lens 224/224 e 0 to 0 dl 1780340990 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.040519:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961282432:12345-0@lo:400:kworker.0 Request processed in 65us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340979.040524:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687 00000100:00000040:0.0:1780340979.040527:0:8399:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0452a6e000 : new rpc_count 0 00000020:00000040:0.0:1780340979.040533:0:8399:0:(genops.c:900:class_export_put()) PUTting export ffff8c0452a6e000 : new refcount 4 00000100:00080000:0.0:1780340979.040566:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1780340979.040570:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00080000:0.0:1780340979.040572:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1780340979.040574:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff8c03475519c0) now 10 - evictor 00000100:00100000:0.0:1780340979.040595:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:0.0:1780340979.040599:0:3658:0:(client.c:3212:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:0.0:1780340979.040604:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c047a8cb800 x1866818961281280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340979.040615:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000020:00000040:0.0:1780340979.040618:0:3658:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432776278 00000020:00000040:0.0:1780340979.040620:0:3658:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c044d43a800 refcount=4 00000100:00080000:0.0:1780340979.040627:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:0.0:1780340979.040630:0:3658:0:(genops.c:900:class_export_put()) PUTting export ffff8c044d43a800 : new refcount 3 00000100:00080000:0.0:1780340979.040634:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1780340979.040637:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c047a95f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00000040:0.0:1780340979.040645:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8cb800 x1866818961281280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340989 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.040653:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1866818961281280:0@lo:38:llog_process_th.0 00000100:00000040:0.0:1780340979.040666:0:3658:0:(client.c:3098:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294969456 00000100:00000040:0.0:1780340979.040670:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2dc00 x1866818961281792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780341004 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340979.040679:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340979.040682:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:0.0:1780340979.040686:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2dc00 x1866818961281792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780341004 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.040694:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961281792:0@lo:8:kworker.0 00000100:00000040:0.0:1780340979.040715:0:3658:0:(client.c:3098:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294969457 00000100:00000040:0.0:1780340979.040720:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2df80 x1866818961282304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780341004 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1780340979.040727:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c046b9a9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1780340979.040730:0:3658:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:0.0:1780340979.040734:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2df80 x1866818961282304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780341004 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.040741:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961282304:0@lo:8:kworker.0 00000100:00000040:0.0:1780340979.040747:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c047a8cb800 x1866818961281280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340989 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340979.040756:0:3658:0:(genops.c:1244:class_import_put()) import ffff8c047a95f000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:0.0:1780340979.040783:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2dc00 x1866818961281792/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780341004 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340979.040801:0:3658:0:(genops.c:1244:class_import_put()) import ffff8c034a39f800 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1780340979.040807:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2df80 x1866818961282304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1780341004 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340979.040814:0:3658:0:(genops.c:1244:class_import_put()) import ffff8c046b9a9000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000020:00000040:1.0:1780340979.040989:0:93018:0:(genops.c:889:class_export_get()) GET export ffff8c044d43a800 refcount=4 00000020:00000040:1.0:1780340979.041005:0:93018:0:(genops.c:889:class_export_get()) GET export ffff8c044d43a800 refcount=5 00000100:00000040:1.0:1780340979.041067:0:93018:0:(lustre_peer.c:111:class_add_uuid()) found uuid 192.168.203.116@tcp 192.168.203.116@tcp cnt=1 00000020:01000004:1.0:1780340979.041087:0:93018:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1780340979.041099:0:93018:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8c0349004d40) 00000020:00000040:1.0:1780340979.041105:0:93018:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c034530c800 with handle 0xa24651432776286 to hash 00000020:00000040:1.0:1780340979.041110:0:93018:0:(genops.c:900:class_export_put()) PUTting export ffff8c034530c800 : new refcount 1 00000020:00000040:1.0:1780340979.041124:0:93018:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff8c0349004d40) now 2 - obd_device_list 00000020:00000080:1.0:1780340979.041130:0:93018:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:00000040:3.0:1780340979.041359:0:93020:0:(genops.c:889:class_export_get()) GET export ffff8c044d43a800 refcount=6 00000020:00000040:3.0:1780340979.041364:0:93020:0:(genops.c:889:class_export_get()) GET export ffff8c044d43a800 refcount=7 00000020:00000040:3.0:1780340979.041368:0:93020:0:(genops.c:900:class_export_put()) PUTting export ffff8c044d43a800 : new refcount 6 00000020:01000004:3.0:1780340979.041835:0:93018:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8c0351be9000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1780340979.041840:0:93018:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8c0351be9000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1780340979.041842:0:93018:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8c0351be9000 3 00000020:00000040:3.0:1780340979.041859:0:93018:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff8c0349004d40) now 3 - import 00000020:00000040:3.0:1780340979.041864:0:93018:0:(genops.c:1244:class_import_put()) import ffff8c047b1f9800 refcount=1 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:3.0:1780340979.041873:0:93018:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 57 to 0@lo 00000100:00000040:3.0:1780340979.041876:0:93018:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8c044319f100 refcount 57 to 0@lo 00000100:00000040:3.0:1780340979.041878:0:93018:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.203.116@tcp -> ffff8c044319f100 00010000:00080000:3.0:1780340979.041883:0:93018:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c047b1f9800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.116@tcp at head 00000100:00000040:2.0:1780340979.042869:0:3661:0:(client.c:3098:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969457 00000100:00000040:2.0:1780340979.042882:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c034d4cbb80 x1866818961282432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.042894:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4cbb80 x1866818961282432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340979.042903:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961282432:0@lo:400:kworker.0 00000100:00000040:2.0:1780340979.042917:0:3661:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1780340979.042921:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c046ba2e300 x1866818961281536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340979.042930:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c046ba2e300 x1866818961281536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340979.042937:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961281536:0@lo:400:kworker.0 00000100:00000040:2.0:1780340979.042944:0:3661:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c034d4cbb80 x1866818961282432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340979.042967:0:3661:0:(genops.c:1244:class_import_put()) import ffff8c046bae0000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1780340979.042977:0:3661:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c046ba2e300 x1866818961281536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340979.042985:0:3661:0:(genops.c:1244:class_import_put()) import ffff8c0346bbc000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1780340979.045672:0:93018:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000040:3.0:1780340979.045808:0:93018:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff8c0349004d40) now 4 - setup 00000020:00000080:3.0:1780340979.045813:0:93018:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1780340979.045860:0:93018:0:(lwp_dev.c:494:lwp_obd_connect()) connect #0 00000020:00000040:3.0:1780340979.045866:0:93018:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c034530a000 with handle 0xa2465143277628d to hash 00000020:00000040:3.0:1780340979.045873:0:93018:0:(genops.c:889:class_export_get()) GET export ffff8c034530a000 refcount=3 00000020:00000040:3.0:1780340979.045878:0:93018:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff8c0349004d40) now 5 - export 00000020:00000040:3.0:1780340979.045881:0:93018:0:(genops.c:900:class_export_put()) PUTting export ffff8c034530a000 : new refcount 2 00000020:00000080:3.0:1780340979.045883:0:93018:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xa2465143277628d 00000020:00000040:3.0:1780340979.045885:0:93018:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277628d 00000020:00000040:3.0:1780340979.045887:0:93018:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c034530a000 refcount=3 00000100:00080000:3.0:1780340979.045896:0:93018:0:(import.c:512:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:3.0:1780340979.045906:0:93018:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 58 to 0@lo 00000020:00000040:3.0:1780340979.045909:0:93018:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277628d 00000020:00000040:3.0:1780340979.045910:0:93018:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c034530a000 refcount=4 00000100:00000040:3.0:1780340979.045913:0:93018:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 59 to 0@lo 00000020:00000040:3.0:1780340979.045915:0:93018:0:(genops.c:900:class_export_put()) PUTting export ffff8c034530a000 : new refcount 3 00000100:00080000:3.0:1780340979.045917:0:93018:0:(import.c:626:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8c047b1f9800 using connection 192.168.203.116@tcp/0@lo 00000020:00000040:3.0:1780340979.045931:0:93018:0:(genops.c:1231:class_import_get()) import ffff8c047b1f9800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:3.0:1780340979.045955:0:93018:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c045f291880 x1866818961282688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780340979.045969:0:93018:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000862d643f] to pc [ptlrpcd_rcv+-1] req@ffff8c045f291880 x1866818961282688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340979.046006:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c045f291880 x1866818961282688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.046019:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3658:1866818961282688:0@lo:38:llog_process_th.0 00000100:00000040:3.0:1780340979.046048:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c045f291880 x1866818961282688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1780340989 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340979.046055:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340979.046090:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff8c045f292a00 x1866818961282688 msgsize 520 00000100:00100000:3.0:1780340979.046094:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340979.046114:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c045f291880 x1866818961282688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1780340989 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340979.046125:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00080000:3.0:1780340979.046157:0:93018:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000020:00000040:3.0:1780340979.046160:0:93018:0:(genops.c:1231:class_import_get()) import ffff8c047b1f9800 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:3.0:1780340979.046184:0:71335:0:(pinger.c:306:ptlrpc_pinger_main()) next wakeup in 5 (3764) 00000100:00100000:2.0:1780340979.046602:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961282688 00000100:00100000:2.0:1780340979.046610:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961282688 00000020:00000040:2.0:1780340979.046612:0:64454:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:2.0:1780340979.046654:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594 00000100:00000040:2.0:1780340979.046661:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c045f292a00 x1866818961282688/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1780340999 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340979.046683:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1866818961282688:12345-0@lo:38:llog_process_th.0 00000020:00000040:2.0:1780340979.046697:0:64454:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff8c03475519c0) now 10 - find 00010000:00000040:2.0:1780340979.046707:0:64454:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-MDT0001: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:2.0:1780340979.046714:0:64454:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3759 last 0 00000020:00000040:2.0:1780340979.046722:0:64454:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c0346bbf000 with handle 0xa24651432776294 to hash 00000020:00000040:2.0:1780340979.046746:0:64454:0:(genops.c:889:class_export_get()) GET export ffff8c0346bbf000 refcount=3 00000020:00000040:2.0:1780340979.046749:0:64454:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff8c03475519c0) now 11 - export 00000020:00000040:2.0:1780340979.046752:0:64454:0:(genops.c:900:class_export_put()) PUTting export ffff8c0346bbf000 : new refcount 2 00000020:00000080:2.0:1780340979.046754:0:64454:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xa24651432776294 00000020:00000040:2.0:1780340979.046756:0:64454:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432776294 00000020:00000040:2.0:1780340979.046780:0:64454:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0346bbf000 refcount=3 00000001:00000040:2.0:1780340979.046797:0:64454:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.203.116@tcp 00000001:00000040:2.0:1780340979.046802:0:64454:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8c044d6a9c00) : new refcount 16 00000020:00000040:2.0:1780340979.046805:0:64454:0:(genops.c:889:class_export_get()) GET export ffff8c0346bbf000 refcount=4 00000001:00000040:2.0:1780340979.046807:0:64454:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8c044d6a9c00) : new refcount 17 00000001:00000040:2.0:1780340979.046812:0:64454:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff8c044d6a9c00) : new refcount 16 00000004:00100000:2.0:1780340979.046817:0:64454:0:(mdt_handler.c:7305:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:3.0:1780340979.047198:0:64454:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff8c047b3c0c00 for nid 0@lo - ref 4 00000020:00000040:3.0:1780340979.047207:0:64454:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff8c03475519c0) now 12 - import 00000020:00000040:3.0:1780340979.047218:0:64454:0:(genops.c:1244:class_import_put()) import ffff8c0346ee8800 refcount=1 obd=lustre-MDT0001 00000020:00000040:3.0:1780340979.047225:0:64454:0:(genops.c:889:class_export_get()) GET export ffff8c0346bbf000 refcount=5 00000100:00000040:3.0:1780340979.047227:0:64454:0:(service.c:1085:ptlrpc_request_change_export()) RPC GETting export ffff8c0346bbf000 : new rpc_count 1 00000100:00000040:3.0:1780340979.047233:0:64454:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 60 to 0@lo 00000100:00000040:3.0:1780340979.047235:0:64454:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8c044319f100 refcount 60 to 0@lo 00000020:00000040:3.0:1780340979.047237:0:64454:0:(genops.c:889:class_export_get()) GET export ffff8c0346bbf000 refcount=6 00000100:00000040:3.0:1780340979.047243:0:64454:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 61 to 0@lo 00000100:00080000:3.0:1780340979.047249:0:64454:0:(import.c:65:import_set_state_nolock()) ffff8c0346ee8800 : changing import state from RECOVER to FULL 00000020:00000040:3.0:1780340979.047254:0:64454:0:(genops.c:900:class_export_put()) PUTting export ffff8c0346bbf000 : new refcount 5 00000020:00000040:3.0:1780340979.047256:0:64454:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff8c03475519c0) now 12 - find 00010000:00000040:3.0:1780340979.047333:0:64454:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961282688 00000100:00000040:3.0:1780340979.047343:0:64454:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 62 to 0@lo 00000100:00000040:3.0:1780340979.047347:0:64454:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340979.047374:0:64454:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff8c045f291880 x1866818961282688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1780340989 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340979.047396:0:64454:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 61 to 0@lo 00000100:00000040:3.0:1780340979.047400:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f292a00 x1866818961282688/t0(0) o38->lustre-MDT0001-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1780340999 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.047409:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1866818961282688:12345-0@lo:38:llog_process_th.0 Request processed in 727us (1318us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340979.047417:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594 00000100:00000040:3.0:1780340979.047420:0:64454:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0346bbf000 : new rpc_count 0 00000020:00000040:3.0:1780340979.047429:0:64454:0:(genops.c:900:class_export_put()) PUTting export ffff8c0346bbf000 : new refcount 4 00000100:00100000:3.0:1780340979.047464:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:3.0:1780340979.047467:0:3658:0:(client.c:3212:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:3.0:1780340979.047472:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c045f291880 x1866818961282688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780340979.047482:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 19 00000020:00000040:3.0:1780340979.047484:0:3658:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277628d 00000020:00000040:3.0:1780340979.047492:0:3658:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c034530a000 refcount=4 00000100:00080000:3.0:1780340979.047499:0:3658:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:3.0:1780340979.047502:0:3658:0:(genops.c:900:class_export_put()) PUTting export ffff8c034530a000 : new refcount 3 00000100:00080000:3.0:1780340979.047505:0:3658:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1780340979.047507:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c047b1f9800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00000040:3.0:1780340979.047514:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f291880 x1866818961282688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340989 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.047521:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3658:1866818961282688:0@lo:38:llog_process_th.0 00000100:00000040:3.0:1780340979.047527:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c045f291880 x1866818961282688/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1780340989 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340979.047535:0:3658:0:(genops.c:1244:class_import_put()) import ffff8c047b1f9800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000020:00000040:0.0:1780340979.049532:0:93018:0:(genops.c:889:class_export_get()) GET export ffff8c034530a000 refcount=4 00000020:00000040:0.0:1780340979.049546:0:93018:0:(genops.c:889:class_export_get()) GET export ffff8c034530a000 refcount=5 00000040:00080000:0.0:1780340979.049630:0:93018:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000020:00000040:2.0:1780340979.049929:0:93022:0:(genops.c:900:class_export_put()) PUTting export ffff8c034530a000 : new refcount 4 00000020:01000000:3.0:1780340979.050435:0:93007:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:3.0:1780340979.050473:0:93007:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-client' succeeded (0). 00000020:00000040:3.0:1780340979.050522:0:93007:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0475fa5000 refcount=3 00010000:00010000:3.0:1780340979.050530:0:93007:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432776263 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277626a expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.050540:0:93007:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0475fa5000/0xa24651432776263 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xa2465143277626a expref: -99 pid: 93007 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1780340979.050591:0:93007:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1780340979.050593:0:93007:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1780340979.050595:0:93007:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780340979.050596:0:93007:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780340979.050597:0:93007:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780340979.050598:0:93007:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780340979.050599:0:93007:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780340979.050601:0:93007:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780340979.050602:0:93007:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1780340979.050605:0:93007:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1780340979.050608:0:93007:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1780340979.050613:0:93007:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1780340979.050613:0:93007:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1780340979.050614:0:93007:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1780340979.050615:0:93007:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1780340979.050616:0:93007:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1780340979.050616:0:93007:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1780340979.050617:0:93007:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1780340979.050618:0:93007:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:00000040:3.0:1780340979.050624:0:93007:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 10000000:01000000:3.0:1780340979.050645:0:93007:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:3.0:1780340979.050664:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c045f291880 x1866818961282816/t0(0) o253->MGC192.168.203.116@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.050688:0:93007:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f291880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961282816:0@lo:253:mount.lustre.0 00000100:00000040:3.0:1780340979.050711:0:93007:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c045f291880 x1866818961282816/t0(0) o253->MGC192.168.203.116@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780340995 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340979.050720:0:93007:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340979.051112:0:93007:0:(events.c:337:request_in_callback()) incoming req@ffff8c047b031850 x1866818961282816 msgsize 4848 00000100:00100000:3.0:1780340979.051118:0:93007:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340979.051120:0:93007:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780340979.051139:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c045f291880 x1866818961282816/t0(0) o253->MGC192.168.203.116@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780340995 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.051162:0:93007:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04455f00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1780340979.051255:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961282816 00000100:00100000:1.0:1780340979.051264:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961282816 00000020:00000040:1.0:1780340979.051267:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:1.0:1780340979.051270:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=23 00000100:00000040:1.0:1780340979.051291:0:90573:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1780340979.051324:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00000040:1.0:1780340979.051328:0:90573:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:1.0:1780340979.051334:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047b031850 x1866818961282816/t0(0) o253->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:405/0 lens 4848/0 e 0 to 0 dl 1780340990 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340979.051346:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:93007:x1866818961282816:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1780340979.051372:0:90573:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1780340979.051384:0:90573:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1780340979.065969:0:90573:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1780340979.066034:0:90573:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:1.0:1780340979.066286:0:90573:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961282816 00000100:00000040:1.0:1780340979.066302:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 62 to 0@lo 00000100:00000040:1.0:1780340979.066311:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340979.066357:0:90573:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff8c045f291880 x1866818961282816/t0(0) o253->MGC192.168.203.116@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780340995 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340979.066447:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 61 to 0@lo 00000100:00000040:1.0:1780340979.066455:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047b031850 x1866818961282816/t0(0) o253->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:405/0 lens 4848/4768 e 0 to 0 dl 1780340990 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340979.066464:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b031850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:93007:x1866818961282816:12345-0@lo:253:mount.lustre.0 Request processed in 15120us (15351us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340979.066474:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00000040:1.0:1780340979.066477:0:90573:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:1.0:1780340979.066491:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 22 00000100:00000040:0.0:1780340979.067262:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c045f291880 x1866818961282816/t0(0) o253->MGC192.168.203.116@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780340995 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340979.067274:0:93007:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f291880 x1866818961282816/t0(0) o253->MGC192.168.203.116@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780340995 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340979.067283:0:93007:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f291880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:93007:1866818961282816:0@lo:253:mount.lustre.0 00000100:00000040:0.0:1780340979.067304:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c045f291880 x1866818961282816/t0(0) o253->MGC192.168.203.116@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780340995 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1780340979.067316:0:93007:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1780340979.067319:0:93007:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1780340979.067320:0:93007:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1780340979.067322:0:93007:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1780340979.067323:0:93007:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1780340979.067324:0:93007:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1780340979.067325:0:93007:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1780340979.067327:0:93007:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1780340979.067329:0:93007:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1780340979.067330:0:93007:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00000040:0.0:1780340979.067333:0:93007:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c045f291880 x1866818961282816/t0(0) o253->MGC192.168.203.116@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1780340995 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340979.067344:0:93007:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000020:02000000:0.0:1780340979.067356:0:93007:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00002000:00000040:0.0:1780340979.067476:0:93007:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000003:0x3:0x0] 00002000:00000040:0.0:1780340979.067492:0:93007:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0xf:0x0] 00002000:00000040:0.0:1780340979.067532:0:93007:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000003:0x4:0x0] 00002000:00000040:0.0:1780340979.067565:0:93007:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000005:0x1:0x0] 00002000:00000040:0.0:1780340979.067593:0:93007:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0x10:0x0] 00002000:00000040:0.0:1780340979.067622:0:93007:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000003:0x5:0x0] 00002000:00000040:0.0:1780340979.067641:0:93007:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000005:0x2:0x0] 00002000:00000040:0.0:1780340979.067659:0:93007:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0x16:0x0] 00002000:00000040:0.0:1780340979.067706:0:93007:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000003:0x6:0x0] 00002000:00000040:0.0:1780340979.067741:0:93007:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000005:0x3:0x0] 20000000:01000000:3.0:1780340979.068069:0:90571:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1780340979.068074:0:90571:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00000040:3.0:1780340979.068083:0:90571:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff8c045247c900 count: 4 00000020:00000040:3.0:1780340979.068091:0:90571:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c0440030800 with handle 0xa2465143277629b to hash 00010000:00010000:3.0:1780340979.068098:0:90571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c0440030800/0xa2465143277629b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.068113:0:90571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c04754c6200/0xa24651432775383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa2465143277537c expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.068121:0:90571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c0475fa5600/0xa2465143277539f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa24651432775398 expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.068136:0:90571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c04754c6e00/0xa24651432775447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25f9 expref: 8 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.068143:0:90571:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c0440030800/0xa2465143277629b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340979.068150:0:90571:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8c045247c900) refcount = 4 00010000:00000040:3.0:1780340979.068153:0:90571:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1780340979.068156:0:90571:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c04754c6e00/0xa24651432775447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25f9 expref: 8 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340979.068162:0:90571:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c0475fa5600/0xa2465143277539f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0xa24651432775398 expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340979.068168:0:90571:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c04754c6200/0xa24651432775383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0xa2465143277537c expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340979.068173:0:90571:0:(ldlm_resource.c:1868:ldlm_resource_dump()) Waiting locks: 00010000:00000040:3.0:1780340979.068175:0:90571:0:(ldlm_resource.c:1870:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c0440030800/0xa2465143277629b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1780340979.068192:0:90571:0:(genops.c:1231:class_import_get()) import ffff8c0346fd0800 refcount=2 obd=MGS 00010000:00010000:3.0:1780340979.068207:0:90571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c04754c6e00/0xa24651432775447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25f9 expref: 8 pid: 90567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.068222:0:90571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c04754c6e00/0xa24651432775447 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25f9 expref: 8 pid: 90567 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1780340979.068244:0:90571:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c045f293b80 x1866818961282944/t0(0) o104->MGS@192.168.203.16@tcp:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340979.068266:0:90571:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f293b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90571:1866818961282944:192.168.203.16@tcp:104: 00000100:00000040:3.0:1780340979.068288:0:90571:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff8c045f293b80 x1866818961282944/t0(0) o104->MGS@192.168.203.16@tcp:15/16 lens 328/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780340979.068295:0:90571:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000020:00000040:3.0:1780340979.068360:0:90571:0:(genops.c:1231:class_import_get()) import ffff8c0346bbc800 refcount=2 obd=MGS 00010000:00010000:3.0:1780340979.068369:0:90571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c0475fa5600/0xa2465143277539f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa24651432775398 expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.068377:0:90571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c0475fa5600/0xa2465143277539f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa24651432775398 expref: 22 pid: 90570 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1780340979.068386:0:90571:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c045f290380 x1866818961283072/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340979.068393:0:90571:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f290380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90571:1866818961283072:0@lo:104: 00000100:00000040:3.0:1780340979.068404:0:90571:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff8c045f290380 x1866818961283072/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780340979.068411:0:90571:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340979.068437:0:90571:0:(events.c:337:request_in_callback()) incoming req@ffff8c045f291880 x1866818961283072 msgsize 328 00000100:00100000:3.0:1780340979.068442:0:90571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340979.068501:0:90571:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c045f290380 x1866818961283072/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:3.0:1780340979.068516:0:90571:0:(genops.c:1231:class_import_get()) import ffff8c0346bbc800 refcount=3 obd=MGS 00010000:00010000:3.0:1780340979.068524:0:90571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c04754c6200/0xa24651432775383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa2465143277537c expref: 22 pid: 90570 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.068532:0:90571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c04754c6200/0xa24651432775383 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa2465143277537c expref: 22 pid: 90570 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1780340979.068540:0:90571:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c048583ea00 x1866818961283200/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340979.068554:0:90571:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90571:1866818961283200:0@lo:104: 00000100:00000040:3.0:1780340979.068565:0:90571:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff8c048583ea00 x1866818961283200/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780340979.068572:0:90571:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340979.068590:0:90571:0:(events.c:337:request_in_callback()) incoming req@ffff8c0349832c50 x1866818961283200 msgsize 328 00000100:00100000:3.0:1780340979.068594:0:90571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340979.068597:0:90571:0:(events.c:349:request_in_callback()) Buffer complete: 0 buffers still posted 00000100:00000040:0.0:1780340979.068716:0:3653:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c045f293b80 x1866818961282944/t0(0) o104->MGS@192.168.203.16@tcp:15/16 lens 328/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00002000:00000040:0.0:1780340979.069320:0:93007:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0x12:0x0] 00010000:00080000:0.0:1780340979.069433:0:93007:0:(ldlm_lib.c:3035:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 4294969478 00010000:00080000:0.0:1780340979.070143:0:93024:0:(ldlm_lib.c:2838:target_recovery_thread()) lustre-OST0000: started recovery thread pid 93024 00010000:02000000:0.0:1780340979.070158:0:93024:0:(ldlm_lib.c:2320:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1780340979.070166:0:93024:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:0.0:1780340979.070170:0:93024:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:01000004:1.0:1780340979.070249:0:93007:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:00000040:1.0:1780340979.070256:0:93007:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff8c0461148b40 : new refcount 2 00000040:00000040:1.0:1780340979.070264:0:93007:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff8c0461148b40 : new refcount 1 00000020:00000040:1.0:1780340979.070292:0:93007:0:(genops.c:900:class_export_put()) PUTting export ffff8c0351bee800 : new refcount 1 00000020:00000040:1.0:1780340979.070304:0:93007:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.203.116@tcp (ffff8c0471e119c0) now 6 - mgc_fs 10000000:01000000:1.0:1780340979.070307:0:93007:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.116@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1780340979.070328:0:93007:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1780340979.070352:0:93007:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1780340979.071314:0:93007:0:(tgt_mount.c:2299:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1780340979.071526:0:93007:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00000040:3.0:1780340979.077359:0:90571:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c048583ea00 x1866818961283200/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340979.077398:0:90571:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c04455f0300 going to sleep for 11 seconds 00000100:00100000:2.0:1780340979.087040:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1780340979.087068:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961283072 00000100:00100000:2.0:1780340979.087077:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961283072 00000020:00000040:2.0:1780340979.087080:0:6500:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143272838a 00000020:00000040:2.0:1780340979.087085:0:6500:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0475494800 refcount=3 00000100:00000040:2.0:1780340979.087112:0:6500:0:(service.c:1435:ptlrpc_at_set_timer()) armed ldlm_cbd at +6s 00000100:00100000:2.0:1780340979.087152:0:6500:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961283200 00000100:00100000:2.0:1780340979.087156:0:6500:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961283200 00000020:00000040:2.0:1780340979.087158:0:6500:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143272838a 00000020:00000040:2.0:1780340979.087159:0:6500:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0475494800 refcount=4 00000100:00100000:2.0:1780340979.087178:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00000040:2.0:1780340979.087183:0:6500:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0475494800 : new rpc_count 1 00000100:00000040:2.0:1780340979.087191:0:6500:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c045f291880 x1866818961283072/t0(0) o104->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:405/0 lens 328/0 e 0 to 0 dl 1780340990 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340979.087203:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f291880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:90571:x1866818961283072:12345-0@lo:104: 00000020:00000040:2.0:1780340979.087214:0:6500:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0475fa4000 refcount=2 00010000:00010000:2.0:1780340979.087223:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432775398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2465143277539f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1780340979.087245:0:6500:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 62 to 0@lo 00000100:00000040:2.0:1780340979.087251:0:6500:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340979.087292:0:6500:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff8c045f290380 x1866818961283072/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340979.087325:0:6500:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 61 to 0@lo 00010000:00010000:2.0:1780340979.087335:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00000040:2.0:1780340979.087340:0:6500:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f291880 x1866818961283072/t0(0) o104->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:405/0 lens 328/224 e 0 to 0 dl 1780340990 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340979.087349:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f291880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+4:90571:x1866818961283072:12345-0@lo:104: Request processed in 148us (18911us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340979.087368:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00000040:2.0:1780340979.087371:0:6500:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0475494800 : new rpc_count 0 00000020:00000040:2.0:1780340979.087381:0:6500:0:(genops.c:900:class_export_put()) PUTting export ffff8c0475494800 : new refcount 3 00000100:00100000:2.0:1780340979.087391:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00000040:2.0:1780340979.087394:0:6500:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0475494800 : new rpc_count 1 00000100:00000040:2.0:1780340979.087398:0:6500:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0349832c50 x1866818961283200/t0(0) o104->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:405/0 lens 328/0 e 0 to 0 dl 1780340990 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340979.087410:0:6500:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349832c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:90571:x1866818961283200:12345-0@lo:104: 00000020:00000040:2.0:1780340979.087415:0:6500:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0453123a00 refcount=2 00010000:00010000:2.0:1780340979.087420:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa2465143277537c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775383 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1780340979.087432:0:6500:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 62 to 0@lo 00000100:00000040:2.0:1780340979.087436:0:6500:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340979.087452:0:6500:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff8c048583ea00 x1866818961283200/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340979.087464:0:6500:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 61 to 0@lo 00010000:00010000:2.0:1780340979.087474:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00000040:2.0:1780340979.087478:0:6500:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0349832c50 x1866818961283200/t0(0) o104->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:405/0 lens 328/224 e 0 to 0 dl 1780340990 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340979.087486:0:6500:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349832c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+3:90571:x1866818961283200:12345-0@lo:104: Request processed in 79us (18895us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340979.087492:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00000040:2.0:1780340979.087494:0:6500:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0475494800 : new rpc_count 0 00000020:00000040:2.0:1780340979.087499:0:6500:0:(genops.c:900:class_export_put()) PUTting export ffff8c0475494800 : new refcount 2 00000100:00100000:3.0:1780340979.087665:0:9471:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00000040:3.0:1780340979.087702:0:90571:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c045f290380 x1866818961283072/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780340979.087715:0:90571:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f290380 x1866818961283072/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340979.087723:0:90571:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f290380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90571:1866818961283072:0@lo:104: 00000100:00000040:3.0:1780340979.087733:0:90571:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c048583ea00 x1866818961283200/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780340979.087742:0:90571:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583ea00 x1866818961283200/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1780340979.087748:0:90571:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90571:1866818961283200:0@lo:104: 00000100:00000040:3.0:1780340979.087826:0:3654:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff8c045f293b80 x1866818961282944/t0(0) o104->MGS@192.168.203.16@tcp:15/16 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780340979.087875:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8c048583f480 x1866818940545536 msgsize 328 00000100:00100000:3.0:1780340979.087881:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00010000:00010000:3.0:1780340979.087901:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1780340979.087912:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432775398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa2465143277539f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.087920:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0475fa4000 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340979.087924:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432775398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa2465143277539f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1780340979.087932:0:7442:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0475fa4000 refcount=3 00010000:00010000:3.0:1780340979.087936:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432775398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa2465143277539f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340979.087943:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432775398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa2465143277539f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340979.087949:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:3.0:1780340979.087953:0:7442:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:3.0:1780340979.087954:0:7442:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:3.0:1780340979.087964:0:7442:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff8c0349397600) refs 2 00000020:00000040:3.0:1780340979.087971:0:7442:0:(lustre_handles.c:91:class_handle_unhash_nolock()) removing object ffff8c0475fa4000 with handle 0xa24651432775398 from hash 00000020:00000040:3.0:1780340979.087980:0:7442:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00010000:00010000:3.0:1780340979.087996:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432775398 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2465143277539f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.088003:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:3.0:1780340979.088012:0:7442:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000fce25be7] to pc [ptlrpcd_00_01+1] req@ffff8c048583ce00 x1866818961283328/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1780340979.088033:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432775398 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2465143277539f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.088040:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0475fa4000/0xa24651432775398 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa2465143277539f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.088064:0:7442:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1780340979.088067:0:7442:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa2465143277537c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa24651432775383 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.088073:0:7442:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0453123a00 already unused, calling callback (ffffffffc129ac20) 10000000:00010000:3.0:1780340979.088076:0:7442:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa2465143277537c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa24651432775383 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1780340979.088082:0:7442:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0453123a00 refcount=3 00010000:00010000:3.0:1780340979.088086:0:7442:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa2465143277537c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa24651432775383 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1780340979.088092:0:7442:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa2465143277537c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa24651432775383 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1780340979.088098:0:7442:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:3.0:1780340979.088100:0:7442:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=3) 10000000:00000040:3.0:1780340979.088102:0:7442:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:3.0:1780340979.088104:0:7442:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff8c04495af600) refs 2 00000020:00000040:3.0:1780340979.088108:0:7442:0:(lustre_handles.c:91:class_handle_unhash_nolock()) removing object ffff8c0453123a00 with handle 0xa2465143277537c from hash 00000020:00000040:3.0:1780340979.088113:0:7442:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=5 obd=MGC192.168.203.116@tcp 00010000:00010000:3.0:1780340979.088121:0:7442:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa2465143277537c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775383 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.088126:0:7442:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:3.0:1780340979.088132:0:7442:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000074c35df1] to pc [ptlrpcd_00_02+2] req@ffff8c048583ed80 x1866818961283456/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1780340979.088150:0:7442:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa2465143277537c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775383 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.088167:0:7442:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.116@tcp lock: ffff8c0453123a00/0xa2465143277537c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa24651432775383 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340979.088174:0:7442:0:(ldlm_resource.c:1678:ldlm_resource_putref()) putref res: ffff8c047a3b5000 count: 0 00010000:00010000:3.0:1780340979.088185:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340979.088186:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340979.088188:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1780340979.088201:0:6502:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940545536 00000100:00100000:3.0:1780340979.088205:0:6502:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940545536 00000020:00000040:3.0:1780340979.088207:0:6502:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775440 00000020:00000040:3.0:1780340979.088209:0:6502:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0346fd5800 refcount=9 00000100:00000040:3.0:1780340979.088224:0:6502:0:(service.c:1435:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:3.0:1780340979.088229:0:6502:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c04754c6e00 refcount=5 00010000:00010000:3.0:1780340979.088234:0:6502:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c04754c6e00/0xa24651432775447 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25f9 expref: 9 pid: 90567 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340979.088258:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2603 00000100:00000040:3.0:1780340979.088261:0:6502:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0346fd5800 : new rpc_count 1 00000100:00000040:3.0:1780340979.088266:0:6502:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c048583f480 x1866818940545536/t0(0) o103->540506f4-4e8e-4fb6-b537-f45d44291964@192.168.203.16@tcp:405/0 lens 328/0 e 0 to 0 dl 1780340990 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.088277:0:6502:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940545536:12345-192.168.203.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1780340979.088287:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:3.0:1780340979.088289:0:6502:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c04754c6e00 refcount=5 00010000:00000040:3.0:1780340979.088292:0:6502:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff8c045247c900 count: 5 00010000:00010000:3.0:1780340979.088295:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c04754c6e00/0xa24651432775447 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25f9 expref: 9 pid: 90567 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.088305:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c04754c6e00/0xa24651432775447 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25f9 expref: 9 pid: 90567 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1780340979.088322:0:6502:0:(lustre_handles.c:91:class_handle_unhash_nolock()) removing object ffff8c04754c6e00 with handle 0xa24651432775447 from hash 00010000:00000040:3.0:1780340979.088327:0:6502:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff8c0440030800 00010000:00010000:3.0:1780340979.088331:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:3.0:1780340979.088337:0:6502:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 9 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340979.088342:0:6502:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340979.088375:0:6502:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 8 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340979.088380:0:6502:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583f480 x1866818940545536/t0(0) o103->540506f4-4e8e-4fb6-b537-f45d44291964@192.168.203.16@tcp:405/0 lens 328/224 e 0 to 0 dl 1780340990 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.088389:0:6502:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940545536:12345-192.168.203.16@tcp:103:ldlm_bl.0 Request processed in 114us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340979.088396:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2603 00000100:00000040:3.0:1780340979.088399:0:6502:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0346fd5800 : new rpc_count 0 00000020:00000040:3.0:1780340979.088407:0:6502:0:(genops.c:900:class_export_put()) PUTting export ffff8c0346fd5800 : new refcount 8 00000100:00000040:3.0:1780340979.088426:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c048583ce00 x1866818961283328/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.088440:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961283328:0@lo:103:ldlm_bl.0 00000100:00000040:3.0:1780340979.088457:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c048583ce00 x1866818961283328/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340979.088465:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340979.088480:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff8c048583f100 x1866818961283328 msgsize 328 00000100:00100000:3.0:1780340979.088484:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340979.088498:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c048583ce00 x1866818961283328/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340979.088538:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c048583ed80 x1866818961283456/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.088547:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961283456:0@lo:103:ldlm_bl.0 00000100:00000040:3.0:1780340979.088564:0:3661:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c048583ed80 x1866818961283456/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340979.088571:0:3661:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340979.088583:0:3661:0:(events.c:337:request_in_callback()) incoming req@ffff8c048583d500 x1866818961283456 msgsize 328 00000100:00100000:3.0:1780340979.088587:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340979.088599:0:3661:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c048583ed80 x1866818961283456/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780340995 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.088627:0:6503:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961283328 00000100:00100000:3.0:1780340979.088631:0:6503:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961283328 00000020:00000040:3.0:1780340979.088632:0:6503:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:3.0:1780340979.088634:0:6503:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=23 00000100:00000040:3.0:1780340979.088643:0:6503:0:(service.c:1435:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:3.0:1780340979.088647:0:6503:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0475fa5600 refcount=4 00010000:00010000:3.0:1780340979.088651:0:6503:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c0475fa5600/0xa2465143277539f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432775398 expref: 23 pid: 90570 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340979.088669:0:6503:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961283456 00000100:00100000:3.0:1780340979.088672:0:6503:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961283456 00000020:00000040:3.0:1780340979.088674:0:6503:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:3.0:1780340979.088676:0:6503:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=24 00000020:00000040:3.0:1780340979.088684:0:6503:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c04754c6200 refcount=4 00010000:00010000:3.0:1780340979.088688:0:6503:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c04754c6200/0xa24651432775383 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2465143277537c expref: 24 pid: 90570 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1780340979.088703:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00000040:3.0:1780340979.088705:0:6503:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:3.0:1780340979.088709:0:6503:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c048583f100 x1866818961283328/t0(0) o103->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:405/0 lens 328/0 e 0 to 0 dl 1780340990 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.088718:0:6503:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+24:3660:x1866818961283328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340979.088725:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:3.0:1780340979.088733:0:6503:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0475fa5600 refcount=4 00010000:00000040:3.0:1780340979.088735:0:6503:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff8c045247c900 count: 5 00010000:00010000:3.0:1780340979.088738:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c0475fa5600/0xa2465143277539f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa24651432775398 expref: 24 pid: 90570 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.088746:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c0475fa5600/0xa2465143277539f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa24651432775398 expref: 24 pid: 90570 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1780340979.088756:0:6503:0:(lustre_handles.c:91:class_handle_unhash_nolock()) removing object ffff8c0475fa5600 with handle 0xa2465143277539f from hash 00010000:00010000:3.0:1780340979.088784:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0475fa5600/0xa2465143277539f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa24651432775398 expref: 24 pid: 90570 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340979.088801:0:6503:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff8c047a289800 : new locks_count 17 00000020:00000040:3.0:1780340979.088803:0:6503:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 23 00010000:00000040:3.0:1780340979.088810:0:6503:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff8c0440030800 00010000:00010000:3.0:1780340979.088812:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:3.0:1780340979.088817:0:6503:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 62 to 0@lo 00000100:00000040:3.0:1780340979.088821:0:6503:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340979.088836:0:6503:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c048583ce00 x1866818961283328/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340979.088854:0:6503:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 61 to 0@lo 00000100:00000040:3.0:1780340979.088858:0:6503:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583f100 x1866818961283328/t0(0) o103->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:405/0 lens 328/224 e 0 to 0 dl 1780340990 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.088867:0:6503:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3660:x1866818961283328:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340979.088873:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00000040:3.0:1780340979.088875:0:6503:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:3.0:1780340979.088881:0:6503:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 22 00000100:00100000:3.0:1780340979.088891:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2605 00000100:00000040:3.0:1780340979.088893:0:6503:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:3.0:1780340979.088903:0:6503:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c048583d500 x1866818961283456/t0(0) o103->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:405/0 lens 328/0 e 0 to 0 dl 1780340990 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.088913:0:6503:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:3661:x1866818961283456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1780340979.088921:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:3.0:1780340979.088923:0:6503:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c04754c6200 refcount=4 00010000:00000040:3.0:1780340979.088926:0:6503:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff8c045247c900 count: 4 00010000:00010000:3.0:1780340979.088929:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c04754c6200/0xa24651432775383 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa2465143277537c expref: 22 pid: 90570 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.088938:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c04754c6200/0xa24651432775383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa2465143277537c expref: 22 pid: 90570 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1780340979.088946:0:6503:0:(lustre_handles.c:91:class_handle_unhash_nolock()) removing object ffff8c04754c6200 with handle 0xa24651432775383 from hash 00010000:00010000:3.0:1780340979.088950:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04754c6200/0xa24651432775383 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa2465143277537c expref: 22 pid: 90570 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340979.088956:0:6503:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff8c047a289800 : new locks_count 16 00000020:00000040:3.0:1780340979.088958:0:6503:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 21 00010000:00000040:3.0:1780340979.088962:0:6503:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff8c0440030800 00010000:00010000:3.0:1780340979.088966:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c0440030800/0xa2465143277629b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340979.088975:0:6503:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8c045247c900) refcount = 3 00010000:00010000:3.0:1780340979.088979:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0440030800/0xa2465143277629b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1780340979.088994:0:6503:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.020920533s 00000020:00000040:3.0:1780340979.088997:0:6503:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0440030800 refcount=5 00010000:00010000:3.0:1780340979.089000:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0440030800/0xa2465143277629b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.089016:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c0440030800/0xa2465143277629b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.089023:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c0440030800/0xa2465143277629b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.089029:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c0440030800/0xa2465143277629b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.089035:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c0440030800 already unused, calling callback (ffffffffc0cb36f0) 00010000:00010000:3.0:1780340979.089039:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c0440030800/0xa2465143277629b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1780340979.089046:0:6503:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0440030800 refcount=6 00010000:00010000:3.0:1780340979.089049:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c0440030800/0xa2465143277629b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:3.0:1780340979.089056:0:6503:0:(lustre_handles.c:91:class_handle_unhash_nolock()) removing object ffff8c0440030800 with handle 0xa2465143277629b from hash 00010000:00010000:3.0:1780340979.089060:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c0440030800/0xa2465143277629b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340979.089069:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:3.0:1780340979.089074:0:6503:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 62 to 0@lo 00000100:00000040:3.0:1780340979.089077:0:6503:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340979.089094:0:6503:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c048583ed80 x1866818961283456/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340979.089110:0:6503:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 61 to 0@lo 00000100:00000040:3.0:1780340979.089113:0:6503:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583d500 x1866818961283456/t0(0) o103->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:405/0 lens 328/224 e 0 to 0 dl 1780340990 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.089132:0:6503:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:3661:x1866818961283456:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340979.089139:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2605 00000100:00000040:3.0:1780340979.089141:0:6503:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:3.0:1780340979.089146:0:6503:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 20 00000100:00000040:3.0:1780340979.089278:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c048583ce00 x1866818961283328/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340979.089286:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583ce00 x1866818961283328/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.089292:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3660:1866818961283328:0@lo:103:ldlm_bl.0 00000100:00000040:3.0:1780340979.089297:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c048583ce00 x1866818961283328/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340979.089306:0:3660:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000100:00000040:3.0:1780340979.089326:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c048583ed80 x1866818961283456/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340979.089334:0:3661:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583ed80 x1866818961283456/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340979.089340:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3661:1866818961283456:0@lo:103:ldlm_bl.0 00000100:00000040:3.0:1780340979.089345:0:3661:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c048583ed80 x1866818961283456/t0(0) o103->MGC192.168.203.116@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340979.089352:0:3661:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000100:00000040:2.0:1780340979.089515:0:90571:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c045f293b80 x1866818961282944/t0(0) o104->MGS@192.168.203.16@tcp:15/16 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1780340979.089537:0:90571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c04754c6e00/0xa24651432775447 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced25f9 expref: 8 pid: 90567 timeout: 3859 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780340979.089543:0:90571:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff8c0346fd5800 : new locks_count 3 00000020:00000040:2.0:1780340979.089545:0:90571:0:(genops.c:900:class_export_put()) PUTting export ffff8c0346fd5800 : new refcount 7 00000100:00000040:2.0:1780340979.089551:0:90571:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f293b80 x1866818961282944/t0(0) o104->MGS@192.168.203.16@tcp:15/16 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1780340979.089558:0:90571:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f293b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90571:1866818961282944:192.168.203.16@tcp:104: 00000100:00000040:2.0:1780340979.089565:0:90571:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c045f290380 x1866818961283072/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1780340979.089574:0:90571:0:(genops.c:1244:class_import_put()) import ffff8c0346bbc800 refcount=2 obd=MGS 00000100:00000040:2.0:1780340979.089580:0:90571:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c048583ea00 x1866818961283200/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1780340979.089587:0:90571:0:(genops.c:1244:class_import_put()) import ffff8c0346bbc800 refcount=1 obd=MGS 00000100:00000040:2.0:1780340979.089591:0:90571:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c045f293b80 x1866818961282944/t0(0) o104->MGS@192.168.203.16@tcp:15/16 lens 328/224 e 0 to 0 dl 1780340995 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1780340979.089598:0:90571:0:(genops.c:1244:class_import_put()) import ffff8c0346fd0800 refcount=1 obd=MGS 00010000:00010000:2.0:1780340979.089617:0:90571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c0440030800/0xa2465143277629b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340979.089626:0:90571:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c0440030800/0xa2465143277629b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340979.089632:0:90571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c0440030800/0xa2465143277629b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340979.089639:0:90571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c0440030800/0xa2465143277629b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780340979.089654:0:90571:0:(ldlm_resource.c:1678:ldlm_resource_putref()) putref res: ffff8c045247c900 count: 0 00010000:00010000:1.0:1780340979.089742:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340979.595152:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1780340979.972575:0:93074:0:(tgt_mount.c:2299:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1780340979.973062:0:93074:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00000040:0.0:1780340980.395482:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c047b033850 x1866818940545664 msgsize 328 00000100:00100000:0.0:1780340980.395496:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00000040:0.0:1780340980.395498:0:3653:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:2.0:1780340980.395818:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940545664 00000100:00100000:2.0:1780340980.395829:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940545664 00000020:00000040:2.0:1780340980.395832:0:90568:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775440 00000020:00000040:2.0:1780340980.395836:0:90568:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0346fd5800 refcount=8 00000100:00000040:2.0:1780340980.395863:0:90568:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780340980.395891:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 209 00000100:00000040:2.0:1780340980.395895:0:90568:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0346fd5800 : new rpc_count 1 00000100:00000040:2.0:1780340980.395903:0:90568:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047b033850 x1866818940545664/t0(0) o101->540506f4-4e8e-4fb6-b537-f45d44291964@192.168.203.16@tcp:406/0 lens 328/0 e 0 to 0 dl 1780340991 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340980.395916:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+8:70274:x1866818940545664:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340980.395931:0:90568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00000040:2.0:1780340980.395950:0:90568:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c03476f8c00 with handle 0xa246514327762a2 to hash 00010000:00010000:2.0:1780340980.395955:0:90568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f8c00/0xa246514327762a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6187c9cbfced296b expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780340980.395964:0:90568:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff8c0346fd5800 : new locks_count 4 00000020:00000040:2.0:1780340980.395967:0:90568:0:(genops.c:889:class_export_get()) GET export ffff8c0346fd5800 refcount=9 00010000:00000040:2.0:1780340980.395985:0:90568:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8c03453b6d00) refcount = 1 00010000:00010000:2.0:1780340980.395990:0:90568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f8c00/0xa246514327762a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced296b expref: 9 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340980.396000:0:90568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f8c00/0xa246514327762a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced296b expref: 9 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340980.396009:0:90568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f8c00, rc 0) 00010000:00000040:2.0:1780340980.396013:0:90568:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818940545664 00000100:00000040:2.0:1780340980.396036:0:90568:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 9 to 192.168.203.16@tcp 00000100:00000040:2.0:1780340980.396042:0:90568:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:2.0:1780340980.396079:0:90568:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 8 to 192.168.203.16@tcp 00000100:00000040:2.0:1780340980.396085:0:90568:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047b033850 x1866818940545664/t0(0) o101->540506f4-4e8e-4fb6-b537-f45d44291964@192.168.203.16@tcp:406/0 lens 328/344 e 0 to 0 dl 1780340991 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340980.396095:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b033850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940545664:12345-192.168.203.16@tcp:101:ll_cfg_requeue.0 Request processed in 180us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340980.396102:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 209 00000100:00000040:2.0:1780340980.396105:0:90568:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0346fd5800 : new rpc_count 0 00000020:00000040:2.0:1780340980.396115:0:90568:0:(genops.c:900:class_export_put()) PUTting export ffff8c0346fd5800 : new refcount 8 00000100:00000040:3.0:1780340980.410117:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c047b033450 x1866818940545792 msgsize 304 00000100:00100000:3.0:1780340980.410134:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00000040:3.0:1780340980.410149:0:3652:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:1.0:1780340980.410254:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940545792 00000100:00100000:1.0:1780340980.410264:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940545792 00000020:00000040:1.0:1780340980.410267:0:90570:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775440 00000020:00000040:1.0:1780340980.410271:0:90570:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0346fd5800 refcount=9 00000100:00000040:1.0:1780340980.410294:0:90570:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1780340980.410336:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 210 00000100:00000040:1.0:1780340980.410340:0:90570:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0346fd5800 : new rpc_count 1 00000100:00000040:1.0:1780340980.410347:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047b033450 x1866818940545792/t0(0) o256->540506f4-4e8e-4fb6-b537-f45d44291964@192.168.203.16@tcp:406/0 lens 304/0 e 0 to 0 dl 1780340991 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340980.410360:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940545792:12345-192.168.203.16@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1780340980.410384:0:90570:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:00000040:1.0:1780340980.410405:0:90570:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:1.0:1780340980.410412:0:90570:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1780340980.410415:0:90570:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:1.0:1780340980.410422:0:90570:0:(genops.c:889:class_export_get()) GET export ffff8c0346fd5800 refcount=10 00000020:00000040:1.0:1780340980.412399:0:90570:0:(genops.c:900:class_export_put()) PUTting export ffff8c0346fd5800 : new refcount 9 00010000:00000040:1.0:1780340980.412426:0:90570:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818940545792 00000100:00000040:1.0:1780340980.412444:0:90570:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 9 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340980.412451:0:90570:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:1.0:1780340980.412496:0:90570:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 8 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340980.412504:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047b033450 x1866818940545792/t0(0) o256->540506f4-4e8e-4fb6-b537-f45d44291964@192.168.203.16@tcp:406/0 lens 304/240 e 0 to 0 dl 1780340991 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340980.412531:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b033450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:70274:x1866818940545792:12345-192.168.203.16@tcp:256:ll_cfg_requeue.0 Request processed in 2172us (2415us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340980.412541:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 210 00000100:00000040:1.0:1780340980.412545:0:90570:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0346fd5800 : new rpc_count 0 00000020:00000040:1.0:1780340980.412557:0:90570:0:(genops.c:900:class_export_put()) PUTting export ffff8c0346fd5800 : new refcount 8 00000100:00000040:0.0:1780340980.414435:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c0446efd500 x1866818940545920 msgsize 520 00000100:00100000:0.0:1780340980.414448:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340980.414827:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940545920 00000100:00100000:1.0:1780340980.414837:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940545920 00000020:00000040:1.0:1780340980.414840:0:25492:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277591e 00000100:00100000:1.0:1780340980.414878:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6017 00000100:00000040:1.0:1780340980.414886:0:25492:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0446efd500 x1866818940545920/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780341000 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340980.414897:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2406:x1866818940545920:12345-192.168.203.16@tcp:8:ll_cfg_requeue.0 00000020:00000040:1.0:1780340980.414916:0:25492:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff8c0476588000) now 7 - find 00010000:00000040:1.0:1780340980.414928:0:25492:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa0465af2e3640038 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1780340980.414933:0:25492:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID '7d14eb83-fa7c-40d9-843e-6367bec0a7b4' at ffff8c046bae3800, cookie 0xa2465143277624e 00010000:00080000:1.0:1780340980.414937:0:25492:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0000: connection from 7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp recovering/t4294969479 exp ffff8c046bae3800 cur 3760 last 1780340978 00010000:02000400:1.0:1780340980.414945:0:25492:0:(ldlm_lib.c:2021:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:1.0:1780340980.414950:0:25492:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00000001:00000040:1.0:1780340980.414959:0:25492:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8c044d6a9c00) : new refcount 17 00000020:00000040:1.0:1780340980.414963:0:25492:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=4 00000001:00000040:1.0:1780340980.414965:0:25492:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8c044d6a9c00) : new refcount 18 00000001:00000040:1.0:1780340980.414968:0:25492:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff8c044d6a9c00) : new refcount 17 00002000:00100000:1.0:1780340980.414971:0:25492:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7d14eb83-fa7c-40d9-843e-6367bec0a7b4/ffff8c046bae3800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211351c ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1780340980.414987:0:25492:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000040:1.0:1780340980.415008:0:25492:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff8c0347d8ea20 for nid 192.168.203.16@tcp - ref 2 00000020:00000040:1.0:1780340980.415107:0:25492:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff8c0476588000) now 8 - import 00000020:00000040:1.0:1780340980.415114:0:25492:0:(genops.c:1244:class_import_put()) import ffff8c047a28f800 refcount=1 obd=lustre-OST0000 00000020:00000040:1.0:1780340980.415122:0:25492:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=5 00000100:00000040:1.0:1780340980.415125:0:25492:0:(service.c:1085:ptlrpc_request_change_export()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:1.0:1780340980.415135:0:25492:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 9 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340980.415138:0:25492:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8c0346e3c480 refcount 9 to 192.168.203.16@tcp 00000020:00000040:1.0:1780340980.415142:0:25492:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=6 00000100:00000040:1.0:1780340980.415147:0:25492:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00000100:00080000:1.0:1780340980.415159:0:25492:0:(import.c:65:import_set_state_nolock()) ffff8c047a28f800 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1780340980.415165:0:25492:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 5 00000020:00000040:1.0:1780340980.415167:0:25492:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff8c0476588000) now 8 - find 00010000:00000040:1.0:1780340980.415182:0:25492:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 0, xid 1866818940545920 00000100:00000040:1.0:1780340980.415190:0:25492:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340980.415197:0:25492:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:1.0:1780340980.416315:0:25492:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340980.416326:0:25492:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446efd500 x1866818940545920/t0(0) o8->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:0/0 lens 520/416 e 0 to 0 dl 1780341000 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340980.416337:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2406:x1866818940545920:12345-192.168.203.16@tcp:8:ll_cfg_requeue.0 Request processed in 1440us (1902us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340980.416347:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6017 00000100:00000040:1.0:1780340980.416350:0:25492:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:1.0:1780340980.416364:0:25492:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 4 00000100:00000040:3.0:1780340980.421185:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c048583ed80 x1866818940515072 msgsize 440 00000100:00100000:3.0:1780340980.421203:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340980.421295:0:8405:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940515072 00000100:00100000:2.0:1780340980.421313:0:8405:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940515072 00000020:00000040:2.0:1780340980.421316:0:8405:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:2.0:1780340980.421320:0:8405:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=5 00000100:00000040:2.0:1780340980.421345:0:8405:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1780340980.421382:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1048 00000100:00000040:2.0:1780340980.421385:0:8405:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:2.0:1780340980.421402:0:8405:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c048583ed80 x1866818940515072/t0(4294969479) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:406/0 lens 440/0 e 0 to 0 dl 1780340991 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340980.421416:0:8405:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2406:x1866818940515072:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:2.0:1780340980.421428:0:8405:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c048583ed80 x1866818940515072/t0(4294969479) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:406/0 lens 440/0 e 0 to 0 dl 1780340991 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1780340980.421436:0:8405:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969479, current: 4294969479, replaying 00010000:00000040:2.0:1780340980.421439:0:8405:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:2.0:1780340980.421455:0:8405:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583ed80 x1866818940515072/t0(4294969479) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:406/0 lens 440/0 e 0 to 0 dl 1780340991 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340980.421464:0:8405:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2406:x1866818940515072:12345-192.168.203.16@tcp:10:dd.0 Request processed in 51us (279us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340980.421481:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1048 00000100:00000040:2.0:1780340980.421484:0:8405:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:1.0:1780340980.421790:0:93024:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00010000:1.0:1780340980.618935:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:00000040:1.0:1780340980.880204:0:93122:0:(lproc_fid.c:544:ldebugfs_client_fid_width_seq_write()) cli-lustre-OST0000-super: Sequence size: 65536 10000000:00000040:3.0:1780340981.009368:0:6514:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff8c04495af600) refs 2 10000000:01000000:3.0:1780340981.009379:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1780340981.009383:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c0470f7c000 from 125 10000000:01000000:3.0:1780340981.009387:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:3.0:1780340981.009401:0:6514:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:3.0:1780340981.009928:0:6514:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c0440030800 with handle 0xa246514327762a9 to hash 00010000:00010000:3.0:1780340981.009938:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440030800/0xa246514327762a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340981.009949:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0440030800/0xa246514327762a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340981.009961:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0440030800/0xa246514327762a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1780340981.009986:0:6514:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c048583ce00 x1866818961283584/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.010000:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961283584:0@lo:101:ll_cfg_requeue.0 00000100:00000040:3.0:1780340981.010024:0:6514:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c048583ce00 x1866818961283584/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340997 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.010032:0:6514:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340981.010075:0:6514:0:(events.c:337:request_in_callback()) incoming req@ffff8c047b033050 x1866818961283584 msgsize 328 00000100:00100000:3.0:1780340981.010079:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340981.010081:0:6514:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780340981.010107:0:6514:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c048583ce00 x1866818961283584/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340997 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.010133:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c044947dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1780340981.010217:0:90568:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961283584 00000100:00100000:2.0:1780340981.010225:0:90568:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961283584 00000020:00000040:2.0:1780340981.010227:0:90568:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:2.0:1780340981.010230:0:90568:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=21 00000100:00000040:2.0:1780340981.010254:0:90568:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780340981.010280:0:90568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00000040:2.0:1780340981.010284:0:90568:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:2.0:1780340981.010290:0:90568:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047b033050 x1866818961283584/t0(0) o101->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340981.010303:0:90568:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+21:6514:x1866818961283584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1780340981.010316:0:90568:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:2.0:1780340981.010326:0:90568:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff8c03453b6d00 count: 2 00000020:00000040:2.0:1780340981.010331:0:90568:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c03476f9e00 with handle 0xa246514327762b0 to hash 00010000:00010000:2.0:1780340981.010335:0:90568:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c03476f9e00/0xa246514327762b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327762a9 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1780340981.010342:0:90568:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff8c047a289800 : new locks_count 17 00000020:00000040:2.0:1780340981.010344:0:90568:0:(genops.c:889:class_export_get()) GET export ffff8c047a289800 refcount=22 00010000:00000040:2.0:1780340981.010362:0:90568:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8c03453b6d00) refcount = 2 00010000:00000040:2.0:1780340981.010365:0:90568:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1780340981.010371:0:90568:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c03476f8c00/0xa246514327762a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced296b expref: 8 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340981.010378:0:90568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c03476f9e00/0xa246514327762b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327762a9 expref: 22 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340981.010388:0:90568:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c03476f9e00/0xa246514327762b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327762a9 expref: 22 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1780340981.010404:0:90568:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c03476f9e00, rc 0) 00010000:00000040:2.0:1780340981.010408:0:90568:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961283584 00000100:00000040:2.0:1780340981.010418:0:90568:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 62 to 0@lo 00000100:00000040:2.0:1780340981.010423:0:90568:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340981.010442:0:90568:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff8c048583ce00 x1866818961283584/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340997 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340981.010468:0:90568:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 61 to 0@lo 00000100:00000040:2.0:1780340981.010473:0:90568:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047b033050 x1866818961283584/t0(0) o101->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:407/0 lens 328/344 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340981.010482:0:90568:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b033050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961283584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340981.010488:0:90568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00000040:2.0:1780340981.010491:0:90568:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:2.0:1780340981.010501:0:90568:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 21 00000100:00000040:3.0:1780340981.010579:0:6514:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c048583ce00 x1866818961283584/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340997 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.010590:0:6514:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583ce00 x1866818961283584/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340997 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.010597:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961283584:0@lo:101:ll_cfg_requeue.0 00000100:00000040:3.0:1780340981.010604:0:6514:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c048583ce00 x1866818961283584/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340997 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340981.010613:0:6514:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0440030800 refcount=4 00010000:00000040:3.0:1780340981.010617:0:6514:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff8c0440030800, remote cookie: 0xa246514327762b0, flags: 0x0 00010000:00000040:3.0:1780340981.010622:0:6514:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8c044120fb00) refcount = 1 00010000:00010000:3.0:1780340981.010625:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0440030800/0xa246514327762a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327762b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340981.010633:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0440030800/0xa246514327762a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327762b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1780340981.010640:0:6514:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c048583ce00 x1866818961283584/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340997 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340981.010649:0:6514:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 10000000:00000040:3.0:1780340981.010655:0:6514:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff8c04495af600) refs 3 00000020:00000040:3.0:1780340981.010658:0:6514:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0440030800 refcount=3 00000020:00000040:3.0:1780340981.010674:0:6514:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:3.0:1780340981.010754:0:6514:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=5 obd=MGC192.168.203.116@tcp 00000100:00000040:3.0:1780340981.010793:0:6514:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c048583ce00 x1866818961283712/t0(0) o256->MGC192.168.203.116@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.010804:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961283712:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1780340981.010821:0:6514:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c048583ce00 x1866818961283712/t0(0) o256->MGC192.168.203.116@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780340997 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.010832:0:6514:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340981.010850:0:6514:0:(events.c:337:request_in_callback()) incoming req@ffff8c047b031450 x1866818961283712 msgsize 304 00000100:00100000:3.0:1780340981.010855:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340981.010856:0:6514:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780340981.010954:0:6514:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c048583ce00 x1866818961283712/t0(0) o256->MGC192.168.203.116@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780340997 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.010972:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c044947dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1780340981.013007:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961283712 00000100:00100000:0.0:1780340981.013020:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961283712 00000020:00000040:0.0:1780340981.013023:0:90570:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:0.0:1780340981.013028:0:90570:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=22 00000100:00000040:0.0:1780340981.013056:0:90570:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1780340981.013118:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00000040:0.0:1780340981.013122:0:90570:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:0.0:1780340981.013128:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047b031450 x1866818961283712/t0(0) o256->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:407/0 lens 304/0 e 0 to 0 dl 1780340992 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340981.013141:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961283712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1780340981.013164:0:90570:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:0.0:1780340981.013181:0:90570:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:0.0:1780340981.013188:0:90570:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1780340981.013191:0:90570:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:0.0:1780340981.013199:0:90570:0:(genops.c:889:class_export_get()) GET export ffff8c047a289800 refcount=23 00000020:00000040:0.0:1780340981.013318:0:90570:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 22 00010000:00000040:0.0:1780340981.013331:0:90570:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961283712 00000100:00000040:0.0:1780340981.013342:0:90570:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 62 to 0@lo 00000100:00000040:0.0:1780340981.013347:0:90570:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340981.013364:0:90570:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff8c048583ce00 x1866818961283712/t0(0) o256->MGC192.168.203.116@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780340997 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340981.013427:0:90570:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 61 to 0@lo 00000100:00000040:0.0:1780340981.013438:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047b031450 x1866818961283712/t0(0) o256->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:407/0 lens 304/240 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340981.013447:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b031450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961283712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 308us (2595us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340981.013454:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00000040:0.0:1780340981.013458:0:90570:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:0.0:1780340981.013466:0:90570:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 21 00000100:00000040:3.0:1780340981.014170:0:6514:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff8c048583ce00 x1866818961283712/t0(0) o256->MGC192.168.203.116@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780340997 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.014182:0:6514:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff8c048583ce00 x1866818961283712/t0(0) o256->MGC192.168.203.116@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780340997 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.014190:0:6514:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583ce00 x1866818961283712/t0(0) o256->MGC192.168.203.116@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780340997 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.014197:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961283712:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1780340981.014205:0:6514:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c048583ce00 x1866818961283712/t0(0) o256->MGC192.168.203.116@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780340997 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1780340981.014214:0:6514:0:(mgc_request.c:1599:mgc_process_recover_log()) Latest version 125, more 0. 10000000:00000040:3.0:1780340981.014226:0:6514:0:(mgc_request.c:1442:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1780340981.014236:0:6514:0:(lustre_peer.c:213:class_check_uuid()) check if uuid 192.168.203.116@tcp has 192.168.203.116@tcp. 10000000:00000040:3.0:1780340981.014250:0:6514:0:(mgc_request.c:1471:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0000 target is obsoleted(1/2), reconnect 00000100:00080000:3.0:1780340981.014254:0:6514:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8c046b9a9000 already not connected (conn 6, was 0): DISCONN 00000100:00000040:3.0:1780340981.014263:0:6514:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 62 to 0@lo 00000100:00000040:3.0:1780340981.014266:0:6514:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8c044319f100 refcount 62 to 0@lo 00000100:00000040:3.0:1780340981.014268:0:6514:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.203.116@tcp -> ffff8c044319f100 00010000:00080000:3.0:1780340981.014271:0:6514:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8c046b9a9000@lustre-OST0000-osc-MDT0000: found existing conn 192.168.203.116@tcp, moved to head 00010000:00000040:3.0:1780340981.014274:0:6514:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 61 to 0@lo 00000100:00080000:3.0:1780340981.014285:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8c046b9a9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:3.0:1780340981.014289:0:6514:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 60 to 0@lo 00000100:00000040:3.0:1780340981.014291:0:6514:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 61 to 0@lo 00000020:00000040:3.0:1780340981.014293:0:6514:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775313 00000020:00000040:3.0:1780340981.014296:0:6514:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0445b41800 refcount=4 00000100:00000040:3.0:1780340981.014299:0:6514:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 60 to 0@lo 00000100:00000040:3.0:1780340981.014301:0:6514:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 61 to 0@lo 00000020:00000040:3.0:1780340981.014302:0:6514:0:(genops.c:900:class_export_put()) PUTting export ffff8c0445b41800 : new refcount 3 00000100:00080000:3.0:1780340981.014305:0:6514:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c046b9a9000 using connection 192.168.203.116@tcp/0@lo 00000020:00000040:3.0:1780340981.014317:0:6514:0:(genops.c:1231:class_import_get()) import ffff8c046b9a9000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:3.0:1780340981.014334:0:6514:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c048583dc00 x1866818961283840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780340981.014345:0:6514:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003c371edc] to pc [ptlrpcd_rcv+-1] req@ffff8c048583dc00 x1866818961283840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1780340981.014365:0:6514:0:(mgc_request.c:1488:mgc_apply_recover_logs()) ir apply logs 125/125 for lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1780340981.014373:0:6514:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c048583ce00 x1866818961283712/t0(0) o256->MGC192.168.203.116@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780340997 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340981.014382:0:6514:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:3.0:1780340981.014385:0:6514:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 10000000:01000000:3.0:1780340981.014417:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:3.0:1780340981.014423:0:6514:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0440030800 refcount=3 00010000:00010000:3.0:1780340981.014429:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440030800/0xa246514327762a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327762b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340981.014439:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0440030800/0xa246514327762a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327762b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:3.0:1780340981.014450:0:6514:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff8c0349397600) refs 2 10000000:00000040:3.0:1780340981.014454:0:6514:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff8c04495af600) refs 3 10000000:01000000:3.0:1780340981.014462:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1780340981.014464:0:6514:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8c045f0c4800 from 125 10000000:01000000:3.0:1780340981.014467:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:3.0:1780340981.014470:0:6514:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00010000:00000040:3.0:1780340981.014482:0:6514:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff8c044120fb00 count: 2 00000020:00000040:3.0:1780340981.014489:0:6514:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c0440031800 with handle 0xa246514327762b7 to hash 00010000:00010000:3.0:1780340981.014495:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa246514327762b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340981.014502:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa246514327762b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340981.014510:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa246514327762b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1780340981.014523:0:6514:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c048583ce00 x1866818961283968/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.014534:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961283968:0@lo:101:ll_cfg_requeue.0 00000100:00000040:3.0:1780340981.014549:0:6514:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c048583ce00 x1866818961283968/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340997 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.014556:0:6514:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340981.014584:0:6514:0:(events.c:337:request_in_callback()) incoming req@ffff8c047b030050 x1866818961283968 msgsize 328 00000100:00100000:3.0:1780340981.014589:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340981.014590:0:6514:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780340981.015200:0:6514:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c048583ce00 x1866818961283968/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340997 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.015225:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c044947dd80 going to sleep for 11 seconds 00000100:00000040:3.0:1780340981.015242:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c048583dc00 x1866818961283840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.015252:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961283840:0@lo:8:ll_cfg_requeue.0 00000100:00000040:3.0:1780340981.015273:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c048583dc00 x1866818961283840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780341006 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.015280:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340981.015297:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff8c048583c700 x1866818961283840 msgsize 520 00000100:00100000:3.0:1780340981.015301:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340981.015316:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c048583dc00 x1866818961283840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780341006 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.015325:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 9623 usecs (10 jiffies) 00000100:00100000:2.0:1780340981.015952:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961283968 00000100:00100000:2.0:1780340981.015960:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961283968 00000020:00000040:2.0:1780340981.015963:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:2.0:1780340981.015967:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=22 00000100:00000040:3.0:1780340981.016051:0:90573:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1780340981.016086:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00000040:3.0:1780340981.016091:0:90573:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:3.0:1780340981.016097:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047b030050 x1866818961283968/t0(0) o101->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.016109:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+22:6514:x1866818961283968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1780340981.016123:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1780340981.016132:0:90573:0:(ldlm_resource.c:1630:ldlm_resource_getref()) getref res: ffff8c03453b6d00 count: 3 00000020:00000040:3.0:1780340981.016138:0:90573:0:(lustre_handles.c:77:class_handle_hash()) added object ffff8c0440031c00 with handle 0xa246514327762be to hash 00010000:00010000:3.0:1780340981.016143:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c0440031c00/0xa246514327762be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa246514327762b7 expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340981.016151:0:90573:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff8c047a289800 : new locks_count 18 00000020:00000040:3.0:1780340981.016153:0:90573:0:(genops.c:889:class_export_get()) GET export ffff8c047a289800 refcount=23 00010000:00000040:3.0:1780340981.016171:0:90573:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8c03453b6d00) refcount = 3 00010000:00000040:3.0:1780340981.016174:0:90573:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1780340981.016177:0:90573:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c03476f9e00/0xa246514327762b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327762a9 expref: 23 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1780340981.016186:0:90573:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGS lock: ffff8c03476f8c00/0xa246514327762a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.16@tcp remote: 0x6187c9cbfced296b expref: 8 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340981.016201:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c0440031c00/0xa246514327762be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa246514327762b7 expref: 23 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340981.016212:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c0440031c00/0xa246514327762be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa246514327762b7 expref: 23 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340981.016221:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c0440031c00, rc 0) 00010000:00000040:3.0:1780340981.016225:0:90573:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961283968 00000100:00000040:3.0:1780340981.016236:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 62 to 0@lo 00000100:00000040:3.0:1780340981.016241:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340981.016269:0:90573:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff8c048583ce00 x1866818961283968/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340997 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.016293:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 61 to 0@lo 00000100:00000040:3.0:1780340981.016298:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047b030050 x1866818961283968/t0(0) o101->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:407/0 lens 328/344 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.016306:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b030050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961283968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340981.016313:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00000040:3.0:1780340981.016316:0:90573:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:3.0:1780340981.016327:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 22 00000100:00000040:3.0:1780340981.016365:0:6514:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c048583ce00 x1866818961283968/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340997 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.016376:0:6514:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583ce00 x1866818961283968/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340997 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.016382:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961283968:0@lo:101:ll_cfg_requeue.0 00000100:00000040:3.0:1780340981.016401:0:6514:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c048583ce00 x1866818961283968/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340997 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340981.016417:0:6514:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0440031800 refcount=4 00010000:00000040:3.0:1780340981.016421:0:6514:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff8c0440031800, remote cookie: 0xa246514327762be, flags: 0x0 00010000:00000040:3.0:1780340981.016425:0:6514:0:(ldlm_resource.c:1850:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff8c044120fb00) refcount = 2 00010000:00000040:3.0:1780340981.016427:0:6514:0:(ldlm_resource.c:1853:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1780340981.016429:0:6514:0:(ldlm_resource.c:1856:ldlm_resource_dump()) ### ### ns: MGC192.168.203.116@tcp lock: ffff8c0440030800/0xa246514327762a9 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327762b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340981.016435:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa246514327762b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327762be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340981.016442:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa246514327762b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa246514327762be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1780340981.016452:0:6514:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c048583ce00 x1866818961283968/t0(0) o101->MGC192.168.203.116@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1780340997 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340981.016460:0:6514:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 10000000:00000040:3.0:1780340981.016469:0:6514:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff8c0349397600) refs 3 00000020:00000040:3.0:1780340981.016471:0:6514:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0440031800 refcount=3 00000020:00000040:3.0:1780340981.016488:0:6514:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:3.0:1780340981.016504:0:6514:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=5 obd=MGC192.168.203.116@tcp 00000100:00000040:3.0:1780340981.016517:0:6514:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c048583ce00 x1866818961284096/t0(0) o256->MGC192.168.203.116@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.016527:0:6514:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961284096:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1780340981.016546:0:6514:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c048583ce00 x1866818961284096/t0(0) o256->MGC192.168.203.116@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780340997 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.016552:0:6514:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340981.016570:0:6514:0:(events.c:337:request_in_callback()) incoming req@ffff8c047b031c50 x1866818961284096 msgsize 304 00000100:00100000:3.0:1780340981.016574:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340981.016581:0:6514:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780340981.016595:0:6514:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff8c048583ce00 x1866818961284096/t0(0) o256->MGC192.168.203.116@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780340997 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.016614:0:6514:0:(client.c:2692:ptlrpc_set_wait()) set ffff8c044947dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1780340981.016626:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961284096 00000100:00100000:3.0:1780340981.016629:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961284096 00000020:00000040:3.0:1780340981.016631:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000020:00000040:3.0:1780340981.016633:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=23 00000100:00000040:3.0:1780340981.016642:0:90573:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1780340981.016651:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00000040:3.0:1780340981.016653:0:90573:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:3.0:1780340981.016670:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047b031c50 x1866818961284096/t0(0) o256->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:407/0 lens 304/0 e 0 to 0 dl 1780340992 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.016679:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961284096:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1780340981.016692:0:90573:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:3.0:1780340981.016704:0:90573:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:3.0:1780340981.016710:0:90573:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1780340981.016712:0:90573:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:3.0:1780340981.016717:0:90573:0:(genops.c:889:class_export_get()) GET export ffff8c047a289800 refcount=24 00000020:00000040:3.0:1780340981.016753:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 23 00010000:00000040:3.0:1780340981.016801:0:90573:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961284096 00000100:00000040:3.0:1780340981.016807:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 62 to 0@lo 00000100:00000040:3.0:1780340981.016810:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340981.016826:0:90573:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff8c048583ce00 x1866818961284096/t0(0) o256->MGC192.168.203.116@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780340997 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.016837:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 61 to 0@lo 00000100:00000040:3.0:1780340981.016841:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047b031c50 x1866818961284096/t0(0) o256->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:407/0 lens 304/240 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.016848:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b031c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:6514:x1866818961284096:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 170us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340981.016859:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00000040:3.0:1780340981.016861:0:90573:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:3.0:1780340981.016868:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 22 00000100:00000040:3.0:1780340981.016893:0:6514:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff8c048583ce00 x1866818961284096/t0(0) o256->MGC192.168.203.116@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780340997 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.016901:0:6514:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff8c048583ce00 x1866818961284096/t0(0) o256->MGC192.168.203.116@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780340997 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.016909:0:6514:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583ce00 x1866818961284096/t0(0) o256->MGC192.168.203.116@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780340997 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.016916:0:6514:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:6514:1866818961284096:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1780340981.016923:0:6514:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c048583ce00 x1866818961284096/t0(0) o256->MGC192.168.203.116@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780340997 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1780340981.016931:0:6514:0:(mgc_request.c:1599:mgc_process_recover_log()) Latest version 125, more 0. 10000000:00000040:3.0:1780340981.016941:0:6514:0:(mgc_request.c:1442:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1780340981.016953:0:6514:0:(lustre_peer.c:213:class_check_uuid()) check if uuid 192.168.203.116@tcp has 192.168.203.116@tcp. 10000000:00000040:3.0:1780340981.016966:0:6514:0:(mgc_request.c:1471:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0001 target is obsoleted(1/2), reconnect 00000100:00080000:3.0:1780340981.016970:0:6514:0:(import.c:214:ptlrpc_set_import_discon()) osp: import ffff8c034a39f800 already not connected (conn 7, was 0): DISCONN 00000100:00000040:3.0:1780340981.016979:0:6514:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 62 to 0@lo 00000100:00000040:3.0:1780340981.016982:0:6514:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8c044319f100 refcount 62 to 0@lo 00000100:00000040:3.0:1780340981.016984:0:6514:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.203.116@tcp -> ffff8c044319f100 00010000:00080000:3.0:1780340981.016987:0:6514:0:(ldlm_lib.c:85:import_set_conn()) imp ffff8c034a39f800@lustre-OST0000-osc-MDT0001: found existing conn 192.168.203.116@tcp, moved to head 00010000:00000040:3.0:1780340981.016990:0:6514:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 61 to 0@lo 00000100:00080000:3.0:1780340981.016994:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8c034a39f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:3.0:1780340981.016998:0:6514:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 60 to 0@lo 00000100:00000040:3.0:1780340981.017000:0:6514:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 61 to 0@lo 00000020:00000040:3.0:1780340981.017008:0:6514:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f160 00000020:00000040:3.0:1780340981.017010:0:6514:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0475fab800 refcount=4 00000100:00000040:3.0:1780340981.017013:0:6514:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 60 to 0@lo 00000100:00000040:3.0:1780340981.017015:0:6514:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 61 to 0@lo 00000020:00000040:3.0:1780340981.017017:0:6514:0:(genops.c:900:class_export_put()) PUTting export ffff8c0475fab800 : new refcount 3 00000100:00080000:3.0:1780340981.017019:0:6514:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c034a39f800 using connection 192.168.203.116@tcp/0@lo 00000020:00000040:3.0:1780340981.017029:0:6514:0:(genops.c:1231:class_import_get()) import ffff8c034a39f800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:3.0:1780340981.017040:0:6514:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c048583d880 x1866818961284224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1780340981.017051:0:6514:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000b71d9e40] to pc [ptlrpcd_rcv+-1] req@ffff8c048583d880 x1866818961284224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1780340981.017065:0:6514:0:(mgc_request.c:1488:mgc_apply_recover_logs()) ir apply logs 125/125 for lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1780340981.017071:0:6514:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c048583ce00 x1866818961284096/t0(0) o256->MGC192.168.203.116@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1780340997 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340981.017077:0:6514:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000020:00000040:3.0:1780340981.017079:0:6514:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 10000000:01000000:3.0:1780340981.017094:0:6514:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.116@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:3.0:1780340981.017098:0:6514:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff8c0440031800 refcount=3 00010000:00010000:3.0:1780340981.017102:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa246514327762b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327762be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1780340981.017110:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.116@tcp lock: ffff8c0440031800/0xa246514327762b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa246514327762be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:3.0:1780340981.017119:0:6514:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff8c0349397600) refs 3 00000100:00000040:3.0:1780340981.017133:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c048583d880 x1866818961284224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.017142:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961284224:0@lo:8:ll_cfg_requeue.0 00000100:00000040:3.0:1780340981.017160:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c048583d880 x1866818961284224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780341006 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.017167:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340981.017180:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff8c048583ce00 x1866818961284224 msgsize 520 00000100:00100000:3.0:1780340981.017184:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340981.017200:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c048583d880 x1866818961284224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780341006 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.017210:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5431 usecs (6 jiffies) 00000100:00100000:1.0:1780340981.019575:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961283840 00000100:00100000:1.0:1780340981.019589:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961283840 00000020:00000040:1.0:1780340981.019591:0:25491:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775328 00000100:00100000:1.0:1780340981.019638:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961284224 00000100:00100000:1.0:1780340981.019642:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961284224 00000020:00000040:1.0:1780340981.019644:0:25491:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f175 00000100:00100000:1.0:1780340981.019667:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6018 00000100:00000040:1.0:1780340981.019676:0:25491:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c048583c700 x1866818961283840/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780341001 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340981.019687:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:3658:x1866818961283840:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:1.0:1780340981.019705:0:25491:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff8c0476588000) now 8 - find 00010000:00000040:1.0:1780340981.019716:0:25491:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1780340981.019723:0:25491:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff8c047a1eb800, cookie 0xa24651432776240 00010000:00080000:1.0:1780340981.019728:0:25491:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t4294969474 exp ffff8c047a1eb800 cur 3761 last 1780340978 00000001:00000040:1.0:1780340981.019742:0:25491:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.203.116@tcp 00000001:00000040:1.0:1780340981.019747:0:25491:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8c044d6a9c00) : new refcount 18 00000020:00000040:1.0:1780340981.019751:0:25491:0:(genops.c:889:class_export_get()) GET export ffff8c047a1eb800 refcount=4 00000001:00000040:1.0:1780340981.019753:0:25491:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8c044d6a9c00) : new refcount 19 00000001:00000040:1.0:1780340981.019756:0:25491:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff8c044d6a9c00) : new refcount 18 00002000:00100000:1.0:1780340981.019788:0:25491:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c047a1eb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211351c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1780340981.019792:0:25491:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1780340981.019795:0:25491:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:1.0:1780340981.019805:0:25491:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff8c0347d8e540 for nid 0@lo - ref 2 00000020:00000040:1.0:1780340981.019899:0:25491:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff8c0476588000) now 9 - import 00000020:00000040:1.0:1780340981.019905:0:25491:0:(genops.c:1244:class_import_put()) import ffff8c047a288000 refcount=1 obd=lustre-OST0000 00000020:00000040:1.0:1780340981.019911:0:25491:0:(genops.c:889:class_export_get()) GET export ffff8c047a1eb800 refcount=5 00000100:00000040:1.0:1780340981.019913:0:25491:0:(service.c:1085:ptlrpc_request_change_export()) RPC GETting export ffff8c047a1eb800 : new rpc_count 1 00000100:00000040:1.0:1780340981.019917:0:25491:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 62 to 0@lo 00000100:00000040:1.0:1780340981.019920:0:25491:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8c044319f100 refcount 62 to 0@lo 00000020:00000040:1.0:1780340981.019922:0:25491:0:(genops.c:889:class_export_get()) GET export ffff8c047a1eb800 refcount=6 00000100:00000040:1.0:1780340981.019927:0:25491:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 63 to 0@lo 00000100:00080000:1.0:1780340981.019944:0:25491:0:(import.c:65:import_set_state_nolock()) ffff8c047a288000 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1780340981.019950:0:25491:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a1eb800 : new refcount 5 00000020:00000040:1.0:1780340981.019952:0:25491:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff8c0476588000) now 9 - find 00010000:00000040:1.0:1780340981.019964:0:25491:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969474, transno 0, xid 1866818961283840 00000100:00100000:0.0:1780340981.019970:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6019 00000100:00000040:1.0:1780340981.019971:0:25491:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 64 to 0@lo 00000100:00000040:1.0:1780340981.019976:0:25491:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340981.019976:0:23153:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c048583ce00 x1866818961284224/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1780341001 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340981.019985:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3658:x1866818961284224:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:0.0:1780340981.019993:0:23153:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff8c0476588000) now 9 - find 00010000:00000040:0.0:1780340981.019999:0:23153:0:(ldlm_lib.c:1251:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:0.0:1780340981.020003:0:23153:0:(ldlm_lib.c:925:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff8c0351be9800, cookie 0xa24651432776247 00010000:00080000:0.0:1780340981.020006:0:23153:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff8c0351be9800 cur 3761 last 1780340978 00000001:00000040:0.0:1780340981.020011:0:23153:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.203.116@tcp 00000100:00000040:1.0:1780340981.020014:0:25491:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff8c048583dc00 x1866818961283840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780341006 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000001:00000040:0.0:1780340981.020014:0:23153:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8c044d6a9c00) : new refcount 19 00000020:00000040:0.0:1780340981.020016:0:23153:0:(genops.c:889:class_export_get()) GET export ffff8c0351be9800 refcount=4 00000001:00000040:0.0:1780340981.020018:0:23153:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff8c044d6a9c00) : new refcount 20 00000001:00000040:0.0:1780340981.020021:0:23153:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff8c044d6a9c00) : new refcount 19 00002000:00100000:0.0:1780340981.020023:0:23153:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8c0351be9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211351c ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1780340981.020026:0:23153:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1780340981.020028:0:23153:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:0.0:1780340981.020033:0:23153:0:(lprocfs_status_server.c:693:lprocfs_exp_setup()) Found stats ffff8c0347d8e540 for nid 0@lo - ref 3 00000020:00000040:0.0:1780340981.020039:0:23153:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff8c0476588000) now 10 - import 00000020:00000040:0.0:1780340981.020042:0:23153:0:(genops.c:1244:class_import_put()) import ffff8c047b060800 refcount=1 obd=lustre-OST0000 00000100:00000040:1.0:1780340981.020045:0:25491:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 63 to 0@lo 00000100:00000040:1.0:1780340981.020050:0:25491:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583c700 x1866818961283840/t0(0) o8->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1780341001 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340981.020052:0:23153:0:(genops.c:889:class_export_get()) GET export ffff8c0351be9800 refcount=5 00000100:00000040:0.0:1780340981.020054:0:23153:0:(service.c:1085:ptlrpc_request_change_export()) RPC GETting export ffff8c0351be9800 : new rpc_count 1 00000100:00000040:0.0:1780340981.020057:0:23153:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 64 to 0@lo 00000100:00100000:1.0:1780340981.020059:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818961283840:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 371us (4759us total) trans 0 rc 0/0 00000100:00000040:0.0:1780340981.020059:0:23153:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff8c044319f100 refcount 64 to 0@lo 00000020:00000040:0.0:1780340981.020061:0:23153:0:(genops.c:889:class_export_get()) GET export ffff8c0351be9800 refcount=6 00000100:00100000:1.0:1780340981.020065:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6018 00000100:00000040:0.0:1780340981.020065:0:23153:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 65 to 0@lo 00000100:00000040:1.0:1780340981.020068:0:25491:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a1eb800 : new rpc_count 0 00000100:00080000:0.0:1780340981.020069:0:23153:0:(import.c:65:import_set_state_nolock()) ffff8c047b060800 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1780340981.020075:0:25491:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a1eb800 : new refcount 4 00000020:00000040:0.0:1780340981.020079:0:23153:0:(genops.c:900:class_export_put()) PUTting export ffff8c0351be9800 : new refcount 5 00000020:00000040:0.0:1780340981.020080:0:23153:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff8c0476588000) now 10 - find 00010000:00000040:0.0:1780340981.020086:0:23153:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969456, transno 0, xid 1866818961284224 00000100:00000040:0.0:1780340981.020091:0:23153:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 66 to 0@lo 00000100:00000040:0.0:1780340981.020094:0:23153:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340981.020113:0:23153:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff8c048583d880 x1866818961284224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1780341006 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340981.020126:0:23153:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 65 to 0@lo 00000100:00000040:0.0:1780340981.020130:0:23153:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583ce00 x1866818961284224/t0(0) o8->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1780341001 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340981.020137:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1866818961284224:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 153us (2955us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340981.020144:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6019 00000100:00000040:0.0:1780340981.020146:0:23153:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0351be9800 : new rpc_count 0 00000020:00000040:0.0:1780340981.020151:0:23153:0:(genops.c:900:class_export_put()) PUTting export ffff8c0351be9800 : new refcount 4 00010000:00080000:0.0:1780340981.020163:0:93024:0:(ldlm_lib.c:2530:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00000040:0.0:1780340981.020168:0:93024:0:(ldlm_lib.c:2859:target_recovery_thread()) 1: request replay stage - 3 clients from t4294969479 00010000:00080000:0.0:1780340981.020170:0:93024:0:(ldlm_lib.c:2668:replay_request_or_update()) Waiting for transno 4294969479 00010000:00080000:0.0:1780340981.020174:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 0, queue_len: 1, req_transno: 4294969479, next_transno: 4294969479 00010000:00080000:0.0:1780340981.020177:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969479) 00010000:00080000:0.0:1780340981.020184:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940515072 t4294969479 from 192.168.203.16@tcp req@ffff8c048583ed80 x1866818940515072/t0(4294969479) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:406/0 lens 440/0 e 0 to 0 dl 1780340991 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780340981.020212:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c048583ed80 x1866818940515072/t0(4294969479) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:406/0 lens 440/0 e 0 to 0 dl 1780340991 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1780340981.020236:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x362:0x0] 00000001:00000040:0.0:1780340981.020813:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 1 00000020:00000040:0.0:1780340981.020818:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=6 00010000:00000040:0.0:1780340981.020861:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969479, xid 1866818940515072 00000100:00000040:0.0:1780340981.020868:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340981.020873:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:0.0:1780340981.020907:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:0.0:1780340981.020920:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780340981.020925:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:0.0:1780340981.020932:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 5 00010000:00080000:0.0:1780340981.020936:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 0, queue_len: 0, req_transno: 0, next_transno: 4294969480 00010000:00080000:0.0:1780340981.020939:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 0, queue_len: 0, req_transno: 0, next_transno: 4294969480 00010000:00080000:3.0:1780340981.021562:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c048583d880 x1866818961284224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1780341006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.021573:0:3658:0:(client.c:3098:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294969456 00000100:00000040:3.0:1780340981.021578:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c048583d880 x1866818961284224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1780341006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780340981.021589:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000020:00000040:3.0:1780340981.021591:0:3658:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f160 00000020:00000040:3.0:1780340981.021594:0:3658:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0475fab800 refcount=4 00000020:00000040:3.0:1780340981.021601:0:3658:0:(genops.c:900:class_export_put()) PUTting export ffff8c0475fab800 : new refcount 3 00000100:00080000:3.0:1780340981.021606:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39f800 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1780340981.021610:0:3658:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1780340981.021613:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969456 gen 2 00000100:00000040:3.0:1780340981.021615:0:3658:0:(client.c:3212:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:3.0:1780340981.021618:0:3658:0:(recover.c:53:ptlrpc_replay_next()) import ffff8c034a39f800 from lustre-OST0000_UUID committed 4294969456 last 0 00000100:00080000:3.0:1780340981.021620:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c034a39f800 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:3.0:1780340981.021623:0:3658:0:(genops.c:1231:class_import_get()) import ffff8c034a39f800 refcount=5 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1780340981.023429:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583d880 x1866818961284224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1780341006 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.023441:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961284224:0@lo:8:ll_cfg_requeue.0 00010000:00080000:3.0:1780340981.023479:0:3658:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c048583dc00 x1866818961283840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1780341006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.023487:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969474 gen 2 00000100:00000040:3.0:1780340981.023493:0:3658:0:(client.c:3158:ptlrpc_free_committed()) @@@ commit (last_committed 4294969474) req@ffff8c03498ed880 x1866818961264000/t4294969474(4294969474) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1780340959 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.023500:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c03498ed880 x1866818961264000/t4294969474(4294969474) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1780340959 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340981.023510:0:3658:0:(genops.c:1244:class_import_put()) import ffff8c046b9a9000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1780340981.023519:0:3658:0:(client.c:3212:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=1 replay=1/1 committed=0/0 00000100:00000040:3.0:1780340981.023523:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c048583dc00 x1866818961283840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1780341006 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1780340981.023533:0:3658:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000020:00000040:3.0:1780340981.023536:0:3658:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775313 00000020:00000040:3.0:1780340981.023539:0:3658:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0445b41800 refcount=4 00000020:00000040:3.0:1780340981.023547:0:3658:0:(genops.c:900:class_export_put()) PUTting export ffff8c0445b41800 : new refcount 3 00000100:00080000:3.0:1780340981.023551:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c046b9a9000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1780340981.023555:0:3658:0:(import.c:1701:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:3.0:1780340981.023558:0:3658:0:(client.c:3102:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969474 gen 2 00000100:00000040:3.0:1780340981.023560:0:3658:0:(client.c:3212:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:3.0:1780340981.023562:0:3658:0:(recover.c:53:ptlrpc_replay_next()) import ffff8c046b9a9000 from lustre-OST0000_UUID committed 4294969474 last 0 00000100:00080000:3.0:1780340981.023565:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c046b9a9000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:3.0:1780340981.023568:0:3658:0:(genops.c:1231:class_import_get()) import ffff8c046b9a9000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00010000:00080000:3.0:1780340981.023585:0:93131:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:3.0:1780340981.023589:0:93131:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:3.0:1780340981.023595:0:93131:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:3.0:1780340981.023640:0:93131:0:(import.c:65:import_set_state_nolock()) ffff8c034a39f800 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:3.0:1780340981.023646:0:93131:0:(genops.c:1231:class_import_get()) import ffff8c034a39f800 refcount=6 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1780340981.023679:0:93131:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000954d10e0] to pc [ptlrpcd_rcv+-1] req@ffff8c048583c000 x1866818961284352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340981.023694:0:93131:0:(genops.c:1244:class_import_put()) import ffff8c034a39f800 refcount=5 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1780340981.025037:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8c0446eff100 x1866818940516864 msgsize 440 00000100:00100000:0.0:1780340981.025049:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00000040:3.0:1780340981.027090:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583dc00 x1866818961283840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1780341006 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.027103:0:3658:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c048583dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961283840:0@lo:8:ll_cfg_requeue.0 00000100:00000040:3.0:1780340981.027112:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c048583d880 x1866818961284224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1780341006 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340981.027124:0:3658:0:(genops.c:1244:class_import_put()) import ffff8c034a39f800 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1780340981.027133:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c048583dc00 x1866818961283840/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1780341006 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340981.027140:0:3658:0:(genops.c:1244:class_import_put()) import ffff8c046b9a9000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1780340981.027154:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c048583c000 x1866818961284352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.027166:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c048583c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1866818961284352:0@lo:400:ldlm_lock_repla.0 00000100:00000040:3.0:1780340981.027188:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff8c048583c000 x1866818961284352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340997 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.027197:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340981.027228:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff8c048583dc00 x1866818961284352 msgsize 224 00000100:00100000:3.0:1780340981.027232:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340981.027249:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c048583c000 x1866818961284352/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340997 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.027261:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5431 usecs (6 jiffies) 00000100:00100000:2.0:1780340981.029016:0:24176:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940516864 00000100:00100000:2.0:1780340981.029028:0:24176:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940516864 00000020:00000040:2.0:1780340981.029031:0:24176:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:2.0:1780340981.029035:0:24176:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=6 00000100:00000040:2.0:1780340981.029059:0:24176:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1780340981.029102:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1049 00000100:00000040:2.0:1780340981.029107:0:24176:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:2.0:1780340981.029113:0:24176:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0446eff100 x1866818940516864/t0(4294969480) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340981.029136:0:24176:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2406:x1866818940516864:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:2.0:1780340981.029148:0:24176:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c0446eff100 x1866818940516864/t0(4294969480) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1780340981.029156:0:24176:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969480, current: 4294969480, replaying 00010000:00000040:2.0:1780340981.029159:0:24176:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:2.0:1780340981.029169:0:24176:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446eff100 x1866818940516864/t0(4294969480) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340981.029178:0:24176:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+6:2406:x1866818940516864:12345-192.168.203.16@tcp:10:dd.0 Request processed in 43us (4140us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340981.029185:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1049 00000100:00000040:2.0:1780340981.029188:0:24176:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00000100:00100000:2.0:1780340981.029205:0:25488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961284352 00000100:00100000:2.0:1780340981.029208:0:25488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961284352 00000020:00000040:2.0:1780340981.029210:0:25488:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432776247 00000020:00000040:2.0:1780340981.029212:0:25488:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0351be9800 refcount=5 00000100:00000040:2.0:1780340981.029222:0:25488:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1780340981.029237:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2688 00000100:00000040:2.0:1780340981.029239:0:25488:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0351be9800 : new rpc_count 1 00000100:00000040:2.0:1780340981.029243:0:25488:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c048583dc00 x1866818961284352/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:407/0 lens 224/0 e 0 to 0 dl 1780340992 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340981.029253:0:25488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3658:x1866818961284352:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:2.0:1780340981.029260:0:25488:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c048583dc00 x1866818961284352/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:407/0 lens 224/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1780340981.029267:0:25488:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c0351be9800 : new rpc_count 2 00010000:00080000:2.0:1780340981.029275:0:25488:0:(ldlm_lib.c:3119:target_queue_recovery_request()) @@@ queue final req req@ffff8c048583dc00 x1866818961284352/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:407/0 lens 224/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340981.029283:0:25488:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583dc00 x1866818961284352/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:407/0 lens 224/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340981.029291:0:25488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3658:x1866818961284352:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 39us (2062us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340981.029298:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2688 00000100:00000040:2.0:1780340981.029300:0:25488:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0351be9800 : new rpc_count 1 00010000:00080000:2.0:1780340981.029316:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 1, req_transno: 4294969480, next_transno: 4294969480 00010000:00080000:2.0:1780340981.029319:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969480) 00010000:00080000:2.0:1780340981.029326:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940516864 t4294969480 from 192.168.203.16@tcp req@ffff8c0446eff100 x1866818940516864/t0(4294969480) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780340981.029340:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c0446eff100 x1866818940516864/t0(4294969480) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1780340981.029365:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x363:0x0] 00000001:00000040:2.0:1780340981.029520:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 2 00000020:00000040:2.0:1780340981.029524:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=7 00010000:00000040:2.0:1780340981.029554:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969480, xid 1866818940516864 00000100:00000040:2.0:1780340981.029562:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:2.0:1780340981.029568:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:2.0:1780340981.029608:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:2.0:1780340981.029615:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1780340981.029620:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:2.0:1780340981.029627:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 6 00010000:00080000:2.0:1780340981.029631:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 0, req_transno: 0, next_transno: 4294969481 00010000:00080000:2.0:1780340981.029634:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 0, req_transno: 0, next_transno: 4294969481 00010000:00080000:0.0:1780340981.030498:0:93132:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:0.0:1780340981.030502:0:93132:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:0.0:1780340981.030507:0:93132:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:0.0:1780340981.030543:0:93132:0:(import.c:65:import_set_state_nolock()) ffff8c046b9a9000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:0.0:1780340981.030550:0:93132:0:(genops.c:1231:class_import_get()) import ffff8c046b9a9000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:0.0:1780340981.030574:0:93132:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000081b1bb4b] to pc [ptlrpcd_rcv+-1] req@ffff8c0446efc700 x1866818961284480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340981.030631:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c0446efc700 x1866818961284480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340981.030707:0:93132:0:(genops.c:1244:class_import_put()) import ffff8c046b9a9000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:2.0:1780340981.030841:0:3658:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0446efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1866818961284480:0@lo:400:ldlm_lock_repla.0 00000100:00000040:2.0:1780340981.030868:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff8c0446efc700 x1866818961284480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340997 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340981.030875:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340981.030902:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d4cbb80 x1866818961284480 msgsize 224 00000100:00100000:2.0:1780340981.030907:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340981.030925:0:3658:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c0446efc700 x1866818961284480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780340997 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340981.030935:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 9678 usecs (10 jiffies) 00000100:00100000:2.0:1780340981.030961:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961284480 00000100:00100000:2.0:1780340981.030967:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961284480 00000020:00000040:2.0:1780340981.030969:0:25494:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432776240 00000020:00000040:2.0:1780340981.030972:0:25494:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a1eb800 refcount=5 00000100:00100000:2.0:1780340981.031006:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689 00000100:00000040:2.0:1780340981.031009:0:25494:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a1eb800 : new rpc_count 1 00000100:00000040:2.0:1780340981.031014:0:25494:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d4cbb80 x1866818961284480/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:407/0 lens 224/0 e 0 to 0 dl 1780340992 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340981.031024:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818961284480:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:2.0:1780340981.031034:0:25494:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4cbb80 x1866818961284480/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:407/0 lens 224/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1780340981.031041:0:25494:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c047a1eb800 : new rpc_count 2 00010000:00080000:2.0:1780340981.031045:0:25494:0:(ldlm_lib.c:3119:target_queue_recovery_request()) @@@ queue final req req@ffff8c034d4cbb80 x1866818961284480/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:407/0 lens 224/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340981.031059:0:25494:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4cbb80 x1866818961284480/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:407/0 lens 224/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340981.031078:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3658:x1866818961284480:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 55us (174us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340981.031084:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689 00000100:00000040:2.0:1780340981.031086:0:25494:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a1eb800 : new rpc_count 1 00010000:00080000:2.0:1780340981.031102:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969481 00000100:00000040:2.0:1780340981.032599:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d4cb800 x1866818940519168 msgsize 440 00000100:00100000:2.0:1780340981.032611:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340981.032729:0:24177:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940519168 00000100:00100000:0.0:1780340981.032743:0:24177:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940519168 00000020:00000040:0.0:1780340981.032746:0:24177:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:0.0:1780340981.032750:0:24177:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=7 00000100:00000040:0.0:1780340981.032801:0:24177:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780340981.032842:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1050 00000100:00000040:0.0:1780340981.032847:0:24177:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:0.0:1780340981.032853:0:24177:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d4cb800 x1866818940519168/t0(4294969481) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.032867:0:24177:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2406:x1866818940519168:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:0.0:1780340981.032877:0:24177:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4cb800 x1866818940519168/t0(4294969481) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780340981.032885:0:24177:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969481, current: 4294969481, replaying 00010000:00000040:0.0:1780340981.032888:0:24177:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:0.0:1780340981.032898:0:24177:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4cb800 x1866818940519168/t0(4294969481) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.032907:0:24177:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2406:x1866818940519168:12345-192.168.203.16@tcp:10:dd.0 Request processed in 43us (307us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340981.032913:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1050 00000100:00000040:0.0:1780340981.032917:0:24177:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:2.0:1780340981.032975:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969481, next_transno: 4294969481 00010000:00080000:2.0:1780340981.032980:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969481) 00010000:00080000:2.0:1780340981.032987:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940519168 t4294969481 from 192.168.203.16@tcp req@ffff8c034d4cb800 x1866818940519168/t0(4294969481) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780340981.033002:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4cb800 x1866818940519168/t0(4294969481) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1780340981.033030:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x368:0x0] 00000001:00000040:2.0:1780340981.033186:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 3 00000020:00000040:2.0:1780340981.033190:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=8 00010000:00000040:2.0:1780340981.033221:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969481, xid 1866818940519168 00000100:00000040:2.0:1780340981.033231:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:2.0:1780340981.033236:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:2.0:1780340981.033275:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:2.0:1780340981.033283:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1780340981.033288:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:2.0:1780340981.033296:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 7 00010000:00080000:2.0:1780340981.033300:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969482 00010000:00080000:2.0:1780340981.033303:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969482 00000100:00000040:2.0:1780340981.035822:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d4cad80 x1866818940519296 msgsize 440 00000100:00100000:2.0:1780340981.035842:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340981.035932:0:24174:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940519296 00000100:00100000:0.0:1780340981.035943:0:24174:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940519296 00000020:00000040:0.0:1780340981.035946:0:24174:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:0.0:1780340981.035951:0:24174:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=8 00000100:00000040:0.0:1780340981.035976:0:24174:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780340981.036014:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1051 00000100:00000040:0.0:1780340981.036017:0:24174:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:0.0:1780340981.036024:0:24174:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d4cad80 x1866818940519296/t0(4294969482) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.036046:0:24174:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2406:x1866818940519296:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:0.0:1780340981.036056:0:24174:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4cad80 x1866818940519296/t0(4294969482) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780340981.036064:0:24174:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969482, current: 4294969482, replaying 00010000:00000040:0.0:1780340981.036067:0:24174:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:0.0:1780340981.036078:0:24174:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4cad80 x1866818940519296/t0(4294969482) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.036087:0:24174:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+8:2406:x1866818940519296:12345-192.168.203.16@tcp:10:dd.0 Request processed in 43us (265us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340981.036094:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1051 00000100:00000040:0.0:1780340981.036097:0:24174:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:0.0:1780340981.036118:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969482, next_transno: 4294969482 00010000:00080000:0.0:1780340981.036121:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969482) 00010000:00080000:0.0:1780340981.036127:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940519296 t4294969482 from 192.168.203.16@tcp req@ffff8c034d4cad80 x1866818940519296/t0(4294969482) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780340981.036141:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4cad80 x1866818940519296/t0(4294969482) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1780340981.036170:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x364:0x0] 00000001:00000040:0.0:1780340981.036326:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 4 00000020:00000040:0.0:1780340981.036329:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=9 00010000:00000040:0.0:1780340981.036359:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969482, xid 1866818940519296 00000100:00000040:0.0:1780340981.036369:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340981.036376:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:0.0:1780340981.036415:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:0.0:1780340981.036429:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780340981.036435:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:0.0:1780340981.036443:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 8 00010000:00080000:0.0:1780340981.036447:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969483 00010000:00080000:0.0:1780340981.036450:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969483 00000100:00000040:0.0:1780340981.043045:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8c0446efc380 x1866818940520448 msgsize 440 00000100:00100000:0.0:1780340981.043058:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340981.043087:0:24754:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940520448 00000100:00100000:0.0:1780340981.043095:0:24754:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940520448 00000020:00000040:0.0:1780340981.043097:0:24754:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:0.0:1780340981.043101:0:24754:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=9 00000100:00000040:0.0:1780340981.043121:0:24754:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780340981.043156:0:24754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1052 00000100:00000040:0.0:1780340981.043160:0:24754:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:0.0:1780340981.043167:0:24754:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0446efc380 x1866818940520448/t0(4294969483) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.043180:0:24754:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2406:x1866818940520448:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:0.0:1780340981.043190:0:24754:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c0446efc380 x1866818940520448/t0(4294969483) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780340981.043198:0:24754:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969483, current: 4294969483, replaying 00010000:00000040:0.0:1780340981.043202:0:24754:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:0.0:1780340981.043211:0:24754:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446efc380 x1866818940520448/t0(4294969483) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.043220:0:24754:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2406:x1866818940520448:12345-192.168.203.16@tcp:10:dd.0 Request processed in 42us (175us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340981.043227:0:24754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1052 00000100:00000040:0.0:1780340981.043235:0:24754:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:0.0:1780340981.043252:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969483, next_transno: 4294969483 00010000:00080000:0.0:1780340981.043255:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969483) 00010000:00080000:0.0:1780340981.043262:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940520448 t4294969483 from 192.168.203.16@tcp req@ffff8c0446efc380 x1866818940520448/t0(4294969483) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780340981.043275:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c0446efc380 x1866818940520448/t0(4294969483) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1780340981.043300:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x365:0x0] 00000001:00000040:0.0:1780340981.043445:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 5 00000020:00000040:0.0:1780340981.043448:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=10 00010000:00000040:0.0:1780340981.043476:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969483, xid 1866818940520448 00000100:00000040:0.0:1780340981.043484:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340981.043489:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:0.0:1780340981.043523:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:0.0:1780340981.043529:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780340981.043533:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:0.0:1780340981.043541:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 9 00010000:00080000:0.0:1780340981.043545:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969484 00010000:00080000:0.0:1780340981.043548:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969484 00000100:00000040:0.0:1780340981.048695:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c0446eff800 x1866818940520960 msgsize 440 00000100:00100000:0.0:1780340981.048710:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340981.051914:0:24180:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940520960 00000100:00100000:1.0:1780340981.051927:0:24180:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940520960 00000020:00000040:1.0:1780340981.051929:0:24180:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:1.0:1780340981.051934:0:24180:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=10 00000100:00000040:1.0:1780340981.051957:0:24180:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780340981.052003:0:24180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1053 00000100:00000040:1.0:1780340981.052007:0:24180:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:1.0:1780340981.052014:0:24180:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0446eff800 x1866818940520960/t0(4294969484) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340981.052027:0:24180:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0446eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2406:x1866818940520960:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:1.0:1780340981.052038:0:24180:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c0446eff800 x1866818940520960/t0(4294969484) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780340981.052055:0:24180:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969484, current: 4294969484, replaying 00010000:00000040:1.0:1780340981.052059:0:24180:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:1.0:1780340981.052072:0:24180:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0446eff800 x1866818940520960/t0(4294969484) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340981.052081:0:24180:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0446eff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+10:2406:x1866818940520960:12345-192.168.203.16@tcp:10:dd.0 Request processed in 55us (3386us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780340981.052087:0:24180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1053 00000100:00000040:1.0:1780340981.052090:0:24180:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:1.0:1780340981.052110:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969484, next_transno: 4294969484 00010000:00080000:1.0:1780340981.052114:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969484) 00010000:00080000:1.0:1780340981.052121:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940520960 t4294969484 from 192.168.203.16@tcp req@ffff8c0446eff800 x1866818940520960/t0(4294969484) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1780340981.052133:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c0446eff800 x1866818940520960/t0(4294969484) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1780340981.052157:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x366:0x0] 00000001:00000040:1.0:1780340981.052725:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 6 00000020:00000040:1.0:1780340981.052729:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=11 00010000:00000040:1.0:1780340981.052797:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969484, xid 1866818940520960 00000100:00000040:1.0:1780340981.052807:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340981.052813:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:1.0:1780340981.052859:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340981.056831:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c048583d880 x1866818940522624 msgsize 440 00000100:00100000:3.0:1780340981.056857:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340981.056892:0:24762:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940522624 00000100:00100000:3.0:1780340981.056901:0:24762:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940522624 00000020:00000040:3.0:1780340981.056903:0:24762:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.056907:0:24762:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=12 00010000:00080000:1.0:1780340981.058800:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1780340981.058814:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:1.0:1780340981.058830:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 11 00010000:00080000:1.0:1780340981.058835:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969485 00010000:00080000:1.0:1780340981.058839:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969485 00000100:00000040:3.0:1780340981.059791:0:24762:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780340981.059846:0:24762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1054 00000100:00000040:3.0:1780340981.059851:0:24762:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:3.0:1780340981.059859:0:24762:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c048583d880 x1866818940522624/t0(4294969485) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.059874:0:24762:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2406:x1866818940522624:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:3.0:1780340981.059885:0:24762:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c048583d880 x1866818940522624/t0(4294969485) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780340981.059894:0:24762:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969485, current: 4294969485, replaying 00010000:00000040:3.0:1780340981.059897:0:24762:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:3.0:1780340981.059907:0:24762:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583d880 x1866818940522624/t0(4294969485) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.059916:0:24762:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2406:x1866818940522624:12345-192.168.203.16@tcp:10:dd.0 Request processed in 44us (3086us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.059923:0:24762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1054 00000100:00000040:3.0:1780340981.059926:0:24762:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:3.0:1780340981.059945:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969485, next_transno: 4294969485 00010000:00080000:3.0:1780340981.059948:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969485) 00010000:00080000:3.0:1780340981.059954:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940522624 t4294969485 from 192.168.203.16@tcp req@ffff8c048583d880 x1866818940522624/t0(4294969485) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.059969:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c048583d880 x1866818940522624/t0(4294969485) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1780340981.060006:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x367:0x0] 00000001:00000040:3.0:1780340981.060151:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 7 00000020:00000040:3.0:1780340981.060155:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=12 00010000:00000040:3.0:1780340981.060190:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969485, xid 1866818940522624 00000100:00000040:3.0:1780340981.060199:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340981.060205:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340981.060253:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:3.0:1780340981.060260:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780340981.060265:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:3.0:1780340981.060273:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 11 00010000:00080000:3.0:1780340981.060276:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969486 00010000:00080000:3.0:1780340981.060733:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969486 00000100:00000040:3.0:1780340981.066972:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8c048583df80 x1866818940524160 msgsize 440 00000100:00100000:3.0:1780340981.066985:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340981.067011:0:24179:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940524160 00000100:00100000:3.0:1780340981.067020:0:24179:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940524160 00000020:00000040:3.0:1780340981.067023:0:24179:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.067026:0:24179:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=12 00000100:00000040:3.0:1780340981.067048:0:24179:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780340981.067083:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1055 00000100:00000040:3.0:1780340981.067087:0:24179:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:3.0:1780340981.067095:0:24179:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c048583df80 x1866818940524160/t0(4294969486) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.067107:0:24179:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2406:x1866818940524160:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:3.0:1780340981.067119:0:24179:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c048583df80 x1866818940524160/t0(4294969486) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780340981.067128:0:24179:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969486, current: 4294969486, replaying 00010000:00000040:3.0:1780340981.067141:0:24179:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:3.0:1780340981.067151:0:24179:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583df80 x1866818940524160/t0(4294969486) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.067161:0:24179:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2406:x1866818940524160:12345-192.168.203.16@tcp:10:dd.0 Request processed in 54us (188us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.067169:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1055 00000100:00000040:3.0:1780340981.067172:0:24179:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:3.0:1780340981.067188:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969486, next_transno: 4294969486 00010000:00080000:3.0:1780340981.067192:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969486) 00010000:00080000:3.0:1780340981.067198:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940524160 t4294969486 from 192.168.203.16@tcp req@ffff8c048583df80 x1866818940524160/t0(4294969486) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.067211:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c048583df80 x1866818940524160/t0(4294969486) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1780340981.067235:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x369:0x0] 00000001:00000040:3.0:1780340981.067852:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 8 00000020:00000040:3.0:1780340981.067857:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=13 00010000:00000040:3.0:1780340981.067886:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969486, xid 1866818940524160 00000100:00000040:3.0:1780340981.067896:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340981.067901:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340981.067942:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:3.0:1780340981.067949:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780340981.067955:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:3.0:1780340981.067964:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 12 00010000:00080000:3.0:1780340981.067968:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969487 00010000:00080000:3.0:1780340981.067971:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969487 00000100:00000040:0.0:1780340981.070976:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a9a9f80 x1866818940526080 msgsize 440 00000100:00100000:0.0:1780340981.070990:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340981.071047:0:8407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940526080 00000100:00100000:3.0:1780340981.071061:0:8407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940526080 00000020:00000040:3.0:1780340981.071063:0:8407:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.071067:0:8407:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=13 00000100:00000040:3.0:1780340981.071087:0:8407:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780340981.071129:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1056 00000100:00000040:3.0:1780340981.071133:0:8407:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:3.0:1780340981.071140:0:8407:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a9a9f80 x1866818940526080/t0(4294969487) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.071152:0:8407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:2406:x1866818940526080:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:3.0:1780340981.071163:0:8407:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a9a9f80 x1866818940526080/t0(4294969487) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780340981.071171:0:8407:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969487, current: 4294969487, replaying 00010000:00000040:3.0:1780340981.071175:0:8407:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:3.0:1780340981.071188:0:8407:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a9a9f80 x1866818940526080/t0(4294969487) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780340981.071195:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969487, next_transno: 4294969487 00000100:00100000:3.0:1780340981.071196:0:8407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a9a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+13:2406:x1866818940526080:12345-192.168.203.16@tcp:10:dd.0 Request processed in 46us (221us total) trans 0 rc 0/-999 00010000:00080000:1.0:1780340981.071200:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969487) 00000100:00100000:3.0:1780340981.071202:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1056 00000100:00000040:3.0:1780340981.071206:0:8407:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:1.0:1780340981.071207:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940526080 t4294969487 from 192.168.203.16@tcp req@ffff8c047a9a9f80 x1866818940526080/t0(4294969487) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1780340981.071222:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a9a9f80 x1866818940526080/t0(4294969487) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1780340981.071248:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x36a:0x0] 00000001:00000040:1.0:1780340981.071706:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 9 00000020:00000040:1.0:1780340981.071710:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=14 00010000:00000040:1.0:1780340981.071740:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969487, xid 1866818940526080 00000100:00000040:1.0:1780340981.071749:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340981.071754:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:1.0:1780340981.071825:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:1.0:1780340981.071833:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1780340981.071837:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:1.0:1780340981.071845:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 13 00010000:00080000:1.0:1780340981.071849:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969488 00010000:00080000:1.0:1780340981.071853:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969488 00000100:00000040:3.0:1780340981.075687:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c048583ea00 x1866818940526464 msgsize 440 00000100:00100000:3.0:1780340981.075702:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340981.079982:0:24191:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940526464 00000100:00100000:2.0:1780340981.079997:0:24191:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940526464 00000020:00000040:2.0:1780340981.080001:0:24191:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:2.0:1780340981.080006:0:24191:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=14 00000100:00000040:2.0:1780340981.080034:0:24191:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1780340981.080096:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1057 00000100:00000040:2.0:1780340981.080100:0:24191:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:2.0:1780340981.080107:0:24191:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c048583ea00 x1866818940526464/t0(4294969488) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340981.080121:0:24191:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+14:2406:x1866818940526464:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:2.0:1780340981.080132:0:24191:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c048583ea00 x1866818940526464/t0(4294969488) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1780340981.080141:0:24191:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969488, current: 4294969488, replaying 00010000:00000040:2.0:1780340981.080145:0:24191:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:2.0:1780340981.080159:0:24191:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583ea00 x1866818940526464/t0(4294969488) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340981.080168:0:24191:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+14:2406:x1866818940526464:12345-192.168.203.16@tcp:10:dd.0 Request processed in 49us (4482us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340981.080175:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1057 00000100:00000040:2.0:1780340981.080178:0:24191:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:0.0:1780340981.082914:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969488, next_transno: 4294969488 00010000:00080000:0.0:1780340981.082922:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969488) 00010000:00080000:0.0:1780340981.082937:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940526464 t4294969488 from 192.168.203.16@tcp req@ffff8c048583ea00 x1866818940526464/t0(4294969488) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780340981.082976:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c048583ea00 x1866818940526464/t0(4294969488) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1780340981.083007:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x372:0x0] 00000001:00000040:0.0:1780340981.083154:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 10 00000020:00000040:0.0:1780340981.083158:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=15 00010000:00000040:0.0:1780340981.083186:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969488, xid 1866818940526464 00000100:00000040:0.0:1780340981.083194:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340981.083201:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:0.0:1780340981.083247:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:0.0:1780340981.083256:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780340981.083263:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:0.0:1780340981.083274:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 14 00010000:00080000:0.0:1780340981.083278:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969489 00010000:00080000:0.0:1780340981.083282:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969489 00000100:00000040:2.0:1780340981.088156:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d4c9c00 x1866818940528128 msgsize 440 00000100:00100000:2.0:1780340981.088169:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340981.088228:0:24752:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940528128 00000100:00100000:3.0:1780340981.088237:0:24752:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940528128 00000020:00000040:3.0:1780340981.088240:0:24752:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.088245:0:24752:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=15 00000100:00000040:3.0:1780340981.088267:0:24752:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780340981.088320:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1058 00000100:00000040:3.0:1780340981.088324:0:24752:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:3.0:1780340981.088340:0:24752:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d4c9c00 x1866818940528128/t0(4294969489) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.088352:0:24752:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+15:2406:x1866818940528128:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:3.0:1780340981.088363:0:24752:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4c9c00 x1866818940528128/t0(4294969489) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780340981.088372:0:24752:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969489, current: 4294969489, replaying 00010000:00000040:3.0:1780340981.088375:0:24752:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:3.0:1780340981.088388:0:24752:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4c9c00 x1866818940528128/t0(4294969489) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.088719:0:24752:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+15:2406:x1866818940528128:12345-192.168.203.16@tcp:10:dd.0 Request processed in 368us (561us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.088726:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1058 00000100:00000040:3.0:1780340981.088729:0:24752:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:0.0:1780340981.089111:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969489, next_transno: 4294969489 00010000:00080000:0.0:1780340981.089116:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969489) 00010000:00080000:0.0:1780340981.089125:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940528128 t4294969489 from 192.168.203.16@tcp req@ffff8c034d4c9c00 x1866818940528128/t0(4294969489) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780340981.089141:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4c9c00 x1866818940528128/t0(4294969489) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1780340981.089167:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x36c:0x0] 00000001:00000040:0.0:1780340981.089322:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 11 00000020:00000040:0.0:1780340981.089326:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=16 00010000:00000040:0.0:1780340981.089356:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969489, xid 1866818940528128 00000100:00000040:0.0:1780340981.089366:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340981.089372:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:0.0:1780340981.089431:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:0.0:1780340981.089440:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780340981.089445:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:0.0:1780340981.089455:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 15 00010000:00080000:0.0:1780340981.089459:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969490 00010000:00080000:0.0:1780340981.089462:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969490 00000100:00000040:1.0:1780340981.094708:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a8c8a80 x1866818940528000 msgsize 440 00000100:00100000:1.0:1780340981.094720:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340981.095373:0:8406:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940528000 00000100:00100000:1.0:1780340981.095454:0:8406:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940528000 00000020:00000040:1.0:1780340981.095457:0:8406:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:1.0:1780340981.095461:0:8406:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=16 00000100:00000040:1.0:1780340981.095482:0:8406:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780340981.095528:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1059 00000100:00000040:1.0:1780340981.095532:0:8406:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:1.0:1780340981.095539:0:8406:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a8c8a80 x1866818940528000/t0(4294969490) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340981.095557:0:8406:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+16:2406:x1866818940528000:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:1.0:1780340981.095568:0:8406:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a8c8a80 x1866818940528000/t0(4294969490) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780340981.095577:0:8406:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969490, current: 4294969490, replaying 00010000:00000040:1.0:1780340981.095581:0:8406:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:1.0:1780340981.095591:0:8406:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8c8a80 x1866818940528000/t0(4294969490) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340981.095600:0:8406:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+16:2406:x1866818940528000:12345-192.168.203.16@tcp:10:dd.0 Request processed in 45us (892us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780340981.095608:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1059 00000100:00000040:1.0:1780340981.095611:0:8406:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:1.0:1780340981.095633:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969490, next_transno: 4294969490 00010000:00080000:1.0:1780340981.095636:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969490) 00010000:00080000:1.0:1780340981.095642:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940528000 t4294969490 from 192.168.203.16@tcp req@ffff8c047a8c8a80 x1866818940528000/t0(4294969490) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1780340981.095656:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a8c8a80 x1866818940528000/t0(4294969490) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1780340981.095682:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x36b:0x0] 00000001:00000040:1.0:1780340981.095848:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 12 00000020:00000040:1.0:1780340981.095851:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=17 00010000:00000040:1.0:1780340981.095880:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969490, xid 1866818940528000 00000100:00000040:1.0:1780340981.095889:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340981.095894:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:1.0:1780340981.095938:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:1.0:1780340981.095950:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1780340981.095955:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:1.0:1780340981.095962:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 16 00010000:00080000:1.0:1780340981.095966:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969491 00010000:00080000:1.0:1780340981.095969:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969491 00000100:00000040:3.0:1780340981.099586:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c048583ca80 x1866818940529920 msgsize 440 00000100:00100000:3.0:1780340981.099598:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340981.100010:0:24178:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940529920 00000100:00100000:0.0:1780340981.100019:0:24178:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940529920 00000020:00000040:0.0:1780340981.100021:0:24178:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:0.0:1780340981.100025:0:24178:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=17 00000100:00000040:0.0:1780340981.100046:0:24178:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780340981.100085:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1060 00000100:00000040:0.0:1780340981.100089:0:24178:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:0.0:1780340981.100096:0:24178:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c048583ca80 x1866818940529920/t0(4294969491) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.100107:0:24178:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+17:2406:x1866818940529920:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:0.0:1780340981.100117:0:24178:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c048583ca80 x1866818940529920/t0(4294969491) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780340981.100125:0:24178:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969491, current: 4294969491, replaying 00010000:00000040:0.0:1780340981.100128:0:24178:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:0.0:1780340981.100138:0:24178:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583ca80 x1866818940529920/t0(4294969491) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.100146:0:24178:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+17:2406:x1866818940529920:12345-192.168.203.16@tcp:10:dd.0 Request processed in 40us (560us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340981.100152:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1060 00000100:00000040:0.0:1780340981.100154:0:24178:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:1.0:1780340981.105210:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969491, next_transno: 4294969491 00010000:00080000:1.0:1780340981.105220:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969491) 00010000:00080000:1.0:1780340981.105250:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940529920 t4294969491 from 192.168.203.16@tcp req@ffff8c048583ca80 x1866818940529920/t0(4294969491) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1780340981.105456:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c048583ca80 x1866818940529920/t0(4294969491) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1780340981.105489:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x36d:0x0] 00000001:00000040:1.0:1780340981.105637:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 13 00000020:00000040:1.0:1780340981.105642:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=18 00010000:00000040:1.0:1780340981.105673:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969491, xid 1866818940529920 00000100:00000040:1.0:1780340981.105684:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340981.105691:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:1.0:1780340981.105738:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:1.0:1780340981.105749:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1780340981.105756:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:1.0:1780340981.105796:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 17 00010000:00080000:1.0:1780340981.105800:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969492 00010000:00080000:1.0:1780340981.105804:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969492 00000100:00000040:3.0:1780340981.109325:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8c048583c380 x1866818940530816 msgsize 440 00000100:00100000:3.0:1780340981.109340:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340981.109369:0:8405:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940530816 00000100:00100000:3.0:1780340981.110862:0:8405:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940530816 00000020:00000040:3.0:1780340981.110869:0:8405:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.110873:0:8405:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=18 00000100:00000040:3.0:1780340981.110897:0:8405:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780340981.110943:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1061 00000100:00000040:3.0:1780340981.110947:0:8405:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:3.0:1780340981.110954:0:8405:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c048583c380 x1866818940530816/t0(4294969492) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.110979:0:8405:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+18:2406:x1866818940530816:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:3.0:1780340981.110991:0:8405:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c048583c380 x1866818940530816/t0(4294969492) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780340981.111000:0:8405:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969492, current: 4294969492, replaying 00010000:00000040:3.0:1780340981.111004:0:8405:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:3.0:1780340981.111021:0:8405:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583c380 x1866818940530816/t0(4294969492) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.111030:0:8405:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+18:2406:x1866818940530816:12345-192.168.203.16@tcp:10:dd.0 Request processed in 55us (1706us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.111038:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1061 00000100:00000040:3.0:1780340981.111041:0:8405:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:0.0:1780340981.111360:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969492, next_transno: 4294969492 00010000:00080000:0.0:1780340981.111370:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969492) 00010000:00080000:0.0:1780340981.111378:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940530816 t4294969492 from 192.168.203.16@tcp req@ffff8c048583c380 x1866818940530816/t0(4294969492) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780340981.111393:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c048583c380 x1866818940530816/t0(4294969492) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1780340981.111419:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x36e:0x0] 00000001:00000040:0.0:1780340981.111576:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 14 00000020:00000040:0.0:1780340981.111580:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=19 00010000:00000040:0.0:1780340981.111612:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969492, xid 1866818940530816 00000100:00000040:0.0:1780340981.111622:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340981.111629:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:0.0:1780340981.112807:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:0.0:1780340981.112823:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780340981.112832:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:0.0:1780340981.112844:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 18 00010000:00080000:0.0:1780340981.112849:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969493 00010000:00080000:0.0:1780340981.112853:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969493 00000100:00000040:1.0:1780340981.121371:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a8c9180 x1866818940532864 msgsize 440 00000100:00100000:1.0:1780340981.121396:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340981.121433:0:24176:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940532864 00000100:00100000:1.0:1780340981.121442:0:24176:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940532864 00000020:00000040:1.0:1780340981.121451:0:24176:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:1.0:1780340981.121455:0:24176:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=19 00000100:00000040:1.0:1780340981.121478:0:24176:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780340981.121518:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1062 00000100:00000040:1.0:1780340981.121523:0:24176:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:1.0:1780340981.121530:0:24176:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a8c9180 x1866818940532864/t0(4294969493) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340981.121542:0:24176:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+19:2406:x1866818940532864:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:1.0:1780340981.121553:0:24176:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a8c9180 x1866818940532864/t0(4294969493) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780340981.121561:0:24176:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969493, current: 4294969493, replaying 00010000:00000040:1.0:1780340981.121565:0:24176:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:1.0:1780340981.121576:0:24176:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8c9180 x1866818940532864/t0(4294969493) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340981.121584:0:24176:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+19:2406:x1866818940532864:12345-192.168.203.16@tcp:10:dd.0 Request processed in 44us (214us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780340981.121591:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1062 00000100:00000040:1.0:1780340981.121594:0:24176:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:1.0:1780340981.121612:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969493, next_transno: 4294969493 00010000:00080000:1.0:1780340981.121616:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969493) 00010000:00080000:1.0:1780340981.121623:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940532864 t4294969493 from 192.168.203.16@tcp req@ffff8c047a8c9180 x1866818940532864/t0(4294969493) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1780340981.121638:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a8c9180 x1866818940532864/t0(4294969493) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1780340981.121663:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x370:0x0] 00000001:00000040:1.0:1780340981.121848:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 15 00000020:00000040:1.0:1780340981.121852:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=20 00010000:00000040:1.0:1780340981.121884:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969493, xid 1866818940532864 00000100:00000040:1.0:1780340981.121894:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340981.121899:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:1.0:1780340981.121935:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:1.0:1780340981.121943:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1780340981.121949:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:1.0:1780340981.121957:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 19 00010000:00080000:1.0:1780340981.121960:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969494 00010000:00080000:1.0:1780340981.121964:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969494 00000100:00000040:3.0:1780340981.125877:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c048583e300 x1866818940533120 msgsize 440 00000100:00100000:3.0:1780340981.125894:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340981.129819:0:24177:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940533120 00000100:00100000:0.0:1780340981.129830:0:24177:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940533120 00000020:00000040:0.0:1780340981.129833:0:24177:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:0.0:1780340981.129837:0:24177:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=20 00000100:00000040:0.0:1780340981.129859:0:24177:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780340981.129898:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1063 00000100:00000040:0.0:1780340981.129902:0:24177:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:0.0:1780340981.129909:0:24177:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c048583e300 x1866818940533120/t0(4294969494) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.129923:0:24177:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+20:2406:x1866818940533120:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:0.0:1780340981.129942:0:24177:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c048583e300 x1866818940533120/t0(4294969494) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780340981.129951:0:24177:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969494, current: 4294969494, replaying 00010000:00000040:0.0:1780340981.129955:0:24177:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:0.0:1780340981.129966:0:24177:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583e300 x1866818940533120/t0(4294969494) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.129976:0:24177:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+20:2406:x1866818940533120:12345-192.168.203.16@tcp:10:dd.0 Request processed in 54us (4099us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340981.129983:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1063 00000100:00000040:0.0:1780340981.129986:0:24177:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:0.0:1780340981.130013:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969494, next_transno: 4294969494 00010000:00080000:0.0:1780340981.130017:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969494) 00010000:00080000:0.0:1780340981.130024:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940533120 t4294969494 from 192.168.203.16@tcp req@ffff8c048583e300 x1866818940533120/t0(4294969494) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780340981.130036:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c048583e300 x1866818940533120/t0(4294969494) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1780340981.130060:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x36f:0x0] 00000001:00000040:0.0:1780340981.130188:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 16 00000020:00000040:0.0:1780340981.130191:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=21 00010000:00000040:0.0:1780340981.130216:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969494, xid 1866818940533120 00000100:00000040:0.0:1780340981.130225:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340981.130230:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:0.0:1780340981.130283:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:0.0:1780340981.130291:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780340981.130296:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:0.0:1780340981.130303:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 20 00010000:00080000:0.0:1780340981.130313:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969495 00010000:00080000:0.0:1780340981.130316:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969495 00000020:00000040:2.0:1780340981.135465:0:72692:0:(genops.c:1231:class_import_get()) import ffff8c0346ee9000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1780340981.135503:0:72692:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a2aea96f] to pc [ptlrpcd_00_03+3] req@ffff8c034d4ca680 x1866818961284608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.135600:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c034d4ca680 x1866818961284608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.135615:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d4ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961284608:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1780340981.135646:0:3662:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c034d4ca680 x1866818961284608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340997 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.135666:0:3662:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340981.135704:0:3662:0:(events.c:337:request_in_callback()) incoming req@ffff8c048583fb80 x1866818961284608 msgsize 224 00000100:00100000:3.0:1780340981.135708:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340981.135729:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c034d4ca680 x1866818961284608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340997 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.135739:0:3662:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 5007 usecs (6 jiffies) 00000100:00100000:3.0:1780340981.135806:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961284608 00000100:00100000:3.0:1780340981.135815:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961284608 00000020:00000040:3.0:1780340981.135817:0:10290:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f183 00000020:00000040:3.0:1780340981.135821:0:10290:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0442c08800 refcount=5 00000020:00000040:3.0:1780340981.135834:0:10290:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00000040:3.0:1780340981.135858:0:10290:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:3.0:1780340981.135893:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2193 00000100:00000040:3.0:1780340981.136011:0:10290:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0442c08800 : new rpc_count 1 00000100:00000040:3.0:1780340981.136017:0:10290:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c048583fb80 x1866818961284608/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:407/0 lens 224/0 e 0 to 0 dl 1780340992 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.136032:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961284608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1780340981.136064:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:3.0:1780340981.136075:0:10290:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969444, transno 0, xid 1866818961284608 00000100:00000040:3.0:1780340981.136084:0:10290:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 66 to 0@lo 00000100:00000040:3.0:1780340981.136089:0:10290:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340981.136109:0:10290:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8c034d4ca680 x1866818961284608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340997 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.136137:0:10290:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 65 to 0@lo 00000100:00000040:3.0:1780340981.136142:0:10290:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583fb80 x1866818961284608/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:407/0 lens 224/368 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.136151:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961284608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340981.136158:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2193 00000100:00000040:3.0:1780340981.136161:0:10290:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0442c08800 : new rpc_count 0 00000020:00000040:3.0:1780340981.136171:0:10290:0:(genops.c:900:class_export_put()) PUTting export ffff8c0442c08800 : new refcount 4 00000100:00080000:3.0:1780340981.136185:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1780340981.136189:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00000040:0.0:1780340981.136244:0:3662:0:(client.c:3098:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969444 00000100:00000040:0.0:1780340981.136251:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c034d4ca680 x1866818961284608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1780340981.136261:0:3662:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:0.0:1780340981.136264:0:3662:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:0.0:1780340981.136271:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4ca680 x1866818961284608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340997 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340981.136344:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d4ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961284608:0@lo:13:osp-pre-1-1.0 00000100:00000040:0.0:1780340981.136352:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c034d4ca680 x1866818961284608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340997 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340981.136363:0:3662:0:(genops.c:1244:class_import_put()) import ffff8c0346ee9000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1780340981.136886:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a9aa680 x1866818940533888 msgsize 440 00000100:00100000:0.0:1780340981.136895:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340981.136954:0:24174:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940533888 00000100:00100000:3.0:1780340981.136966:0:24174:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940533888 00000020:00000040:3.0:1780340981.136968:0:24174:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.136971:0:24174:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=21 00000100:00000040:3.0:1780340981.136985:0:24174:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780340981.137026:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1064 00000100:00000040:3.0:1780340981.137029:0:24174:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:3.0:1780340981.137035:0:24174:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a9aa680 x1866818940533888/t0(4294969495) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.137049:0:24174:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a9aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+21:2406:x1866818940533888:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:3.0:1780340981.137058:0:24174:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a9aa680 x1866818940533888/t0(4294969495) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780340981.137068:0:24174:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969495, current: 4294969495, replaying 00010000:00000040:3.0:1780340981.137071:0:24174:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:3.0:1780340981.137085:0:24174:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a9aa680 x1866818940533888/t0(4294969495) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.137093:0:24174:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a9aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+21:2406:x1866818940533888:12345-192.168.203.16@tcp:10:dd.0 Request processed in 49us (207us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.137100:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1064 00000100:00000040:3.0:1780340981.137102:0:24174:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:3.0:1780340981.137119:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969495, next_transno: 4294969495 00010000:00080000:3.0:1780340981.137123:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969495) 00010000:00080000:3.0:1780340981.137131:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940533888 t4294969495 from 192.168.203.16@tcp req@ffff8c047a9aa680 x1866818940533888/t0(4294969495) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.137145:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a9aa680 x1866818940533888/t0(4294969495) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1780340981.137171:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x373:0x0] 00000001:00000040:3.0:1780340981.137417:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 17 00000020:00000040:3.0:1780340981.137421:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=22 00010000:00000040:3.0:1780340981.137453:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969495, xid 1866818940533888 00000100:00000040:3.0:1780340981.137460:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340981.137465:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340981.137503:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:3.0:1780340981.137511:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780340981.137516:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:3.0:1780340981.137524:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 21 00010000:00080000:3.0:1780340981.137528:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969496 00010000:00080000:3.0:1780340981.137531:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969496 00000100:00000040:3.0:1780340981.139530:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c048583e680 x1866818940535040 msgsize 440 00000100:00100000:3.0:1780340981.139545:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340981.139589:0:24752:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940535040 00000100:00100000:3.0:1780340981.139598:0:24752:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940535040 00000020:00000040:3.0:1780340981.139601:0:24752:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.139605:0:24752:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=22 00000100:00000040:3.0:1780340981.139629:0:24752:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780340981.139726:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1065 00000100:00000040:3.0:1780340981.139731:0:24752:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:3.0:1780340981.139737:0:24752:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c048583e680 x1866818940535040/t0(4294969496) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.139752:0:24752:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c048583e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+22:2406:x1866818940535040:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:3.0:1780340981.139791:0:24752:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c048583e680 x1866818940535040/t0(4294969496) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780340981.139800:0:24752:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969496, current: 4294969496, replaying 00010000:00000040:3.0:1780340981.139803:0:24752:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:3.0:1780340981.139812:0:24752:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c048583e680 x1866818940535040/t0(4294969496) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.139826:0:24752:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c048583e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+22:2406:x1866818940535040:12345-192.168.203.16@tcp:10:dd.0 Request processed in 79us (296us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.139832:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1065 00000100:00000040:3.0:1780340981.139835:0:24752:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:3.0:1780340981.139850:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969496, next_transno: 4294969496 00010000:00080000:3.0:1780340981.139854:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969496) 00010000:00080000:3.0:1780340981.139859:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940535040 t4294969496 from 192.168.203.16@tcp req@ffff8c048583e680 x1866818940535040/t0(4294969496) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.139873:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c048583e680 x1866818940535040/t0(4294969496) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1780340981.139896:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x371:0x0] 00000001:00000040:3.0:1780340981.140029:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 18 00000020:00000040:3.0:1780340981.140033:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=23 00010000:00000040:3.0:1780340981.140064:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969496, xid 1866818940535040 00000100:00000040:3.0:1780340981.140074:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340981.140079:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340981.140119:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:3.0:1780340981.140127:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780340981.140132:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:3.0:1780340981.140142:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 22 00010000:00080000:3.0:1780340981.140145:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969497 00010000:00080000:3.0:1780340981.140149:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969497 00000100:00000040:3.0:1780340981.145594:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d874700 x1866818940536192 msgsize 440 00000100:00100000:3.0:1780340981.145609:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340981.145680:0:24180:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940536192 00000100:00100000:0.0:1780340981.145690:0:24180:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940536192 00000020:00000040:0.0:1780340981.145693:0:24180:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:0.0:1780340981.145697:0:24180:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=23 00000100:00000040:0.0:1780340981.145720:0:24180:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780340981.145944:0:24180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1066 00000100:00000040:0.0:1780340981.145948:0:24180:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:0.0:1780340981.145955:0:24180:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d874700 x1866818940536192/t0(4294969497) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.145969:0:24180:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+23:2406:x1866818940536192:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:0.0:1780340981.145981:0:24180:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d874700 x1866818940536192/t0(4294969497) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780340981.145995:0:24180:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969497, current: 4294969497, replaying 00010000:00000040:0.0:1780340981.145998:0:24180:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:0.0:1780340981.146011:0:24180:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d874700 x1866818940536192/t0(4294969497) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.146020:0:24180:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+23:2406:x1866818940536192:12345-192.168.203.16@tcp:10:dd.0 Request processed in 54us (426us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340981.146027:0:24180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1066 00000100:00000040:0.0:1780340981.146030:0:24180:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:3.0:1780340981.146189:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969497, next_transno: 4294969497 00010000:00080000:3.0:1780340981.146199:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969497) 00010000:00080000:3.0:1780340981.146206:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940536192 t4294969497 from 192.168.203.16@tcp req@ffff8c034d874700 x1866818940536192/t0(4294969497) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.146222:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d874700 x1866818940536192/t0(4294969497) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1780340981.146247:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x374:0x0] 00000001:00000040:3.0:1780340981.146398:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 19 00000020:00000040:3.0:1780340981.146401:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=24 00010000:00000040:3.0:1780340981.146431:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969497, xid 1866818940536192 00000100:00000040:3.0:1780340981.146441:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340981.146447:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340981.146490:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:3.0:1780340981.146499:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780340981.146504:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:3.0:1780340981.146511:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 23 00010000:00080000:3.0:1780340981.146515:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969498 00010000:00080000:3.0:1780340981.146518:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969498 00000100:00000040:2.0:1780340981.151954:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d4c8380 x1866818940536704 msgsize 440 00000100:00100000:2.0:1780340981.151977:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340981.152040:0:24762:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940536704 00000100:00100000:3.0:1780340981.152050:0:24762:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940536704 00000020:00000040:3.0:1780340981.152053:0:24762:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.152058:0:24762:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=24 00000100:00000040:3.0:1780340981.152079:0:24762:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780340981.152120:0:24762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1067 00000100:00000040:3.0:1780340981.152124:0:24762:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:3.0:1780340981.152131:0:24762:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d4c8380 x1866818940536704/t0(4294969498) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.152144:0:24762:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+24:2406:x1866818940536704:12345-192.168.203.16@tcp:10:dd.0 00000020:00000040:3.0:1780340981.152162:0:24762:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4c8380 x1866818940536704/t0(4294969498) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780340981.152171:0:24762:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969498, current: 4294969498, replaying 00010000:00000040:3.0:1780340981.152174:0:24762:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:3.0:1780340981.152240:0:24762:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4c8380 x1866818940536704/t0(4294969498) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.152249:0:24762:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+24:2406:x1866818940536704:12345-192.168.203.16@tcp:10:dd.0 Request processed in 107us (296us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.152257:0:24762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1067 00000100:00000040:3.0:1780340981.152260:0:24762:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:0.0:1780340981.152378:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969498, next_transno: 4294969498 00010000:00080000:0.0:1780340981.152383:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969498) 00010000:00080000:0.0:1780340981.152391:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940536704 t4294969498 from 192.168.203.16@tcp req@ffff8c034d4c8380 x1866818940536704/t0(4294969498) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780340981.152407:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4c8380 x1866818940536704/t0(4294969498) o10->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 440/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1780340981.152434:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x375:0x0] 00000001:00000040:0.0:1780340981.152590:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 20 00000020:00000040:0.0:1780340981.152594:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=25 00010000:00000040:0.0:1780340981.152626:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969498, xid 1866818940536704 00000100:00000040:0.0:1780340981.152636:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340981.152641:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:0.0:1780340981.152866:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:0.0:1780340981.152875:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780340981.152880:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:0.0:1780340981.152889:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 24 00010000:00080000:0.0:1780340981.152893:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969499 00010000:00080000:0.0:1780340981.152896:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969499 00000100:00000040:3.0:1780340981.154853:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d875880 x1866818940537088 msgsize 1512 00000100:00100000:3.0:1780340981.154866:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340981.154933:0:24179:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940537088 00000100:00100000:2.0:1780340981.154942:0:24179:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940537088 00000020:00000040:2.0:1780340981.154944:0:24179:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:2.0:1780340981.154949:0:24179:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=25 00000100:00000040:2.0:1780340981.154968:0:24179:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1780340981.155004:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1068 00000100:00000040:2.0:1780340981.155007:0:24179:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:2.0:1780340981.155014:0:24179:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d875880 x1866818940537088/t0(4294969499) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340981.155025:0:24179:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2406:x1866818940537088:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:2.0:1780340981.155035:0:24179:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d875880 x1866818940537088/t0(4294969499) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1780340981.155044:0:24179:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969499, current: 4294969499, replaying 00010000:00000040:2.0:1780340981.155047:0:24179:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:2.0:1780340981.155056:0:24179:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d875880 x1866818940537088/t0(4294969499) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340981.155066:0:24179:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+25:2406:x1866818940537088:12345-192.168.203.16@tcp:4:dd.0 Request processed in 42us (212us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340981.155073:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1068 00000100:00000040:2.0:1780340981.155075:0:24179:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:2.0:1780340981.155093:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969499, next_transno: 4294969499 00010000:00080000:2.0:1780340981.155096:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969499) 00010000:00080000:2.0:1780340981.155102:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940537088 t4294969499 from 192.168.203.16@tcp req@ffff8c034d875880 x1866818940537088/t0(4294969499) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780340981.155116:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d875880 x1866818940537088/t0(4294969499) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1780340981.155156:0:93024:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x0:0x0] 00002000:00080000:2.0:1780340981.155240:0:93024:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00000020:00000040:2.0:1780340981.155305:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1780340981.155331:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:2.0:1780340981.155794:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 21 00000020:00000040:2.0:1780340981.155798:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=26 00010000:00000040:2.0:1780340981.155825:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969499, xid 1866818940537088 00000100:00000040:2.0:1780340981.155834:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:2.0:1780340981.155840:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:2.0:1780340981.155967:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:2.0:1780340981.155976:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1780340981.155981:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:2.0:1780340981.155989:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 25 00010000:00080000:2.0:1780340981.155994:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969500 00010000:00080000:2.0:1780340981.155997:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969500 00000100:00000040:3.0:1780340981.158394:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d875180 x1866818940537984 msgsize 1512 00000100:00100000:3.0:1780340981.158407:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340981.158474:0:8407:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940537984 00000100:00100000:0.0:1780340981.158484:0:8407:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940537984 00000020:00000040:0.0:1780340981.158487:0:8407:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:0.0:1780340981.158491:0:8407:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=26 00000100:00000040:0.0:1780340981.158514:0:8407:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780340981.158556:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1069 00000100:00000040:0.0:1780340981.158561:0:8407:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:0.0:1780340981.158567:0:8407:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d875180 x1866818940537984/t0(4294969500) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.158580:0:8407:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+26:2406:x1866818940537984:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:0.0:1780340981.158591:0:8407:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d875180 x1866818940537984/t0(4294969500) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780340981.158600:0:8407:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969500, current: 4294969500, replaying 00010000:00000040:0.0:1780340981.158603:0:8407:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:0.0:1780340981.158614:0:8407:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d875180 x1866818940537984/t0(4294969500) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.158623:0:8407:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+26:2406:x1866818940537984:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44us (229us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340981.158630:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1069 00000100:00000040:0.0:1780340981.158633:0:8407:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:2.0:1780340981.159065:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969500, next_transno: 4294969500 00010000:00080000:2.0:1780340981.159069:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969500) 00010000:00080000:2.0:1780340981.159078:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940537984 t4294969500 from 192.168.203.16@tcp req@ffff8c034d875180 x1866818940537984/t0(4294969500) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780340981.159094:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d875180 x1866818940537984/t0(4294969500) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780340981.159179:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1780340981.159204:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:2.0:1780340981.159949:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 22 00000020:00000040:2.0:1780340981.159955:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=27 00010000:00000040:2.0:1780340981.159986:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969500, xid 1866818940537984 00000100:00000040:2.0:1780340981.159998:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:2.0:1780340981.160012:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:2.0:1780340981.160103:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:2.0:1780340981.160113:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1780340981.160120:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:2.0:1780340981.160130:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 26 00010000:00080000:2.0:1780340981.160135:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969501 00010000:00080000:2.0:1780340981.160139:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969501 00000100:00000040:0.0:1780340981.162301:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a9a8e00 x1866818940538240 msgsize 1512 00000100:00100000:0.0:1780340981.162316:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340981.162385:0:24191:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940538240 00000100:00100000:3.0:1780340981.162394:0:24191:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940538240 00000020:00000040:3.0:1780340981.162397:0:24191:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.162401:0:24191:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=27 00000100:00000040:3.0:1780340981.162424:0:24191:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780340981.162471:0:24191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1070 00000100:00000040:3.0:1780340981.162475:0:24191:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:3.0:1780340981.162481:0:24191:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a9a8e00 x1866818940538240/t0(4294969501) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.162495:0:24191:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2406:x1866818940538240:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:3.0:1780340981.162506:0:24191:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a9a8e00 x1866818940538240/t0(4294969501) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780340981.162527:0:24191:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969501, current: 4294969501, replaying 00010000:00000040:3.0:1780340981.162531:0:24191:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:3.0:1780340981.162543:0:24191:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a9a8e00 x1866818940538240/t0(4294969501) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.162552:0:24191:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a9a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+27:2406:x1866818940538240:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59us (252us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.162559:0:24191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1070 00000100:00000040:3.0:1780340981.162562:0:24191:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:3.0:1780340981.162835:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969501, next_transno: 4294969501 00010000:00080000:3.0:1780340981.162839:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969501) 00010000:00080000:3.0:1780340981.162847:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940538240 t4294969501 from 192.168.203.16@tcp req@ffff8c047a9a8e00 x1866818940538240/t0(4294969501) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.162862:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a9a8e00 x1866818940538240/t0(4294969501) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.162936:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1780340981.162963:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:3.0:1780340981.163171:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 23 00000020:00000040:3.0:1780340981.163175:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=28 00010000:00000040:3.0:1780340981.163470:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969501, xid 1866818940538240 00000100:00000040:3.0:1780340981.163481:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340981.163486:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340981.163531:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:3.0:1780340981.163540:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780340981.163545:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:3.0:1780340981.163553:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 27 00010000:00080000:3.0:1780340981.163566:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969502 00010000:00080000:3.0:1780340981.163569:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969502 00000100:00000040:2.0:1780340981.166834:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d4ca300 x1866818940538496 msgsize 1512 00000100:00100000:2.0:1780340981.166847:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340981.167012:0:24754:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940538496 00000100:00100000:0.0:1780340981.167022:0:24754:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940538496 00000020:00000040:0.0:1780340981.167025:0:24754:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:0.0:1780340981.167029:0:24754:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=28 00000100:00000040:0.0:1780340981.167052:0:24754:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780340981.167099:0:24754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1071 00000100:00000040:0.0:1780340981.167103:0:24754:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:0.0:1780340981.167110:0:24754:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d4ca300 x1866818940538496/t0(4294969502) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.167124:0:24754:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+28:2406:x1866818940538496:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:0.0:1780340981.167134:0:24754:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4ca300 x1866818940538496/t0(4294969502) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780340981.167143:0:24754:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969502, current: 4294969502, replaying 00010000:00000040:0.0:1780340981.167147:0:24754:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:0.0:1780340981.167156:0:24754:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4ca300 x1866818940538496/t0(4294969502) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.167165:0:24754:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+28:2406:x1866818940538496:12345-192.168.203.16@tcp:4:dd.0 Request processed in 43us (331us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340981.167171:0:24754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1071 00000100:00000040:0.0:1780340981.167174:0:24754:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:3.0:1780340981.167376:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969502, next_transno: 4294969502 00010000:00080000:3.0:1780340981.167381:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969502) 00010000:00080000:3.0:1780340981.167389:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940538496 t4294969502 from 192.168.203.16@tcp req@ffff8c034d4ca300 x1866818940538496/t0(4294969502) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.167404:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4ca300 x1866818940538496/t0(4294969502) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.167484:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1780340981.167511:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:3.0:1780340981.167720:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 24 00000020:00000040:3.0:1780340981.167723:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=29 00010000:00000040:3.0:1780340981.167982:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969502, xid 1866818940538496 00000100:00000040:3.0:1780340981.167994:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340981.167999:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340981.168040:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:3.0:1780340981.168048:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780340981.168054:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:3.0:1780340981.168064:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 28 00010000:00080000:3.0:1780340981.168067:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969503 00010000:00080000:3.0:1780340981.168071:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969503 00000100:00000040:0.0:1780340981.171160:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a9aa300 x1866818940538752 msgsize 1512 00000100:00100000:0.0:1780340981.171173:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340981.171328:0:8406:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940538752 00000100:00100000:1.0:1780340981.171338:0:8406:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940538752 00000020:00000040:1.0:1780340981.171340:0:8406:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:1.0:1780340981.171345:0:8406:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=29 00000100:00000040:1.0:1780340981.171368:0:8406:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780340981.171483:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1072 00000100:00000040:1.0:1780340981.171487:0:8406:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:1.0:1780340981.171494:0:8406:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a9aa300 x1866818940538752/t0(4294969503) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340981.171507:0:8406:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+29:2406:x1866818940538752:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:1.0:1780340981.171518:0:8406:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a9aa300 x1866818940538752/t0(4294969503) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780340981.171526:0:8406:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969503, current: 4294969503, replaying 00010000:00000040:1.0:1780340981.171529:0:8406:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:1.0:1780340981.171546:0:8406:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a9aa300 x1866818940538752/t0(4294969503) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340981.171567:0:8406:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a9aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+29:2406:x1866818940538752:12345-192.168.203.16@tcp:4:dd.0 Request processed in 63us (408us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780340981.171574:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1072 00000100:00000040:1.0:1780340981.171577:0:8406:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:3.0:1780340981.171693:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969503, next_transno: 4294969503 00010000:00080000:3.0:1780340981.171698:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969503) 00010000:00080000:3.0:1780340981.171706:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940538752 t4294969503 from 192.168.203.16@tcp req@ffff8c047a9aa300 x1866818940538752/t0(4294969503) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.171723:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a9aa300 x1866818940538752/t0(4294969503) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.171847:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1780340981.171873:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:3.0:1780340981.172072:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 25 00000020:00000040:3.0:1780340981.172076:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=30 00010000:00000040:3.0:1780340981.172384:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969503, xid 1866818940538752 00000100:00000040:3.0:1780340981.172397:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340981.172402:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340981.172448:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:3.0:1780340981.172456:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780340981.172462:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:3.0:1780340981.172470:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 29 00010000:00080000:3.0:1780340981.172475:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969504 00010000:00080000:3.0:1780340981.172478:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969504 00000100:00000040:2.0:1780340981.178826:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d4cb100 x1866818940539008 msgsize 1512 00000100:00100000:2.0:1780340981.178841:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340981.178923:0:24178:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940539008 00000100:00100000:0.0:1780340981.178934:0:24178:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940539008 00000020:00000040:0.0:1780340981.178937:0:24178:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:0.0:1780340981.178942:0:24178:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=30 00000100:00000040:0.0:1780340981.178967:0:24178:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780340981.179014:0:24178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1073 00000100:00000040:0.0:1780340981.179018:0:24178:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:0.0:1780340981.179026:0:24178:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d4cb100 x1866818940539008/t0(4294969504) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.179039:0:24178:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+30:2406:x1866818940539008:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:0.0:1780340981.179063:0:24178:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4cb100 x1866818940539008/t0(4294969504) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780340981.179072:0:24178:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969504, current: 4294969504, replaying 00010000:00000040:0.0:1780340981.179075:0:24178:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:0.0:1780340981.179093:0:24178:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4cb100 x1866818940539008/t0(4294969504) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.179102:0:24178:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+30:2406:x1866818940539008:12345-192.168.203.16@tcp:4:dd.0 Request processed in 65us (278us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340981.179109:0:24178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1073 00000100:00000040:0.0:1780340981.179112:0:24178:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:3.0:1780340981.179185:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969504, next_transno: 4294969504 00010000:00080000:3.0:1780340981.179190:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969504) 00010000:00080000:3.0:1780340981.179199:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940539008 t4294969504 from 192.168.203.16@tcp req@ffff8c034d4cb100 x1866818940539008/t0(4294969504) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.179216:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4cb100 x1866818940539008/t0(4294969504) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.179313:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1780340981.179342:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:3.0:1780340981.179568:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 26 00000020:00000040:3.0:1780340981.179572:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=31 00010000:00000040:3.0:1780340981.180420:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969504, xid 1866818940539008 00000100:00000040:3.0:1780340981.180433:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340981.180440:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340981.180501:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:3.0:1780340981.180512:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780340981.180520:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:3.0:1780340981.180531:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 30 00010000:00080000:3.0:1780340981.180537:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969505 00010000:00080000:3.0:1780340981.180541:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969505 00000100:00000040:2.0:1780340981.182459:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d4c9180 x1866818940539520 msgsize 1512 00000100:00100000:2.0:1780340981.182473:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340981.182608:0:24762:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940539520 00000100:00100000:3.0:1780340981.182617:0:24762:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940539520 00000020:00000040:3.0:1780340981.182620:0:24762:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.182624:0:24762:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=31 00000100:00000040:3.0:1780340981.182646:0:24762:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780340981.182700:0:24762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1074 00000100:00000040:3.0:1780340981.182704:0:24762:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:3.0:1780340981.182711:0:24762:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d4c9180 x1866818940539520/t0(4294969505) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.182725:0:24762:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+31:2406:x1866818940539520:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:3.0:1780340981.182736:0:24762:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4c9180 x1866818940539520/t0(4294969505) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780340981.182745:0:24762:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969505, current: 4294969505, replaying 00010000:00000040:3.0:1780340981.182747:0:24762:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:3.0:1780340981.182798:0:24762:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4c9180 x1866818940539520/t0(4294969505) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.182807:0:24762:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+31:2406:x1866818940539520:12345-192.168.203.16@tcp:4:dd.0 Request processed in 85us (348us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.182815:0:24762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1074 00000100:00000040:3.0:1780340981.182818:0:24762:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:0.0:1780340981.182985:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969505, next_transno: 4294969505 00010000:00080000:0.0:1780340981.182990:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969505) 00010000:00080000:0.0:1780340981.182998:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940539520 t4294969505 from 192.168.203.16@tcp req@ffff8c034d4c9180 x1866818940539520/t0(4294969505) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780340981.183012:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4c9180 x1866818940539520/t0(4294969505) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780340981.183099:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1780340981.183131:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:0.0:1780340981.183367:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 27 00000020:00000040:0.0:1780340981.183370:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=32 00010000:00000040:0.0:1780340981.184031:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969505, xid 1866818940539520 00000100:00000040:0.0:1780340981.184045:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340981.184052:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:0.0:1780340981.184135:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:0.0:1780340981.184144:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780340981.184156:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:0.0:1780340981.184167:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 31 00010000:00080000:0.0:1780340981.184172:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969506 00010000:00080000:0.0:1780340981.184175:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969506 00000100:00000040:0.0:1780340981.190636:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a9a9180 x1866818940539264 msgsize 1512 00000100:00100000:0.0:1780340981.190650:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340981.190862:0:24176:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940539264 00000100:00100000:2.0:1780340981.190872:0:24176:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940539264 00000020:00000040:2.0:1780340981.190875:0:24176:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:2.0:1780340981.190879:0:24176:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=32 00000100:00000040:2.0:1780340981.190902:0:24176:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1780340981.190971:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1075 00000100:00000040:2.0:1780340981.190975:0:24176:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:2.0:1780340981.190982:0:24176:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a9a9180 x1866818940539264/t0(4294969506) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340981.190994:0:24176:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a9a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+32:2406:x1866818940539264:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:2.0:1780340981.191005:0:24176:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a9a9180 x1866818940539264/t0(4294969506) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1780340981.191013:0:24176:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969506, current: 4294969506, replaying 00010000:00000040:2.0:1780340981.191017:0:24176:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:2.0:1780340981.191033:0:24176:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a9a9180 x1866818940539264/t0(4294969506) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340981.191050:0:24176:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a9a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+32:2406:x1866818940539264:12345-192.168.203.16@tcp:4:dd.0 Request processed in 56us (414us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340981.191057:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1075 00000100:00000040:2.0:1780340981.191060:0:24176:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:3.0:1780340981.191104:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969506, next_transno: 4294969506 00010000:00080000:3.0:1780340981.191112:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969506) 00010000:00080000:3.0:1780340981.191119:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940539264 t4294969506 from 192.168.203.16@tcp req@ffff8c047a9a9180 x1866818940539264/t0(4294969506) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.191133:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a9a9180 x1866818940539264/t0(4294969506) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.191208:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1780340981.191234:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:3.0:1780340981.191462:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 28 00000020:00000040:3.0:1780340981.191467:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=33 00010000:00000040:3.0:1780340981.191810:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969506, xid 1866818940539264 00000100:00000040:3.0:1780340981.191822:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340981.191828:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340981.191874:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:3.0:1780340981.191882:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780340981.191888:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:3.0:1780340981.191898:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 32 00010000:00080000:3.0:1780340981.191902:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969507 00010000:00080000:3.0:1780340981.191905:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969507 00000100:00000040:3.0:1780340981.193648:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d874e00 x1866818940539776 msgsize 1512 00000100:00100000:3.0:1780340981.193671:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340981.193805:0:24177:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940539776 00000100:00100000:0.0:1780340981.193816:0:24177:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940539776 00000020:00000040:0.0:1780340981.193819:0:24177:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:0.0:1780340981.193823:0:24177:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=33 00000100:00000040:0.0:1780340981.193845:0:24177:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780340981.193892:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1076 00000100:00000040:0.0:1780340981.193896:0:24177:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:0.0:1780340981.193904:0:24177:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d874e00 x1866818940539776/t0(4294969507) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.193917:0:24177:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+33:2406:x1866818940539776:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:0.0:1780340981.193927:0:24177:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d874e00 x1866818940539776/t0(4294969507) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780340981.193934:0:24177:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969507, current: 4294969507, replaying 00010000:00000040:0.0:1780340981.193937:0:24177:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:0.0:1780340981.193959:0:24177:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d874e00 x1866818940539776/t0(4294969507) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.193967:0:24177:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+33:2406:x1866818940539776:12345-192.168.203.16@tcp:4:dd.0 Request processed in 54us (319us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340981.193973:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1076 00000100:00000040:0.0:1780340981.193975:0:24177:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:1.0:1780340981.194223:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969507, next_transno: 4294969507 00010000:00080000:1.0:1780340981.194228:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969507) 00010000:00080000:1.0:1780340981.194235:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940539776 t4294969507 from 192.168.203.16@tcp req@ffff8c034d874e00 x1866818940539776/t0(4294969507) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1780340981.194258:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d874e00 x1866818940539776/t0(4294969507) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1780340981.194488:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1780340981.194515:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000020:00000040:1.0:1780340981.194530:0:93024:0:(tgt_handler.c:2946:tgt_brw_write()) Checksum 1024 from 12345-192.168.203.16@tcp OK: 435018a 00000001:00000040:1.0:1780340981.194699:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 29 00000020:00000040:1.0:1780340981.194703:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=34 00010000:00000040:1.0:1780340981.195045:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969507, xid 1866818940539776 00000100:00000040:1.0:1780340981.195056:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340981.195061:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:1.0:1780340981.195150:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:1.0:1780340981.195159:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1780340981.195165:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:1.0:1780340981.195175:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 33 00010000:00080000:1.0:1780340981.195179:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969508 00010000:00080000:1.0:1780340981.195187:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969508 00000100:00000040:0.0:1780340981.197105:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a9a8000 x1866818940540032 msgsize 1512 00000100:00100000:0.0:1780340981.197120:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340981.197292:0:24174:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940540032 00000100:00100000:3.0:1780340981.197301:0:24174:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940540032 00000020:00000040:3.0:1780340981.197304:0:24174:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.197308:0:24174:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=34 00000100:00000040:3.0:1780340981.197744:0:24174:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780340981.197826:0:24174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1077 00000100:00000040:3.0:1780340981.197831:0:24174:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:3.0:1780340981.197838:0:24174:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a9a8000 x1866818940540032/t0(4294969508) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.197863:0:24174:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+34:2406:x1866818940540032:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:3.0:1780340981.197874:0:24174:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a9a8000 x1866818940540032/t0(4294969508) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780340981.197882:0:24174:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969508, current: 4294969508, replaying 00010000:00000040:3.0:1780340981.197886:0:24174:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:3.0:1780340981.198014:0:24174:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a9a8000 x1866818940540032/t0(4294969508) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.198023:0:24174:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a9a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+34:2406:x1866818940540032:12345-192.168.203.16@tcp:4:dd.0 Request processed in 164us (919us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.198031:0:24174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1077 00000100:00000040:3.0:1780340981.198033:0:24174:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:1.0:1780340981.198117:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969508, next_transno: 4294969508 00010000:00080000:1.0:1780340981.198129:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969508) 00010000:00080000:1.0:1780340981.198137:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940540032 t4294969508 from 192.168.203.16@tcp req@ffff8c047a9a8000 x1866818940540032/t0(4294969508) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1780340981.198159:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a9a8000 x1866818940540032/t0(4294969508) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1780340981.198244:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1780340981.198271:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:1.0:1780340981.198518:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 30 00000020:00000040:1.0:1780340981.198522:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=35 00010000:00000040:1.0:1780340981.198809:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969508, xid 1866818940540032 00000100:00000040:1.0:1780340981.198820:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340981.198827:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:1.0:1780340981.198877:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:1.0:1780340981.198888:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780340981.199527:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:0.0:1780340981.199540:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 34 00010000:00080000:0.0:1780340981.199546:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969509 00010000:00080000:0.0:1780340981.199550:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969509 00000100:00000040:0.0:1780340981.200827:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a9ab480 x1866818940540288 msgsize 1512 00000100:00100000:0.0:1780340981.200838:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340981.200917:0:24752:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940540288 00000100:00100000:3.0:1780340981.200926:0:24752:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940540288 00000020:00000040:3.0:1780340981.200928:0:24752:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.200933:0:24752:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=35 00000100:00000040:3.0:1780340981.200953:0:24752:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780340981.200992:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1078 00000100:00000040:3.0:1780340981.200995:0:24752:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:3.0:1780340981.201002:0:24752:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a9ab480 x1866818940540288/t0(4294969509) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.201013:0:24752:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a9ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+35:2406:x1866818940540288:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:3.0:1780340981.201021:0:24752:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a9ab480 x1866818940540288/t0(4294969509) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780340981.201029:0:24752:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969509, current: 4294969509, replaying 00010000:00000040:3.0:1780340981.201043:0:24752:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:3.0:1780340981.201089:0:24752:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a9ab480 x1866818940540288/t0(4294969509) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.201099:0:24752:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a9ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+35:2406:x1866818940540288:12345-192.168.203.16@tcp:4:dd.0 Request processed in 87us (271us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.201106:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1078 00000100:00000040:3.0:1780340981.201109:0:24752:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:0.0:1780340981.201139:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969509, next_transno: 4294969509 00010000:00080000:0.0:1780340981.201142:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969509) 00010000:00080000:0.0:1780340981.201148:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940540288 t4294969509 from 192.168.203.16@tcp req@ffff8c047a9ab480 x1866818940540288/t0(4294969509) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780340981.201163:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a9ab480 x1866818940540288/t0(4294969509) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780340981.201242:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1780340981.201448:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:0.0:1780340981.201701:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 31 00000020:00000040:0.0:1780340981.201705:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=36 00010000:00000040:0.0:1780340981.201964:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969509, xid 1866818940540288 00000100:00000040:0.0:1780340981.201974:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340981.201980:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:0.0:1780340981.202023:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:0.0:1780340981.202030:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780340981.202036:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:0.0:1780340981.202045:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 35 00010000:00080000:0.0:1780340981.202049:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969510 00010000:00080000:0.0:1780340981.202052:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969510 00000100:00000040:2.0:1780340981.204000:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d4c9500 x1866818940540544 msgsize 1512 00000100:00100000:2.0:1780340981.204010:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340981.204069:0:24180:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940540544 00000100:00100000:0.0:1780340981.204076:0:24180:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940540544 00000020:00000040:0.0:1780340981.204079:0:24180:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:0.0:1780340981.204083:0:24180:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=36 00000100:00000040:0.0:1780340981.204101:0:24180:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780340981.204160:0:24180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1079 00000100:00000040:0.0:1780340981.204164:0:24180:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:0.0:1780340981.204171:0:24180:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d4c9500 x1866818940540544/t0(4294969510) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.204184:0:24180:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+36:2406:x1866818940540544:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:0.0:1780340981.204194:0:24180:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4c9500 x1866818940540544/t0(4294969510) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780340981.204203:0:24180:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969510, current: 4294969510, replaying 00010000:00000040:0.0:1780340981.204206:0:24180:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:0.0:1780340981.204224:0:24180:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4c9500 x1866818940540544/t0(4294969510) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.204233:0:24180:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+36:2406:x1866818940540544:12345-192.168.203.16@tcp:4:dd.0 Request processed in 52us (233us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340981.204240:0:24180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1079 00000100:00000040:0.0:1780340981.204243:0:24180:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:3.0:1780340981.204301:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969510, next_transno: 4294969510 00010000:00080000:3.0:1780340981.204306:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969510) 00010000:00080000:3.0:1780340981.204313:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940540544 t4294969510 from 192.168.203.16@tcp req@ffff8c034d4c9500 x1866818940540544/t0(4294969510) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.204536:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4c9500 x1866818940540544/t0(4294969510) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.204606:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1780340981.204713:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:3.0:1780340981.205006:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 32 00000020:00000040:3.0:1780340981.205010:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=37 00010000:00000040:3.0:1780340981.205107:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969510, xid 1866818940540544 00000100:00000040:3.0:1780340981.205117:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340981.205124:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340981.205178:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:3.0:1780340981.205187:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780340981.205193:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:3.0:1780340981.205203:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 36 00010000:00080000:3.0:1780340981.205207:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969511 00010000:00080000:3.0:1780340981.205211:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969511 00000100:00000040:2.0:1780340981.207168:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d4c8e00 x1866818940540800 msgsize 1512 00000100:00100000:2.0:1780340981.207181:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340981.207288:0:8405:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940540800 00000100:00100000:3.0:1780340981.207308:0:8405:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940540800 00000020:00000040:3.0:1780340981.207311:0:8405:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.207315:0:8405:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=37 00000100:00000040:3.0:1780340981.207336:0:8405:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780340981.207382:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1080 00000100:00000040:3.0:1780340981.207386:0:8405:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:3.0:1780340981.207392:0:8405:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d4c8e00 x1866818940540800/t0(4294969511) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.207405:0:8405:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+37:2406:x1866818940540800:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:3.0:1780340981.207415:0:8405:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4c8e00 x1866818940540800/t0(4294969511) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780340981.207423:0:8405:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969511, current: 4294969511, replaying 00010000:00000040:3.0:1780340981.207426:0:8405:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:3.0:1780340981.207444:0:8405:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4c8e00 x1866818940540800/t0(4294969511) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.207452:0:8405:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+37:2406:x1866818940540800:12345-192.168.203.16@tcp:4:dd.0 Request processed in 50us (284us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.207459:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1080 00000100:00000040:3.0:1780340981.207462:0:8405:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:0.0:1780340981.207609:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969511, next_transno: 4294969511 00010000:00080000:0.0:1780340981.207614:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969511) 00010000:00080000:0.0:1780340981.207622:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940540800 t4294969511 from 192.168.203.16@tcp req@ffff8c034d4c8e00 x1866818940540800/t0(4294969511) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780340981.207638:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4c8e00 x1866818940540800/t0(4294969511) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780340981.207744:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1780340981.207816:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:0.0:1780340981.208035:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 33 00000020:00000040:0.0:1780340981.208039:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=38 00010000:00000040:0.0:1780340981.208805:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969511, xid 1866818940540800 00000100:00000040:0.0:1780340981.208821:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340981.208827:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:0.0:1780340981.208887:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:0.0:1780340981.208896:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780340981.208905:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:0.0:1780340981.208921:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 37 00010000:00080000:0.0:1780340981.208926:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969512 00010000:00080000:0.0:1780340981.208929:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969512 00000100:00000040:0.0:1780340981.212023:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a9aad80 x1866818940541056 msgsize 1512 00000100:00100000:0.0:1780340981.212039:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340981.212476:0:24179:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940541056 00000100:00100000:2.0:1780340981.212486:0:24179:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940541056 00000020:00000040:2.0:1780340981.212489:0:24179:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:2.0:1780340981.212493:0:24179:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=38 00000100:00000040:2.0:1780340981.212521:0:24179:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1780340981.212609:0:24179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1081 00000100:00000040:2.0:1780340981.212613:0:24179:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:2.0:1780340981.212620:0:24179:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a9aad80 x1866818940541056/t0(4294969512) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340981.212633:0:24179:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+38:2406:x1866818940541056:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:2.0:1780340981.212644:0:24179:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a9aad80 x1866818940541056/t0(4294969512) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1780340981.212661:0:24179:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969512, current: 4294969512, replaying 00010000:00000040:2.0:1780340981.212665:0:24179:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:2.0:1780340981.212686:0:24179:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a9aad80 x1866818940541056/t0(4294969512) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340981.212695:0:24179:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a9aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+38:2406:x1866818940541056:12345-192.168.203.16@tcp:4:dd.0 Request processed in 64us (673us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340981.212715:0:24179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1081 00000100:00000040:2.0:1780340981.212719:0:24179:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:3.0:1780340981.212811:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969512, next_transno: 4294969512 00010000:00080000:3.0:1780340981.212815:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969512) 00010000:00080000:3.0:1780340981.212823:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940541056 t4294969512 from 192.168.203.16@tcp req@ffff8c047a9aad80 x1866818940541056/t0(4294969512) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.212839:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a9aad80 x1866818940541056/t0(4294969512) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.212918:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1780340981.212946:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:3.0:1780340981.213147:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 34 00000020:00000040:3.0:1780340981.213151:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=39 00010000:00000040:3.0:1780340981.213489:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969512, xid 1866818940541056 00000100:00000040:3.0:1780340981.213500:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340981.213506:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340981.213547:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:3.0:1780340981.213556:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780340981.213561:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:3.0:1780340981.213571:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 38 00010000:00080000:3.0:1780340981.213575:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969513 00010000:00080000:3.0:1780340981.213579:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969513 00000100:00000040:3.0:1780340981.217857:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d875500 x1866818940541312 msgsize 1512 00000100:00100000:3.0:1780340981.217872:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340981.217951:0:24177:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940541312 00000100:00100000:0.0:1780340981.217960:0:24177:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940541312 00000020:00000040:0.0:1780340981.217964:0:24177:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:0.0:1780340981.217968:0:24177:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=39 00000100:00000040:0.0:1780340981.217997:0:24177:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780340981.218084:0:24177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1082 00000100:00000040:0.0:1780340981.218089:0:24177:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:0.0:1780340981.218096:0:24177:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d875500 x1866818940541312/t0(4294969513) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.218111:0:24177:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+39:2406:x1866818940541312:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:0.0:1780340981.218121:0:24177:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d875500 x1866818940541312/t0(4294969513) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780340981.218147:0:24177:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969513, current: 4294969513, replaying 00010000:00000040:0.0:1780340981.218152:0:24177:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:0.0:1780340981.218176:0:24177:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d875500 x1866818940541312/t0(4294969513) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.218186:0:24177:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+39:2406:x1866818940541312:12345-192.168.203.16@tcp:4:dd.0 Request processed in 79us (330us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340981.218194:0:24177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1082 00000100:00000040:0.0:1780340981.218198:0:24177:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:1.0:1780340981.218251:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969513, next_transno: 4294969513 00010000:00080000:1.0:1780340981.218256:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969513) 00010000:00080000:1.0:1780340981.218264:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940541312 t4294969513 from 192.168.203.16@tcp req@ffff8c034d875500 x1866818940541312/t0(4294969513) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1780340981.218280:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d875500 x1866818940541312/t0(4294969513) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1780340981.218365:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1780340981.218394:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:1.0:1780340981.218614:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 35 00000020:00000040:1.0:1780340981.218618:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=40 00010000:00000040:1.0:1780340981.218942:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969513, xid 1866818940541312 00000100:00000040:1.0:1780340981.218954:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340981.218960:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:1.0:1780340981.219018:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:1.0:1780340981.219028:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1780340981.219035:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:1.0:1780340981.219043:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 39 00010000:00080000:1.0:1780340981.219049:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969514 00010000:00080000:1.0:1780340981.219052:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969514 00000100:00000040:1.0:1780340981.221946:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a8c9c00 x1866818940541568 msgsize 1512 00000100:00100000:1.0:1780340981.221960:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:2.0:1780340981.222114:0:24176:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940541568 00000100:00100000:2.0:1780340981.222125:0:24176:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940541568 00000020:00000040:2.0:1780340981.222128:0:24176:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:2.0:1780340981.222132:0:24176:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=40 00000100:00000040:2.0:1780340981.222158:0:24176:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1780340981.222248:0:24176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1083 00000100:00000040:2.0:1780340981.222252:0:24176:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:2.0:1780340981.222259:0:24176:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a8c9c00 x1866818940541568/t0(4294969514) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340981.222273:0:24176:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+40:2406:x1866818940541568:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:2.0:1780340981.222293:0:24176:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a8c9c00 x1866818940541568/t0(4294969514) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1780340981.222302:0:24176:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969514, current: 4294969514, replaying 00010000:00000040:2.0:1780340981.222306:0:24176:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:2.0:1780340981.222321:0:24176:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8c9c00 x1866818940541568/t0(4294969514) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1780340981.222329:0:24176:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+40:2406:x1866818940541568:12345-192.168.203.16@tcp:4:dd.0 Request processed in 59us (384us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340981.222336:0:24176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1083 00000100:00000040:2.0:1780340981.222339:0:24176:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:1.0:1780340981.222378:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969514, next_transno: 4294969514 00010000:00080000:1.0:1780340981.222382:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969514) 00010000:00080000:1.0:1780340981.222389:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940541568 t4294969514 from 192.168.203.16@tcp req@ffff8c047a8c9c00 x1866818940541568/t0(4294969514) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1780340981.222404:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a8c9c00 x1866818940541568/t0(4294969514) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1780340981.222491:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1780340981.222521:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:1.0:1780340981.222749:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 36 00000020:00000040:1.0:1780340981.222753:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=41 00010000:00000040:1.0:1780340981.223146:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969514, xid 1866818940541568 00000100:00000040:1.0:1780340981.223158:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340981.223164:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:1.0:1780340981.223223:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:1.0:1780340981.223232:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1780340981.223238:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:1.0:1780340981.223249:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 40 00010000:00080000:1.0:1780340981.223254:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969515 00010000:00080000:1.0:1780340981.223257:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969515 00000100:00000040:2.0:1780340981.225919:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d4ca680 x1866818940541824 msgsize 1512 00000100:00100000:2.0:1780340981.225933:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340981.226034:0:24754:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940541824 00000100:00100000:0.0:1780340981.226043:0:24754:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940541824 00000020:00000040:0.0:1780340981.226046:0:24754:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:0.0:1780340981.226050:0:24754:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=41 00000100:00000040:0.0:1780340981.226076:0:24754:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780340981.226174:0:24754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1084 00000100:00000040:0.0:1780340981.226179:0:24754:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:0.0:1780340981.226186:0:24754:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d4ca680 x1866818940541824/t0(4294969515) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.226201:0:24754:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d4ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+41:2406:x1866818940541824:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:0.0:1780340981.226211:0:24754:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4ca680 x1866818940541824/t0(4294969515) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780340981.226220:0:24754:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969515, current: 4294969515, replaying 00010000:00000040:0.0:1780340981.226224:0:24754:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:0.0:1780340981.226244:0:24754:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d4ca680 x1866818940541824/t0(4294969515) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.226252:0:24754:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d4ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+41:2406:x1866818940541824:12345-192.168.203.16@tcp:4:dd.0 Request processed in 55us (334us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340981.226273:0:24754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1084 00000100:00000040:0.0:1780340981.226275:0:24754:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:3.0:1780340981.226362:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969515, next_transno: 4294969515 00010000:00080000:3.0:1780340981.226366:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969515) 00010000:00080000:3.0:1780340981.226375:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940541824 t4294969515 from 192.168.203.16@tcp req@ffff8c034d4ca680 x1866818940541824/t0(4294969515) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.226390:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d4ca680 x1866818940541824/t0(4294969515) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1780340981.226477:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1780340981.226507:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:3.0:1780340981.226934:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 37 00000020:00000040:3.0:1780340981.226938:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=42 00010000:00000040:3.0:1780340981.227222:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969515, xid 1866818940541824 00000100:00000040:3.0:1780340981.227233:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340981.227239:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340981.227344:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:3.0:1780340981.227359:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1780340981.227364:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:3.0:1780340981.227373:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 41 00010000:00080000:3.0:1780340981.227377:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969516 00010000:00080000:3.0:1780340981.227381:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969516 00000100:00000040:0.0:1780340981.238875:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a9a9c00 x1866818940542080 msgsize 1512 00000100:00100000:0.0:1780340981.239544:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340981.240733:0:24752:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940542080 00000100:00100000:3.0:1780340981.240746:0:24752:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940542080 00000020:00000040:3.0:1780340981.240749:0:24752:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.240754:0:24752:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=42 00000100:00000040:3.0:1780340981.240843:0:24752:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1780340981.240895:0:24752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1085 00000100:00000040:3.0:1780340981.240899:0:24752:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:3.0:1780340981.240907:0:24752:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a9a9c00 x1866818940542080/t0(4294969516) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.240919:0:24752:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+42:2406:x1866818940542080:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:3.0:1780340981.240929:0:24752:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a9a9c00 x1866818940542080/t0(4294969516) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1780340981.240937:0:24752:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969516, current: 4294969516, replaying 00010000:00000040:3.0:1780340981.240941:0:24752:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:3.0:1780340981.240953:0:24752:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a9a9c00 x1866818940542080/t0(4294969516) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1780340981.240961:0:24752:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a9a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+42:2406:x1866818940542080:12345-192.168.203.16@tcp:4:dd.0 Request processed in 44us (2088us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.240968:0:24752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1085 00000100:00000040:3.0:1780340981.240970:0:24752:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:0.0:1780340981.241095:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969516, next_transno: 4294969516 00010000:00080000:0.0:1780340981.241100:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969516) 00010000:00080000:0.0:1780340981.241108:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940542080 t4294969516 from 192.168.203.16@tcp req@ffff8c047a9a9c00 x1866818940542080/t0(4294969516) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780340981.241123:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c047a9a9c00 x1866818940542080/t0(4294969516) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1780340981.241219:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1780340981.241249:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:0.0:1780340981.241486:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 38 00000020:00000040:0.0:1780340981.241490:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=43 00010000:00000040:0.0:1780340981.242110:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969516, xid 1866818940542080 00000100:00000040:0.0:1780340981.242123:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340981.242130:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:0.0:1780340981.242182:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:0.0:1780340981.242192:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780340981.242199:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:0.0:1780340981.242209:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 42 00010000:00080000:0.0:1780340981.242214:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969517 00010000:00080000:0.0:1780340981.242217:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969517 00000100:00000040:3.0:1780340981.245237:0:3654:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d876a00 x1866818940542336 msgsize 1512 00000100:00100000:3.0:1780340981.245263:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340981.245368:0:24180:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940542336 00000100:00100000:0.0:1780340981.245377:0:24180:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940542336 00000020:00000040:0.0:1780340981.245380:0:24180:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:0.0:1780340981.245391:0:24180:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=43 00000100:00000040:0.0:1780340981.245417:0:24180:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1780340981.245464:0:24180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1086 00000100:00000040:0.0:1780340981.245468:0:24180:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:0.0:1780340981.245475:0:24180:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d876a00 x1866818940542336/t0(4294969517) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.245491:0:24180:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+43:2406:x1866818940542336:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:0.0:1780340981.245502:0:24180:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d876a00 x1866818940542336/t0(4294969517) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1780340981.245509:0:24180:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969517, current: 4294969517, replaying 00010000:00000040:0.0:1780340981.245513:0:24180:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:0.0:1780340981.245527:0:24180:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d876a00 x1866818940542336/t0(4294969517) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1780340981.245535:0:24180:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+43:2406:x1866818940542336:12345-192.168.203.16@tcp:4:dd.0 Request processed in 47us (299us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340981.245541:0:24180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1086 00000100:00000040:0.0:1780340981.245544:0:24180:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:2.0:1780340981.245857:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969517, next_transno: 4294969517 00010000:00080000:2.0:1780340981.245867:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969517) 00010000:00080000:2.0:1780340981.245875:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940542336 t4294969517 from 192.168.203.16@tcp req@ffff8c034d876a00 x1866818940542336/t0(4294969517) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780340981.245891:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d876a00 x1866818940542336/t0(4294969517) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780340981.245966:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1780340981.245992:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:2.0:1780340981.246191:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 39 00000020:00000040:2.0:1780340981.246195:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=44 00010000:00000040:2.0:1780340981.246531:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969517, xid 1866818940542336 00000100:00000040:2.0:1780340981.246541:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:2.0:1780340981.246547:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:2.0:1780340981.246589:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:2.0:1780340981.246598:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1780340981.246603:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:2.0:1780340981.246611:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 43 00010000:00080000:2.0:1780340981.246615:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969518 00010000:00080000:2.0:1780340981.246619:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969518 00000100:00000040:2.0:1780340981.256942:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c045f293b80 x1866818940542592 msgsize 1512 00000100:00100000:2.0:1780340981.256959:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340981.257566:0:24762:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940542592 00000100:00100000:1.0:1780340981.257590:0:24762:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940542592 00000020:00000040:1.0:1780340981.257593:0:24762:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:1.0:1780340981.257597:0:24762:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=44 00000100:00000040:1.0:1780340981.257620:0:24762:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1780340981.257793:0:24762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1087 00000100:00000040:1.0:1780340981.257797:0:24762:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:1.0:1780340981.257805:0:24762:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c045f293b80 x1866818940542592/t0(4294969518) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340981.257818:0:24762:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c045f293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+44:2406:x1866818940542592:12345-192.168.203.16@tcp:4:dd.0 00000020:00000040:1.0:1780340981.257828:0:24762:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c045f293b80 x1866818940542592/t0(4294969518) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1780340981.257836:0:24762:0:(ldlm_lib.c:3210:target_queue_recovery_request()) Next recovery transno: 4294969518, current: 4294969518, replaying 00010000:00000040:1.0:1780340981.257839:0:24762:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:1.0:1780340981.257847:0:24762:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f293b80 x1866818940542592/t0(4294969518) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1780340981.257855:0:24762:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c045f293b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+44:2406:x1866818940542592:12345-192.168.203.16@tcp:4:dd.0 Request processed in 40us (914us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780340981.257861:0:24762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1087 00000100:00000040:1.0:1780340981.257864:0:24762:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:2.0:1780340981.257924:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969518, next_transno: 4294969518 00010000:00080000:2.0:1780340981.257928:0:93024:0:(ldlm_lib.c:2231:check_for_next_transno()) waking for next (4294969518) 00010000:00080000:2.0:1780340981.257936:0:93024:0:(ldlm_lib.c:2732:replay_request_or_update()) @@@ processing x1866818940542592 t4294969518 from 192.168.203.16@tcp req@ffff8c045f293b80 x1866818940542592/t0(4294969518) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780340981.257950:0:93024:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c045f293b80 x1866818940542592/t0(4294969518) o4->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 1512/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1780340981.258057:0:93024:0:(tgt_handler.c:2885:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1780340981.258085:0:93024:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: adler32 (adler32-zlib) speed 565 MB/s 00000001:00000040:2.0:1780340981.258317:0:93024:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff8c046bae3800 : new cb_count 40 00000020:00000040:2.0:1780340981.258321:0:93024:0:(genops.c:889:class_export_get()) GET export ffff8c046bae3800 refcount=45 00010000:00000040:0.0:1780340981.266865:0:93024:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969478, transno 4294969518, xid 1866818940542592 00000100:00000040:0.0:1780340981.266885:0:93024:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340981.266893:0:93024:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:0.0:1780340981.266964:0:93024:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00010000:00080000:0.0:1780340981.266976:0:93024:0:(ldlm_lib.c:2085:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1780340981.266985:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:0.0:1780340981.266995:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 44 00010000:00080000:0.0:1780340981.267002:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969519 00010000:00080000:0.0:1780340981.267005:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969519 00000100:00000040:3.0:1780340981.274119:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d877b80 x1866818940546048 msgsize 328 00000100:00100000:3.0:1780340981.274134:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00000040:3.0:1780340981.276054:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d874a80 x1866818940546176 msgsize 328 00000100:00100000:3.0:1780340981.276066:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00000040:3.0:1780340981.287496:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d875f80 x1866818940546304 msgsize 328 00000100:00100000:3.0:1780340981.287513:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340981.287569:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940546048 00000100:00100000:1.0:1780340981.287579:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940546048 00000020:00000040:1.0:1780340981.287582:0:25495:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:1.0:1780340981.287587:0:25495:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=45 00000100:00100000:2.0:1780340981.291217:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940546176 00000100:00100000:2.0:1780340981.291229:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940546176 00000020:00000040:2.0:1780340981.291232:0:25490:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:2.0:1780340981.291237:0:25490:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=46 00000100:00100000:2.0:1780340981.291302:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6020 00000100:00000040:2.0:1780340981.291307:0:25490:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 1 00000100:00000040:2.0:1780340981.291314:0:25490:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d877b80 x1866818940546048/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340981.291328:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+46:2406:x1866818940546048:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 00000020:00000040:2.0:1780340981.291343:0:25490:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d877b80 x1866818940546048/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1780340981.291352:0:25490:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00010000:00080000:2.0:1780340981.291356:0:25490:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c034d877b80 x1866818940546048/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340981.291371:0:25490:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d877b80 x1866818940546048/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340981.291381:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+46:2406:x1866818940546048:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 Request processed in 55us (17261us total) trans 0 rc 0/-999 00000100:00100000:2.0:1780340981.291388:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6020 00000100:00000040:2.0:1780340981.291391:0:25490:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00010000:00080000:2.0:1780340981.291417:0:93024:0:(ldlm_lib.c:2213:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294969519 00010000:00080000:2.0:1780340981.291421:0:93024:0:(ldlm_lib.c:2247:check_for_next_transno()) waking for completed recovery 00010000:00000040:2.0:1780340981.291428:0:93024:0:(ldlm_lib.c:2866:target_recovery_thread()) 2: lock replay stage - 1 clients 00010000:00080000:2.0:1780340981.291430:0:93024:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1780340981.291432:0:93024:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780340981.291437:0:93024:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 192.168.203.16@tcp: req@ffff8c034d877b80 x1866818940546048/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1780340981.291456:0:93024:0:(ldlm_lib.c:2871:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00000100:00100000:0.0:1780340981.292705:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6021 00000100:00000040:0.0:1780340981.292711:0:25493:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:0.0:1780340981.292718:0:25493:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d874a80 x1866818940546176/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340981.292739:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+46:2406:x1866818940546176:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1780340981.292751:0:25493:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d874a80 x1866818940546176/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1780340981.292792:0:25493:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 3 00010000:00080000:0.0:1780340981.292796:0:25493:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c034d874a80 x1866818940546176/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340981.292805:0:25493:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d874a80 x1866818940546176/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340981.292813:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+46:2406:x1866818940546176:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 Request processed in 84us (16760us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340981.292819:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6021 00000100:00000040:0.0:1780340981.292822:0:25493:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 2 00000100:00000040:3.0:1780340981.293513:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d876680 x1866818940546432 msgsize 328 00000100:00100000:3.0:1780340981.293521:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00000040:3.0:1780340981.293541:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d874000 x1866818940546560 msgsize 328 00000100:00100000:3.0:1780340981.293556:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00000040:3.0:1780340981.293574:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d877800 x1866818940546688 msgsize 328 00000100:00100000:3.0:1780340981.293578:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00000040:3.0:1780340981.293594:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d877480 x1866818940546816 msgsize 328 00000100:00100000:3.0:1780340981.293598:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00000040:3.0:1780340981.293618:0:3653:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d874380 x1866818940546944 msgsize 328 00000100:00100000:3.0:1780340981.293622:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340981.293938:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940546304 00000100:00100000:3.0:1780340981.293947:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940546304 00000020:00000040:3.0:1780340981.293950:0:25490:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.293954:0:25490:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=47 00000100:00100000:3.0:1780340981.294006:0:25490:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940546432 00000100:00100000:3.0:1780340981.294009:0:25490:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940546432 00000020:00000040:3.0:1780340981.294011:0:25490:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.294013:0:25490:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=48 00000100:00100000:3.0:1780340981.294036:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940546560 00000100:00100000:3.0:1780340981.294039:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940546560 00000020:00000040:3.0:1780340981.294040:0:25491:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.294042:0:25491:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=49 00000100:00100000:3.0:1780340981.294059:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940546688 00000100:00100000:3.0:1780340981.294074:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940546688 00000020:00000040:3.0:1780340981.294075:0:25491:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.294077:0:25491:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=50 00000100:00100000:3.0:1780340981.294096:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940546816 00000100:00100000:3.0:1780340981.294098:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940546816 00000020:00000040:3.0:1780340981.294100:0:25491:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.294102:0:25491:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=51 00000100:00100000:3.0:1780340981.294117:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940546944 00000100:00100000:3.0:1780340981.294120:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940546944 00000020:00000040:3.0:1780340981.294122:0:25491:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277624e 00000020:00000040:3.0:1780340981.294123:0:25491:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046bae3800 refcount=52 00000100:00100000:3.0:1780340981.294141:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6022 00000100:00000040:3.0:1780340981.294145:0:25491:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 3 00000100:00000040:3.0:1780340981.294151:0:25491:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d875f80 x1866818940546304/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.294162:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+52:2406:x1866818940546304:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1780340981.294172:0:25491:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d875f80 x1866818940546304/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1780340981.294192:0:25491:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 4 00010000:00080000:3.0:1780340981.294196:0:25491:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c034d875f80 x1866818940546304/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.294204:0:25491:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d875f80 x1866818940546304/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.294213:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+52:2406:x1866818940546304:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 Request processed in 52us (6718us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.294219:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6022 00000100:00000040:3.0:1780340981.294222:0:25491:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 3 00000100:00100000:3.0:1780340981.294241:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6023 00000100:00000040:3.0:1780340981.294243:0:25491:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 4 00000100:00000040:3.0:1780340981.294246:0:25491:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d876680 x1866818940546432/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.294257:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+52:2406:x1866818940546432:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1780340981.294264:0:25491:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d876680 x1866818940546432/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1780340981.294271:0:25491:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 5 00010000:00080000:3.0:1780340981.294274:0:25491:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c034d876680 x1866818940546432/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.294282:0:25491:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d876680 x1866818940546432/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.294290:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+52:2406:x1866818940546432:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 Request processed in 35us (777us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.294295:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6023 00000100:00000040:3.0:1780340981.294297:0:25491:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 4 00000100:00100000:3.0:1780340981.294306:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6024 00000100:00000040:3.0:1780340981.294308:0:25491:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 5 00000100:00000040:3.0:1780340981.294311:0:25491:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d874000 x1866818940546560/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.294322:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+52:2406:x1866818940546560:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1780340981.294327:0:25491:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d874000 x1866818940546560/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1780340981.294344:0:25491:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 6 00010000:00080000:3.0:1780340981.294347:0:25491:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c034d874000 x1866818940546560/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.294355:0:25491:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d874000 x1866818940546560/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.294362:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+52:2406:x1866818940546560:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 Request processed in 42us (819us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.294368:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6024 00000100:00000040:3.0:1780340981.294370:0:25491:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 5 00000100:00100000:3.0:1780340981.294379:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6025 00000100:00000040:3.0:1780340981.294381:0:25491:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 6 00000100:00000040:3.0:1780340981.294384:0:25491:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d877800 x1866818940546688/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.294395:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+52:2406:x1866818940546688:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1780340981.294401:0:25491:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d877800 x1866818940546688/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1780340981.294407:0:25491:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 7 00010000:00080000:3.0:1780340981.294410:0:25491:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c034d877800 x1866818940546688/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.294418:0:25491:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d877800 x1866818940546688/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.294425:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+52:2406:x1866818940546688:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 Request processed in 33us (850us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.294437:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6025 00000100:00000040:3.0:1780340981.294439:0:25491:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 6 00000100:00100000:3.0:1780340981.294448:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6026 00000100:00000040:3.0:1780340981.294451:0:25491:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 7 00000100:00000040:3.0:1780340981.294455:0:25491:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d877480 x1866818940546816/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.294464:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+52:2406:x1866818940546816:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1780340981.294470:0:25491:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d877480 x1866818940546816/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1780340981.294477:0:25491:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 8 00010000:00080000:3.0:1780340981.294480:0:25491:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c034d877480 x1866818940546816/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.294489:0:25491:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d877480 x1866818940546816/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.294496:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+52:2406:x1866818940546816:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 Request processed in 34us (901us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.294501:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6026 00000100:00000040:3.0:1780340981.294503:0:25491:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 7 00000100:00100000:3.0:1780340981.294510:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6027 00000100:00000040:3.0:1780340981.294513:0:25491:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 8 00000100:00000040:3.0:1780340981.294516:0:25491:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d874380 x1866818940546944/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.294526:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+52:2406:x1866818940546944:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1780340981.294539:0:25491:0:(tgt_handler.c:595:tgt_handle_recovery()) @@@ Got new replay req@ffff8c034d874380 x1866818940546944/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1780340981.295919:0:25491:0:(ldlm_lib.c:1759:target_request_copy_get()) RPC GETting export ffff8c046bae3800 : new rpc_count 9 00010000:00080000:3.0:1780340981.295929:0:25491:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c034d874380 x1866818940546944/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.295940:0:25491:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d874380 x1866818940546944/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.295949:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+52:2406:x1866818940546944:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 Request processed in 1424us (2329us total) trans 0 rc 0/-999 00000100:00100000:3.0:1780340981.295956:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6027 00000100:00000040:3.0:1780340981.295958:0:25491:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046bae3800 : new rpc_count 8 00010000:00000040:2.0:1780340981.301994:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 7 00000020:00000040:2.0:1780340981.302016:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 51 00010000:00080000:2.0:1780340981.302021:0:93024:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1780340981.302024:0:93024:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780340981.302037:0:93024:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 192.168.203.16@tcp: req@ffff8c034d874a80 x1866818940546176/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1780340981.302048:0:93024:0:(ldlm_lib.c:2871:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1780340981.302050:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 6 00000020:00000040:2.0:1780340981.302057:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 50 00010000:00080000:2.0:1780340981.302059:0:93024:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1780340981.302060:0:93024:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780340981.302065:0:93024:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 192.168.203.16@tcp: req@ffff8c034d875f80 x1866818940546304/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1780340981.302070:0:93024:0:(ldlm_lib.c:2871:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1780340981.302072:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 5 00000020:00000040:2.0:1780340981.302077:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 49 00010000:00080000:2.0:1780340981.302079:0:93024:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1780340981.302080:0:93024:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780340981.302083:0:93024:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 192.168.203.16@tcp: req@ffff8c034d876680 x1866818940546432/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1780340981.302089:0:93024:0:(ldlm_lib.c:2871:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1780340981.302106:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 4 00000020:00000040:2.0:1780340981.302111:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 48 00010000:00080000:2.0:1780340981.302113:0:93024:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1780340981.302114:0:93024:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780340981.302118:0:93024:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 192.168.203.16@tcp: req@ffff8c034d874000 x1866818940546560/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1780340981.302124:0:93024:0:(ldlm_lib.c:2871:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1780340981.302126:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 3 00000020:00000040:2.0:1780340981.302129:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 47 00010000:00080000:2.0:1780340981.302130:0:93024:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1780340981.302131:0:93024:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780340981.302135:0:93024:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 192.168.203.16@tcp: req@ffff8c034d877800 x1866818940546688/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1780340981.302140:0:93024:0:(ldlm_lib.c:2871:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1780340981.302142:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 2 00000020:00000040:2.0:1780340981.302147:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 46 00010000:00080000:2.0:1780340981.302148:0:93024:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1780340981.302150:0:93024:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780340981.302154:0:93024:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 192.168.203.16@tcp: req@ffff8c034d877480 x1866818940546816/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1780340981.302159:0:93024:0:(ldlm_lib.c:2871:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1780340981.302161:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 1 00000020:00000040:2.0:1780340981.302165:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 45 00010000:00080000:2.0:1780340981.302166:0:93024:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1780340981.302167:0:93024:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780340981.302171:0:93024:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 192.168.203.16@tcp: req@ffff8c034d874380 x1866818940546944/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:407/0 lens 328/0 e 0 to 0 dl 1780340992 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1780340981.302295:0:93024:0:(ldlm_lib.c:2871:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1780340981.302298:0:93024:0:(ldlm_lib.c:1775:target_request_copy_put()) RPC PUTting export ffff8c046bae3800 : new rpc_count 0 00000020:00000040:2.0:1780340981.302305:0:93024:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 44 00010000:00080000:2.0:1780340981.302312:0:93024:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00000020:00000040:3.0:1780340981.642547:0:90579:0:(genops.c:1231:class_import_get()) import ffff8c0450113000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1780340981.642588:0:90579:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000c0f8426] to pc [ptlrpcd_00_00+0] req@ffff8c034d875c00 x1866818961284736/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.642635:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:3.0:1780340981.642649:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c034d875c00 x1866818961284736/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.642662:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961284736:0@lo:41:osp-pre-1-0.0 00000100:00000040:3.0:1780340981.642689:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c034d875c00 x1866818961284736/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340997 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.642697:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00010000:00010000:0.0:1780340981.642923:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1780340981.643002:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d876300 x1866818961284736 msgsize 224 00000100:00100000:3.0:1780340981.643008:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340981.643035:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c034d875c00 x1866818961284736/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340997 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340981.643061:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3568 usecs (4 jiffies) 00000100:00100000:0.0:1780340981.643113:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961284736 00000100:00100000:0.0:1780340981.643122:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961284736 00000020:00000040:0.0:1780340981.643124:0:8411:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277530c 00000020:00000040:0.0:1780340981.643128:0:8411:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c04514b0800 refcount=5 00000100:00000040:0.0:1780340981.643151:0:8411:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1780340981.643183:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4019 00000100:00000040:0.0:1780340981.643187:0:8411:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c04514b0800 : new rpc_count 1 00000100:00000040:0.0:1780340981.643191:0:8411:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d876300 x1866818961284736/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:407/0 lens 224/0 e 0 to 0 dl 1780340992 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340981.643223:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961284736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1780340981.643257:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00010000:00000040:0.0:1780340981.643270:0:8411:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961284736 00000100:00000040:0.0:1780340981.643280:0:8411:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 66 to 0@lo 00000100:00000040:0.0:1780340981.643285:0:8411:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340981.643304:0:8411:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8c034d875c00 x1866818961284736/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340997 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340981.643321:0:8411:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 65 to 0@lo 00000100:00000040:0.0:1780340981.643326:0:8411:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d876300 x1866818961284736/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:407/0 lens 224/368 e 0 to 0 dl 1780340992 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340981.643335:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d876300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961284736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340981.643342:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4019 00000100:00000040:0.0:1780340981.643345:0:8411:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c04514b0800 : new rpc_count 0 00000020:00000040:0.0:1780340981.643354:0:8411:0:(genops.c:900:class_export_put()) PUTting export ffff8c04514b0800 : new refcount 4 00000100:00000040:3.0:1780340981.643529:0:3660:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1780340981.643535:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c034d875c00 x1866818961284736/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340997 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1780340981.643546:0:3660:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352898 avail=317195 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023684 state=0: rc = 0 00000100:00000040:3.0:1780340981.643553:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d875c00 x1866818961284736/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340997 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340981.643561:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034d875c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961284736:0@lo:41:osp-pre-1-0.0 00000100:00000040:3.0:1780340981.643568:0:3660:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c034d875c00 x1866818961284736/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340997 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340981.643577:0:3660:0:(genops.c:1244:class_import_put()) import ffff8c0450113000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000020:00000040:0.0:1780340981.678108:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osd (ffff8c047ac74d40) now 12 - health_check_show 00000020:00000040:0.0:1780340981.678120:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osd (ffff8c047ac74d40) now 12 - health_check_show 00000020:00000040:0.0:1780340981.678123:0:93172:0:(obd_config.c:994:class_incref()) incref MGS (ffff8c0445ba4d40) now 8 - health_check_show 00000020:00000040:0.0:1780340981.678128:0:93172:0:(obd_config.c:1022:class_decref()) Decref MGS (ffff8c0445ba4d40) now 8 - health_check_show 00000020:00000040:0.0:1780340981.678130:0:93172:0:(obd_config.c:994:class_incref()) incref MGC192.168.203.116@tcp (ffff8c0471e119c0) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678133:0:93172:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.203.116@tcp (ffff8c0471e119c0) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678135:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osd (ffff8c0471d50000) now 10 - health_check_show 00000020:00000040:0.0:1780340981.678138:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osd (ffff8c0471d50000) now 10 - health_check_show 00000020:00000040:0.0:1780340981.678141:0:93172:0:(obd_config.c:994:class_incref()) incref MDS (ffff8c047b0a3380) now 4 - health_check_show 00000020:00000040:0.0:1780340981.678148:0:93172:0:(obd_config.c:1022:class_decref()) Decref MDS (ffff8c047b0a3380) now 4 - health_check_show 00000020:00000040:0.0:1780340981.678150:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-mdtlov (ffff8c0445ba0000) now 5 - health_check_show 00000020:00000040:0.0:1780340981.678157:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-mdtlov (ffff8c0445ba0000) now 5 - health_check_show 00000020:00000040:0.0:1780340981.678160:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff8c0445ba19c0) now 16 - health_check_show 00000020:00000040:0.0:1780340981.678162:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff8c0445ba19c0) now 16 - health_check_show 00000020:00000040:0.0:1780340981.678164:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-MDD0000 (ffff8c0445ba3380) now 5 - health_check_show 00000020:00000040:0.0:1780340981.678166:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0000 (ffff8c0445ba3380) now 5 - health_check_show 00000020:00000040:0.0:1780340981.678168:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-QMT0000 (ffff8c047ac70000) now 5 - health_check_show 00000020:00000040:0.0:1780340981.678171:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-QMT0000 (ffff8c047ac70000) now 5 - health_check_show 00000020:00000040:0.0:1780340981.678173:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osp-MDT0000 (ffff8c047ac73380) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678175:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osp-MDT0000 (ffff8c047ac73380) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678178:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0000 (ffff8c0349000000) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678180:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0000 (ffff8c0349000000) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678182:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0000 (ffff8c03482b3380) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678184:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0000 (ffff8c03482b3380) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678186:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0000 (ffff8c047658b380) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678188:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0000 (ffff8c047658b380) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678190:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-mdtlov (ffff8c0347553380) now 5 - health_check_show 00000020:00000040:0.0:1780340981.678192:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-mdtlov (ffff8c0347553380) now 5 - health_check_show 00000020:00000040:0.0:1780340981.678194:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff8c03475519c0) now 12 - health_check_show 00000020:00000040:0.0:1780340981.678196:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff8c03475519c0) now 12 - health_check_show 00000020:00000040:0.0:1780340981.678198:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-MDD0001 (ffff8c0347550000) now 5 - health_check_show 00000020:00000040:0.0:1780340981.678200:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0001 (ffff8c0347550000) now 5 - health_check_show 00000020:00000040:0.0:1780340981.678202:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff8c047ac719c0) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678205:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osd (ffff8c047ac719c0) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678207:0:93172:0:(obd_config.c:994:class_incref()) incref OSS (ffff8c04775d99c0) now 4 - health_check_show 00000020:00000040:0.0:1780340981.678213:0:93172:0:(obd_config.c:1022:class_decref()) Decref OSS (ffff8c04775d99c0) now 4 - health_check_show 00000020:00000040:0.0:1780340981.678215:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff8c0476588000) now 10 - health_check_show 00000020:00000040:0.0:1780340981.678276:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff8c0476588000) now 10 - health_check_show 00000020:00000040:0.0:1780340981.678279:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff8c03482b0000) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678287:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0000 (ffff8c03482b0000) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678289:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff8c0349004d40) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678291:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0000 (ffff8c0349004d40) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678294:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osp-MDT0001 (ffff8c03453699c0) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678295:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osp-MDT0001 (ffff8c03453699c0) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678297:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0001 (ffff8c0471e14d40) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678299:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0001 (ffff8c0471e14d40) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678301:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osd (ffff8c03450bb380) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678305:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osd (ffff8c03450bb380) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678307:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff8c03450b99c0) now 10 - health_check_show 00000020:00000040:0.0:1780340981.678329:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff8c03450b99c0) now 10 - health_check_show 00000020:00000040:0.0:1780340981.678332:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0001 (ffff8c047b0a4d40) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678335:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0001 (ffff8c047b0a4d40) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678337:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0001 (ffff8c047b0a0000) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678339:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0001 (ffff8c047b0a0000) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678340:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0001 (ffff8c034536cd40) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678342:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0001 (ffff8c034536cd40) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678344:0:93172:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0001 (ffff8c03482b19c0) now 6 - health_check_show 00000020:00000040:0.0:1780340981.678346:0:93172:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0001 (ffff8c03482b19c0) now 6 - health_check_show 00000020:00000040:1.0:1780340982.153960:0:72688:0:(genops.c:1231:class_import_get()) import ffff8c034a39c800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1780340982.154003:0:72688:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000009c05a6ed] to pc [ptlrpcd_00_01+1] req@ffff8c047a8cb800 x1866818961284864/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340982.154106:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:0.0:1780340982.154123:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c047a8cb800 x1866818961284864/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340982.154136:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961284864:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1780340982.154164:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c047a8cb800 x1866818961284864/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340998 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340982.154172:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340982.154223:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff8c047a9ab100 x1866818961284864 msgsize 224 00000100:00100000:0.0:1780340982.154227:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1780340982.154261:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c047a8cb800 x1866818961284864/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340998 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340982.154274:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 837870 usecs (838 jiffies) 00000100:00100000:1.0:1780340982.154341:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961284864 00000100:00100000:1.0:1780340982.154365:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961284864 00000020:00000040:1.0:1780340982.154367:0:8410:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa246514327752c6 00000020:00000040:1.0:1780340982.154371:0:8410:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0475fad800 refcount=7 00000100:00000040:1.0:1780340982.154393:0:8410:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1780340982.154422:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4020 00000100:00000040:1.0:1780340982.154426:0:8410:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0475fad800 : new rpc_count 1 00000100:00000040:1.0:1780340982.154431:0:8410:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047a9ab100 x1866818961284864/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:408/0 lens 224/0 e 0 to 0 dl 1780340993 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340982.154441:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a9ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961284864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1780340982.154474:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445199872 avail 1298960384 00010000:00000040:1.0:1780340982.154485:0:8410:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1866818961284864 00000100:00000040:1.0:1780340982.154494:0:8410:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 66 to 0@lo 00000100:00000040:1.0:1780340982.154498:0:8410:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1780340982.154517:0:8410:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8c047a8cb800 x1866818961284864/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340998 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1780340982.154542:0:8410:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 65 to 0@lo 00000100:00000040:1.0:1780340982.154547:0:8410:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a9ab100 x1866818961284864/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:408/0 lens 224/368 e 0 to 0 dl 1780340993 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340982.154555:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a9ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961284864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340982.154561:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4020 00000100:00000040:1.0:1780340982.154564:0:8410:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0475fad800 : new rpc_count 0 00000020:00000040:1.0:1780340982.154580:0:8410:0:(genops.c:900:class_export_put()) PUTting export ffff8c0475fad800 : new refcount 6 00000100:00000040:0.0:1780340982.154805:0:3659:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:0.0:1780340982.154811:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c047a8cb800 x1866818961284864/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1780340982.154821:0:3659:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352832 avail=317129 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023573 state=0: rc = 0 00000100:00000040:0.0:1780340982.154828:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8cb800 x1866818961284864/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340998 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340982.154836:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961284864:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1780340982.154842:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c047a8cb800 x1866818961284864/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1780340998 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340982.154852:0:3659:0:(genops.c:1244:class_import_put()) import ffff8c034a39c800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000020:00000040:1.0:1780340982.156679:0:90583:0:(genops.c:1231:class_import_get()) import ffff8c046bae0000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:1.0:1780340982.156712:0:90583:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005a08eee9] to pc [ptlrpcd_00_02+2] req@ffff8c047a8ca300 x1866818961284992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340982.157144:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:3.0:1780340982.157158:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c047a8ca300 x1866818961284992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340982.157171:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961284992:0@lo:13:osp-pre-1-0.0 00000100:00000040:3.0:1780340982.157196:0:3662:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c047a8ca300 x1866818961284992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340998 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340982.157204:0:3662:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340982.157238:0:3662:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d875c00 x1866818961284992 msgsize 224 00000100:00100000:3.0:1780340982.157242:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340982.157272:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c047a8ca300 x1866818961284992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340998 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340982.157286:0:3662:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 8178 usecs (9 jiffies) 00000100:00100000:2.0:1780340982.157368:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961284992 00000100:00100000:2.0:1780340982.157376:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961284992 00000020:00000040:2.0:1780340982.157378:0:8403:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775336 00000020:00000040:2.0:1780340982.157382:0:8403:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0452a6e000 refcount=5 00000020:00000040:2.0:1780340982.157396:0:8403:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00000040:2.0:1780340982.157419:0:8403:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:2.0:1780340982.157447:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2194 00000100:00000040:2.0:1780340982.157450:0:8403:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0452a6e000 : new rpc_count 1 00000100:00000040:2.0:1780340982.157455:0:8403:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d875c00 x1866818961284992/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:408/0 lens 224/0 e 0 to 0 dl 1780340993 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340982.157467:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961284992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780340982.157487:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:2.0:1780340982.157496:0:8403:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1866818961284992 00000100:00000040:2.0:1780340982.157504:0:8403:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 66 to 0@lo 00000100:00000040:2.0:1780340982.157509:0:8403:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340982.157526:0:8403:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff8c047a8ca300 x1866818961284992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340998 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340982.157545:0:8403:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 65 to 0@lo 00000100:00000040:2.0:1780340982.157549:0:8403:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d875c00 x1866818961284992/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:408/0 lens 224/368 e 0 to 0 dl 1780340993 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340982.157559:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961284992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340982.157565:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2194 00000100:00000040:2.0:1780340982.157568:0:8403:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0452a6e000 : new rpc_count 0 00000020:00000040:2.0:1780340982.157586:0:8403:0:(genops.c:900:class_export_put()) PUTting export ffff8c0452a6e000 : new refcount 4 00000100:00000040:2.0:1780340982.157614:0:3662:0:(client.c:3098:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969457 00000100:00000040:2.0:1780340982.157619:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c047a8ca300 x1866818961284992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1780340982.157641:0:3662:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:2.0:1780340982.157652:0:3662:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261731 state=0: rc = 0 00000100:00000040:2.0:1780340982.157661:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047a8ca300 x1866818961284992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340998 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340982.157669:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961284992:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1780340982.157675:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c047a8ca300 x1866818961284992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1780340998 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340982.157685:0:3662:0:(genops.c:1244:class_import_put()) import ffff8c046bae0000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00080000:3.0:1780340982.157980:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1780340982.157985:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00010000:00010000:1.0:1780340982.672474:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1780340983.336297:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c047b032c50 x1866818940547072 msgsize 224 00000100:00100000:3.0:1780340983.336312:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00000040:3.0:1780340983.336383:0:3652:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1780340983.336421:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c034d877100 x1866818940547328 msgsize 224 00000100:00100000:3.0:1780340983.336426:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00000040:3.0:1780340983.336458:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c034cc8ca80 x1866818940547200 msgsize 224 00000100:00100000:3.0:1780340983.336463:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00000040:3.0:1780340983.336492:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff8c034cc8e680 x1866818940547456 msgsize 224 00000100:00100000:3.0:1780340983.336497:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340983.336530:0:25494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940547456 00000100:00100000:3.0:1780340983.336540:0:25494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940547456 00000020:00000040:3.0:1780340983.336542:0:25494:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277567e 00000020:00000040:3.0:1780340983.336546:0:25494:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047570b000 refcount=7 00000020:00000040:3.0:1780340983.336560:0:25494:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00100000:3.0:1780340983.336604:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2690 00000100:00000040:3.0:1780340983.336608:0:25494:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047570b000 : new rpc_count 1 00000100:00000040:3.0:1780340983.336614:0:25494:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034cc8e680 x1866818940547456/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:409/0 lens 224/0 e 0 to 0 dl 1780340994 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340983.336627:0:25494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940547456:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000040:3.0:1780340983.336647:0:25494:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818940547456 00000100:00000040:3.0:1780340983.336657:0:25494:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340983.336663:0:25494:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:3.0:1780340983.336694:0:25494:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00000100:00000040:3.0:1780340983.336699:0:25494:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034cc8e680 x1866818940547456/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:409/0 lens 224/224 e 0 to 0 dl 1780340994 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340983.336720:0:25494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940547456:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 95us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340983.336728:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2690 00000100:00000040:3.0:1780340983.336738:0:25494:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047570b000 : new rpc_count 0 00000020:00000040:3.0:1780340983.336749:0:25494:0:(genops.c:900:class_export_put()) PUTting export ffff8c047570b000 : new refcount 6 00000100:00080000:3.0:1780340983.336789:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1780340983.336792:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00100000:1.0:1780340983.337101:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940547328 00000100:00100000:1.0:1780340983.337113:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940547328 00000020:00000040:1.0:1780340983.337114:0:63711:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa246514327748d9 00000020:00000040:1.0:1780340983.337117:0:63711:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047b1fc000 refcount=11 00000020:00000040:1.0:1780340983.337127:0:63711:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff8c03475519c0) now 12 - evictor 00000100:00000040:1.0:1780340983.337143:0:63711:0:(service.c:1435:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1780340983.337160:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940547200 00000100:00100000:1.0:1780340983.337163:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940547200 00000020:00000040:1.0:1780340983.337164:0:63711:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa246514327752cd 00000020:00000040:1.0:1780340983.337167:0:63711:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0475faa800 refcount=51 00000020:00000040:1.0:1780340983.337172:0:63711:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff8c0445ba19c0) now 16 - evictor 00000100:00100000:1.0:1780340983.337192:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1531 00000100:00000040:1.0:1780340983.337195:0:63711:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047b1fc000 : new rpc_count 1 00000100:00000040:1.0:1780340983.337199:0:63711:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034d877100 x1866818940547328/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:409/0 lens 224/0 e 0 to 0 dl 1780340994 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340983.337212:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034d877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2408:x1866818940547328:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000040:1.0:1780340983.337224:0:63711:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 81604378768, transno 0, xid 1866818940547328 00000100:00000040:1.0:1780340983.337230:0:63711:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340983.337234:0:63711:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:1.0:1780340983.337252:0:63711:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340983.337257:0:63711:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034d877100 x1866818940547328/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:409/0 lens 224/224 e 0 to 0 dl 1780340994 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340983.337266:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034d877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2408:x1866818940547328:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 56us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340983.337272:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1531 00000100:00000040:1.0:1780340983.337275:0:63711:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047b1fc000 : new rpc_count 0 00000020:00000040:1.0:1780340983.337281:0:63711:0:(genops.c:900:class_export_put()) PUTting export ffff8c047b1fc000 : new refcount 10 00000100:00100000:1.0:1780340983.337290:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1532 00000100:00000040:1.0:1780340983.337293:0:63711:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0475faa800 : new rpc_count 1 00000100:00000040:1.0:1780340983.337302:0:63711:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c034cc8ca80 x1866818940547200/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:409/0 lens 224/0 e 0 to 0 dl 1780340994 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340983.337313:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+51:2408:x1866818940547200:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000040:1.0:1780340983.337324:0:63711:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 120259084436, transno 0, xid 1866818940547200 00000100:00000040:1.0:1780340983.337330:0:63711:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340983.337334:0:63711:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:1.0:1780340983.337348:0:63711:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00000100:00000040:1.0:1780340983.337352:0:63711:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c034cc8ca80 x1866818940547200/t0(0) o400->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:409/0 lens 224/224 e 0 to 0 dl 1780340994 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340983.337360:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+51:2408:x1866818940547200:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 49us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340983.337367:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1532 00000100:00000040:1.0:1780340983.337369:0:63711:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0475faa800 : new rpc_count 0 00000020:00000040:1.0:1780340983.337375:0:63711:0:(genops.c:900:class_export_put()) PUTting export ffff8c0475faa800 : new refcount 50 00000100:00100000:0.0:1780340983.337672:0:90573:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940547072 00000100:00100000:0.0:1780340983.337677:0:90573:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940547072 00000020:00000040:0.0:1780340983.337679:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775440 00000020:00000040:0.0:1780340983.337682:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0346fd5800 refcount=9 00000100:00000040:0.0:1780340983.337697:0:90573:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1780340983.337730:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 215 00000100:00000040:0.0:1780340983.337733:0:90573:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0346fd5800 : new rpc_count 1 00000100:00000040:0.0:1780340983.337737:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047b032c50 x1866818940547072/t0(0) o400->540506f4-4e8e-4fb6-b537-f45d44291964@192.168.203.16@tcp:409/0 lens 224/0 e 0 to 0 dl 1780340994 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340983.337749:0:90573:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940547072:12345-192.168.203.16@tcp:400:kworker.0 00010000:00000040:0.0:1780340983.337790:0:90573:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818940547072 00000100:00000040:0.0:1780340983.337811:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c0346e3c480 refcount 11 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340983.337816:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.203.16@tcp 00000100:00000040:0.0:1780340983.337853:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c0346e3c480 refcount 10 to 192.168.203.16@tcp 00000100:00000040:0.0:1780340983.337858:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047b032c50 x1866818940547072/t0(0) o400->540506f4-4e8e-4fb6-b537-f45d44291964@192.168.203.16@tcp:409/0 lens 224/224 e 0 to 0 dl 1780340994 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340983.337866:0:90573:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b032c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940547072:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 120us (1570us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340983.337872:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 215 00000100:00000040:0.0:1780340983.337875:0:90573:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0346fd5800 : new rpc_count 0 00000020:00000040:0.0:1780340983.337881:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff8c0346fd5800 : new refcount 8 00000100:00080000:3.0:1780340983.338682:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1780340983.338688:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff8c0445ba19c0) now 16 - evictor 00000100:00080000:3.0:1780340983.338692:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:3.0:1780340983.338694:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff8c03475519c0) now 12 - evictor 00010000:00010000:1.0:1780340983.690444:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1780340984.208747:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340984.208799:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c0475490800 refcount=4 obd=MGC192.168.203.116@tcp 00000100:00000040:2.0:1780340984.208827:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging f26f7947-2bb0-4491-8dd4-005fa8e64f3a->MGS req@ffff8c045f290380 x1866818961285120/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340984.208844:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000dc9142af] to pc [ptlrpcd_00_03+3] req@ffff8c045f290380 x1866818961285120/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.208876:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340984.208882:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c0346bb9800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1780340984.208890:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff8c045f291880 x1866818961285248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340984.208898:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000862d643f] to pc [ptlrpcd_00_00+0] req@ffff8c045f291880 x1866818961285248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.208914:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340984.208920:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c0346bbc000 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1780340984.208926:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff8c0485a1b480 x1866818961285376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340984.208947:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e1a3c239] to pc [ptlrpcd_00_01+1] req@ffff8c0485a1b480 x1866818961285376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.208956:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340984.208961:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c034a39c800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1780340984.208969:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff8c0485a1bb80 x1866818961285504/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340984.208977:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000bb36cee] to pc [ptlrpcd_00_02+2] req@ffff8c0485a1bb80 x1866818961285504/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340984.208984:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340984.208987:0:80497:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:2.0:1780340984.208990:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340984.208994:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c0346ee9000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1780340984.208999:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff8c0485a19880 x1866818961285632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340984.209007:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000090e6b288] to pc [ptlrpcd_00_03+3] req@ffff8c0485a19880 x1866818961285632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209014:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340984.209018:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c0346eef800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1780340984.209023:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff8c0485a1b100 x1866818961285760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340984.209032:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000cc9e0836] to pc [ptlrpcd_00_00+0] req@ffff8c0485a1b100 x1866818961285760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209050:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340984.209055:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c0450113000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1780340984.209063:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff8c0485a18e00 x1866818961285888/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340984.209071:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000703965c2] to pc [ptlrpcd_00_01+1] req@ffff8c0485a18e00 x1866818961285888/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1780340984.209077:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1780340984.209080:0:80497:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:2.0:1780340984.209082:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340984.209086:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c046bae0000 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1780340984.209091:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff8c0485a19f80 x1866818961286016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340984.209100:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e990e2dd] to pc [ptlrpcd_00_02+2] req@ffff8c0485a19f80 x1866818961286016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209105:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340984.209109:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c0442c0f800 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1780340984.209113:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff8c0485a18700 x1866818961286144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340984.209121:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003a832de4] to pc [ptlrpcd_00_03+3] req@ffff8c0485a18700 x1866818961286144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209127:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340984.209132:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c047a95f000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1780340984.209145:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID req@ffff8c0485a1ad80 x1866818961286272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340984.209154:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d13c1804] to pc [ptlrpcd_00_00+0] req@ffff8c0485a1ad80 x1866818961286272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209162:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1780340984.209166:0:80497:0:(genops.c:1231:class_import_get()) import ffff8c047b1f9800 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1780340984.209171:0:80497:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID req@ffff8c0485a19500 x1866818961286400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1780340984.209178:0:80497:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005e870829] to pc [ptlrpcd_00_01+1] req@ffff8c0485a19500 x1866818961286400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209187:0:80497:0:(pinger.c:306:ptlrpc_pinger_main()) next wakeup in 2 (3769) 00000100:00000040:2.0:1780340984.209207:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c045f290380 x1866818961285120/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.209219:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961285120:0@lo:400:kworker.0 00000100:00000040:2.0:1780340984.209244:0:3662:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c045f290380 x1866818961285120/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209253:0:3662:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340984.209308:0:3662:0:(events.c:337:request_in_callback()) incoming req@ffff8c047b226850 x1866818961285120 msgsize 224 00000100:00100000:2.0:1780340984.209313:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340984.209315:0:3662:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1780340984.209335:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c045f290380 x1866818961285120/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209361:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c0485a19880 x1866818961285632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.209369:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961285632:0@lo:400:kworker.0 00000100:00000040:2.0:1780340984.209382:0:3662:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c0485a19880 x1866818961285632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209395:0:3662:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340984.209411:0:3662:0:(events.c:337:request_in_callback()) incoming req@ffff8c0485a18a80 x1866818961285632 msgsize 224 00000100:00100000:2.0:1780340984.209414:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340984.209429:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c0485a19880 x1866818961285632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209439:0:3662:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 4996 usecs (5 jiffies) 00000100:00000040:2.0:1780340984.209445:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c0485a18700 x1866818961286144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.209453:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961286144:0@lo:400:kworker.0 00000100:00000040:2.0:1780340984.209466:0:3662:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c0485a18700 x1866818961286144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209473:0:3662:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340984.209485:0:3662:0:(events.c:337:request_in_callback()) incoming req@ffff8c0485a1a300 x1866818961286144 msgsize 224 00000100:00100000:2.0:1780340984.209489:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340984.209507:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c0485a18700 x1866818961286144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209517:0:3662:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 6606 usecs (7 jiffies) 00000100:00100000:2.0:1780340984.209531:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00000040:2.0:1780340984.209535:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c0485a1bb80 x1866818961285504/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.209543:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961285504:0@lo:400:kworker.0 00000100:00000040:2.0:1780340984.209555:0:3662:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c0485a1bb80 x1866818961285504/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209562:0:3662:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340984.209575:0:3662:0:(events.c:337:request_in_callback()) incoming req@ffff8c0485a19180 x1866818961285504 msgsize 224 00000100:00100000:2.0:1780340984.209578:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340984.209584:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961286144 00000100:00000040:2.0:1780340984.209591:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c0485a1bb80 x1866818961285504/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340984.209592:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961286144 00000020:00000040:3.0:1780340984.209594:0:64454:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775478 00000020:00000040:3.0:1780340984.209597:0:64454:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a0a2800 refcount=5 00000100:00000040:2.0:1780340984.209606:0:3662:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 835485 usecs (836 jiffies) 00000100:00000040:2.0:1780340984.209611:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c0485a19f80 x1866818961286016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340984.209616:0:64454:0:(service.c:1435:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1780340984.209619:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961286016:0@lo:400:kworker.0 00000100:00000040:2.0:1780340984.209630:0:3662:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c0485a19f80 x1866818961286016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209636:0:3662:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:3.0:1780340984.209639:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1533 00000100:00000040:3.0:1780340984.209643:0:64454:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a0a2800 : new rpc_count 1 00000100:00000040:2.0:1780340984.209646:0:3662:0:(events.c:337:request_in_callback()) incoming req@ffff8c0485a19c00 x1866818961286016 msgsize 224 00000100:00000040:3.0:1780340984.209648:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0485a1a300 x1866818961286144/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:410/0 lens 224/0 e 0 to 0 dl 1780340995 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.209650:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340984.209659:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961286144:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1780340984.209661:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c0485a19f80 x1866818961286016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209668:0:3662:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 7970 usecs (8 jiffies) 00010000:00000040:3.0:1780340984.209678:0:64454:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961286144 00000100:00000040:2.0:1780340984.209686:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c045f291880 x1866818961285248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340984.209688:0:64454:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 66 to 0@lo 00000100:00000040:3.0:1780340984.209692:0:64454:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00100000:2.0:1780340984.209695:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c045f291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961285248:0@lo:400:kworker.0 00000100:00000040:2.0:1780340984.209705:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c045f291880 x1866818961285248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340984.209709:0:64454:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c0485a18700 x1866818961286144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209712:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340984.209720:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff8c0485a18380 x1866818961285248 msgsize 224 00000100:00100000:2.0:1780340984.209724:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340984.209727:0:64454:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 65 to 0@lo 00000100:00000040:3.0:1780340984.209731:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0485a1a300 x1866818961286144/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:410/0 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209734:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c045f291880 x1866818961285248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340984.209740:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961286144:12345-0@lo:400:kworker.0 Request processed in 82us (252us total) trans 0 rc 0/0 00000100:00000040:2.0:1780340984.209743:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 7328 usecs (8 jiffies) 00000100:00100000:3.0:1780340984.209746:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1533 00000100:00000040:2.0:1780340984.209748:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c0485a1b100 x1866818961285760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340984.209782:0:64454:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a0a2800 : new rpc_count 0 00000100:00100000:2.0:1780340984.209785:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961285760:0@lo:400:kworker.0 00000020:00000040:3.0:1780340984.209793:0:64454:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a0a2800 : new refcount 4 00000100:00100000:3.0:1780340984.209800:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961285248 00000100:00000040:2.0:1780340984.209802:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c0485a1b100 x1866818961285760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340984.209803:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961285248 00000020:00000040:3.0:1780340984.209805:0:64454:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277546a 00000020:00000040:3.0:1780340984.209807:0:64454:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0458280800 refcount=5 00000100:00000040:2.0:1780340984.209809:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:3.0:1780340984.209815:0:64454:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff8c0445ba19c0) now 16 - evictor 00000100:00000040:2.0:1780340984.209820:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff8c0485a1b800 x1866818961285760 msgsize 224 00000100:00100000:2.0:1780340984.209824:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340984.209826:0:64454:0:(service.c:1435:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000040:2.0:1780340984.209835:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c0485a1b100 x1866818961285760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340984.209837:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961285760 00000100:00100000:3.0:1780340984.209839:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961285760 00000020:00000040:3.0:1780340984.209841:0:64454:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775471 00000020:00000040:3.0:1780340984.209843:0:64454:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046b908800 refcount=5 00000100:00000040:2.0:1780340984.209844:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 128388 usecs (129 jiffies) 00000100:00000040:2.0:1780340984.209849:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c0485a1ad80 x1866818961286272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340984.209856:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1534 00000100:00100000:2.0:1780340984.209857:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961286272:0@lo:400:kworker.0 00000100:00000040:3.0:1780340984.209858:0:64454:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0458280800 : new rpc_count 1 00000100:00000040:3.0:1780340984.209861:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0485a18380 x1866818961285248/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:410/0 lens 224/0 e 0 to 0 dl 1780340995 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340984.209870:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961285248:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1780340984.209871:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c0485a1ad80 x1866818961286272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1780340984.209878:0:64454:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961285248 00000100:00000040:2.0:1780340984.209878:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340984.209883:0:64454:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 66 to 0@lo 00000100:00000040:3.0:1780340984.209886:0:64454:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340984.209888:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff8c0349086a00 x1866818961286272 msgsize 224 00000100:00100000:2.0:1780340984.209892:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1780340984.209898:0:64454:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c045f291880 x1866818961285248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209898:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c0485a1ad80 x1866818961286272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.209906:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 8415 usecs (9 jiffies) 00000100:00000040:3.0:1780340984.209909:0:64454:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 65 to 0@lo 00000100:00000040:3.0:1780340984.209913:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0485a18380 x1866818961285248/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:410/0 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340984.209919:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961285248:12345-0@lo:400:kworker.0 Request processed in 51us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340984.209924:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1534 00000100:00000040:3.0:1780340984.209926:0:64454:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0458280800 : new rpc_count 0 00000100:00000040:2.0:1780340984.209929:0:3659:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1780340984.209934:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c045f291880 x1866818961285248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340984.209937:0:64454:0:(genops.c:900:class_export_put()) PUTting export ffff8c0458280800 : new refcount 4 00000100:00000040:2.0:1780340984.209941:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f291880 x1866818961285248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340984.209943:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961286272 00000100:00100000:3.0:1780340984.209946:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961286272 00000020:00000040:3.0:1780340984.209947:0:64454:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277627f 00000020:00000040:3.0:1780340984.209949:0:64454:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0345308800 refcount=5 00000100:00100000:2.0:1780340984.209949:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f291880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961285248:0@lo:400:kworker.0 00000100:00000040:2.0:1780340984.209954:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c045f291880 x1866818961285248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340984.209964:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1535 00000100:00000040:3.0:1780340984.209966:0:64454:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046b908800 : new rpc_count 1 00000020:00000040:2.0:1780340984.209968:0:3659:0:(genops.c:1244:class_import_put()) import ffff8c0346bb9800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1780340984.209969:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0485a1b800 x1866818961285760/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:410/0 lens 224/0 e 0 to 0 dl 1780340995 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.209974:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1780340984.209976:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961285760:12345-0@lo:400:kworker.0 00000100:00000040:2.0:1780340984.209980:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c0485a1b480 x1866818961285376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1780340984.209984:0:64454:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961285760 00000100:00100000:2.0:1780340984.209987:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961285376:0@lo:400:kworker.0 00000100:00000040:3.0:1780340984.209988:0:64454:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 66 to 0@lo 00000100:00000040:3.0:1780340984.209991:0:64454:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340984.209998:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c0485a1b480 x1866818961285376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.210004:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340984.210076:0:64454:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c0485a1b100 x1866818961285760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340984.210088:0:64454:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 65 to 0@lo 00000100:00000040:3.0:1780340984.210092:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0485a1b800 x1866818961285760/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:410/0 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340984.210098:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961285760:12345-0@lo:400:kworker.0 Request processed in 123us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340984.210103:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1535 00000100:00000040:3.0:1780340984.210105:0:64454:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046b908800 : new rpc_count 0 00000020:00000040:3.0:1780340984.210111:0:64454:0:(genops.c:900:class_export_put()) PUTting export ffff8c046b908800 : new refcount 4 00000100:00100000:3.0:1780340984.210120:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1536 00000100:00000040:3.0:1780340984.210122:0:64454:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0345308800 : new rpc_count 1 00000100:00000040:3.0:1780340984.210125:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0349086a00 x1866818961286272/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:410/0 lens 224/0 e 0 to 0 dl 1780340995 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340984.210134:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961286272:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780340984.210148:0:64454:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961286272 00000100:00000040:3.0:1780340984.210153:0:64454:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 66 to 0@lo 00000100:00000040:3.0:1780340984.210156:0:64454:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340984.210164:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff8c0349086d80 x1866818961285376 msgsize 224 00000100:00000040:3.0:1780340984.210167:0:64454:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c0485a1ad80 x1866818961286272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.210169:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340984.210176:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c0485a1b480 x1866818961285376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340984.210178:0:64454:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 65 to 0@lo 00000100:00000040:3.0:1780340984.210182:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0349086a00 x1866818961286272/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:410/0 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.210184:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 7008 usecs (8 jiffies) 00000100:00100000:3.0:1780340984.210189:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961286272:12345-0@lo:400:kworker.0 Request processed in 57us (299us total) trans 0 rc 0/0 00000100:00000040:2.0:1780340984.210190:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c0485a18e00 x1866818961285888/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340984.210195:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1536 00000100:00000040:3.0:1780340984.210198:0:64454:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0345308800 : new rpc_count 0 00000100:00100000:2.0:1780340984.210198:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961285888:0@lo:400:kworker.0 00000020:00000040:3.0:1780340984.210203:0:64454:0:(genops.c:900:class_export_put()) PUTting export ffff8c0345308800 : new refcount 4 00000100:00100000:3.0:1780340984.210209:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961285376 00000100:00000040:2.0:1780340984.210209:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c0485a18e00 x1866818961285888/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340984.210212:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961285376 00000020:00000040:3.0:1780340984.210214:0:64454:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f208 00000020:00000040:3.0:1780340984.210216:0:64454:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c046ba26800 refcount=5 00000100:00000040:2.0:1780340984.210216:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000020:00000040:3.0:1780340984.210224:0:64454:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff8c03475519c0) now 12 - evictor 00000100:00000040:2.0:1780340984.210227:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff8c0349084380 x1866818961285888 msgsize 224 00000100:00000040:3.0:1780340984.210229:0:64454:0:(service.c:1435:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1780340984.210230:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340984.210238:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1537 00000100:00000040:3.0:1780340984.210240:0:64454:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c046ba26800 : new rpc_count 1 00000100:00000040:2.0:1780340984.210243:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c0485a18e00 x1866818961285888/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340984.210244:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0349086d80 x1866818961285376/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:410/0 lens 224/0 e 0 to 0 dl 1780340995 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340984.210253:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961285376:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780340984.210262:0:64454:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961285376 00000100:00000040:3.0:1780340984.210266:0:64454:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 66 to 0@lo 00000100:00000040:3.0:1780340984.210269:0:64454:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340984.210369:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3487 usecs (4 jiffies) 00000100:00000040:2.0:1780340984.210378:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff8c0485a19500 x1866818961286400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.210398:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0485a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961286400:0@lo:400:kworker.0 00000100:00000040:2.0:1780340984.210417:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff8c0485a19500 x1866818961286400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.210424:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340984.210436:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff8c0349085c00 x1866818961286400 msgsize 224 00000100:00100000:2.0:1780340984.210440:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1780340984.210446:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff8c0485a19500 x1866818961286400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.210455:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 1841 usecs (2 jiffies) 00000100:00000040:2.0:1780340984.210467:0:3659:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:3.0:1780340984.210472:0:64454:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c0485a1b480 x1866818961285376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.210472:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c0485a1b100 x1866818961285760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.210479:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0485a1b100 x1866818961285760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.210487:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961285760:0@lo:400:kworker.0 00000100:00000040:3.0:1780340984.210490:0:64454:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 65 to 0@lo 00000100:00000040:3.0:1780340984.210494:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0349086d80 x1866818961285376/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:410/0 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.210495:0:3659:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:2.0:1780340984.210498:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c0485a1ad80 x1866818961286272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340984.210503:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1866818961285376:12345-0@lo:400:kworker.0 Request processed in 251us (337us total) trans 0 rc 0/0 00000100:00000040:2.0:1780340984.210506:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0485a1ad80 x1866818961286272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.210513:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961286272:0@lo:400:kworker.0 00000100:00000040:2.0:1780340984.210518:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c0485a1b100 x1866818961285760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340984.210525:0:3659:0:(genops.c:1244:class_import_put()) import ffff8c0346eef800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1780340984.210538:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c0485a1ad80 x1866818961286272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340984.210545:0:3659:0:(genops.c:1244:class_import_put()) import ffff8c047a95f000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1780340984.210557:0:3659:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1780340984.210561:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c0485a1b480 x1866818961285376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.210569:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0485a1b480 x1866818961285376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.210575:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1866818961285376:0@lo:400:kworker.0 00000100:00100000:3.0:1780340984.210577:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1537 00000100:00000040:3.0:1780340984.210580:0:64454:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c046ba26800 : new rpc_count 0 00000100:00000040:2.0:1780340984.210580:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c0485a1b480 x1866818961285376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1780340984.210586:0:64454:0:(genops.c:900:class_export_put()) PUTting export ffff8c046ba26800 : new refcount 4 00000020:00000040:2.0:1780340984.210586:0:3659:0:(genops.c:1244:class_import_put()) import ffff8c0346bbc000 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00100000:3.0:1780340984.210593:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961286400 00000100:00100000:3.0:1780340984.210596:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961286400 00000020:00000040:3.0:1780340984.210598:0:64454:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432776294 00000020:00000040:3.0:1780340984.210600:0:64454:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0346bbf000 refcount=5 00000100:00000040:3.0:1780340984.210609:0:64454:0:(service.c:1435:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1780340984.210616:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961285120 00000100:00100000:3.0:1780340984.210617:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1538 00000100:00000040:3.0:1780340984.210619:0:64454:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0346bbf000 : new rpc_count 1 00000100:00100000:2.0:1780340984.210619:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961285120 00000020:00000040:2.0:1780340984.210620:0:90570:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277525d 00000100:00000040:3.0:1780340984.210623:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0349085c00 x1866818961286400/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:410/0 lens 224/0 e 0 to 0 dl 1780340995 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1780340984.210623:0:90570:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c047a289800 refcount=23 00000100:00100000:3.0:1780340984.210632:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961286400:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1780340984.210641:0:64454:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961286400 00000100:00000040:3.0:1780340984.210646:0:64454:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 66 to 0@lo 00000100:00000040:3.0:1780340984.210649:0:64454:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1780340984.210663:0:64454:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c0485a19500 x1866818961286400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1780340984.210681:0:64454:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 65 to 0@lo 00000100:00000040:3.0:1780340984.210685:0:64454:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0349085c00 x1866818961286400/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:410/0 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1780340984.210693:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961286400:12345-0@lo:400:kworker.0 Request processed in 62us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340984.210707:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1538 00000100:00000040:3.0:1780340984.210710:0:64454:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0346bbf000 : new rpc_count 0 00000020:00000040:3.0:1780340984.210715:0:64454:0:(genops.c:900:class_export_put()) PUTting export ffff8c0346bbf000 : new refcount 4 00000100:00080000:3.0:1780340984.210731:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:3.0:1780340984.210735:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff8c03475519c0) now 12 - evictor 00000100:00080000:3.0:1780340984.210738:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1780340984.210740:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff8c0445ba19c0) now 16 - evictor 00000100:00000040:2.0:1780340984.210938:0:90570:0:(service.c:1435:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1780340984.210956:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00000040:2.0:1780340984.210959:0:90570:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c047a289800 : new rpc_count 1 00000100:00000040:2.0:1780340984.210963:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c047b226850 x1866818961285120/t0(0) o400->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:410/0 lens 224/0 e 0 to 0 dl 1780340995 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.210974:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961285120:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1780340984.210982:0:90570:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961285120 00000100:00000040:2.0:1780340984.210987:0:90570:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 66 to 0@lo 00000100:00000040:2.0:1780340984.210990:0:90570:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340984.211007:0:90570:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c045f290380 x1866818961285120/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.211033:0:90570:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 65 to 0@lo 00000100:00000040:2.0:1780340984.211037:0:90570:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c047b226850 x1866818961285120/t0(0) o400->f26f7947-2bb0-4491-8dd4-005fa8e64f3a@0@lo:410/0 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.211045:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b226850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961285120:12345-0@lo:400:kworker.0 Request processed in 72us (1735us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340984.211051:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00000040:2.0:1780340984.211053:0:90570:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c047a289800 : new rpc_count 0 00000020:00000040:2.0:1780340984.211059:0:90570:0:(genops.c:900:class_export_put()) PUTting export ffff8c047a289800 : new refcount 22 00000100:00100000:2.0:1780340984.211085:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961285632 00000100:00100000:2.0:1780340984.211089:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961285632 00000020:00000040:2.0:1780340984.211091:0:25493:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143276f183 00000020:00000040:2.0:1780340984.211093:0:25493:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0442c08800 refcount=5 00000020:00000040:2.0:1780340984.211100:0:25493:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00100000:2.0:1780340984.211123:0:25493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961286016 00000100:00100000:2.0:1780340984.211126:0:25493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961286016 00000020:00000040:2.0:1780340984.211127:0:25493:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa24651432775336 00000020:00000040:2.0:1780340984.211129:0:25493:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0452a6e000 refcount=5 00000100:00100000:2.0:1780340984.211147:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2691 00000100:00000040:2.0:1780340984.211149:0:25493:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0442c08800 : new rpc_count 1 00000100:00000040:2.0:1780340984.211153:0:25493:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0485a18a80 x1866818961285632/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:410/0 lens 224/0 e 0 to 0 dl 1780340995 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.211163:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961285632:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1780340984.211171:0:25493:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969444, transno 0, xid 1866818961285632 00000100:00000040:2.0:1780340984.211175:0:25493:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 66 to 0@lo 00000100:00000040:2.0:1780340984.211178:0:25493:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340984.211194:0:25493:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c0485a19880 x1866818961285632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.211217:0:25493:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 65 to 0@lo 00000100:00000040:2.0:1780340984.211221:0:25493:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0485a18a80 x1866818961285632/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:410/0 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.211229:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961285632:12345-0@lo:400:kworker.0 Request processed in 68us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340984.211235:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2691 00000100:00000040:2.0:1780340984.211237:0:25493:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0442c08800 : new rpc_count 0 00000020:00000040:2.0:1780340984.211242:0:25493:0:(genops.c:900:class_export_put()) PUTting export ffff8c0442c08800 : new refcount 4 00000100:00100000:2.0:1780340984.211250:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2692 00000100:00000040:2.0:1780340984.211252:0:25493:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0452a6e000 : new rpc_count 1 00000100:00000040:2.0:1780340984.211381:0:25493:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0485a19c00 x1866818961286016/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:410/0 lens 224/0 e 0 to 0 dl 1780340995 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.211396:0:25493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961286016:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1780340984.211406:0:25493:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 4294969457, transno 0, xid 1866818961286016 00000100:00000040:2.0:1780340984.211410:0:25493:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 66 to 0@lo 00000100:00000040:2.0:1780340984.211413:0:25493:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340984.211430:0:25493:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c0485a19f80 x1866818961286016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.211441:0:25493:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 65 to 0@lo 00000100:00000040:2.0:1780340984.211445:0:25493:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0485a19c00 x1866818961286016/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:410/0 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.211452:0:25493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961286016:12345-0@lo:400:kworker.0 Request processed in 61us (1804us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340984.211459:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2692 00000100:00000040:2.0:1780340984.211461:0:25493:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0452a6e000 : new rpc_count 0 00000020:00000040:2.0:1780340984.211472:0:25493:0:(genops.c:900:class_export_put()) PUTting export ffff8c0452a6e000 : new refcount 4 00000100:00100000:2.0:1780340984.211487:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961285504 00000100:00100000:2.0:1780340984.211491:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961285504 00000020:00000040:2.0:1780340984.211493:0:8411:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa246514327752c6 00000020:00000040:2.0:1780340984.211495:0:8411:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c0475fad800 refcount=7 00000100:00000040:2.0:1780340984.211503:0:8411:0:(service.c:1435:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1780340984.211519:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961285888 00000100:00100000:2.0:1780340984.211521:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961285888 00000020:00000040:2.0:1780340984.211523:0:8411:0:(genops.c:825:class_conn2export()) looking for export cookie 0xa2465143277530c 00000020:00000040:2.0:1780340984.211525:0:8411:0:(lustre_handles.c:131:class_handle2object()) GET export ffff8c04514b0800 refcount=5 00000100:00100000:2.0:1780340984.211542:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4021 00000100:00000040:2.0:1780340984.211545:0:8411:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c0475fad800 : new rpc_count 1 00000100:00000040:2.0:1780340984.211548:0:8411:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0485a19180 x1866818961285504/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:410/0 lens 224/0 e 0 to 0 dl 1780340995 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.211558:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0485a19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961285504:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1780340984.211568:0:8411:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1866818961285504 00000100:00000040:2.0:1780340984.211573:0:8411:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 66 to 0@lo 00000100:00000040:2.0:1780340984.211576:0:8411:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1780340984.211592:0:8411:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c0485a1bb80 x1866818961285504/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1780340984.211604:0:8411:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 65 to 0@lo 00000100:00000040:2.0:1780340984.211607:0:8411:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0485a19180 x1866818961285504/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:410/0 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1780340984.211615:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0485a19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961285504:12345-0@lo:400:kworker.0 Request processed in 58us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340984.211620:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4021 00000100:00000040:2.0:1780340984.211623:0:8411:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c0475fad800 : new rpc_count 0 00000020:00000040:2.0:1780340984.211628:0:8411:0:(genops.c:900:class_export_put()) PUTting export ffff8c0475fad800 : new refcount 6 00000100:00100000:0.0:1780340984.211981:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4022 00000100:00000040:0.0:1780340984.211985:0:8410:0:(service.c:2258:ptlrpc_server_request_get()) RPC GETting export ffff8c04514b0800 : new rpc_count 1 00000100:00000040:0.0:1780340984.211990:0:8410:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff8c0349084380 x1866818961285888/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:410/0 lens 224/0 e 0 to 0 dl 1780340995 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340984.212003:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961285888:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1780340984.212014:0:8410:0:(ldlm_lib.c:3287:target_committed_to_req()) last_committed 0, transno 0, xid 1866818961285888 00000100:00000040:0.0:1780340984.212019:0:8410:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff8c044319f100 refcount 66 to 0@lo 00000100:00000040:0.0:1780340984.212022:0:8410:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1780340984.212042:0:8410:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff8c0485a18e00 x1866818961285888/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340984.212057:0:8410:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff8c044319f100 refcount 65 to 0@lo 00000100:00000040:0.0:1780340984.212061:0:8410:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0349084380 x1866818961285888/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:410/0 lens 224/224 e 0 to 0 dl 1780340995 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340984.212069:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349084380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961285888:12345-0@lo:400:kworker.0 Request processed in 70us (1840us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340984.212075:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4022 00000100:00000040:0.0:1780340984.212077:0:8410:0:(service.c:1116:ptlrpc_server_finish_active_request()) RPC PUTting export ffff8c04514b0800 : new rpc_count 0 00000020:00000040:0.0:1780340984.212088:0:8410:0:(genops.c:900:class_export_put()) PUTting export ffff8c04514b0800 : new refcount 4 00000100:00000040:0.0:1780340984.212157:0:3662:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:0.0:1780340984.212163:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c0485a1bb80 x1866818961285504/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340984.212172:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0485a1bb80 x1866818961285504/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340984.212179:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961285504:0@lo:400:kworker.0 00000100:00000040:0.0:1780340984.212189:0:3662:0:(client.c:3098:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969457 00000100:00000040:0.0:1780340984.212193:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c0485a19f80 x1866818961286016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340984.212200:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0485a19f80 x1866818961286016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340984.212207:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961286016:0@lo:400:kworker.0 00000100:00000040:0.0:1780340984.212217:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c045f290380 x1866818961285120/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340984.212224:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c045f290380 x1866818961285120/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340984.212231:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c045f290380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961285120:0@lo:400:kworker.0 00000100:00000040:0.0:1780340984.212240:0:3662:0:(client.c:3098:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969444 00000100:00000040:0.0:1780340984.212244:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c0485a19880 x1866818961285632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340984.212250:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0485a19880 x1866818961285632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340984.212331:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961285632:0@lo:400:kworker.0 00000100:00000040:0.0:1780340984.212355:0:3662:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1780340984.212359:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c0485a18700 x1866818961286144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340984.212367:0:3662:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0485a18700 x1866818961286144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340984.212373:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961286144:0@lo:400:kworker.0 00000100:00000040:0.0:1780340984.212378:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c0485a1bb80 x1866818961285504/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340984.212386:0:3662:0:(genops.c:1244:class_import_put()) import ffff8c034a39c800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1780340984.212394:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c0485a19f80 x1866818961286016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340984.212400:0:3662:0:(genops.c:1244:class_import_put()) import ffff8c046bae0000 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1780340984.212405:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c045f290380 x1866818961285120/t0(0) o400->MGC192.168.203.116@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340984.212411:0:3662:0:(genops.c:1244:class_import_put()) import ffff8c0475490800 refcount=3 obd=MGC192.168.203.116@tcp 00000100:00000040:0.0:1780340984.212416:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c0485a19880 x1866818961285632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340984.212422:0:3662:0:(genops.c:1244:class_import_put()) import ffff8c0346ee9000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1780340984.212426:0:3662:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c0485a18700 x1866818961286144/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340984.212432:0:3662:0:(genops.c:1244:class_import_put()) import ffff8c0442c0f800 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00080000:0.0:1780340984.212463:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1780340984.212466:0:6513:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff8c03450b99c0) now 10 - evictor 00000100:00000040:0.0:1780340984.212483:0:3659:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1780340984.212488:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c0485a18e00 x1866818961285888/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340984.212508:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0485a18e00 x1866818961285888/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340984.212515:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961285888:0@lo:400:kworker.0 00000100:00000040:0.0:1780340984.212534:0:3659:0:(client.c:3098:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:0.0:1780340984.212538:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff8c0485a19500 x1866818961286400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1780340984.212545:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff8c0485a19500 x1866818961286400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340984.212552:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0485a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961286400:0@lo:400:kworker.0 00000100:00000040:0.0:1780340984.212557:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c0485a18e00 x1866818961285888/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340984.212565:0:3659:0:(genops.c:1244:class_import_put()) import ffff8c0450113000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1780340984.212570:0:3659:0:(client.c:2852:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff8c0485a19500 x1866818961286400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1780341000 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1780340984.212575:0:3659:0:(genops.c:1244:class_import_put()) import ffff8c047b1f9800 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00010000:00010000:3.0:1780340984.714211:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1780340984.723304:0:93008:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969518 is committed 00000001:00000040:3.0:1780340984.723314:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 39 00000020:00000040:3.0:1780340984.723318:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 43 00000001:00000040:3.0:1780340984.723328:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 38 00000020:00000040:3.0:1780340984.723330:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 42 00000001:00000040:3.0:1780340984.723334:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 37 00000020:00000040:3.0:1780340984.723335:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 41 00000001:00000040:3.0:1780340984.723342:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 36 00000020:00000040:3.0:1780340984.723343:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 40 00000001:00000040:3.0:1780340984.723352:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 35 00000020:00000040:3.0:1780340984.723354:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 39 00000001:00000040:3.0:1780340984.723360:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 34 00000020:00000040:3.0:1780340984.723362:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 38 00000001:00000040:3.0:1780340984.723366:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 33 00000020:00000040:3.0:1780340984.723368:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 37 00000001:00000040:3.0:1780340984.723372:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 32 00000020:00000040:3.0:1780340984.723374:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 36 00000001:00000040:3.0:1780340984.723379:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 31 00000020:00000040:3.0:1780340984.723380:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 35 00000001:00000040:3.0:1780340984.723384:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 30 00000020:00000040:3.0:1780340984.723385:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 34 00000001:00000040:3.0:1780340984.723400:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 29 00000020:00000040:3.0:1780340984.723402:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 33 00000001:00000040:3.0:1780340984.723406:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 28 00000020:00000040:3.0:1780340984.723407:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 32 00000001:00000040:3.0:1780340984.723411:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 27 00000020:00000040:3.0:1780340984.723413:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 31 00000001:00000040:3.0:1780340984.723417:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 26 00000020:00000040:3.0:1780340984.723419:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 30 00000001:00000040:3.0:1780340984.723422:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 25 00000020:00000040:3.0:1780340984.723423:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 29 00000001:00000040:3.0:1780340984.723427:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 24 00000020:00000040:3.0:1780340984.723429:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 28 00000001:00000040:3.0:1780340984.723434:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 23 00000020:00000040:3.0:1780340984.723436:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 27 00000001:00000040:3.0:1780340984.723440:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 22 00000020:00000040:3.0:1780340984.723442:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 26 00000001:00000040:3.0:1780340984.723447:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 21 00000020:00000040:3.0:1780340984.723449:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 25 00000001:00000040:3.0:1780340984.723454:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 20 00000020:00000040:3.0:1780340984.723456:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 24 00000001:00000040:3.0:1780340984.723461:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 19 00000020:00000040:3.0:1780340984.723463:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 23 00000001:00000040:3.0:1780340984.723468:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 18 00000020:00000040:3.0:1780340984.723471:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 22 00000001:00000040:3.0:1780340984.723474:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 17 00000020:00000040:3.0:1780340984.723476:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 21 00000001:00000040:3.0:1780340984.723480:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 16 00000020:00000040:3.0:1780340984.723481:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 20 00000001:00000040:3.0:1780340984.723484:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 15 00000020:00000040:3.0:1780340984.723485:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 19 00000001:00000040:3.0:1780340984.723495:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 14 00000020:00000040:3.0:1780340984.723497:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 18 00000001:00000040:3.0:1780340984.723500:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 13 00000020:00000040:3.0:1780340984.723502:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 17 00000001:00000040:3.0:1780340984.723504:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 12 00000020:00000040:3.0:1780340984.723506:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 16 00000001:00000040:3.0:1780340984.723509:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 11 00000020:00000040:3.0:1780340984.723510:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 15 00000001:00000040:3.0:1780340984.723512:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 10 00000020:00000040:3.0:1780340984.723514:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 14 00000001:00000040:3.0:1780340984.723517:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 9 00000020:00000040:3.0:1780340984.723518:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 13 00000001:00000040:3.0:1780340984.723523:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 8 00000020:00000040:3.0:1780340984.723525:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 12 00000001:00000040:3.0:1780340984.723588:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 7 00000020:00000040:3.0:1780340984.723590:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 11 00000001:00000040:3.0:1780340984.723593:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 6 00000020:00000040:3.0:1780340984.723595:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 10 00000001:00000040:3.0:1780340984.723598:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 5 00000020:00000040:3.0:1780340984.723600:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 9 00000001:00000040:3.0:1780340984.723603:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 4 00000020:00000040:3.0:1780340984.723605:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 8 00000001:00000040:3.0:1780340984.723608:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 3 00000020:00000040:3.0:1780340984.723610:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 7 00000001:00000040:3.0:1780340984.723613:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 2 00000020:00000040:3.0:1780340984.723615:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 6 00000001:00000040:3.0:1780340984.723618:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 1 00000020:00000040:3.0:1780340984.723620:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 5 00000001:00000040:3.0:1780340984.723623:0:93008:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff8c046bae3800 : new cb_count 0 00000020:00000040:3.0:1780340984.723625:0:93008:0:(genops.c:900:class_export_put()) PUTting export ffff8c046bae3800 : new refcount 4 00000001:02000400:2.0:1780340985.737979:0:93348:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1780340985.739013:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340986.252956:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340986.252981:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961286528:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1780340986.253053:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340986.253118:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961286528 00000100:00100000:1.0:1780340986.253126:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961286528 00000100:00100000:1.0:1780340986.253177:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2195 00000100:00100000:1.0:1780340986.253188:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961286528:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1780340986.253217:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1780340986.253433:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340986.253668:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961286528:12345-0@lo:13:osp-pre-1-1.0 Request processed in 481us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340986.253677:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2195 00000100:00100000:2.0:1780340986.253824:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961286528:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1780340986.255021:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340986.255026:0:80497:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:3.0:1780340986.255039:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1780340986.255043:0:80497:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1780340986.255100:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961286912:0@lo:400:kworker.0 00000100:00100000:3.0:1780340986.255150:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340986.255178:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961287424:0@lo:400:kworker.0 00000100:00100000:3.0:1780340986.255204:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340986.255227:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1780340986.255233:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961286784:0@lo:400:kworker.0 00000100:00100000:3.0:1780340986.255397:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340986.255418:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961287296:0@lo:400:kworker.0 00000100:00100000:3.0:1780340986.255443:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340986.255461:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961287808:0@lo:400:kworker.0 00000100:00100000:3.0:1780340986.255481:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340986.255513:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961286912 00000100:00100000:3.0:1780340986.255519:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961286912 00000100:00100000:3.0:1780340986.255567:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961286784 00000100:00100000:3.0:1780340986.255571:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961286784 00000100:00100000:3.0:1780340986.255590:0:64454:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961287808 00000100:00100000:3.0:1780340986.255592:0:64454:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961287808 00000100:00100000:3.0:1780340986.255609:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539 00000100:00100000:3.0:1780340986.255617:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961286912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340986.255665:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1866818961286912:12345-0@lo:400:kworker.0 Request processed in 48us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340986.255685:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539 00000100:00100000:3.0:1780340986.255703:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1540 00000100:00100000:3.0:1780340986.255709:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961286784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340986.255752:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961286784:12345-0@lo:400:kworker.0 Request processed in 43us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340986.255788:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1540 00000100:00100000:3.0:1780340986.255801:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1541 00000100:00100000:3.0:1780340986.255809:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961287808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340986.255974:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961286656:0@lo:400:kworker.0 00000100:00100000:2.0:1780340986.256006:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340986.256032:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961287168:0@lo:400:kworker.0 00000100:00100000:2.0:1780340986.256066:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340986.256087:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961287680:0@lo:400:kworker.0 00000100:00100000:2.0:1780340986.256107:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340986.256121:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1780340986.256127:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961287040:0@lo:400:kworker.0 00000100:00100000:2.0:1780340986.256149:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340986.256168:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961287552:0@lo:400:kworker.0 00000100:00100000:2.0:1780340986.256189:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340986.256210:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961286656 00000100:00100000:2.0:1780340986.256214:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961286656 00000100:00100000:2.0:1780340986.256454:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1780340986.256465:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961286656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340986.256502:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b224050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3662:x1866818961286656:12345-0@lo:400:kworker.0 Request processed in 39us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340986.256508:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1780340986.256536:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961287296 00000100:00100000:2.0:1780340986.256540:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961287296 00000100:00100000:2.0:1780340986.256562:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961287040 00000100:00100000:2.0:1780340986.256564:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961287040 00000100:00100000:2.0:1780340986.256580:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4023 00000100:00100000:2.0:1780340986.256586:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961287296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340986.256628:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961287296:12345-0@lo:400:kworker.0 Request processed in 43us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340986.256635:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4023 00000100:00100000:2.0:1780340986.256647:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4024 00000100:00100000:2.0:1780340986.256652:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961287040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340986.256677:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961287040:12345-0@lo:400:kworker.0 Request processed in 25us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340986.256683:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4024 00000100:00100000:2.0:1780340986.256723:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961287040:0@lo:400:kworker.0 00000100:00100000:2.0:1780340986.256732:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3662:1866818961286656:0@lo:400:kworker.0 00000100:00100000:2.0:1780340986.256995:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961287168 00000100:00100000:2.0:1780340986.257000:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961287168 00000100:00100000:2.0:1780340986.257019:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961287680 00000100:00100000:2.0:1780340986.257022:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961287680 00000100:00100000:2.0:1780340986.257035:0:70100:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961287552 00000100:00100000:2.0:1780340986.257037:0:70100:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961287552 00000100:00100000:2.0:1780340986.257049:0:70100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1542 00000100:00100000:2.0:1780340986.257056:0:70100:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818961287168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340986.257354:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1866818961287808:12345-0@lo:400:kworker.0 Request processed in 29us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340986.257362:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1541 00000100:00100000:3.0:1780340986.257379:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1543 00000100:00100000:3.0:1780340986.257386:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818961287680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340986.257449:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1866818961287680:12345-0@lo:400:kworker.0 Request processed in 63us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340986.257454:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1543 00000100:00100000:3.0:1780340986.257467:0:64454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544 00000100:00100000:3.0:1780340986.257473:0:64454:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961287552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340986.257500:0:64454:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1866818961287552:12345-0@lo:400:kworker.0 Request processed in 28us (1310us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340986.257505:0:64454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1544 00000100:00080000:3.0:1780340986.257528:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780340986.257532:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340986.257653:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961286784:0@lo:400:kworker.0 00000100:00100000:3.0:1780340986.257681:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961287296:0@lo:400:kworker.0 00000100:00100000:3.0:1780340986.257693:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1866818961287808:0@lo:400:kworker.0 00000100:00100000:3.0:1780340986.257702:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1866818961286912:0@lo:400:kworker.0 00000100:00100000:2.0:1780340986.257816:0:70100:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1866818961287168:12345-0@lo:400:kworker.0 Request processed in 759us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340986.257823:0:70100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1542 00000100:00100000:2.0:1780340986.257866:0:23153:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961287424 00000100:00100000:2.0:1780340986.257871:0:23153:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961287424 00000100:00100000:2.0:1780340986.257904:0:23153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2693 00000100:00100000:2.0:1780340986.257910:0:23153:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961287424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1780340986.257947:0:23153:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961287424:12345-0@lo:400:kworker.0 Request processed in 37us (2742us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340986.257960:0:23153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2693 00000100:00100000:0.0:1780340986.258247:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1866818961287552:0@lo:400:kworker.0 00000100:00100000:0.0:1780340986.258260:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1866818961287168:0@lo:400:kworker.0 00000100:00100000:0.0:1780340986.258270:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1866818961287680:0@lo:400:kworker.0 00000100:00080000:3.0:1780340986.258475:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340986.258497:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961287424:0@lo:400:kworker.0 00000100:00100000:3.0:1780340986.351958:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340986.351993:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340986.352028:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340986.352036:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940547584 00000100:00100000:0.0:1780340986.352048:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940547584 00000100:00100000:3.0:1780340986.352061:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340986.352083:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940547840 00000100:00100000:3.0:1780340986.352088:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940547840 00000100:00100000:0.0:1780340986.352113:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 218 00000100:00100000:0.0:1780340986.352127:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940547584:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340986.352131:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940547712 00000100:00100000:3.0:1780340986.352135:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940547712 00000100:00100000:3.0:1780340986.352163:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1545 00000100:00100000:3.0:1780340986.352172:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2408:x1866818940547840:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340986.352215:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2408:x1866818940547840:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 42us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340986.352215:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b226050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940547584:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 90us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340986.352232:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1545 00000100:00100000:0.0:1780340986.352233:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 218 00000100:00100000:3.0:1780340986.352254:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1546 00000100:00100000:3.0:1780340986.352262:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+51:2408:x1866818940547712:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340986.352301:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+51:2408:x1866818940547712:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 40us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340986.352309:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1546 00000100:00080000:3.0:1780340986.352329:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1780340986.352339:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340986.353856:0:25492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940547968 00000100:00100000:1.0:1780340986.353869:0:25492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940547968 00000100:00100000:1.0:1780340986.353950:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2694 00000100:00100000:1.0:1780340986.353961:0:25492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940547968:12345-192.168.203.16@tcp:400:kworker.0 00000100:00080000:3.0:1780340986.353986:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1780340986.354038:0:25492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940547968:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 79us (1976us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340986.354046:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2694 00000020:00000004:0.0:1780340986.722442:0:93401:0:(tgt_mount.c:2299:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1780340986.722669:0:93401:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1780340986.762998:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340986.763808:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c034cc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961287936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340986.763880:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340986.764595:0:26074:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961287936 00000100:00100000:3.0:1780340986.764604:0:26074:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961287936 00000100:00100000:3.0:1780340986.764660:0:26074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4025 00000100:00100000:3.0:1780340986.764670:0:26074:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961287936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780340986.764704:0:26074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:3.0:1780340986.764789:0:26074:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a8ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961287936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 119us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340986.764798:0:26074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4025 00000100:00100000:2.0:1780340986.765308:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c034cc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961287936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340987.274153:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340987.274174:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961288064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1780340987.274247:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340987.274702:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961288064 00000100:00100000:2.0:1780340987.274709:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961288064 00000100:00100000:2.0:1780340987.274793:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2196 00000100:00100000:2.0:1780340987.274804:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961288064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780340987.274825:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340987.274879:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961288064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340987.274886:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2196 00000100:00100000:2.0:1780340987.274929:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a8cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961288064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340987.275697:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1780340987.275710:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961288192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1780340987.275786:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340987.275875:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961288192 00000100:00100000:3.0:1780340987.275880:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961288192 00000100:00100000:3.0:1780340987.275919:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4026 00000100:00100000:3.0:1780340987.275926:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961288192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340987.275951:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445199872 avail 1298960384 00000100:00100000:3.0:1780340987.275992:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349087b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961288192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340987.275999:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4026 00000100:00100000:1.0:1780340987.276186:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961288192:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1780340987.791977:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1780340987.858517:0:93452:0:(tgt_mount.c:2299:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1780340987.858842:0:93452:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1780340988.810197:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340989.836195:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340990.858420:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1780340991.371280:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340991.371286:0:71335:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:1.0:1780340991.371304:0:71335:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1780340991.371307:0:71335:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1780340991.371324:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961288448:0@lo:400:kworker.0 00000100:00100000:1.0:1780340991.371357:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961288576:0@lo:400:kworker.0 00000100:00100000:0.0:1780340991.371412:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340991.371427:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961288320:0@lo:400:kworker.0 00000100:00100000:0.0:1780340991.371452:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961288960:0@lo:400:kworker.0 00000100:00100000:3.0:1780340991.371478:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340991.371508:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961288832:0@lo:400:kworker.0 00000100:00100000:0.0:1780340991.371532:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340991.371544:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340991.371567:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818961289472:0@lo:400:kworker.0 00000100:00100000:3.0:1780340991.371570:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961289344:0@lo:400:kworker.0 00000100:00100000:0.0:1780340991.371599:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340991.371622:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961288320 00000100:00100000:3.0:1780340991.371630:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961288320 00000100:00100000:0.0:1780340991.371646:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961288448 00000100:00100000:0.0:1780340991.371651:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961288448 00000100:00100000:3.0:1780340991.371690:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1780340991.371709:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961288320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340991.371712:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961288960 00000100:00100000:0.0:1780340991.371717:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961288960 00000100:00100000:0.0:1780340991.371742:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961289472 00000100:00100000:0.0:1780340991.371746:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961289472 00000100:00100000:3.0:1780340991.371790:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b224c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961288320:12345-0@lo:400:kworker.0 Request processed in 90us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340991.371796:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1547 00000100:00100000:3.0:1780340991.371801:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1780340991.371807:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961288448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340991.371841:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1548 00000100:00100000:3.0:1780340991.371850:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961288960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340991.371866:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a9a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1866818961288448:12345-0@lo:400:kworker.0 Request processed in 61us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340991.371873:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1547 00000100:00100000:3.0:1780340991.371886:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a9aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1866818961288960:12345-0@lo:400:kworker.0 Request processed in 37us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340991.371894:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1549 00000100:00100000:3.0:1780340991.371905:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1548 00000100:00100000:0.0:1780340991.371905:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1866818961289472:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1780340991.371933:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1780340991.371953:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340991.371953:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a9a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1866818961289472:12345-0@lo:400:kworker.0 Request processed in 51us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340991.371969:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1549 00000100:00100000:0.0:1780340991.371987:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961289344 00000100:00100000:0.0:1780340991.371990:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961289344 00000100:00100000:0.0:1780340991.372014:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1550 00000100:00100000:0.0:1780340991.372022:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961289344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340991.372025:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961288320:0@lo:400:kworker.0 00000100:00100000:0.0:1780340991.372066:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1866818961289344:12345-0@lo:400:kworker.0 Request processed in 45us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340991.372073:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1550 00000100:00100000:3.0:1780340991.372103:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1866818961289344:0@lo:400:kworker.0 00000100:00100000:0.0:1780340991.372122:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b883100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1866818961289472:0@lo:400:kworker.0 00000100:00100000:0.0:1780340991.372138:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1866818961288448:0@lo:400:kworker.0 00000100:00100000:3.0:1780340991.372139:0:8400:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961288832 00000100:00100000:3.0:1780340991.372144:0:8400:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961288832 00000100:00100000:0.0:1780340991.372158:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1866818961288960:0@lo:400:kworker.0 00000100:00100000:3.0:1780340991.372181:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2695 00000100:00100000:3.0:1780340991.372188:0:8400:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961288832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340991.372226:0:8400:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1866818961288832:12345-0@lo:400:kworker.0 Request processed in 38us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340991.372231:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2695 00000100:00100000:3.0:1780340991.372250:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961288704:0@lo:400:kworker.0 00000100:00100000:3.0:1780340991.372293:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340991.372327:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961289216:0@lo:400:kworker.0 00000100:00100000:3.0:1780340991.372354:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340991.372370:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961288832:0@lo:400:kworker.0 00000100:00100000:3.0:1780340991.372382:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961289728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340991.372408:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340991.372449:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961288704 00000100:00100000:3.0:1780340991.372453:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961288704 00000100:00100000:3.0:1780340991.372479:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4027 00000100:00100000:3.0:1780340991.372486:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961288704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340991.372519:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3662:x1866818961288704:12345-0@lo:400:kworker.0 Request processed in 34us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340991.372525:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4027 00000100:00100000:3.0:1780340991.372542:0:25487:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961289216 00000100:00100000:3.0:1780340991.372545:0:25487:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961289216 00000100:00100000:3.0:1780340991.372566:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2696 00000100:00100000:3.0:1780340991.372572:0:25487:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961289216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1780340991.372600:0:25487:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961289216:12345-0@lo:400:kworker.0 Request processed in 28us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340991.372605:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2696 00000100:00100000:0.0:1780340991.372622:0:34330:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961289728 00000100:00100000:0.0:1780340991.372627:0:34330:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961289728 00000100:00080000:3.0:1780340991.372630:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1780340991.372652:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961288704:0@lo:400:kworker.0 00000100:00100000:0.0:1780340991.372665:0:34330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2197 00000100:00100000:3.0:1780340991.372667:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b882300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961289216:0@lo:400:kworker.0 00000100:00100000:0.0:1780340991.372676:0:34330:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961289728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340991.372716:0:34330:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340991.372782:0:34330:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961289728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340991.372789:0:34330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2197 00000100:00100000:1.0:1780340991.373213:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340991.373247:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961289088:0@lo:400:kworker.0 00000100:00100000:1.0:1780340991.373275:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340991.373302:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046b882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961289600:0@lo:400:kworker.0 00000100:00100000:1.0:1780340991.373353:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1780340991.373385:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961289088 00000100:00100000:1.0:1780340991.373389:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961289088 00000100:00100000:1.0:1780340991.373417:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4028 00000100:00100000:1.0:1780340991.373423:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961289088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340991.373458:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961289088:12345-0@lo:400:kworker.0 Request processed in 35us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340991.373464:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4028 00000100:00100000:1.0:1780340991.373482:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961288576 00000100:00100000:1.0:1780340991.373485:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961288576 00000100:00100000:1.0:1780340991.373510:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961289600 00000100:00100000:1.0:1780340991.373513:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961289600 00000100:00100000:1.0:1780340991.373532:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00100000:1.0:1780340991.373538:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961288576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340991.373566:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961288576:12345-0@lo:400:kworker.0 Request processed in 29us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340991.373572:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00100000:1.0:1780340991.373595:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1552 00000100:00100000:1.0:1780340991.373601:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961289600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1780340991.373627:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1866818961289600:12345-0@lo:400:kworker.0 Request processed in 27us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340991.373632:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1552 00000100:00080000:1.0:1780340991.373651:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1780340991.373671:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961288576:0@lo:400:kworker.0 00000100:00100000:1.0:1780340991.373681:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961289088:0@lo:400:kworker.0 00000100:00100000:1.0:1780340991.373712:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046b882a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1866818961289600:0@lo:400:kworker.0 00000100:00100000:3.0:1780340991.375405:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961289728:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1780340991.528258:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340991.528300:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340991.528314:0:63711:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940548224 00000100:00100000:0.0:1780340991.528324:0:63711:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940548224 00000100:00100000:3.0:1780340991.528330:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340991.528352:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340991.528373:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940548352 00000100:00100000:3.0:1780340991.528376:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940548352 00000100:00100000:0.0:1780340991.528386:0:63711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1553 00000100:00100000:0.0:1780340991.528395:0:63711:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+51:2407:x1866818940548224:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340991.528414:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1554 00000100:00100000:3.0:1780340991.528420:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2407:x1866818940548352:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340991.528466:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2407:x1866818940548352:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 46us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340991.528466:0:63711:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+51:2407:x1866818940548224:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 72us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340991.528473:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1554 00000100:00100000:0.0:1780340991.528476:0:63711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1553 00000100:00100000:0.0:1780340991.528518:0:8399:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940548480 00000100:00100000:0.0:1780340991.528521:0:8399:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940548480 00000100:00100000:0.0:1780340991.528569:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2697 00000100:00100000:0.0:1780340991.528577:0:8399:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c034cc8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940548480:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340991.528621:0:8399:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c034cc8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2407:x1866818940548480:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 45us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340991.528627:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2697 00000100:00100000:0.0:1780340991.528645:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940548096 00000100:00100000:0.0:1780340991.528648:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940548096 00000100:00100000:0.0:1780340991.528671:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 220 00000100:00100000:0.0:1780340991.528677:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940548096:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340991.528721:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b227850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2407:x1866818940548096:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 44us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340991.528727:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 220 00000100:00080000:0.0:1780340991.528752:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340991.528773:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340991.528775:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780340991.882570:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961289856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340991.882644:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340991.882854:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961289856 00000100:00100000:3.0:1780340991.882863:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961289856 00000100:00100000:3.0:1780340991.882916:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4029 00000100:00100000:3.0:1780340991.882926:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961289856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780340991.882961:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:3.0:1780340991.883011:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a9a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961289856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340991.883019:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4029 00010000:00010000:0.0:1780340991.883146:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1780340991.883176:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961289856:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1780340992.175633:0:93549:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg316-client.virtnet: executing wait_import_state_mount REPLAY_LOCKS osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 00000100:00100000:2.0:1780340992.401093:0:3660:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961289984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1780340992.401162:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340992.401217:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961289984 00000100:00100000:2.0:1780340992.401225:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961289984 00000100:00100000:2.0:1780340992.401266:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2198 00000100:00100000:2.0:1780340992.401274:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0349087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961289984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780340992.401297:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340992.401335:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0349087480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1866818961289984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340992.401342:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2198 00000100:00100000:2.0:1780340992.401391:0:3660:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1866818961289984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1780340992.403088:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961290112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340992.403145:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340992.403196:0:8411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961290112 00000100:00100000:3.0:1780340992.403203:0:8411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961290112 00000100:00100000:3.0:1780340992.403247:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4030 00000100:00100000:3.0:1780340992.403256:0:8411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961290112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1780340992.403294:0:8411:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445199872 avail 1298960384 00000100:00100000:3.0:1780340992.403337:0:8411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961290112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340992.403344:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4030 00000100:00100000:3.0:1780340992.403387:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961290112:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1780340992.909874:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1780340993.931324:0:23160:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1780340994.319121:0:93598:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in REPLAY_LOCKS state after 0 sec 00010000:00010000:3.0:1780340994.954629:0:41205:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1780340995.983159:0:6504:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1780340996.312969:0:93646:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: replay-single test_135: @@@@@@ FAIL: Unexpected sync success 00000100:00100000:0.0:1780340996.492591:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a9a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961290240:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1780340996.492655:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340996.492752:0:10290:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961290240 00000100:00100000:0.0:1780340996.492772:0:10290:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961290240 00000100:00100000:0.0:1780340996.492832:0:10290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2199 00000100:00100000:0.0:1780340996.492841:0:10290:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047a9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961290240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1780340996.492868:0:10290:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1780340996.492911:0:10290:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047a9a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1866818961290240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340996.492917:0:10290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2199 00000100:00080000:0.0:1780340996.492936:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340996.492966:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a9a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1866818961290240:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1780340996.504740:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340996.504745:0:80497:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:0.0:1780340996.504774:0:80497:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1780340996.504777:0:80497:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:0.0:1780340996.504828:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a9a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961290368:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.507117:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340996.507177:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04765bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961290880:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.507209:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340996.507237:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04765ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961291392:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.507258:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340996.507326:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1780340996.507333:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a9ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961290496:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.507370:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340996.507390:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04765b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961291008:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.507413:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340996.507431:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04765baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961291520:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.508827:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340996.508896:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c047a9abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961290624:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.508923:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340996.508943:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04765b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961291136:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.508963:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340996.508985:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1780340996.508991:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04765bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961290752:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.509011:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340996.509026:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c04765b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961291264:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.509047:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1780340996.509075:0:90567:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961290368 00000100:00100000:0.0:1780340996.509083:0:90567:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961290368 00000100:00100000:0.0:1780340996.509130:0:90567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1780340996.509138:0:90567:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c047b225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961290368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.509186:0:90567:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c047b225450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26f7947-2bb0-4491-8dd4-005fa8e64f3a+23:3659:x1866818961290368:12345-0@lo:400:kworker.0 Request processed in 48us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340996.509193:0:90567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1780340996.509224:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961290880 00000100:00100000:0.0:1780340996.509228:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961290880 00000100:00100000:0.0:1780340996.509246:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961291392 00000100:00100000:0.0:1780340996.509248:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961291392 00000100:00100000:0.0:1780340996.509270:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961290496 00000100:00100000:0.0:1780340996.509281:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961290496 00000100:00100000:0.0:1780340996.509298:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961291520 00000100:00100000:0.0:1780340996.509301:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961291520 00000100:00100000:0.0:1780340996.509312:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961290624 00000100:00100000:0.0:1780340996.509315:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961290624 00000100:00100000:0.0:1780340996.509326:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961291264 00000100:00100000:0.0:1780340996.509328:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961291264 00000100:00100000:0.0:1780340996.509340:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555 00000100:00100000:0.0:1780340996.509345:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04765b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961290880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.509377:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04765b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1866818961290880:12345-0@lo:400:kworker.0 Request processed in 32us (2167us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340996.509383:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555 00000100:00100000:0.0:1780340996.509395:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00100000:0.0:1780340996.509400:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04765bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961291392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.509426:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04765bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1866818961291392:12345-0@lo:400:kworker.0 Request processed in 26us (2167us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340996.509431:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00100000:0.0:1780340996.509442:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1557 00000100:00100000:0.0:1780340996.509447:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04765b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961290496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.509511:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04765b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1866818961290496:12345-0@lo:400:kworker.0 Request processed in 64us (2140us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340996.509518:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1557 00000100:00100000:0.0:1780340996.509529:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1558 00000100:00100000:0.0:1780340996.509535:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04765b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961291520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.509559:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04765b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1866818961291520:12345-0@lo:400:kworker.0 Request processed in 25us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340996.509564:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1558 00000100:00100000:0.0:1780340996.509584:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1559 00000100:00100000:0.0:1780340996.509589:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04765b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961290624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.509621:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04765b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1866818961290624:12345-0@lo:400:kworker.0 Request processed in 32us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340996.509627:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1559 00000100:00100000:0.0:1780340996.509637:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1560 00000100:00100000:0.0:1780340996.509642:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04765b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961291264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.509677:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04765b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1866818961291264:12345-0@lo:400:kworker.0 Request processed in 35us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340996.509683:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1560 00000100:00100000:0.0:1780340996.509705:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961291008 00000100:00100000:0.0:1780340996.509708:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961291008 00000100:00100000:0.0:1780340996.509733:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961290752 00000100:00100000:0.0:1780340996.509736:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961290752 00000100:00100000:0.0:1780340996.509751:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4031 00000100:00100000:0.0:1780340996.509757:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04765bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961291008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.509808:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04765bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1866818961291008:12345-0@lo:400:kworker.0 Request processed in 51us (2393us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340996.509813:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4031 00000100:00100000:0.0:1780340996.509825:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4032 00000100:00100000:0.0:1780340996.509830:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04765b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961290752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.509856:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04765b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3661:x1866818961290752:12345-0@lo:400:kworker.0 Request processed in 26us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340996.509861:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4032 00000100:00100000:0.0:1780340996.509878:0:23157:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961291136 00000100:00100000:0.0:1780340996.509881:0:23157:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961291136 00000100:00100000:0.0:1780340996.509908:0:23157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2698 00000100:00100000:0.0:1780340996.509921:0:23157:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04765bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961291136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.509953:0:23157:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04765bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961291136:12345-0@lo:400:kworker.0 Request processed in 33us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340996.509958:0:23157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2698 00000100:00080000:0.0:1780340996.509979:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1780340996.509983:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1780340996.509986:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1780340996.510022:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04765bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1866818961290752:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.510032:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04765b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1866818961291264:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.510042:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a9abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1866818961290624:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.510051:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04765b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961291136:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.510087:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a9ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1866818961290496:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.510096:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04765b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1866818961291008:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.510104:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04765baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1866818961291520:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.510113:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c047a9a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26f7947-2bb0-4491-8dd4-005fa8e64f3a:3659:1866818961290368:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.510123:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04765bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1866818961290880:0@lo:400:kworker.0 00000100:00100000:0.0:1780340996.510132:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c04765ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1866818961291392:0@lo:400:kworker.0 00000100:00100000:3.0:1780340996.648264:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340996.648305:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340996.648339:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:1.0:1780340996.648463:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940548864 00000100:00100000:1.0:1780340996.648474:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940548864 00000100:00100000:1.0:1780340996.648529:0:63712:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940548736 00000100:00100000:1.0:1780340996.648533:0:63712:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940548736 00000100:00100000:1.0:1780340996.648571:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1561 00000100:00100000:1.0:1780340996.648582:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2408:x1866818940548864:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340996.648673:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+11:2408:x1866818940548864:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 92us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340996.648681:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1561 00000100:00100000:1.0:1780340996.648699:0:63712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 1562 00000100:00100000:1.0:1780340996.648705:0:63712:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+51:2408:x1866818940548736:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:1.0:1780340996.648730:0:63712:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+51:2408:x1866818940548736:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1780340996.648736:0:63712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 1562 00000100:00100000:0.0:1780340996.649181:0:90570:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940548608 00000100:00100000:0.0:1780340996.649186:0:90570:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940548608 00000100:00100000:0.0:1780340996.649225:0:90570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 222 00000100:00100000:0.0:1780340996.649233:0:90570:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c0346e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940548608:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:0.0:1780340996.649262:0:90570:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c0346e20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:540506f4-4e8e-4fb6-b537-f45d44291964+9:2408:x1866818940548608:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 31us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340996.649282:0:90570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 222 00000100:00080000:0.0:1780340996.649309:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1780340996.649313:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1780340996.649721:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340996.649784:0:25489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940548992 00000100:00100000:3.0:1780340996.649790:0:25489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940548992 00000100:00100000:3.0:1780340996.649826:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2699 00000100:00100000:3.0:1780340996.649834:0:25489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940548992:12345-192.168.203.16@tcp:400:kworker.0 00000100:00100000:3.0:1780340996.649867:0:25489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+7:2408:x1866818940548992:12345-192.168.203.16@tcp:400:kworker.0 Request processed in 35us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340996.649874:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2699 00000100:00080000:3.0:1780340996.649888:0:6513:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1780340996.702983:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:3.0:1780340996.703079:0:25491:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940549120 00000100:00100000:3.0:1780340996.703089:0:25491:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940549120 00000100:00100000:3.0:1780340996.703147:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 2700 00000100:00100000:3.0:1780340996.703157:0:25491:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04765ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2406:x1866818940549120:12345-192.168.203.16@tcp:8:ptlrpcd_rcv.0 00010000:02000400:3.0:1780340996.703194:0:25491:0:(ldlm_lib.c:963:target_handle_reconnect()) lustre-OST0000: Client 7d14eb83-fa7c-40d9-843e-6367bec0a7b4 (at 192.168.203.16@tcp) reconnected, waiting for 3 clients in recovery for 1:24 00010000:00080000:3.0:1780340996.720372:0:25491:0:(ldlm_lib.c:1430:target_handle_connect()) lustre-OST0000: connection from 7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp recovering/t4294969479 exp ffff8c046bae3800 cur 3776 last 1780340996 00002000:00100000:3.0:1780340996.720391:0:25491:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7d14eb83-fa7c-40d9-843e-6367bec0a7b4/ffff8c046bae3800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211351c ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1780340996.720414:0:25491:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli 192.168.203.16@tcp supports cksum type f7, return f7 00000100:00080000:3.0:1780340996.720448:0:25491:0:(import.c:65:import_set_state_nolock()) ffff8c047a28f800 : changing import state from FULL to RECOVER 00000100:00080000:3.0:1780340996.720460:0:25491:0:(import.c:65:import_set_state_nolock()) ffff8c047a28f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1780340996.720537:0:25491:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04765ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+5:2406:x1866818940549120:12345-192.168.203.16@tcp:8:ptlrpcd_rcv.0 Request processed in 17381us (17561us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340996.720636:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 2700 00000100:00100000:0.0:1780340996.756397:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340996.756446:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340996.756471:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340996.756503:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340996.756527:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340996.756563:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340996.756595:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340996.756618:0:3654:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.16@tcp (source: 12345-192.168.203.16@tcp) 00000100:00100000:0.0:1780340996.756644:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940549248 00000100:00100000:0.0:1780340996.756671:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940549248 00000100:00100000:0.0:1780340996.756718:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940549376 00000100:00100000:0.0:1780340996.756721:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940549376 00000100:00100000:0.0:1780340996.756737:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940549504 00000100:00100000:0.0:1780340996.756740:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940549504 00000100:00100000:0.0:1780340996.756754:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940549632 00000100:00100000:0.0:1780340996.756756:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940549632 00000100:00100000:0.0:1780340996.756801:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940549760 00000100:00100000:0.0:1780340996.756804:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940549760 00000100:00100000:0.0:1780340996.756820:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6028 00000100:00100000:0.0:1780340996.756830:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04765bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2406:x1866818940549248:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1780340996.756848:0:25495:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c04765bb480 x1866818940549248/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:422/0 lens 328/0 e 0 to 0 dl 1780341007 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340996.756864:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04765bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+9:2406:x1866818940549248:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 Request processed in 37us (476us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340996.756885:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6028 00000100:00100000:0.0:1780340996.756894:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940549888 00000100:00100000:0.0:1780340996.756897:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940549888 00000100:00100000:0.0:1780340996.756916:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940550016 00000100:00100000:0.0:1780340996.756918:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940550016 00000100:00100000:0.0:1780340996.756934:0:25495:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818940550144 00000100:00100000:0.0:1780340996.756936:0:25495:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818940550144 00000100:00100000:0.0:1780340996.756952:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6029 00000100:00100000:0.0:1780340996.756957:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04765baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2406:x1866818940549376:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1780340996.756966:0:25495:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c04765baa00 x1866818940549376/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:422/0 lens 328/0 e 0 to 0 dl 1780341007 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340996.756975:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04765baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2406:x1866818940549376:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 Request processed in 18us (539us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340996.756980:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6029 00000100:00100000:0.0:1780340996.756987:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6030 00000100:00100000:0.0:1780340996.756992:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04765b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2406:x1866818940549504:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1780340996.756998:0:25495:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c04765b9180 x1866818940549504/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:422/0 lens 328/0 e 0 to 0 dl 1780341007 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340996.757007:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04765b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2406:x1866818940549504:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 Request processed in 16us (536us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340996.757013:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6030 00000100:00100000:0.0:1780340996.757019:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6031 00000100:00100000:0.0:1780340996.757024:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04765b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2406:x1866818940549632:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1780340996.757031:0:25495:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c04765b8700 x1866818940549632/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:422/0 lens 328/0 e 0 to 0 dl 1780341007 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340996.757047:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04765b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2406:x1866818940549632:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 Request processed in 22us (543us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340996.757053:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6031 00000100:00100000:0.0:1780340996.757062:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6032 00000100:00100000:0.0:1780340996.757068:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04776c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2406:x1866818940549760:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1780340996.757074:0:25495:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c04776c6450 x1866818940549760/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:422/0 lens 328/0 e 0 to 0 dl 1780341007 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340996.757083:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04776c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2406:x1866818940549760:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 Request processed in 17us (556us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340996.757087:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6032 00000100:00100000:0.0:1780340996.757094:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6033 00000100:00100000:0.0:1780340996.757100:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04765b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2406:x1866818940549888:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1780340996.757107:0:25495:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c04765b9880 x1866818940549888/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:422/0 lens 328/0 e 0 to 0 dl 1780341007 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340996.757115:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04765b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2406:x1866818940549888:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 Request processed in 17us (554us total) trans 0 rc 0/-999 00000100:00100000:0.0:1780340996.757121:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6033 00000100:00100000:0.0:1780340996.757128:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6034 00000100:00100000:0.0:1780340996.757134:0:25495:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04765bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2406:x1866818940550016:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1780340996.757140:0:25495:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c04765bad80 x1866818940550016/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:422/0 lens 328/0 e 0 to 0 dl 1780341007 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1780340996.757159:0:25495:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04765bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2406:x1866818940550016:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 Request processed in 27us (565us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780340996.757266:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.16@tcp, seq: 6035 00000100:00100000:1.0:1780340996.757277:0:25490:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04765ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2406:x1866818940550144:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 00010000:00080000:1.0:1780340996.757285:0:25490:0:(ldlm_lib.c:3169:target_queue_recovery_request()) @@@ queue lock replay req req@ffff8c04765ba680 x1866818940550144/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:422/0 lens 328/0 e 0 to 0 dl 1780341007 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1780340996.757294:0:25490:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04765ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:7d14eb83-fa7c-40d9-843e-6367bec0a7b4+12:2406:x1866818940550144:12345-192.168.203.16@tcp:101:ldlm_lock_repla.0 Request processed in 22us (676us total) trans 0 rc 0/-999 00000100:00100000:1.0:1780340996.757299:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6035 00000100:00100000:0.0:1780340996.757912:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.16@tcp, seq: 6034 00010000:00080000:2.0:1780340996.757980:0:93024:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780340996.757989:0:93024:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 192.168.203.16@tcp: req@ffff8c04765bb480 x1866818940549248/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:422/0 lens 328/0 e 0 to 0 dl 1780341007 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1780340996.757998:0:93024:0:(ldlm_lib.c:2871:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1780340996.758009:0:93024:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1780340996.758011:0:93024:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780340996.758015:0:93024:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 192.168.203.16@tcp: req@ffff8c04765baa00 x1866818940549376/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:422/0 lens 328/0 e 0 to 0 dl 1780341007 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1780340996.758021:0:93024:0:(ldlm_lib.c:2871:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1780340996.758025:0:93024:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1780340996.758026:0:93024:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780340996.758030:0:93024:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 192.168.203.16@tcp: req@ffff8c04765b9180 x1866818940549504/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:422/0 lens 328/0 e 0 to 0 dl 1780341007 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1780340996.758036:0:93024:0:(ldlm_lib.c:2871:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1780340996.758040:0:93024:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1780340996.758041:0:93024:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780340996.758044:0:93024:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 192.168.203.16@tcp: req@ffff8c04765b8700 x1866818940549632/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:422/0 lens 328/0 e 0 to 0 dl 1780341007 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1780340996.758051:0:93024:0:(ldlm_lib.c:2871:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1780340996.758054:0:93024:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1780340996.758055:0:93024:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780340996.758059:0:93024:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 192.168.203.16@tcp: req@ffff8c04776c6450 x1866818940549760/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:422/0 lens 328/0 e 0 to 0 dl 1780341007 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1780340996.758065:0:93024:0:(ldlm_lib.c:2871:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1780340996.758069:0:93024:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1780340996.758080:0:93024:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780340996.758085:0:93024:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 192.168.203.16@tcp: req@ffff8c04765b9880 x1866818940549888/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:422/0 lens 328/0 e 0 to 0 dl 1780341007 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1780340996.758091:0:93024:0:(ldlm_lib.c:2871:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1780340996.758096:0:93024:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1780340996.758098:0:93024:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780340996.758101:0:93024:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 192.168.203.16@tcp: req@ffff8c04765bad80 x1866818940550016/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:422/0 lens 328/0 e 0 to 0 dl 1780341007 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1780340996.758107:0:93024:0:(ldlm_lib.c:2871:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1780340996.758111:0:93024:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1780340996.758113:0:93024:0:(ldlm_lib.c:2267:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1780340996.758116:0:93024:0:(ldlm_lib.c:2870:target_recovery_thread()) @@@ processing lock from 192.168.203.16@tcp: req@ffff8c04765ba680 x1866818940550144/t0(0) o101->7d14eb83-fa7c-40d9-843e-6367bec0a7b4@192.168.203.16@tcp:422/0 lens 328/0 e 0 to 0 dl 1780341007 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1780340996.758122:0:93024:0:(ldlm_lib.c:2871:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1780340996.758125:0:93024:0:(ldlm_lib.c:2437:target_next_replay_lock()) Waiting for lock 00010000:00010000:0.0:1780340997.001937:0:6505:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1780340997.008252:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1780340997.008294:0:3662:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961291648:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1780340997.008360:0:3662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340997.008492:0:22660:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961291648 00000100:00100000:3.0:1780340997.008501:0:22660:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961291648 00000100:00100000:3.0:1780340997.008551:0:22660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4033 00000100:00100000:3.0:1780340997.008561:0:22660:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046b882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961291648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1780340997.008597:0:22660:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445470208 avail 1299230720 00000100:00100000:3.0:1780340997.008667:0:22660:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046b882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3662:x1866818961291648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1780340997.008674:0:22660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4033 00000100:00100000:1.0:1780340997.008825:0:3662:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1866818961291648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1780340997.514326:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1780340997.514348:0:3661:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c0349084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961291776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340997.514441:0:3661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1780340997.514524:0:3659:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8c046ba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961291904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1780340997.514583:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1780340997.514669:0:8403:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961291776 00000100:00100000:2.0:1780340997.514677:0:8403:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961291776 00000100:00100000:2.0:1780340997.514726:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2200 00000100:00100000:2.0:1780340997.514736:0:8403:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c04765b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961291776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1780340997.514783:0:8403:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1780340997.514830:0:8403:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c04765b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1866818961291776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1780340997.514837:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2200 00000100:00100000:1.0:1780340997.514970:0:3661:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c0349084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1866818961291776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1780340997.515955:0:8410:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1866818961291904 00000100:00100000:0.0:1780340997.515964:0:8410:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1866818961291904 00000100:00100000:0.0:1780340997.516038:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4034 00000100:00100000:0.0:1780340997.516046:0:8410:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff8c046ba2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961291904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1780340997.516085:0:8410:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445199872 avail 1298960384 00000100:00100000:0.0:1780340997.516150:0:8410:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff8c046ba2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1866818961291904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1780340997.516157:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4034 00000100:00100000:3.0:1780340997.516995:0:3659:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff8c046ba2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1866818961291904:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1780340998.028255:0:7442:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 71508 lines, 71508 kept, 0 dropped, 0 bad.